-- Logs begin at Fri 2022-09-16 13:07:17 UTC, end at Fri 2022-09-16 15:57:23 UTC. -- Sep 16 13:40:30.879656 n-d-858129-2 systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 13:40:30.892240 n-d-858129-2 devstack@n-api.service[112693]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 13:40:30 2022] *** Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: nodename: n-d-858129-2 Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: machine: x86_64 Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: clock source: unix Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: pcre jit disabled Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: detected number of CPU cores: 4 Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: current working directory: / Sep 16 13:40:30.895462 n-d-858129-2 devstack@n-api.service[112693]: detected binary path: /usr/bin/uwsgi-core Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: your processes number limit is 47680 Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: your memory page size is 4096 bytes Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: detected max file descriptor number: 2048 Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: lock engine: pthread robust mutexes Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: thunder lock: enabled Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 13:40:30.896277 n-d-858129-2 devstack@n-api.service[112693]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 13:40:30.952331 n-d-858129-2 devstack@n-api.service[112693]: Python main interpreter initialized at 0x56283b9969c0 Sep 16 13:40:30.952331 n-d-858129-2 devstack@n-api.service[112693]: python threads support enabled Sep 16 13:40:30.952331 n-d-858129-2 devstack@n-api.service[112693]: your server socket listen backlog is limited to 100 connections Sep 16 13:40:30.952331 n-d-858129-2 devstack@n-api.service[112693]: your mercy for graceful operations on workers is 90 seconds Sep 16 13:40:30.952884 n-d-858129-2 devstack@n-api.service[112693]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 13:40:30.952884 n-d-858129-2 devstack@n-api.service[112693]: *** Operational MODE: preforking *** Sep 16 13:40:30.953228 n-d-858129-2 devstack@n-api.service[112693]: *** uWSGI is running in multiple interpreter mode *** Sep 16 13:40:30.953228 n-d-858129-2 devstack@n-api.service[112693]: spawned uWSGI master process (pid: 112693) Sep 16 13:40:30.954005 n-d-858129-2 systemd[1]: Started Devstack devstack@n-api.service. Sep 16 13:40:30.959096 n-d-858129-2 devstack@n-api.service[112693]: spawned uWSGI worker 1 (pid: 112694, cores: 1) Sep 16 13:40:30.959096 n-d-858129-2 devstack@n-api.service[112693]: spawned uWSGI worker 2 (pid: 112695, cores: 1) Sep 16 13:40:30.959096 n-d-858129-2 devstack@n-api.service[112693]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 13:40:31.713444 n-d-858129-2 devstack@n-api.service[112694]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 13:40:31.719248 n-d-858129-2 devstack@n-api.service[112695]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 13:40:32.915049 n-d-858129-2 devstack@n-api.service[112695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:40:32.915049 n-d-858129-2 devstack@n-api.service[112695]: from cryptography.utils import int_from_bytes Sep 16 13:40:32.916253 n-d-858129-2 devstack@n-api.service[112695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:40:32.916253 n-d-858129-2 devstack@n-api.service[112695]: from cryptography.utils import int_from_bytes Sep 16 13:40:33.193061 n-d-858129-2 devstack@n-api.service[112694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:40:33.193061 n-d-858129-2 devstack@n-api.service[112694]: from cryptography.utils import int_from_bytes Sep 16 13:40:33.194016 n-d-858129-2 devstack@n-api.service[112694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:40:33.194016 n-d-858129-2 devstack@n-api.service[112694]: from cryptography.utils import int_from_bytes Sep 16 13:40:35.833585 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 13:40:35.834383 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 13:40:35.834383 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 13:40:35.834780 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 13:40:35.835036 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 13:40:35.835429 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.835762 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.836088 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.836448 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.836755 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.837066 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.837411 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.837715 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.838049 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.838311 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.838657 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.838985 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858129-2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.839312 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.839621 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.839936 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.840264 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.840572 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.840896 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.841204 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.841710 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.842164 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.842521 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.842836 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.843178 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.843600 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.843834 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.844166 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.844475 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.844889 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.845146 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.845522 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858129-2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.845843 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.846157 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.846502 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.846924 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.847240 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.847553 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.847877 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.848310 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.848526 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.848858 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.849179 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.849501 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.849821 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.850126 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.850465 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.850779 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.851100 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.851407 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.851715 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.851969 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.852280 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.852632 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.852932 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.853259 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.853519 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.853775 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.854106 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.854453 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.854770 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.855082 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.855394 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.855700 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.856011 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.856320 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.856633 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.856945 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.857265 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.857585 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.857912 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.858228 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.858576 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.858992 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.859786 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.860100 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.860446 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.860771 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.861084 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.861405 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.861733 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.862046 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.862357 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.862697 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.863021 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.863364 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.863671 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.864324 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.864504 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.864812 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.865133 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.865611 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.865751 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.866064 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.866367 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.866715 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.867078 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.867334 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.867669 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.867952 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.868262 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.868571 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.868879 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.869188 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.869494 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.869829 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.870153 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.870493 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.870805 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.871117 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.871426 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.871745 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.872133 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.872362 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.872689 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.872997 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.873302 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.873622 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.873934 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.874240 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.874597 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.875478 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.875777 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.876094 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.876406 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.876717 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.877020 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.877466 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.877628 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.877915 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.878215 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.878594 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.878899 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.879235 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.879602 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.879889 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.880200 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.880510 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.880833 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:35.881178 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.881512 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.881867 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.882186 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.882548 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.882883 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.883203 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.883519 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.883838 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.884167 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.884485 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.884797 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.885115 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.885435 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.885756 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.886085 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.886477 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.886745 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.887068 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.887383 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.887699 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.888051 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.888381 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.888695 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.889039 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.889392 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.889712 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.890038 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.890368 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.890809 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.891048 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.891364 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.891714 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.892028 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.892344 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.892668 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.892984 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.893313 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.893631 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.893944 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.894259 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.894608 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.894923 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.895270 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.895588 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.895914 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.896236 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.896550 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.896872 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.897188 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.897508 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.897821 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.898130 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.898461 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.898769 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.899086 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.899393 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.899719 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.900054 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.900364 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.900704 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.901012 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.901326 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.901639 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.901951 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.902259 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.902605 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.902917 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.903224 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.903554 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.903869 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.904178 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.904512 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.904825 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.905135 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.905455 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.905771 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.906115 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.906457 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.906772 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.907103 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.907419 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.907735 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.908081 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.908415 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.908723 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.909054 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.909389 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.909703 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.910011 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.910324 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.910664 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.910969 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.911277 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.911587 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.911893 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.912203 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.912509 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.912817 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.913123 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.913453 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.913765 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.914073 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.914380 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.914720 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.915070 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.915380 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.915730 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.916072 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.916395 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.916724 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.917042 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.917363 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.917677 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.917995 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.918312 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.918677 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.918979 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.919297 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.919624 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.919936 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.920277 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.920592 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.920918 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.921227 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.921549 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.922476 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.922821 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.923146 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.923475 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.923790 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.924109 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.924421 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.924743 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.925064 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.925375 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.925699 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.926012 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.926335 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.926682 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.927012 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.927327 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.927649 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.927959 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.928298 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.928610 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.928951 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.929263 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.929585 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.929903 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.930216 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.930559 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.930876 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.931185 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.931494 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.931807 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.932127 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.932439 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.932752 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.933062 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.933378 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.933690 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.934002 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.934309 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.934657 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.934991 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.935310 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.935635 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.935961 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.936271 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.936580 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.936911 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.937221 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.938119 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.938425 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.938747 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.939098 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.939415 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.939727 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.940055 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.940376 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.940689 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.941012 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.941325 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.941637 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.941966 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.942286 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.942628 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.942945 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.943263 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.943580 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.943896 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.944228 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.944548 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.944866 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.945181 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.945494 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.945809 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.946131 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.946753 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.947101 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.947424 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.947752 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.948120 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.948434 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.948777 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.949115 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.949441 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.949752 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.950075 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.950383 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.950763 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.951087 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.951400 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.951814 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.952132 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.952451 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.952763 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.953110 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.953420 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.953734 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.954060 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.954371 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.954727 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.955050 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.955364 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.955675 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.956031 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.956345 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.956654 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.957029 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.957344 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.957684 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.958020 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.958368 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.958707 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.959019 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.959350 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.959661 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.959982 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.960283 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.960595 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.960904 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.961210 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.961529 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.961844 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.962156 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.962498 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.962805 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.963118 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.963427 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.963747 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.964059 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.964365 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.964684 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.964995 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.965306 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.965614 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.965928 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.966233 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.966579 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.966887 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.967195 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.967507 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.967816 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.968123 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.968431 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.969304 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.969622 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.969931 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.970245 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.970583 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.970890 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.971195 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.971512 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.971836 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.972158 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.972466 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.972780 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.973089 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.973397 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.973706 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.974018 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.974325 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.974707 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.974990 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.975297 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.975606 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.975941 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.976256 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.976564 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.976879 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.977203 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.977541 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.977858 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.978218 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.978563 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.978884 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.979210 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.979530 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.979847 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.980163 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.980473 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.980798 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.981113 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.981429 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.981745 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.982050 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.982382 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.982727 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.983046 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.983374 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.983704 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.984036 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.985298 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.985640 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.985964 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.986282 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.986635 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.986953 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.987275 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.987595 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.987919 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.988239 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.988554 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.989131 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.989449 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.989761 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.990071 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.990438 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.990769 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.991065 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.991373 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.991683 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.992001 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.992308 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.992758 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.993076 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.993394 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.993704 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.994023 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.994347 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.994722 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.995044 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.995355 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.995789 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.996109 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.996426 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.996744 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.997055 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.997364 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.997680 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.998014 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.998162 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 13:40:35.998683 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.998809 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 13:40:35.998943 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.998943 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.999253 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.999534 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 13:40:35.999658 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:35.999908 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.000201 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 13:40:36.000344 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.000641 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 13:40:36.000767 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.000952 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.001315 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.001450 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.001679 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.001893 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.002033 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.002312 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.002493 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.002666 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.002997 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.003135 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.003311 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.003629 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.003754 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.003944 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.004187 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.004320 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.004591 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.004800 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.004923 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.005217 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.005342 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.005536 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.005868 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.006012 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.006198 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.006395 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.006598 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.006863 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.007010 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.007297 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.007511 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858129-2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.007636 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.007936 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.008088 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.008296 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.008592 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.008719 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.008905 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.009191 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.009324 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.009522 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.009728 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.009859 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.010125 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.010273 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.010482 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.010799 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.010939 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.011119 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.011435 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.011586 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.011743 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.012053 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.012371 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.012516 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.012701 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.012926 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.013065 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.013318 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.013488 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.013638 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.013968 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.014102 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.014295 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.014634 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.014767 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.014962 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.015220 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.015355 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.015610 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.015826 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.015950 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.016215 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.016416 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.016558 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.016860 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.016992 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.017192 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.017529 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.017671 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.017891 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.018093 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.018223 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.018547 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.018844 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.018991 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858129-2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.019168 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.019430 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.019555 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.019790 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.019982 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.020117 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.020413 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.020537 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.020719 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.021031 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.021295 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.021488 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.021653 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.021865 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.021991 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.022229 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.022485 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.022683 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.022856 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.023306 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.023447 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.023765 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.023899 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.024074 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.024401 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.024525 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.024715 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.025016 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.025142 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.025323 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.025613 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.025738 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.025972 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.026194 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.026320 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.026628 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.026813 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.026982 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.027258 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.027383 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.027580 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.027902 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.028029 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.028227 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.028468 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.028649 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.028859 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.029050 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.029175 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.029482 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.029613 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.029796 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.030022 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.030148 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.030466 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.030610 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.030771 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.031595 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.031893 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.032152 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.032279 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.032527 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.032740 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.032897 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.033147 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.033317 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.033458 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.033771 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.033899 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.034085 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.034236 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.034426 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.034736 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.034869 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.035052 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.035396 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.035571 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.035709 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.035981 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.036107 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.036366 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.036559 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.036685 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.036996 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.037134 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.037315 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.037634 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.037761 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.038000 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.038234 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.038448 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.038642 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.038799 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.038961 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.039280 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.039412 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.039597 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.039914 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.040040 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.040228 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.040490 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.040621 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.040850 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.041065 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.041192 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.041466 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.041648 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.041775 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.042098 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.042244 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.042452 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.042796 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.043008 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.043163 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.043423 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.043577 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.043731 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.043979 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.044134 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.044554 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.044709 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.044900 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.045182 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.045354 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.045562 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.045779 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.045945 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.046203 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.046384 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.046580 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.047441 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.047572 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.047757 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.048069 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.048205 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.048385 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.048611 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.048734 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.048997 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.049148 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.049331 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.049641 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.049771 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.049951 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.050235 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.050473 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.050618 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.050853 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.051158 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.051409 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.051554 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.051833 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.051957 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.052172 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.052392 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.052518 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.052810 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.052957 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.053140 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.053442 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.053567 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.053758 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.054036 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.054174 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.054381 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.054631 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.054758 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.055018 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.055184 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.055327 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.055684 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.055825 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.056002 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.056282 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.056474 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.056606 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.056844 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.056970 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.057230 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.057399 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.057537 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.057841 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.057977 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.058153 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.058467 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.058598 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.058806 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.059014 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.059144 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.059417 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.059600 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.059724 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.060030 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.060156 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.060341 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.060650 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.060776 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.060959 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.061183 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.061307 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.061627 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.061768 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.061939 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.062254 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.062546 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.062720 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.062943 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.063068 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.063256 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.063535 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.063712 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.063881 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.064067 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.064208 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.064510 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.064656 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.064828 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.065184 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.065310 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.065511 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.065732 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.066097 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.066290 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.066525 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.066774 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.066914 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.067121 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.067460 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.067586 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.067770 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.068022 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.068147 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.068378 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.068606 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.068732 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.069008 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.069166 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.069323 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.069640 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.069815 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.069938 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.070250 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.070387 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.070591 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.070861 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.071006 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.071203 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.071444 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.071571 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.071811 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.072022 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.072147 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.072421 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.072586 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.072718 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.073031 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.073165 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.073356 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.073701 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.073851 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.074019 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.074269 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.074481 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.074677 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.074852 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.075002 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.075318 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.075456 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.075632 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.075937 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.076064 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.076280 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.076499 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.076671 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.076890 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.077017 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.077208 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.077517 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.077655 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.078221 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.078348 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.078630 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.078817 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.078944 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.079274 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.079402 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.079590 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.079924 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.080054 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.080253 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.080511 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:40:36.080636 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.080883 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.081139 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.081266 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.081519 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.081743 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.081869 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.082188 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.082361 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.082536 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.082850 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.083042 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.083180 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.083451 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.083687 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.083835 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.084074 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.084201 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.084390 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.084645 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.084772 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.084991 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.085195 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.085334 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.085605 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.085772 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.085898 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.086208 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.086375 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.086566 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.086846 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.086994 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.087137 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.087449 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.087587 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.087756 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.088056 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.088193 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.088360 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.088632 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.088782 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.088964 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.089202 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.089328 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.089566 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.089807 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.089947 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.090176 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.090380 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.090547 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.090831 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.090990 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.091170 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.091490 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.091615 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.091815 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.092132 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.092259 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.092459 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.092687 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.092823 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.093200 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.093340 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.093466 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.094293 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.094483 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.094734 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.094919 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.095066 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.095419 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.095554 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.095697 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.096093 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.096246 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.096377 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.096633 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.096817 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.096941 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.097271 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.097409 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.097603 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.097847 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.097974 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.098233 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.098459 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.098606 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.098902 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.099026 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.099223 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.099539 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.099677 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.099874 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.100183 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.100327 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.100494 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.100762 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.100900 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.101108 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.101309 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.101433 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.101729 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.101876 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.102044 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.102360 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.102534 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.102712 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.103035 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.103185 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.103510 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.103647 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.103783 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.103986 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.104133 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.104308 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.104658 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.104794 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.105014 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.105258 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.105383 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.105673 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.105857 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.106015 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.106335 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.106535 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.106681 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.106983 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.107111 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.107375 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 13:40:36.107719 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.108299 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.108886 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.110045 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.110638 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.111217 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.111791 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.112344 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.112896 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.113562 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.114304 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.114899 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.115485 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.116095 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.116653 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.117267 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.117822 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.118395 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.119028 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.119598 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.120175 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.120775 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.121362 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.121926 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.122557 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.123135 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.123704 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.124296 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.124900 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.125466 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.126066 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.126676 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.127256 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.127822 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.128397 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.128976 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.129559 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.130121 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.130774 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.131398 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.131950 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.132545 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.133149 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.133727 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.134283 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.134924 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.135466 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.136038 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.136592 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.137159 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.137708 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.138275 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.138866 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.139425 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.139985 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.140634 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.141218 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.141764 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.142326 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.142943 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.143602 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.144156 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.144771 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.145376 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.145973 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.146589 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.147140 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.147729 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.148294 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.148861 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.149435 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.150004 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.150510 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.151005 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.151490 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.152019 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.152548 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.153043 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.153552 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.154029 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.154555 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.155215 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.155629 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.156692 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.157202 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.157706 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.158243 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.158770 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.159262 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.159733 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.160191 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.160700 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.161235 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.161811 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.162387 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.163002 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.163502 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.164001 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.164471 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.164938 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.165478 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.166094 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.166607 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.167099 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.167597 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.168082 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.168626 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.169156 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.169660 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.170201 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.170749 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.171270 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.171832 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.172875 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.173349 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.173829 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.174339 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.174914 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.175420 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.175998 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.176592 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.177155 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.177741 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.178331 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.178911 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.179265 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.179689 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.180022 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.180389 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.180910 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.181438 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.181872 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.182353 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.182891 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.183321 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.183676 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.184007 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.184424 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.184939 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.185508 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.186019 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.186602 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.187181 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.187817 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.188364 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.188844 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.189417 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.190040 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.190667 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.191152 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.191677 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.192248 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.192796 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.193288 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.194328 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.194923 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.195460 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.195961 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.196556 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.197086 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.197628 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.198232 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.198766 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.199332 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.199864 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.200445 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.201013 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.201576 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.202097 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.202614 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.203199 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.203733 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.204248 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.204803 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.205320 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.206010 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.206351 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.206954 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.207548 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.208108 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.208606 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.209173 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.209750 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.210327 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.210917 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.211474 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.212003 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.212610 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.213217 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.213850 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.214393 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.214885 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.215496 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.216078 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.216648 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.217162 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.217748 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.218313 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.219401 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.219903 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.220486 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.221072 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.221608 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.222163 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.222768 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.223330 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.223880 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.224354 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.224929 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.225501 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.226071 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.226633 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.227211 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.227689 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.228219 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.228800 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.229343 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.229821 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.230332 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.230958 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.231517 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.232058 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.232670 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.233216 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.233775 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.234894 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.235413 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.235927 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.236504 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.237091 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.237647 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.238240 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.239063 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.239549 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.240135 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.240620 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.241137 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.241673 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.242136 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.242743 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.243313 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.243883 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.244441 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.244961 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.245496 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.246077 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.246679 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.247250 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.247781 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.248317 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.248981 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.249556 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.250287 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.250803 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.251393 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.251989 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.252569 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.253121 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.253597 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.254152 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.254781 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.255321 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.255866 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.256419 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.257013 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.257551 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.258045 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.258677 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.259235 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.259770 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.260247 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.260831 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.261423 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.261958 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.262562 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.263143 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.263713 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.264178 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.264748 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.264981 n-d-858129-2 devstack@n-api.service[112694]: INFO dbcounter [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Registered counter for database nova_api Sep 16 13:40:36.265332 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.267961 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.269544 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.269971 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.270506 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.271677 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.272105 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.272434 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.273293 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.275651 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.276265 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.276817 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.277576 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.278153 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.278754 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.279267 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.279817 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.280362 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.280929 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.282046 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.282650 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.283423 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.284933 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.284933 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.285368 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.285954 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.290477 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.291521 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.291735 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.292303 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.292842 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.292993 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.293604 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.294166 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.294762 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.295321 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.295901 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.299878 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.299878 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.299878 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.299878 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.299878 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.299878 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.301257 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.301257 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.301652 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.301908 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.302523 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.303099 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.303701 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.304495 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.305025 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.305123 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.305625 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.306225 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.306856 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.307408 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.307969 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.308518 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.309065 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.309609 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.310203 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.310802 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.311378 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.311939 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.312533 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.313085 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.313614 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.314222 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.314805 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.315392 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.315969 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.316560 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.317135 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.317687 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.318276 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.318849 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.319432 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.319956 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.320511 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.321146 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.321705 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.322288 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.322925 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.323517 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.324075 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.324661 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.325255 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.325832 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.326438 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.327014 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.327611 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.328698 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.329253 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.329814 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.330376 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.330948 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.331513 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.332075 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.332632 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.333189 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.333801 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.334349 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.334950 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.335530 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.336084 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.336628 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.337169 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.337722 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.338351 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.338928 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.339515 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.340075 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.340663 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.341245 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.341827 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.342444 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.343004 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.343615 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.344734 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.345316 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.345896 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.346480 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.347067 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.347664 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.348664 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.349260 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.349830 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.350397 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.350987 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.351552 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.352123 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.352693 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.353306 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.353826 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.354431 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.355040 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.355623 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.356218 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.356832 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.357363 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.357933 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.358543 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.359114 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.359798 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.360376 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.360936 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.361502 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.362085 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.362698 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.363262 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.364105 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.364696 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.365223 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.365796 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.366373 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.366979 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.367560 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.368146 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.368755 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.369307 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.369881 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.370480 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.371053 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.372048 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.372598 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.373145 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.373694 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.374254 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.374868 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.375445 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.376005 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.376542 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.377065 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.377361 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.context [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=112694) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 13:40:36.377637 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.378221 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.378810 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.379392 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.379962 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.380506 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.381062 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.381581 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.382567 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.382732 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:40:36.383115 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.383377 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:40:36.383674 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.384268 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.384856 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.385401 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.385565 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:40:36.385949 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.386494 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:40:36.386688 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.387109 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.387270 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:40:36.387673 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.388228 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.388805 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.389362 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.389830 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:40:36.389998 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.391135 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.391629 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.392199 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.392786 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.393280 n-d-858129-2 devstack@n-api.service[112694]: INFO dbcounter [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Registered counter for database nova_cell0 Sep 16 13:40:36.393451 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.393944 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.394528 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.395099 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.395669 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.396241 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.396921 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.397453 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.397991 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.398595 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.398932 n-d-858129-2 devstack@n-api.service[112694]: INFO dbcounter [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Registered counter for database nova_cell1 Sep 16 13:40:36.399158 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.399716 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.400285 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.400828 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.401405 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.402138 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.402713 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.403315 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.403836 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.404395 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.405091 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.405532 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.406164 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.406810 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.409489 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.409489 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.409489 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.409855 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.409933 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.410123 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.410344 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.410753 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.411412 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.411948 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.412543 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.413097 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.413671 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.414217 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.414860 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.415425 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.416012 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.416581 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.417162 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.417724 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.418293 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.418729 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.418898 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.419451 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.420015 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.420583 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.421139 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.422231 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.422442 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.422827 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.423403 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.423970 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.424605 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.425195 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.425779 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.426362 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.426990 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.427566 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.428122 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.428676 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.429234 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.429808 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.430441 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.431020 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.431577 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.432774 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.433356 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.433951 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.434563 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.435146 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.435731 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.436316 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.437309 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.437611 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.438114 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.438773 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.439405 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.440295 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.441134 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.441942 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.442774 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.443332 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.443905 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.444475 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.445020 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.445569 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.446110 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.446694 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.447251 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.447814 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.448372 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.448924 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.449489 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.450056 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.450649 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.451211 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.451787 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.452337 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.452910 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.454031 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.454643 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.455196 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.455739 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.456294 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.456855 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.457485 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.458061 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.458657 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.459247 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.459832 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.460420 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.461002 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.461605 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.462201 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.462815 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.463393 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.464021 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.464595 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.465171 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.465734 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.466306 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.466912 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.467483 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.468087 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.468725 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.469763 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.470329 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.470934 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.471512 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.472082 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.472634 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.473220 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.473787 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.474356 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.474964 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.475539 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.476116 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.476701 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.477282 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.477832 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.478459 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.479061 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.479689 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.480290 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.480863 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.481456 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.482053 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.482702 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.483248 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.483835 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.484483 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.485047 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.485566 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.486110 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:40:36.486577 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 13:40:36.590149 n-d-858129-2 devstack@n-api.service[112694]: INFO dbcounter [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Registered counter for database nova_cell0 Sep 16 13:40:36.598523 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_db.sqlalchemy.engines [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.603548 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writer thread running {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.743513 n-d-858129-2 devstack@n-api.service[112695]: INFO dbcounter [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Registered counter for database nova_api Sep 16 13:40:36.778105 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_db.sqlalchemy.engines [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.790254 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writer thread running {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.902750 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.context [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=112695) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 13:40:36.910816 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_concurrency.lockutils [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:40:36.911665 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_concurrency.lockutils [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:40:36.915054 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_concurrency.lockutils [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:40:36.916425 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_concurrency.lockutils [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:40:36.917239 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_concurrency.lockutils [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:40:36.921209 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_concurrency.lockutils [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:40:36.925659 n-d-858129-2 devstack@n-api.service[112695]: INFO dbcounter [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Registered counter for database nova_cell0 Sep 16 13:40:36.933698 n-d-858129-2 devstack@n-api.service[112695]: INFO dbcounter [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Registered counter for database nova_cell1 Sep 16 13:40:36.945782 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_db.sqlalchemy.engines [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.949843 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_db.sqlalchemy.engines [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:36.957901 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writer thread running {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.960899 n-d-858129-2 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:40:36.968398 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writer thread running {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:36.969459 n-d-858129-2 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:40:37.249068 n-d-858129-2 devstack@n-api.service[112695]: INFO dbcounter [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Registered counter for database nova_cell0 Sep 16 13:40:37.262017 n-d-858129-2 devstack@n-api.service[112695]: DEBUG oslo_db.sqlalchemy.engines [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:40:37.270750 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writer thread running {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:40:37.323427 n-d-858129-2 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:40:37.330197 n-d-858129-2 devstack@n-api.service[112694]: WARNING keystonemiddleware.auth_token [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:40:37.335998 n-d-858129-2 devstack@n-api.service[112694]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56283b9969c0 pid: 112694 (default app) Sep 16 13:40:37.338261 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:40:37.339518 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001936 Sep 16 13:40:37.339955 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Fri Sep 16 13:40:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:40:37.631531 n-d-858129-2 devstack@n-api.service[112695]: WARNING keystonemiddleware.auth_token [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:40:37.639533 n-d-858129-2 devstack@n-api.service[112695]: WARNING keystonemiddleware.auth_token [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:40:37.998744 n-d-858129-2 devstack@n-api.service[112695]: WARNING keystonemiddleware.auth_token [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:40:38.005071 n-d-858129-2 devstack@n-api.service[112695]: WARNING keystonemiddleware.auth_token [None req-b540b926-c281-4a19-af3e-2e585ef88e99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:40:38.010533 n-d-858129-2 devstack@n-api.service[112695]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x56283b9969c0 pid: 112695 (default app) Sep 16 13:42:15.588966 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:15.590748 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002465 Sep 16 13:42:15.592039 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:15.613352 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_api:SELECT=3 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:15.615553 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_cell0:SELECT=3 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:15.616961 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_cell1:SELECT=3 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:15.618301 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_cell0:SELECT=3 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:16.995702 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-6e5573ef-3f5d-4856-b06d-466badd87cb2 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:17.056112 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-6e5573ef-3f5d-4856-b06d-466badd87cb2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.451715 Sep 16 13:42:17.057480 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 13:42:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:21.080202 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:21.083688 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-2062b120-de7d-4977-a363-ee5df0bad3a7 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004732 Sep 16 13:42:21.084749 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:21 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:21.595834 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-24aab554-aa27-49eb-af98-aeadc5507d47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:21.692238 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-24aab554-aa27-49eb-af98-aeadc5507d47 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.599414 Sep 16 13:42:21.692917 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:42:21.711853 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:21.713216 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_cell1:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:21.716916 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_cell0:SELECT=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:21.718850 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:22.081730 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-9111b777-2836-4f5a-9c23-b92d225b1bdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:22.222471 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-9111b777-2836-4f5a-9c23-b92d225b1bdb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.519287 Sep 16 13:42:22.224217 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Sep 16 13:42:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:26.187795 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-24aab554-aa27-49eb-af98-aeadc5507d47 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:26.190257 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-24aab554-aa27-49eb-af98-aeadc5507d47 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002592 Sep 16 13:42:26.198316 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:27.385174 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-6e0d70dd-9f00-4606-ab73-478b664c849d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:27.458201 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-6e0d70dd-9f00-4606-ab73-478b664c849d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.258288 Sep 16 13:42:27.460442 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:42:27.473065 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-4072b335-67c4-43df-9a72-c5174dc068a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:27.524538 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-4072b335-67c4-43df-9a72-c5174dc068a9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054463 Sep 16 13:42:27.535021 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Sep 16 13:42:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:30.653471 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-6e0d70dd-9f00-4606-ab73-478b664c849d admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:30.654515 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-6e0d70dd-9f00-4606-ab73-478b664c849d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Sep 16 13:42:30.655147 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:42:31.388197 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-c68a3bee-cc14-4344-86fe-d4bb3fb8b245 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:31.426394 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-c68a3bee-cc14-4344-86fe-d4bb3fb8b245 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763102 Sep 16 13:42:31.428605 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 13:42:31.451159 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-21098d54-6fba-4667-bd51-c922164fdf55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:31.495629 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-21098d54-6fba-4667-bd51-c922164fdf55 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052019 Sep 16 13:42:31.514790 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Sep 16 13:42:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:35.360131 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-c68a3bee-cc14-4344-86fe-d4bb3fb8b245 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:35.361975 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-c68a3bee-cc14-4344-86fe-d4bb3fb8b245 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002547 Sep 16 13:42:35.363153 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:36.069718 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-72069b73-027a-4021-914e-97206b92942e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "disk": 10, "name": "ds2G", "swap": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:36.095151 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-72069b73-027a-4021-914e-97206b92942e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724757 Sep 16 13:42:36.095990 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:42:36.120528 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-2c6c742a-a96a-44fd-84f9-8f8b53081a28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:36.175090 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-2c6c742a-a96a-44fd-84f9-8f8b53081a28 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063122 Sep 16 13:42:36.176991 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Sep 16 13:42:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:40.772063 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-72069b73-027a-4021-914e-97206b92942e admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:40.774984 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-72069b73-027a-4021-914e-97206b92942e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003433 Sep 16 13:42:40.785724 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:41.799247 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-a8a7f9cd-2f93-4c8a-876b-07d7983a4d79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:41.837937 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-a8a7f9cd-2f93-4c8a-876b-07d7983a4d79 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.050707 Sep 16 13:42:41.842603 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 13:42:41.861041 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-fd91a4da-d765-45c6-b0e3-e854c84fe4b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:41.905849 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-fd91a4da-d765-45c6-b0e3-e854c84fe4b8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051811 Sep 16 13:42:41.911912 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Fri Sep 16 13:42:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:45.042339 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-a8a7f9cd-2f93-4c8a-876b-07d7983a4d79 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:45.043483 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-a8a7f9cd-2f93-4c8a-876b-07d7983a4d79 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Sep 16 13:42:45.043941 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:45.625636 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-e0613b2c-d6fd-48fb-a760-f6b9a3742bbe admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:45.660384 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-e0613b2c-d6fd-48fb-a760-f6b9a3742bbe admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.608396 Sep 16 13:42:45.661345 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 13:42:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:42:49.299790 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-a8a7f9cd-2f93-4c8a-876b-07d7983a4d79 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:49.301419 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-a8a7f9cd-2f93-4c8a-876b-07d7983a4d79 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Sep 16 13:42:49.302302 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:50.040993 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-9aeafaba-2598-4d86-ae4e-132b0cbc68fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:50.066323 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-9aeafaba-2598-4d86-ae4e-132b0cbc68fb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.754364 Sep 16 13:42:50.067167 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:42:50.081616 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-b8fb35b9-429f-4a29-b657-2935e1868910 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:50.087618 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:50.123679 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-b8fb35b9-429f-4a29-b657-2935e1868910 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046173 Sep 16 13:42:50.124757 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Sep 16 13:42:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:42:53.186020 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-9aeafaba-2598-4d86-ae4e-132b0cbc68fb admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:53.187115 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-9aeafaba-2598-4d86-ae4e-132b0cbc68fb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 16 13:42:53.187528 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:53.819270 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-ada3632d-ab38-4a4a-b687-3ad47b9fcebe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:53.849622 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-ada3632d-ab38-4a4a-b687-3ad47b9fcebe admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.654566 Sep 16 13:42:53.850597 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:42:53.871325 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-db86e8f6-ef1c-4adf-9859-da86edffa016 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:53.878014 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=30,nova_api:SAVEPOINT=3,nova_api:INSERT=6,nova_api:RELEASE=3 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:42:53.909453 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-db86e8f6-ef1c-4adf-9859-da86edffa016 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044131 Sep 16 13:42:53.914646 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Sep 16 13:42:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:42:56.973967 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-ada3632d-ab38-4a4a-b687-3ad47b9fcebe admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:42:56.975970 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-ada3632d-ab38-4a4a-b687-3ad47b9fcebe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002694 Sep 16 13:42:56.976794 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:42:57.692650 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-b8d5c9c8-c4a2-408d-961b-97361376568a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "vcpus": 2, "id": "3"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:57.727139 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-b8d5c9c8-c4a2-408d-961b-97361376568a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.742780 Sep 16 13:42:57.728095 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:42:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 13:42:57.746289 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-947ad86c-42be-49bb-90ce-ee8b1b8a760f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:42:57.796630 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-947ad86c-42be-49bb-90ce-ee8b1b8a760f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055660 Sep 16 13:42:57.798495 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Sep 16 13:42:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:43:01.045178 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-b8d5c9c8-c4a2-408d-961b-97361376568a admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:01.046210 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-b8d5c9c8-c4a2-408d-961b-97361376568a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 16 13:43:01.046657 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:43:01.674054 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-ae32bc51-01ff-408d-8b38-06dfba126884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:01.695932 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-ae32bc51-01ff-408d-8b38-06dfba126884 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.642544 Sep 16 13:43:01.705241 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:43:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:43:01.713481 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-38e214a5-6c83-4f35-805b-9ae4e1a013d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:01.741284 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-38e214a5-6c83-4f35-805b-9ae4e1a013d5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033536 Sep 16 13:43:01.741893 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Sep 16 13:43:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:43:05.377488 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-ae32bc51-01ff-408d-8b38-06dfba126884 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:05.383318 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-ae32bc51-01ff-408d-8b38-06dfba126884 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002635 Sep 16 13:43:05.383318 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:43:06.140115 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-f4cacc96-fc80-42d4-a4a4-56fad1c477d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "id": "5"}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:06.180876 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-f4cacc96-fc80-42d4-a4a4-56fad1c477d7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.790936 Sep 16 13:43:06.194570 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Fri Sep 16 13:43:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:43:06.205594 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-63ad244c-31bd-4d4c-8715-8462d640c041 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:06.256218 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-63ad244c-31bd-4d4c-8715-8462d640c041 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058552 Sep 16 13:43:06.257360 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Fri Sep 16 13:43:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:43:24.491716 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-f4cacc96-fc80-42d4-a4a4-56fad1c477d7 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:24.492879 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-f4cacc96-fc80-42d4-a4a4-56fad1c477d7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Sep 16 13:43:24.493337 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:43:24.505202 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:43:24.987091 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-43fec8f8-74df-4d21-86f0-f278346ecf17 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:25.006708 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-43fec8f8-74df-4d21-86f0-f278346ecf17 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.506130 Sep 16 13:43:25.007296 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 13:43:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:43:26.637316 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-f4cacc96-fc80-42d4-a4a4-56fad1c477d7 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:26.638367 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-f4cacc96-fc80-42d4-a4a4-56fad1c477d7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 16 13:43:26.638758 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:43:27.415898 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-34df7d90-fff0-483b-babf-3ca3717903a3 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:27.422163 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.wsgi [None req-34df7d90-fff0-483b-babf-3ca3717903a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-34df7d90-fff0-483b-babf-3ca3717903a3 admin admin] Request method failure captured: Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Accept: application/json Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Accept-Encoding: gzip, deflate Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Connection: keep-alive Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Content-Length: 0 Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Host: 10.222.0.60 Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Openstack-Api-Version: compute 2.92 Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: Openstack-System-Scope: None Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: User-Agent: python-novaclient Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Auth-Token: gAAAAABjJH1-9ihMXQRY2vZEnYPJ6IrnHRTwt6XM9TYYzsTc1t9mbFQJrF8ywXnbSBWAD51iMXI4hFG4_WDDTFXG_FViXhhZQxX88yK3ahiZjxaOF6cSaUlPk2hrz6Y3ExJxQUXeKScbvFzZFpBmKAe6_oNCijELn49UXXLEQ_-Zg3C-fdYk7Hk Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Domain-Id: None Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Domain-Name: None Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Identity-Status: Confirmed Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Is-Admin-Project: True Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Domain-Id: default Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Domain-Name: Default Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Name: admin Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Role: admin,reader,member Sep 16 13:43:27.425956 n-d-858129-2 devstack@n-api.service[112695]: X-Roles: admin,reader,member Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d026afc7566b49388ad630f9a16569d6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}] Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant: admin Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant-Name: admin Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-User: admin Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-User-Domain-Id: default Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-User-Domain-Name: Default Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-User-Id: dba5963f333f4c95b7e406c7115b9343 Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: X-User-Name: admin Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: method: > Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: exception: Flavor 42 could not be found. Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: action_args: {'id': '42'} Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:43:27.428839 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:27.430565 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.432638 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-34df7d90-fff0-483b-babf-3ca3717903a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:43:27.434696 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-34df7d90-fff0-483b-babf-3ca3717903a3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.605578 Sep 16 13:43:27.434696 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Sep 16 13:43:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:43:27.439004 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-5215b54d-9096-42bd-95ef-2320343957fd admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:27.443333 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:43:27.465432 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-5215b54d-9096-42bd-95ef-2320343957fd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030063 Sep 16 13:43:27.466021 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Sep 16 13:43:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:43:27.479958 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-448c3421-a344-4c46-ab58-7f5d545e02c0 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:27.503997 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-448c3421-a344-4c46-ab58-7f5d545e02c0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029093 Sep 16 13:43:27.504705 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Sep 16 13:43:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:43:27.516004 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-cb93bfa8-fbb0-4de6-9ce9-f7d9952048f4 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:27.522668 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.wsgi [None req-cb93bfa8-fbb0-4de6-9ce9-f7d9952048f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-cb93bfa8-fbb0-4de6-9ce9-f7d9952048f4 admin admin] Request method failure captured: Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Accept: application/json Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Accept-Encoding: gzip, deflate Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Connection: keep-alive Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Content-Length: 0 Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Host: 10.222.0.60 Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Openstack-Api-Version: compute 2.92 Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: Openstack-System-Scope: None Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: User-Agent: python-novaclient Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Auth-Token: gAAAAABjJH1-9ihMXQRY2vZEnYPJ6IrnHRTwt6XM9TYYzsTc1t9mbFQJrF8ywXnbSBWAD51iMXI4hFG4_WDDTFXG_FViXhhZQxX88yK3ahiZjxaOF6cSaUlPk2hrz6Y3ExJxQUXeKScbvFzZFpBmKAe6_oNCijELn49UXXLEQ_-Zg3C-fdYk7Hk Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Domain-Id: None Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Domain-Name: None Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Identity-Status: Confirmed Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Is-Admin-Project: True Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Domain-Id: default Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Domain-Name: Default Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Name: admin Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Role: admin,reader,member Sep 16 13:43:27.526634 n-d-858129-2 devstack@n-api.service[112694]: X-Roles: admin,reader,member Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d026afc7566b49388ad630f9a16569d6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}] Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant: admin Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant-Name: admin Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-User: admin Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-User-Domain-Id: default Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-User-Domain-Name: Default Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-User-Id: dba5963f333f4c95b7e406c7115b9343 Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: X-User-Name: admin Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: method: > Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: exception: Flavor 42 could not be found. Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: action_args: {'id': '42'} Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:43:27.529040 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:27.530706 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:27.532719 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-cb93bfa8-fbb0-4de6-9ce9-f7d9952048f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:43:27.534721 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-cb93bfa8-fbb0-4de6-9ce9-f7d9952048f4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016306 Sep 16 13:43:27.534721 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Sep 16 13:43:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:43:28.914701 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-448c3421-a344-4c46-ab58-7f5d545e02c0 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:28.915833 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-448c3421-a344-4c46-ab58-7f5d545e02c0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Sep 16 13:43:28.916352 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:43:29.541064 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-39185ccd-5263-4132-8eb5-f3897983bb6c admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:29.546419 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.wsgi [None req-39185ccd-5263-4132-8eb5-f3897983bb6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-39185ccd-5263-4132-8eb5-f3897983bb6c admin admin] Request method failure captured: Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Accept: application/json Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Accept-Encoding: gzip, deflate Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Connection: keep-alive Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Content-Length: 0 Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Host: 10.222.0.60 Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Openstack-Api-Version: compute 2.92 Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: Openstack-System-Scope: None Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: User-Agent: python-novaclient Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Auth-Token: gAAAAABjJH2A7UR00VGKu_Z5Jo1jytBvXjTLDM-zYNpsb0iXfQ_flGm-yZNGOzupn49W1f2xGNmgFX_g4j4KKRw23AMp80VycIMEcEo7Gf3ugb0k8Q_q6asjn89ksfvim_2Bau6yXI8afgIqa215M5O-f8Sq8czkswgIoHmhl4ZV4ZhsWCqohBc Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Domain-Id: None Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Domain-Name: None Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Identity-Status: Confirmed Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Is-Admin-Project: True Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Domain-Id: default Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Domain-Name: Default Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Name: admin Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Role: admin,reader,member Sep 16 13:43:29.548012 n-d-858129-2 devstack@n-api.service[112694]: X-Roles: admin,reader,member Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d026afc7566b49388ad630f9a16569d6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}] Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant: admin Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant-Name: admin Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-User: admin Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-User-Domain-Id: default Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-User-Domain-Name: Default Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-User-Id: dba5963f333f4c95b7e406c7115b9343 Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: X-User-Name: admin Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: method: > Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: exception: Flavor 84 could not be found. Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: action_args: {'id': '84'} Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:43:29.549490 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:29.550333 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.551491 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-39185ccd-5263-4132-8eb5-f3897983bb6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:43:29.552519 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-39185ccd-5263-4132-8eb5-f3897983bb6c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.486164 Sep 16 13:43:29.552519 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Sep 16 13:43:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 487 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:43:29.559881 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-6747ab12-3121-4951-9fe4-f3ca0eaa4ace admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:29.576612 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-6747ab12-3121-4951-9fe4-f3ca0eaa4ace admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020324 Sep 16 13:43:29.577208 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Sep 16 13:43:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:43:29.587991 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-0d811247-1a68-44e5-8c5f-8c1c2befb170 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:29.605168 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-0d811247-1a68-44e5-8c5f-8c1c2befb170 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021451 Sep 16 13:43:29.606028 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Sep 16 13:43:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:43:29.616056 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-f5e39707-6ce5-47c8-9a76-8c013fff9566 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:29.621952 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.wsgi [None req-f5e39707-6ce5-47c8-9a76-8c013fff9566 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-f5e39707-6ce5-47c8-9a76-8c013fff9566 admin admin] Request method failure captured: Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Accept: application/json Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Accept-Encoding: gzip, deflate Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Connection: keep-alive Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Content-Length: 0 Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Host: 10.222.0.60 Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Openstack-Api-Version: compute 2.92 Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: Openstack-System-Scope: None Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: User-Agent: python-novaclient Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Auth-Token: gAAAAABjJH2A7UR00VGKu_Z5Jo1jytBvXjTLDM-zYNpsb0iXfQ_flGm-yZNGOzupn49W1f2xGNmgFX_g4j4KKRw23AMp80VycIMEcEo7Gf3ugb0k8Q_q6asjn89ksfvim_2Bau6yXI8afgIqa215M5O-f8Sq8czkswgIoHmhl4ZV4ZhsWCqohBc Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Domain-Id: None Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Domain-Name: None Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Identity-Status: Confirmed Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Is-Admin-Project: True Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Domain-Id: default Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Domain-Name: Default Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Name: admin Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Role: admin,reader,member Sep 16 13:43:29.623562 n-d-858129-2 devstack@n-api.service[112695]: X-Roles: admin,reader,member Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d026afc7566b49388ad630f9a16569d6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}] Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant: admin Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant-Name: admin Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-User: admin Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-User-Domain-Id: default Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-User-Domain-Name: Default Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-User-Id: dba5963f333f4c95b7e406c7115b9343 Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: X-User-Name: admin Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: method: > Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: exception: Flavor 84 could not be found. Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: action_args: {'id': '84'} Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:43:29.625256 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:29.626217 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:29.627519 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-f5e39707-6ce5-47c8-9a76-8c013fff9566 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:43:29.628780 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-f5e39707-6ce5-47c8-9a76-8c013fff9566 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012885 Sep 16 13:43:29.628780 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Sep 16 13:43:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:43:30.954765 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-0d811247-1a68-44e5-8c5f-8c1c2befb170 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:30.956542 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-0d811247-1a68-44e5-8c5f-8c1c2befb170 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002594 Sep 16 13:43:30.957286 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:43:31.622661 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-fbf27a5b-32ac-4595-816c-50b6a783e9cf admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:31.629299 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.wsgi [None req-fbf27a5b-32ac-4595-816c-50b6a783e9cf admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-fbf27a5b-32ac-4595-816c-50b6a783e9cf admin admin] Request method failure captured: Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Accept: application/json Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Accept-Encoding: gzip, deflate Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Connection: keep-alive Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Content-Length: 0 Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Host: 10.222.0.60 Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Openstack-Api-Version: compute 2.92 Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: Openstack-System-Scope: None Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: User-Agent: python-novaclient Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Auth-Token: gAAAAABjJH2CY2ppcNjYeAjzI5wAkYE6ZtZMinhve59JUjjQ6zvoz5P-lvpkVkcV3NKtkgYB2kufV1jDevCqbwaIJtT_u1BShdCrUANKeE3i9I8ShmO69qthpNMH_Yvi5jUfyPJQjeQxoSuhZlFEkmcma34BdMjIyX6z3IkfdnMFgGgY6Vd879o Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Domain-Id: None Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Domain-Name: None Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Identity-Status: Confirmed Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Is-Admin-Project: True Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Domain-Id: default Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Domain-Name: Default Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Project-Name: admin Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Role: admin,reader,member Sep 16 13:43:31.631072 n-d-858129-2 devstack@n-api.service[112695]: X-Roles: admin,reader,member Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d026afc7566b49388ad630f9a16569d6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}] Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant: admin Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-Tenant-Name: admin Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-User: admin Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-User-Domain-Id: default Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-User-Domain-Name: Default Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-User-Id: dba5963f333f4c95b7e406c7115b9343 Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: X-User-Name: admin Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: method: > Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: exception: Flavor 451 could not be found. Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: action_args: {'id': '451'} Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:43:31.632889 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:31.634306 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.636887 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-fbf27a5b-32ac-4595-816c-50b6a783e9cf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:43:31.639275 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-fbf27a5b-32ac-4595-816c-50b6a783e9cf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.518809 Sep 16 13:43:31.639275 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 13:43:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 520 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 16 13:43:31.645510 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-8f7e7ccc-cb31-48e0-bfc3-740a470e78ba admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:31.662549 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-8f7e7ccc-cb31-48e0-bfc3-740a470e78ba admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020602 Sep 16 13:43:31.663135 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Sep 16 13:43:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:43:31.673859 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:31.690361 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020097 Sep 16 13:43:31.690981 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Fri Sep 16 13:43:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:43:31.700897 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-56755f15-8cde-43db-946f-eaf293864f3f admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:31.706644 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.wsgi [None req-56755f15-8cde-43db-946f-eaf293864f3f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-56755f15-8cde-43db-946f-eaf293864f3f admin admin] Request method failure captured: Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Accept: application/json Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Accept-Encoding: gzip, deflate Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Connection: keep-alive Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Content-Length: 0 Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Host: 10.222.0.60 Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Openstack-Api-Version: compute 2.92 Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: Openstack-System-Scope: None Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: User-Agent: python-novaclient Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Auth-Token: gAAAAABjJH2CY2ppcNjYeAjzI5wAkYE6ZtZMinhve59JUjjQ6zvoz5P-lvpkVkcV3NKtkgYB2kufV1jDevCqbwaIJtT_u1BShdCrUANKeE3i9I8ShmO69qthpNMH_Yvi5jUfyPJQjeQxoSuhZlFEkmcma34BdMjIyX6z3IkfdnMFgGgY6Vd879o Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Domain-Id: None Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Domain-Name: None Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Identity-Status: Confirmed Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Is-Admin-Project: True Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Domain-Id: default Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Domain-Name: Default Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Project-Name: admin Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Role: admin,reader,member Sep 16 13:43:31.708446 n-d-858129-2 devstack@n-api.service[112694]: X-Roles: admin,reader,member Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d026afc7566b49388ad630f9a16569d6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d026afc7566b49388ad630f9a16569d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d026afc7566b49388ad630f9a16569d6"}]}] Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant: admin Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant-Id: d026afc7566b49388ad630f9a16569d6 Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-Tenant-Name: admin Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-User: admin Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-User-Domain-Id: default Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-User-Domain-Name: Default Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-User-Id: dba5963f333f4c95b7e406c7115b9343 Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: X-User-Name: admin Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: method: > Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: exception: Flavor 451 could not be found. Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: action_args: {'id': '451'} Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:43:31.711360 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:31.712929 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: ERROR nova.api.openstack.wsgi Sep 16 13:43:31.715113 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-56755f15-8cde-43db-946f-eaf293864f3f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:43:31.717179 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-56755f15-8cde-43db-946f-eaf293864f3f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012671 Sep 16 13:43:31.717179 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 13:43:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:43:33.035524 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:33.036685 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 16 13:43:33.037186 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:43:33.690336 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-b6c9b036-65e4-4059-8ac3-f84c43b15537 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:33.719759 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-b6c9b036-65e4-4059-8ac3-f84c43b15537 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.539027 Sep 16 13:43:33.720671 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Sep 16 13:43:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:43:35.056704 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:35.058038 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Sep 16 13:43:35.058640 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:43:35.687462 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-40c30093-7a44-49ac-96ee-4894adf288e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:35.713303 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-40c30093-7a44-49ac-96ee-4894adf288e1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.514907 Sep 16 13:43:35.713893 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Sep 16 13:43:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:43:37.052552 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:37.053611 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 16 13:43:37.054079 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:43:37.713550 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-086587f3-64c0-46fd-a8fa-a545f4a14799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:37.735693 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-086587f3-64c0-46fd-a8fa-a545f4a14799 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.541783 Sep 16 13:43:37.736534 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Sep 16 13:43:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:43:39.133606 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:39.135492 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002497 Sep 16 13:43:39.140218 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:39 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:43:39.977690 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-fb023602-f629-43d6-9a18-1b899c466f78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:43:40.000293 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-fb023602-f629-43d6-9a18-1b899c466f78 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.601889 Sep 16 13:43:40.000872 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Fri Sep 16 13:43:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:43:41.329928 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:41.331000 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 16 13:43:41.331432 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:43:41.945850 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-e8c91cc7-e81c-4371-a06c-cc71a3e121b0 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:43:41.986534 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-e8c91cc7-e81c-4371-a06c-cc71a3e121b0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.512358 Sep 16 13:43:41.987561 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Fri Sep 16 13:43:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:44:45.826905 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:44:45.828228 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-751d9bf9-62c7-409c-b363-69e7dd4a6a22 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Sep 16 13:44:45.828760 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Fri Sep 16 13:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:44:45.837612 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:44:46.336803 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-81b9886b-b55b-4a6f-aea6-5bc7d9e7c961 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:44:46.363633 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-81b9886b-b55b-4a6f-aea6-5bc7d9e7c961 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.527343 Sep 16 13:44:46.364211 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 13:44:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:44:46.386280 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_api:SELECT=14 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:44:46.390106 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-b5973071-d937-4546-82cb-f1f4a469d83f admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:44:46.398959 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-b5973071-d937-4546-82cb-f1f4a469d83f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013842 Sep 16 13:44:46.399453 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Fri Sep 16 13:44:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:44:46.412541 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-4e2192b0-c90c-4663-8cbb-194b1a4ea083 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:44:46.420705 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-4e2192b0-c90c-4663-8cbb-194b1a4ea083 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012319 Sep 16 13:44:46.421367 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Fri Sep 16 13:44:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:44:46.434356 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-35b30934-99b7-4254-bac0-9b0cb1be030e admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:44:46.443277 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-35b30934-99b7-4254-bac0-9b0cb1be030e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012923 Sep 16 13:44:46.444144 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Fri Sep 16 13:44:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:44:46.460520 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-16a4234b-b6c0-43b4-8681-15ea4a27ce5c admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:44:46.471519 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-16a4234b-b6c0-43b4-8681-15ea4a27ce5c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018441 Sep 16 13:44:46.472795 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Fri Sep 16 13:44:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:50:21.133375 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-35b30934-99b7-4254-bac0-9b0cb1be030e admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:50:21.135216 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-35b30934-99b7-4254-bac0-9b0cb1be030e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002584 Sep 16 13:50:21.136015 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:50:21.397756 n-d-858129-2 devstack@n-api.service[112694]: DEBUG dbcounter [-] [112694] Writing DB stats nova_api:SELECT=6 {{(pid=112694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:50:21.569084 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:50:21.577106 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:50:21.577970 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:50:21.578792 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:50:21.580155 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:50:21.580893 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:50:21.581657 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:50:21.657241 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-2c94ade4-7b24-4e2a-a6e1-c42018e7962d admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.260514 Sep 16 13:50:21.658146 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 13:50:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:50:22.870947 n-d-858129-2 devstack@n-api.service[112695]: DEBUG nova.api.openstack.wsgi [None req-35b30934-99b7-4254-bac0-9b0cb1be030e admin admin] Calling method '>' {{(pid=112695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:50:22.872038 n-d-858129-2 devstack@n-api.service[112695]: INFO nova.api.openstack.requestlog [None req-35b30934-99b7-4254-bac0-9b0cb1be030e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001842 Sep 16 13:50:22.872549 n-d-858129-2 devstack@n-api.service[112695]: [pid: 112695|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Fri Sep 16 13:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:50:23.078987 n-d-858129-2 devstack@n-api.service[112694]: DEBUG nova.api.openstack.wsgi [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Calling method '>' {{(pid=112694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:50:23.085357 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:50:23.086289 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:50:23.087079 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:50:23.088892 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:50:23.089703 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:50:23.090537 n-d-858129-2 devstack@n-api.service[112694]: DEBUG oslo_concurrency.lockutils [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:50:23.134729 n-d-858129-2 devstack@n-api.service[112694]: INFO nova.api.openstack.requestlog [None req-16a50a25-c0e5-4f72-ab7e-6a0fddd66226 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.116979 Sep 16 13:50:23.135794 n-d-858129-2 devstack@n-api.service[112694]: [pid: 112694|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 13:50:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:51:09.960111 n-d-858129-2 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 16 13:51:09.961039 n-d-858129-2 devstack@n-api.service[112693]: Fri Sep 16 13:51:09 2022 - graceful shutdown triggered... Sep 16 13:51:09.961582 n-d-858129-2 devstack@n-api.service[112694]: Gracefully killing worker 1 (pid: 112694)... Sep 16 13:51:09.961962 n-d-858129-2 devstack@n-api.service[112695]: Gracefully killing worker 2 (pid: 112695)... Sep 16 13:51:10.095176 n-d-858129-2 devstack@n-api.service[112695]: DEBUG dbcounter [-] [112695] Writing DB stats nova_api:SELECT=4 {{(pid=112695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:51:10.961550 n-d-858129-2 devstack@n-api.service[112693]: worker 1 buried after 1 seconds Sep 16 13:51:10.961550 n-d-858129-2 devstack@n-api.service[112693]: worker 2 buried after 1 seconds Sep 16 13:51:10.961550 n-d-858129-2 devstack@n-api.service[112693]: goodbye to uWSGI. Sep 16 13:51:10.963653 n-d-858129-2 systemd[1]: devstack@n-api.service: Succeeded. Sep 16 13:51:10.964333 n-d-858129-2 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 16 13:51:10.967909 n-d-858129-2 systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 13:51:10.986393 n-d-858129-2 devstack@n-api.service[128626]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 13:51:10 2022] *** Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: nodename: n-d-858129-2 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: machine: x86_64 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: clock source: unix Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: pcre jit disabled Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: detected number of CPU cores: 4 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: current working directory: / Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: detected binary path: /usr/bin/uwsgi-core Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: your processes number limit is 47680 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: your memory page size is 4096 bytes Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: detected max file descriptor number: 2048 Sep 16 13:51:11.000569 n-d-858129-2 devstack@n-api.service[128626]: lock engine: pthread robust mutexes Sep 16 13:51:11.002221 n-d-858129-2 devstack@n-api.service[128626]: thunder lock: enabled Sep 16 13:51:11.002221 n-d-858129-2 devstack@n-api.service[128626]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 13:51:11.002221 n-d-858129-2 devstack@n-api.service[128626]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 13:51:11.054331 n-d-858129-2 devstack@n-api.service[128626]: Python main interpreter initialized at 0x5583ae0b49c0 Sep 16 13:51:11.054331 n-d-858129-2 devstack@n-api.service[128626]: python threads support enabled Sep 16 13:51:11.054331 n-d-858129-2 devstack@n-api.service[128626]: your server socket listen backlog is limited to 100 connections Sep 16 13:51:11.054331 n-d-858129-2 devstack@n-api.service[128626]: your mercy for graceful operations on workers is 90 seconds Sep 16 13:51:11.054909 n-d-858129-2 devstack@n-api.service[128626]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 13:51:11.054909 n-d-858129-2 devstack@n-api.service[128626]: *** Operational MODE: preforking *** Sep 16 13:51:11.055142 n-d-858129-2 devstack@n-api.service[128626]: *** uWSGI is running in multiple interpreter mode *** Sep 16 13:51:11.055142 n-d-858129-2 devstack@n-api.service[128626]: spawned uWSGI master process (pid: 128626) Sep 16 13:51:11.055310 n-d-858129-2 systemd[1]: Started Devstack devstack@n-api.service. Sep 16 13:51:11.055859 n-d-858129-2 devstack@n-api.service[128626]: spawned uWSGI worker 1 (pid: 128642, cores: 1) Sep 16 13:51:11.056944 n-d-858129-2 devstack@n-api.service[128626]: spawned uWSGI worker 2 (pid: 128643, cores: 1) Sep 16 13:51:11.057248 n-d-858129-2 devstack@n-api.service[128626]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 13:51:11.784948 n-d-858129-2 devstack@n-api.service[128642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 13:51:11.796964 n-d-858129-2 devstack@n-api.service[128643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 13:51:13.191293 n-d-858129-2 devstack@n-api.service[128643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:51:13.191293 n-d-858129-2 devstack@n-api.service[128643]: from cryptography.utils import int_from_bytes Sep 16 13:51:13.192442 n-d-858129-2 devstack@n-api.service[128643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:51:13.192442 n-d-858129-2 devstack@n-api.service[128643]: from cryptography.utils import int_from_bytes Sep 16 13:51:13.420318 n-d-858129-2 devstack@n-api.service[128642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:51:13.420318 n-d-858129-2 devstack@n-api.service[128642]: from cryptography.utils import int_from_bytes Sep 16 13:51:13.421289 n-d-858129-2 devstack@n-api.service[128642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 13:51:13.421289 n-d-858129-2 devstack@n-api.service[128642]: from cryptography.utils import int_from_bytes Sep 16 13:51:16.154386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 13:51:16.155107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 13:51:16.155266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 13:51:16.155605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 13:51:16.155950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 13:51:16.156425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.156973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.157411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.157858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.158287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.158741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.159170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.159624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.160164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.160537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.161029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.161621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858129-2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.162058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.162801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.163084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.163603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.164014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.164450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.164940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.165777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.166772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.167318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.167977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.168496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.169019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.169550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.170087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.170674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.171216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.171683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.172253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858129-2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.172745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.173285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.173778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.174371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.174820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.175297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.175865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.176358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.176833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.177403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.177880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.178352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.178847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.179302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.179804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.180257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.180834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.181906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.182357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.182782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.183327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.183847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.184335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.184804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.185255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.185663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.186127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.186559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.186957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.187334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.187776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.188323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.188850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.189315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.189771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.190227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.190727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.191220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.191613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.192064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.192459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.192952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.193305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.193688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.194102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.194532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.194915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.195303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.195701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.196231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.197300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.197829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.198303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.198817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.199279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.199679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.200130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.200582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.201127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.201547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.201924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.202366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.202781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.203158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.203560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.203938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.204314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.204700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.205134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.205508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.205874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.206288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.206721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.207112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.207511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.208059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.208518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.208978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.209437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.209903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.210364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.210908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.211489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.211962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.212501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.212964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.213458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.213893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.214363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.214852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.215304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.215771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.216235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.216762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.217218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.217674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.218197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.218686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.219150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.219613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.220064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.220531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.221007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.221513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.221978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.222373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.222853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.223309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.223717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.224132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.224518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.224923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.225325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.225711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.226092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.226576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.227070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.227538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.228037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.228565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.229033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.229513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.229991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.230511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.230992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.231470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.232007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.232533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.233073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.233551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.234047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.234576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.235073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.235545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.236019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.236591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.237418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.237951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.238546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.239056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.239505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.240045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.240508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.240980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.241438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.241886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.242288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.242795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.243141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.244067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.244436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.244773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.245114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.245445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.245771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.246103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.246448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.246769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.247089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.247396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.247716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.248023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.248342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.248648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.248975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.249343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.249630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.249967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.250279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.250639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.250959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.251281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.251590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.251906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.252219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.252529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.252862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.253175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.253486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.253813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.254128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.254506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.254783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.255122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.255440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.255948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.256272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.256612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.256939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.257328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.257681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.258022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.258325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.258688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.259019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.259931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.260220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.260536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.260936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.261264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.261638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.261959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.263007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.263007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.263007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.263448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.263664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.263825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.264212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.264524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.264905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.265215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.265568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.265980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.266334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.266830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.267160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.267492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.267817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.268137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.268447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.268856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.269191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.269592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.269924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.270247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.270600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.270918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.271253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.271569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.271895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.272200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.272517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.272861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.273201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.273521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.273848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.274160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.274512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.274864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.275180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.275494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.275808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.276130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.276443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.276762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.277072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.277401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.277713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.278040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.278341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.278689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.279028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.279369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.279672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.279987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.280315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.280625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.280940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.281252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.281560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.281869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.282177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.282531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.282846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.283153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.283433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.283759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.284068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.284375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.284671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.285191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.285527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.285840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.286163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.286516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.286824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.287130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.287454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.287764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.288335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.288335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.288839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.289093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.289372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.289632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.290186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.290186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.290774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.291040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.291294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.291537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.292353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.292353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.292822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.292822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.293310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.293310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.294537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.294537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.294537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.294537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.295648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.295648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.295648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.296182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.296767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.297210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.297534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.297860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.298727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.298727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.299231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.299231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.299701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.299950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.300836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.300836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.300836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.301500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.301500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.302038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.302038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.303150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.303150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.303150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.303150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.304057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.304057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.304057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.304713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.304713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.305251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.305251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.305865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.305865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.306833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.307064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.307316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.307566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.307896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.309365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.309365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.309365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.309910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.310457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.310894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.311558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.311558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.311993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.312157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.312432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.312915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.313536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.313915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.314185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.314520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.314830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.315453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.315453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.315989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.316381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.316705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.317018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.317321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.317660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.318300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.318564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.318758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.319397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.319397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.319881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.319881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.320308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.320634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.321068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.321578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.321578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.322854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.323226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.323226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.323801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.323979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.324169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.324476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.324790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.325095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.325487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.325704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.326015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.326319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.326667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.326970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.327275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.327578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.327906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.328216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.328520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.328824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.329136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.329484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.329788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.330151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.330498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.330824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.331153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.331473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.331786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.332101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.332408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.332727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.333045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.333361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.333667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.333971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.334297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.334638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.334953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.335279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.335608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.335931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.336235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.336546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.336857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.337168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.337510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.337820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.338132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.338467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.338780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.339094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.339415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.339716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.340030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.340341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.340645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.340981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.341291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.341595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.341907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.342210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.342547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.342856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.343304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.343617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.343931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.344237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.344547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.344860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.345176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.345493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.345798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.346228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.346568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.346883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.347195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.347501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.347806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.348119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.348446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.348753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.349057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.349361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.349691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.349991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.350314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.350803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.351113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.351420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.351844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.352156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.352469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.352790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.353163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.353729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.353877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.354083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.354392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.354736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.355062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.355378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.355699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.356006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.356328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.356649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.356965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.357294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.357731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.358057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.358367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.358733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.359061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.359376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.359698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.359994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.360293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.360597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.360927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.361231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.361543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.362120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.362453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.362762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.363067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.363389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.363952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.364106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.364316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.364924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.365254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.365584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.365909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.366223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.366561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.366868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.367174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.367522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.367834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.368155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.369031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.369371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.369685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.370022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.370358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.370699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.371013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.371339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.371671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.371977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.372278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.372587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.372898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.373228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.373504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.373815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.374353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.374649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.374924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.375203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.375520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.375846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.376160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.376469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.376781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.377083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.377429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.377738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.378072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.378382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.378731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.379049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.379396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.379684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.380002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.380328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.380644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.380953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.381265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.381579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.381890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.382209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.382811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.383149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.383479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.383768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.384104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.384968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.385275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.385591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.385898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.386210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.386554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.386888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.387213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.387541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.387881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.388204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.388529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.388846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.389162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.389529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.389846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.390155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.392740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.393116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.393678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.393958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.394256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.394824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.395473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.396133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.397526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.397876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.398214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.398601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.398965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.399306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.399638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.399998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.400330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.400928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.401248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.401595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.401935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.402278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.402642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.402971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.403315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.403632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.403946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.404265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.404636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.404895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.405299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.405565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.405861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.406189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.406535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.407124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.407482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.407802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.408203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.408463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.408790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.409099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.409428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.409735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.410045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.410366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.410729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.411173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.411456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.411646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.411946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.412258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.412570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.412872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.413196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.413590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.413799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.414110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.414510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.414883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.415192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.415553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.415871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.416187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.416490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.416918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.417268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.417663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.418012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.418349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.418690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.419030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.419340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.419650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.419977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.420290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.420619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.420934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.421381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.421804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.422042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.422581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.422866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.423239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.423640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.423977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.424704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.424971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.425181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.425481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.425781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.426106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.426495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.426774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.427050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.427367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.427682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.428277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.428277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.428649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.428895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.429206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.429663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.429830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.430133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.431833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.431833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.432253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.432507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.432745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.433069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.433407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.433916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.434117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.434338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.434771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.435093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.435427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.435874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.436187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.436519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.436830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.437174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.437465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.437793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.438387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.438627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.438893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.439229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.439575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.439910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.440235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.440543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.440851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.441157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.441469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.441792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.442110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.442465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.442744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.443054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.443358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.443666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.443969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.444273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.444580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.444901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.445191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.445492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.445792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.446095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.446421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.447325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.447630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.447936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.448240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.448550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.448861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.449194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.449528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.449842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.450165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.450514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.450836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.451144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.451465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.451784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.452101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.452417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.452800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.453111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.453423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.453741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.454046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.454355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.454709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.455046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.455375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.455684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.456008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.456329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.456648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.456961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.457274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.457610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.457915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.458227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.458564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.458931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.459189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.459498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.459807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.460119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.460434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.460747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.461079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.461408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.461718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.462045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.462434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.462786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.463104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.463449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.463800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.464097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.465234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.465234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.465234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 13:51:16.512962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 13:51:16.513744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 13:51:16.514451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 13:51:16.515135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 13:51:16.515611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 13:51:16.516336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.516938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.517534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.518122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.518790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.519388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.520012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.520588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.521178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.521640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.522238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.522889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858129-2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.523498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.524074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.524666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.525259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.525818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.526452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.527077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.527752 n-d-858129-2 devstack@n-api.service[128643]: INFO dbcounter [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Registered counter for database nova_api Sep 16 13:51:16.528038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.528595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.529147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.529789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.530453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.531055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.531657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.532263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.533338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.533970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.534639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.535395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858129-2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.536079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.536723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.537198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.537891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.538523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.539169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.539753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.540958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.543073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.543073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.543601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.544126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.546620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.546620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.546620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.546620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.548042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.548042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.548737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.548737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.550691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.550691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.550979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_db.sqlalchemy.engines [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:16.551134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.551266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.551658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.552145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.552750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.553333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.553918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.554488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.555037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.556734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.557619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.558636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writer thread running {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:16.559678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.560655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.561251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.561886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.562499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.563093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.564059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.564999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.566219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.567132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.567988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.568887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.569744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.570614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.571498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.572678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.573520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.574480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.576453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.577137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.577767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.578595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.579250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.580244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.580965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.581768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.582480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.583161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.584031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.584652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.585214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.585770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.586364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.587004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.587664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.588253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.588833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.589414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.590002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.590619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.591227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.591833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.592436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.593001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.593576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.594153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.594798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.595385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.595951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.596560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.597166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.598177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.598847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.599407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.599989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.600600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.601118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.601468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.602077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.602710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.604149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.604957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.605755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.606581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.607160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.607753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.608336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.608928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.609535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.610138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.610772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.611359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.612217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.612830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 13:51:16.613451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.614093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.614768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.615371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.616055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.616650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.617224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.617821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.618622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.619731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.620078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.620415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.620751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.621091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.621423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.621773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.622103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.622456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.622797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.623232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.623448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.623793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.624090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.624414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.624779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.625348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.625641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.625974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.626304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.626814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.627323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.627807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.context [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=128643) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.668849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.671917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.675872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:51:16.676553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.676790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:51:16.677518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.677888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:51:16.678013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.678830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679739 n-d-858129-2 devstack@n-api.service[128643]: INFO dbcounter [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Registered counter for database nova_cell0 Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.679804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.680699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.681165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.681165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686640 n-d-858129-2 devstack@n-api.service[128643]: INFO dbcounter [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Registered counter for database nova_cell1 Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.686941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.689163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.692055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.693875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_db.sqlalchemy.engines [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.694026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.695265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.695265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.695515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_db.sqlalchemy.engines [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:16.695645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.695645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.695645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.695645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.696176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.696368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.697418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.698099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.698804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.699484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.699997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.700589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.701163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.701733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.701988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writer thread running {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:16.702298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.703475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.704721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.705127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.705688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.706389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.706962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.707482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.708040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.709089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.709855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.710201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.710769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.711297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.711788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.714107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.714393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.715072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.715625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.716179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.716729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.717275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.717831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.718375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.718954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.719491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.720043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.720589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.721134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.721669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.722212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.722801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.723380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.724559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.725110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.725695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.726253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.726830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.727377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.728859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.729488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.730039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.730695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.731283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.731907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.732452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.732995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.733575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.734838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.735389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.735931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.736462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.737254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.737898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.738467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.739003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.739533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.740072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.740585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.741115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.741634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.742179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.742739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.743271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.744925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.745469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.745970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.746506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.746994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.747485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.748047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.748526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.749079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.749565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.750057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.750629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.751115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.751626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.752179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.752702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.753228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.753795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.754337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.755517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.756098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.756698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.757260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.757811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.758372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.758947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.759534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.760085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.760649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.761195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.761735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.762264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.762825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.763380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.763994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.764532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.765693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.766275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.766918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.767542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.768127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.768774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.769348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.769925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.770547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.771152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.771753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.772343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.772911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.773482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.774048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.774669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.780807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.781422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.782045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.782711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.783312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.783964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.784600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.785380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.785796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.786343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.786948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.787525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.788101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.789981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.789981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.789981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.791271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.791891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.792501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.793090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.793707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.794312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.795110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.795716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.796642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.797179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.797699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.798595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.799178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.799747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.800607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.801150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.801709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.802290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.802925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.803499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.804082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.804669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.805245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.806097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.807223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.807810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.808377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.808940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.809492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.810044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.810692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.811257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.811867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.812432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.813052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.813640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.814252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.815143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.815729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.816307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.817095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.817654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.818239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.818891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.819500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.820117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.820968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.821571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.822190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.822838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.823437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.823970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.824561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.825172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.825821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.826372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.827004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.827584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.828410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.828949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.829527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.830103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.830723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.831260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.831818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.832377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.832893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.833438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.834007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.834562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.835115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.835674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.836190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.836725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.837307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.837899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.838473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.839065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.839654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.840231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.840801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.841355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.841955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.842547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.843075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.843613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.844145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.844789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.845278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.845811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.846362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.846959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.847531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.848138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.848737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.849309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.849864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.850444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.850970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.851477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.852008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.852562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.853643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.854196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.854772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.855331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.855871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.856424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.856969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.857549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.858085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.858667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.859222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.859750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.860254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.860760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.861329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.862128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.862756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.863321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.863936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.864515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.865099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.865638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.866221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.866842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.867436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.868032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.869149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.869705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.870272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.870859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.871866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.872447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.873042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.873642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.874194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.874786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.875372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.875987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.876583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.877202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.877750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.878459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.878944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.879515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.880090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.880628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.881164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.881716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.882292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.882987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.883568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.884317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.884887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.885396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.885905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.886444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.886925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.887438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.888282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.888574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.889143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.889836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.890384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.891021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.891790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.892519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.893269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.895736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.895736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.896048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.896157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.896630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.897051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.897571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.898911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.899515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.900815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.901484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.902173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.902910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.903518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.904102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.904719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.905231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.905819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.906455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.907052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.908132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.908991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.909592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.910168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.910790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.911376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.911942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.912555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.913139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.913713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.914315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.914962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.916206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.916789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.917405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.917995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.918622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.919223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.919816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.920852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.921441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.922021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.922627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.923238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.923805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.924436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.924936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.925522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.926133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.926748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.927332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.927934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.928534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.929175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.929751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.930321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.931647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.932245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.933211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.933856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.934570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.935127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.935736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.936346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.937035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.937680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.938826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.939481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.940092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.940740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.941375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.941973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.942626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.943207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.943836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.944388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.944992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.945598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.946177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.946979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.947585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.948178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.949028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.949645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.950246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.950892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.952214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.952214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.952590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writer thread running {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:16.952721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.953304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.953984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.954648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.955235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.955844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.956456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.957061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.957665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.958266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.958920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.959547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.960212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.960813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.961503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.963250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.963823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.964446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.964568 n-d-858129-2 devstack@n-api.service[128643]: INFO dbcounter [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Registered counter for database nova_cell0 Sep 16 13:51:16.965059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.965668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.966286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.967011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.967521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.968130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.968736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.969370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.969990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.970641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.971263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.971850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.972445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.972565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_db.sqlalchemy.engines [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:16.973029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.973626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.974259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.974908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.975647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.976075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.977358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.977358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.977935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.979076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.979660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.980244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.980820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.981408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.981992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.982571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.983131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.983674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writer thread running {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:16.983812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.984459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.984896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.985525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.986068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.986625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.987432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.988052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.988645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.989221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.989833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.990510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.991092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.991662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.992261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.992898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.993609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.994206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.994869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.995463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.996058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.996612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.997179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.997769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.998371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.999034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:16.999571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.000092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.000684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.001282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.001908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.002543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.003119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.003759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.004360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.005040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.005639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.006249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.006873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.007492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.008077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.008683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.009383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.009997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.010676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.011295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.011885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.012521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.013150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.013816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.014442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.015096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.015719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.016324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.016895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.017462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 13:51:17.017904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 13:51:17.279593 n-d-858129-2 devstack@n-api.service[128642]: INFO dbcounter [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Registered counter for database nova_api Sep 16 13:51:17.326379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:17.336731 n-d-858129-2 devstack@n-api.service[128643]: WARNING keystonemiddleware.auth_token [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:51:17.338906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writer thread running {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:17.344794 n-d-858129-2 devstack@n-api.service[128643]: WARNING keystonemiddleware.auth_token [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:51:17.412832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.context [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=128642) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 13:51:17.417444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:51:17.417930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:51:17.419626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:51:17.420399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:51:17.420854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:51:17.422959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:51:17.425063 n-d-858129-2 devstack@n-api.service[128642]: INFO dbcounter [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Registered counter for database nova_cell0 Sep 16 13:51:17.429572 n-d-858129-2 devstack@n-api.service[128642]: INFO dbcounter [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Registered counter for database nova_cell1 Sep 16 13:51:17.440252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:17.445955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:17.449148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writer thread running {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:17.708742 n-d-858129-2 devstack@n-api.service[128643]: WARNING keystonemiddleware.auth_token [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:51:17.715468 n-d-858129-2 devstack@n-api.service[128643]: WARNING keystonemiddleware.auth_token [None req-44d45ecc-a3ec-417d-abe6-590d31bd5105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:51:17.720929 n-d-858129-2 devstack@n-api.service[128643]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5583ae0b49c0 pid: 128643 (default app) Sep 16 13:51:17.728750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writer thread running {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:17.748371 n-d-858129-2 devstack@n-api.service[128642]: INFO dbcounter [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Registered counter for database nova_cell0 Sep 16 13:51:17.760369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 13:51:17.769041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writer thread running {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 13:51:18.434849 n-d-858129-2 devstack@n-api.service[128642]: WARNING keystonemiddleware.auth_token [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:51:18.450373 n-d-858129-2 devstack@n-api.service[128642]: WARNING keystonemiddleware.auth_token [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:51:18.965954 n-d-858129-2 devstack@n-api.service[128642]: WARNING keystonemiddleware.auth_token [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 13:51:18.972172 n-d-858129-2 devstack@n-api.service[128642]: WARNING keystonemiddleware.auth_token [None req-d9ed5c92-2b2f-45bb-9fa1-e77add0a0226 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 13:51:18.977630 n-d-858129-2 devstack@n-api.service[128642]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5583ae0b49c0 pid: 128642 (default app) Sep 16 13:52:05.246644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:05.247809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:05.249247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:05.251817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:06.213049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:06.214732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:06.216053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:06.217307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:07.045045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-789b203e-0b07-423f-a6af-df5f4cdc05ab tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:07.048358 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-789b203e-0b07-423f-a6af-df5f4cdc05ab tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-789b203e-0b07-423f-a6af-df5f4cdc05ab tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin] Request method failure captured: Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-FzdqUK8E88jVMWtlCgj9DKAmASXuNAYXFB-FPXmpRpxe_AQ3rWmmoimqdD8hNlaS-ZUKzKoGyOa4JH8KweAss-InSGgDbY8gvQw7nNtRm_2bqRowZyRWwMymW9MNpIu1-toPpDh-fhBd9uWb9M-2r829_vPXxte_HkltB3OrOawI Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: cd99f5068c324db7bf8ce368e6304554 Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:52:07.057797 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cd99f5068c324db7bf8ce368e6304554", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cd99f5068c324db7bf8ce368e6304554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cd99f5068c324db7bf8ce368e6304554"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cd99f5068c324db7bf8ce368e6304554"}]}] Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: cd99f5068c324db7bf8ce368e6304554 Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e89e28128002492e9fa160ac457c79a2 Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:07.059206 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid timestamp for date invalid_time Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'invalid_time'} Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:07.059895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 16 13:52:07.061099 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.062331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-789b203e-0b07-423f-a6af-df5f4cdc05ab tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:07.063586 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-789b203e-0b07-423f-a6af-df5f4cdc05ab tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222 tempest-InstanceUsageAuditLogNegativeTestJSON-1789158222-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.830166 Sep 16 13:52:07.064282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1224 bytes} [Fri Sep 16 13:52:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1833 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:52:07.658835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9febac2-161b-40d4-94e8-7b8aec5f9d3d tempest-AZAdminNegativeTestJSON-1208577307 tempest-AZAdminNegativeTestJSON-1208577307-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:07.660701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9febac2-161b-40d4-94e8-7b8aec5f9d3d tempest-AZAdminNegativeTestJSON-1208577307 tempest-AZAdminNegativeTestJSON-1208577307-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c9bbadbe4f6b4816a5aef58206803274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5632cb9dc8204b2ca12603c8e9873824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9febac2-161b-40d4-94e8-7b8aec5f9d3d tempest-AZAdminNegativeTestJSON-1208577307 tempest-AZAdminNegativeTestJSON-1208577307-project] Request method failure captured: Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-D3lVGbXWeUhEdYDBkG156jTcQSGaET11amf5e5_oDrJizzIiR1N9LvJlo5sMDl47EeMOf-emn5AaxAGBDKu8oHtUggGaeeljJFMvS2aaUAkXmXiQ5kcqKmTCCpxoYUulFEWZwx-ug2Jv09lt_azMWcmJvtkD5hacCOIAN10_hZzk Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 5632cb9dc8204b2ca12603c8e9873824 Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1208577307 Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:52:07.663991 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5632cb9dc8204b2ca12603c8e9873824", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5632cb9dc8204b2ca12603c8e9873824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5632cb9dc8204b2ca12603c8e9873824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5632cb9dc8204b2ca12603c8e9873824"}]}] Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AZAdminNegativeTestJSON-1208577307 Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 5632cb9dc8204b2ca12603c8e9873824 Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1208577307 Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AZAdminNegativeTestJSON-1208577307-project Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c9bbadbe4f6b4816a5aef58206803274 Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AZAdminNegativeTestJSON-1208577307-project Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 16 13:52:07.666013 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:52:07.666901 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 16 13:52:07.667939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:07.669677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9febac2-161b-40d4-94e8-7b8aec5f9d3d tempest-AZAdminNegativeTestJSON-1208577307 tempest-AZAdminNegativeTestJSON-1208577307-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:07.670918 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9febac2-161b-40d4-94e8-7b8aec5f9d3d tempest-AZAdminNegativeTestJSON-1208577307 tempest-AZAdminNegativeTestJSON-1208577307-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.604743 Sep 16 13:52:07.671838 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 13:52:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 606 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:52:08.132800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '.version_select at 0x7f724eefe430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:08.146228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=128642) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 16 13:52:08.147854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:08.148518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:08.149916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:08.197570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:08.198551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:08.199204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:08.224908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:08.225759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:08.226607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:08.240386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af612d65-ad84-48a0-bfda-cd83f18c8461 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 2.045255 Sep 16 13:52:08.241467 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 13:52:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:08.317330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caf1a26e-a409-4cc5-b157-3b996739ec2d tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:08.321797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-caf1a26e-a409-4cc5-b157-3b996739ec2d tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b3fce55e2c7e4fe6952588d47dac8aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e461f7d7a1d4523b35392f8bccba6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caf1a26e-a409-4cc5-b157-3b996739ec2d tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Request method failure captured: Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-Bq8XUnwcExnpUsDZQvlXgzoEzk5RP1KuKzba18fXLjXhmSkKP1mKoMmcpwKy7gWqEIvTGUgllFRGhIoQ9xMmsy6xTGMtno5kMWZhaxSDkzSHdQuQLy8wMulBFEtiFCtk3mq97M_BOUAkqKzzKNaQmOSO4RUEmZVXftIhGaCsF4rM Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 9e461f7d7a1d4523b35392f8bccba6e2 Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:52:08.324852 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9e461f7d7a1d4523b35392f8bccba6e2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e461f7d7a1d4523b35392f8bccba6e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9e461f7d7a1d4523b35392f8bccba6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e461f7d7a1d4523b35392f8bccba6e2"}]}] Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 9e461f7d7a1d4523b35392f8bccba6e2 Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b3fce55e2c7e4fe6952588d47dac8aa9 Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project Sep 16 13:52:08.326943 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:52:08.327918 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 16 13:52:08.329850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:08.332910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caf1a26e-a409-4cc5-b157-3b996739ec2d tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:08.335949 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-caf1a26e-a409-4cc5-b157-3b996739ec2d tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.662275 Sep 16 13:52:08.337707 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 13:52:07 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 665 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:52:08.729828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Calling method '.version_select at 0x7f724ee90670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:08.741205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:08.742384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:08.743989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:08.762196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d69e335f-4df6-47cc-be0a-c8e6db6e9407 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-406963202", "id": 187977007, "os-flavor-access:is_public": "False"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:08.775377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:08.776519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:08.777471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:08.797181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:08.798000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:08.798786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:08.816385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f809cc34-6f83-4414-8c89-0704c104c90d tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.572430 Sep 16 13:52:08.817418 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2/5] 10.222.0.60 () {60 vars in 1208 bytes} [Fri Sep 16 13:52:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:52:08.834719 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d69e335f-4df6-47cc-be0a-c8e6db6e9407 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.486963 Sep 16 13:52:08.834719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 4/6] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:08 2022] POST /compute/v2.1/flavors => generated 427 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:08.850002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6af36789-2660-467b-84cd-b087cac29f0e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2138970840", "name": "tempest-test_aggregate-1193556958"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:08.867105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-6af36789-2660-467b-84cd-b087cac29f0e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid ffb352ff-ef61-4256-a04e-1fe9b656f626 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:52:08.949906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-87188230", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:09.003601 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6af36789-2660-467b-84cd-b087cac29f0e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.164526 Sep 16 13:52:09.007483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 5/7] 10.222.0.60 () {60 vars in 1165 bytes} [Fri Sep 16 13:52:08 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:09.021635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab375fd2-01df-4fdf-9a87-8cacf99f8fec tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:09.027187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab375fd2-01df-4fdf-9a87-8cacf99f8fec tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b3fce55e2c7e4fe6952588d47dac8aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e461f7d7a1d4523b35392f8bccba6e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab375fd2-01df-4fdf-9a87-8cacf99f8fec tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Request method failure captured: Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16%2013:52:08 HTTP/1.1 Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-Bq8XUnwcExnpUsDZQvlXgzoEzk5RP1KuKzba18fXLjXhmSkKP1mKoMmcpwKy7gWqEIvTGUgllFRGhIoQ9xMmsy6xTGMtno5kMWZhaxSDkzSHdQuQLy8wMulBFEtiFCtk3mq97M_BOUAkqKzzKNaQmOSO4RUEmZVXftIhGaCsF4rM Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 9e461f7d7a1d4523b35392f8bccba6e2 Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:52:09.034686 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9e461f7d7a1d4523b35392f8bccba6e2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e461f7d7a1d4523b35392f8bccba6e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9e461f7d7a1d4523b35392f8bccba6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e461f7d7a1d4523b35392f8bccba6e2"}]}] Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 9e461f7d7a1d4523b35392f8bccba6e2 Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b3fce55e2c7e4fe6952588d47dac8aa9 Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project Sep 16 13:52:09.036582 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2022-09-16 13:52:08'} Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:52:09.037504 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 16 13:52:09.042341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:09.045404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab375fd2-01df-4fdf-9a87-8cacf99f8fec tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:09.045404 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab375fd2-01df-4fdf-9a87-8cacf99f8fec tempest-InstanceUsageAuditLogNegativeTestJSON-691878530 tempest-InstanceUsageAuditLogNegativeTestJSON-691878530-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16 13:52:08" status: 403 len: 128 microversion: 2.1 time: 0.023296 Sep 16 13:52:09.045404 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 6/8] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 13:52:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16%2013%3A52%3A08 => generated 128 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:52:09.687258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b46dd0c0-a0e9-47f6-8663-2dc592757710 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-704121904", "id": 1919468060, "os-flavor-access:is_public": "True"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:09.719111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b46dd0c0-a0e9-47f6-8663-2dc592757710 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.680898 Sep 16 13:52:09.720085 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 7/9] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:09 2022] POST /compute/v2.1/flavors => generated 429 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:09.739749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1deb2649-a890-4f80-b4de-803faaa17b09 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c4711be56a9d4ef5a2c7310502198885"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:10.160379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:52:10.677494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:52:10.678685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:52:10.680398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:52:10.681550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:52:10.685143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:52:10.729131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:10.729922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:10.730913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:10.732407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:10.732845 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1deb2649-a890-4f80-b4de-803faaa17b09 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/187977007/action" status: 200 len: 96 microversion: 2.1 time: 1.008272 Sep 16 13:52:10.734178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:10.735044 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 8/10] 10.222.0.60 () {60 vars in 1197 bytes} [Fri Sep 16 13:52:09 2022] POST /compute/v2.1/flavors/187977007/action => generated 96 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:10.735394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:10.747419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-99901e2c-594d-4da2-b562-9a2ff57c3f4a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:10.789332 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-99901e2c-594d-4da2-b562-9a2ff57c3f4a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.052197 Sep 16 13:52:10.792892 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 9/11] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:52:10 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:10.802752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e6ecde18-c896-4b59-9f0d-6c9f01b264a1 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:10.807107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Getting quotas for project b0e233a388154a039a0875867320d4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:52:10.821540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Getting quotas for user e483157356e344ff90e2ac23f69c5876 and project b0e233a388154a039a0875867320d4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:52:10.869851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:52:10.876818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:52:10.891585 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e6ecde18-c896-4b59-9f0d-6c9f01b264a1 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1919468060" status: 202 len: 0 microversion: 2.1 time: 0.096567 Sep 16 13:52:10.892690 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 10/12] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:10 2022] DELETE /compute/v2.1/flavors/1919468060 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:11.023119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac075ad6-b7b4-44a1-8085-c763f857a24a tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184968 Sep 16 13:52:11.026101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3/13] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:52:11.044495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-622a0f93-4ddd-48b3-8235-f0adff7c706e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:11.076263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-622a0f93-4ddd-48b3-8235-f0adff7c706e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:11.076773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-622a0f93-4ddd-48b3-8235-f0adff7c706e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:11.078273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-622a0f93-4ddd-48b3-8235-f0adff7c706e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:11.381698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19b53e36-2305-41a6-ba44-52888419b2cb tempest-FlavorsAccessTestJSON-694942805 tempest-FlavorsAccessTestJSON-694942805-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:11.430205 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19b53e36-2305-41a6-ba44-52888419b2cb tempest-FlavorsAccessTestJSON-694942805 tempest-FlavorsAccessTestJSON-694942805-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.536212 Sep 16 13:52:11.444838 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 11/14] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:10 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:11.451954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6908078c-2c48-4cb1-b1a3-f9ca19f14415 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:11.481566 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6908078c-2c48-4cb1-b1a3-f9ca19f14415 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034927 Sep 16 13:52:11.483296 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 12/15] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:11.491024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abcd9361-13b5-4e69-970e-308197484d31 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:11.492134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abcd9361-13b5-4e69-970e-308197484d31 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:12.249185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-622a0f93-4ddd-48b3-8235-f0adff7c706e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.220008 Sep 16 13:52:12.252327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4/16] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:52:11 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:12.278086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1245852-7eae-49aa-a63f-0d372c737c35 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c4711be56a9d4ef5a2c7310502198885"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:12.778942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abcd9361-13b5-4e69-970e-308197484d31 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:12.807133 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abcd9361-13b5-4e69-970e-308197484d31 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1218 microversion: 2.1 time: 1.320398 Sep 16 13:52:12.830722 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 13/17] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:11 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1218 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:12.830722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-25a5a938-ae1c-4434-b145-a86261047e46 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-868517676", "id": 1680984012, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:12.863618 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-25a5a938-ae1c-4434-b145-a86261047e46 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.052556 Sep 16 13:52:12.877890 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 14/18] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:12 2022] POST /compute/v2.1/flavors => generated 416 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:13.129377 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1245852-7eae-49aa-a63f-0d372c737c35 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/187977007/action" status: 200 len: 21 microversion: 2.1 time: 0.874907 Sep 16 13:52:13.135822 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 5/19] 10.222.0.60 () {60 vars in 1197 bytes} [Fri Sep 16 13:52:12 2022] POST /compute/v2.1/flavors/187977007/action => generated 21 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:13.141146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0aec088d-302b-4539-bd9b-abe831466b1a tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:13.174880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0aec088d-302b-4539-bd9b-abe831466b1a tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.037351 Sep 16 13:52:13.175585 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 6/20] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:13 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:13.181290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8be227be-e1dc-4c91-b2df-84dd4cb3466f tempest-FlavorsAccessTestJSON-694942805 tempest-FlavorsAccessTestJSON-694942805-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:13.246810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8be227be-e1dc-4c91-b2df-84dd4cb3466f tempest-FlavorsAccessTestJSON-694942805 tempest-FlavorsAccessTestJSON-694942805-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.069118 Sep 16 13:52:13.249056 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 7/21] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:13 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:13.258635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d297a8d0-d447-4abd-99c4-d40c54f38df6 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:13.345240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d297a8d0-d447-4abd-99c4-d40c54f38df6 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1680984012" status: 202 len: 0 microversion: 2.1 time: 0.093570 Sep 16 13:52:13.348043 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 8/22] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:13 2022] DELETE /compute/v2.1/flavors/1680984012 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:13.360333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bce0d37-5aa0-4a42-b41b-b21c3019bc99 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:13.404548 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5bce0d37-5aa0-4a42-b41b-b21c3019bc99 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/187977007" status: 202 len: 0 microversion: 2.1 time: 0.052338 Sep 16 13:52:13.406714 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 9/23] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:52:13 2022] DELETE /compute/v2.1/flavors/187977007 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:13.608995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-535231446", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "availability_zone": "tempest-test_az-2138970840"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:13.679779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:13.681572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:13.682616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:13.684185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:13.685295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:13.686259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:13.694719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5c8ed66-6012-464d-8d62-a5d815c412a2 tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1941962117", "id": 292408312, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:13.788410 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5c8ed66-6012-464d-8d62-a5d815c412a2 tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.378909 Sep 16 13:52:13.791117 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 10/24] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:52:13 2022] POST /compute/v2.1/flavors => generated 468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:52:13.802798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86acc06e-aca6-4091-bba0-9a6c7d2b64e4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:13.855366 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86acc06e-aca6-4091-bba0-9a6c7d2b64e4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.060360 Sep 16 13:52:13.876836 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 11/25] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:13 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:13.916893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf84a4b2-5f42-423c-a976-b1a0b8783149 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:13.983928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf84a4b2-5f42-423c-a976-b1a0b8783149 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.103852 Sep 16 13:52:13.985531 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 12/26] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:13 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:13.994953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85e677e3-4baf-4728-aebc-2604eac7f966 tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:14.009660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:52:14.520794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85e677e3-4baf-4728-aebc-2604eac7f966 tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/292408312/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.532640 Sep 16 13:52:14.523668 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 13/27] 10.222.0.60 () {62 vars in 1262 bytes} [Fri Sep 16 13:52:13 2022] POST /compute/v2.1/flavors/292408312/os-extra_specs => generated 62 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:14.545547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:14.554367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:14.606823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:14.611422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:14.614303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:14.619017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:14.623220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:14.624453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:14.828760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:52:14.831154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:52:14.832551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:52:14.833571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:52:14.834628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:52:14.863633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:14.864858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:14.865847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:14.867438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:14.868607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:14.869604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:14.941871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Getting quotas for project 63412f6bd59645c5a3c5c5f6f37eb351. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:52:14.965537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:14.975037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Getting quotas for user bbdbdad127f14ebcadd865f2eecb04e9 and project 63412f6bd59645c5a3c5c5f6f37eb351. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:52:14.999989 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-22be44cd-a79e-4566-af9e-44bbf3924927 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1236 microversion: 2.1 time: 0.472155 Sep 16 13:52:15.002916 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 14/28] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:14 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1236 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:15.014321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45ddd3fd-25a4-45f9-8c28-8c40be9315e5 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-518117967", "id": 892666860, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:15.015000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:52:15.024470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:52:15.145472 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45ddd3fd-25a4-45f9-8c28-8c40be9315e5 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.139764 Sep 16 13:52:15.168496 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 15/29] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:15 2022] POST /compute/v2.1/flavors => generated 425 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:15.186093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef65f689-50d8-4a86-b018-f3a8ad285a83 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-607644036", "id": 154078090, "os-flavor-access:is_public": "False"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:15.240873 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b3eeecb2-1d5d-4da0-83a3-77ec49e1062d tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374235 Sep 16 13:52:15.255735 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 15/30] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:52:15.257992 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef65f689-50d8-4a86-b018-f3a8ad285a83 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.086827 Sep 16 13:52:15.267034 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 16/31] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:15 2022] POST /compute/v2.1/flavors => generated 427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:15.283829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00ee6d1d-38c9-463d-9088-3b46db512e4d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.293982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4fb538fd-dfec-4f40-bc3d-8bd21b71c79f tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.335073 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00ee6d1d-38c9-463d-9088-3b46db512e4d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/892666860" status: 202 len: 0 microversion: 2.1 time: 0.065954 Sep 16 13:52:15.341784 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 17/32] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:52:15 2022] DELETE /compute/v2.1/flavors/892666860 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:15.355987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d7cb8ea-29f3-4ea2-8e55-831a7b74aac6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.357124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d7cb8ea-29f3-4ea2-8e55-831a7b74aac6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:15.365095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=9,nova_api:DELETE=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:15.366650 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4fb538fd-dfec-4f40-bc3d-8bd21b71c79f tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/292408312" status: 202 len: 0 microversion: 2.86 time: 0.104764 Sep 16 13:52:15.370815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 16/33] 10.222.0.60 () {60 vars in 1199 bytes} [Fri Sep 16 13:52:15 2022] DELETE /compute/v2.1/flavors/292408312 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:52:15.397811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67220068-2f07-4bac-a72d-14870672b736 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.479479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67220068-2f07-4bac-a72d-14870672b736 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/154078090/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.106715 Sep 16 13:52:15.481024 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 17/34] 10.222.0.60 () {58 vars in 1206 bytes} [Fri Sep 16 13:52:15 2022] GET /compute/v2.1/flavors/154078090/os-flavor-access => generated 21 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:15.502602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8d7cb8ea-29f3-4ea2-8e55-831a7b74aac6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:15.509335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-023af912-122e-4635-8968-85903e5d4536 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.535042 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d7cb8ea-29f3-4ea2-8e55-831a7b74aac6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1242 microversion: 2.1 time: 0.191302 Sep 16 13:52:15.542976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 18/35] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:15 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:15.554366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-26710a29-39fe-432c-b08a-d0a0bb219b50 tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.610669 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-023af912-122e-4635-8968-85903e5d4536 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114271 Sep 16 13:52:15.612238 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 18/36] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:15.632537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9171365a-fbf6-4311-b3f4-7a1c3811b421 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.652650 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-26710a29-39fe-432c-b08a-d0a0bb219b50 tempest-FlavorMetadataValidation-1480770454 tempest-FlavorMetadataValidation-1480770454-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.107914 Sep 16 13:52:15.657672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:52:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:52:15.674012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30ade902-726d-464b-ac0c-1cd2187e7da4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1083515879", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:15.694375 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9171365a-fbf6-4311-b3f4-7a1c3811b421 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/154078090" status: 202 len: 0 microversion: 2.1 time: 0.078876 Sep 16 13:52:15.702209 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 19/38] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:52:15 2022] DELETE /compute/v2.1/flavors/154078090 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:15.719680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ece91c7-2648-4f31-98f4-71728b144c91 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.732442 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30ade902-726d-464b-ac0c-1cd2187e7da4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.066841 Sep 16 13:52:15.734615 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:15.752632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea9e4e38-5815-4d2e-94c0-208b271aacc9 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.774722 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3ece91c7-2648-4f31-98f4-71728b144c91 tempest-FlavorsAccessTestJSON-507784368 tempest-FlavorsAccessTestJSON-507784368-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.061867 Sep 16 13:52:15.775511 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 20/40] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:15 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:15.833939 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea9e4e38-5815-4d2e-94c0-208b271aacc9 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/ff84ccf6-6b69-4446-ad94-81db47e96310" status: 202 len: 0 microversion: 2.1 time: 0.088301 Sep 16 13:52:15.835104 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:52:15 2022] DELETE /compute/v2.1/flavors/ff84ccf6-6b69-4446-ad94-81db47e96310 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:52:15.849639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-555230cb-4d91-4583-8f09-67e57ba95c7e tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:15.981777 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-555230cb-4d91-4583-8f09-67e57ba95c7e tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.140033 Sep 16 13:52:15.993686 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 21/42] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:16.022015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9533ce9a-690e-4d81-bb35-5d9c838fb48d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1453541357", "id": "69e9cf14-7fc9-4466-af86-cafac81a0106", "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:16.065696 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9533ce9a-690e-4d81-bb35-5d9c838fb48d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.048663 Sep 16 13:52:16.068890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:16.073951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:16.080187 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 22/43] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:16 2022] POST /compute/v2.1/flavors => generated 507 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:16.093820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66e23c68-ae52-4806-bef7-894c3866be22 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:16.107507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:16.110885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:16.115176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:16.116676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:16.117599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:16.123764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:16.159812 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66e23c68-ae52-4806-bef7-894c3866be22 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/69e9cf14-7fc9-4466-af86-cafac81a0106" status: 202 len: 0 microversion: 2.1 time: 0.070653 Sep 16 13:52:16.159812 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 23/44] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:52:16 2022] DELETE /compute/v2.1/flavors/69e9cf14-7fc9-4466-af86-cafac81a0106 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:16.189229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28c7e128-94f4-48f5-9945-2e828bba4a72 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:16.334913 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28c7e128-94f4-48f5-9945-2e828bba4a72 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.162862 Sep 16 13:52:16.339564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 24/45] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:16.397265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00c6dcc6-e09c-480c-aa4a-f6e7cb6fcd49 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2107680248", "id": 406426599, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:16.481058 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00c6dcc6-e09c-480c-aa4a-f6e7cb6fcd49 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.106330 Sep 16 13:52:16.481828 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 25/46] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:16 2022] POST /compute/v2.1/flavors => generated 411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:16.503367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87ee54b4-5c35-403e-ada4-658f21796140 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:16.517409 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87ee54b4-5c35-403e-ada4-658f21796140 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/406426599" status: 200 len: 411 microversion: 2.1 time: 0.017693 Sep 16 13:52:16.518852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 26/47] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:52:16 2022] GET /compute/v2.1/flavors/406426599 => generated 411 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:16.865092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:16.926296 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc6978bf-a260-45ef-8307-24bcdadac698 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1300 microversion: 2.1 time: 0.874674 Sep 16 13:52:16.933181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 22/48] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:16 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1300 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:16.951304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4930533-6a79-4e90-951c-ba077b9c5047 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:16.955042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4930533-6a79-4e90-951c-ba077b9c5047 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:17.160860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69687ffc-7ad0-48d6-88ad-79be72ba6b1f tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:17.219657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69687ffc-7ad0-48d6-88ad-79be72ba6b1f tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.674590 Sep 16 13:52:17.229140 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 27/49] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:16 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:17.242641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a4b4901-d6b2-4fbf-8f18-b4d617ef9389 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:17.281108 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a4b4901-d6b2-4fbf-8f18-b4d617ef9389 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/406426599" status: 202 len: 0 microversion: 2.1 time: 0.042307 Sep 16 13:52:17.281865 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 28/50] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:52:17 2022] DELETE /compute/v2.1/flavors/406426599 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:17.294541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c939c49-0bb0-41ae-bc2a-90e525be95b2 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:17.393385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4930533-6a79-4e90-951c-ba077b9c5047 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:17.407810 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4930533-6a79-4e90-951c-ba077b9c5047 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1242 microversion: 2.1 time: 0.472845 Sep 16 13:52:17.416617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 23/51] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:16 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1242 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:17.471461 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c939c49-0bb0-41ae-bc2a-90e525be95b2 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.177148 Sep 16 13:52:17.476091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 29/52] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:17.508345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8545df97-3af6-4ae8-b759-1501c13ce6ec tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1910558601", "id": 1708796980, "os-flavor-access:is_public": "False"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:17.549146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8545df97-3af6-4ae8-b759-1501c13ce6ec tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.045433 Sep 16 13:52:17.554466 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 24/53] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:17 2022] POST /compute/v2.1/flavors => generated 430 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:17.585041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5957eec3-50ef-4151-971b-6f4526a0b05e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "1708796980"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:17.619027 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-5957eec3-50ef-4151-971b-6f4526a0b05e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] HTTP exception thrown: Flavor 1708796980 could not be found. Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5957eec3-50ef-4151-971b-6f4526a0b05e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] Request method failure captured: Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 107 Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-FAjVGAfRoov5kos5Tx6LM6FIgC746pXc-BeIXbpVOA49a6g6COgYu6GP9YxLnBUV-woEXOQjwohaJXAu0u6ya6gLGsPFvnA9llP_DMfKB8Xn3ARfQyJwYLyZspUVj5U2HP7EFbOwKY8u7KHkK2nr4p448RZrRl5u-FqONNTJpQTE Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 31cf64a2485d43b2a2c788e05096e352 Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FlavorsAdminTestJSON-920060970 Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:52:17.625213 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31cf64a2485d43b2a2c788e05096e352", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31cf64a2485d43b2a2c788e05096e352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31cf64a2485d43b2a2c788e05096e352"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31cf64a2485d43b2a2c788e05096e352"}]}] Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FlavorsAdminTestJSON-920060970 Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 31cf64a2485d43b2a2c788e05096e352 Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-920060970 Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FlavorsAdminTestJSON-920060970-project Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1c6185a21fe54e9e809e448caf8e66d9 Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FlavorsAdminTestJSON-920060970-project Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "test", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "1708796980"}} Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:52:17.626661 n-d-858129-2 devstack@n-api.service[128642]: exception: Flavor 1708796980 could not be found. Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '1708796980'}}} Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1708796980 could not be found. Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:52:17.627494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1708796980 could not be found. Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:17.628726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:17.630034 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:17.630034 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:52:17.630034 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:52:17.630034 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1708796980 could not be found. Sep 16 13:52:17.630034 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:52:17.640471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5957eec3-50ef-4151-971b-6f4526a0b05e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] Returning 400 to user: Flavor 1708796980 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:17.641861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5957eec3-50ef-4151-971b-6f4526a0b05e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.067600 Sep 16 13:52:17.643128 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 30/54] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:17 2022] POST /compute/v2.1/servers => generated 81 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:52:17.675468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-355c5bbe-46a3-4dfb-b75a-914d6a792643 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:17.715164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=10,nova_api:DELETE=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:17.731272 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-355c5bbe-46a3-4dfb-b75a-914d6a792643 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1708796980" status: 202 len: 0 microversion: 2.1 time: 0.069698 Sep 16 13:52:17.746921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 25/55] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:17 2022] DELETE /compute/v2.1/flavors/1708796980 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:17.750203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb1db44b-3720-4aa0-bee0-b539fb57c75b tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:17.863718 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb1db44b-3720-4aa0-bee0-b539fb57c75b tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.116793 Sep 16 13:52:17.875215 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 31/56] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:17.911756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d2b7e48-cfbf-42fb-ba40-954ed95a05fc tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-237649128", "id": 2105013486, "os-flavor-access:is_public": "False"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:17.970660 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d2b7e48-cfbf-42fb-ba40-954ed95a05fc tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.064026 Sep 16 13:52:17.974070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 32/57] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:17.997958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:18.000363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:18.027982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:18.031744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:18.037535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:18.038895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:18.044334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:18.048131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:18.231067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1338894920", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:18.393352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:52:18.905006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:18.921716 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40201762-aa7d-4a3c-9b12-3cd0e036932e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1298 microversion: 2.1 time: 0.944053 Sep 16 13:52:18.933480 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 33/58] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:17 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1298 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:18.947572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da63c65d-0f0b-4219-afd7-12119e9feff0 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1091478875", "id": 1839318421, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:18.987388 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da63c65d-0f0b-4219-afd7-12119e9feff0 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.045648 Sep 16 13:52:18.991241 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 34/59] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:18.998917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.020699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:19.052620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:19.068120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:19.068913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:19.074965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:19.076338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:19.077547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:19.667360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:19.695209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2196480e-e16f-4f5d-a2a7-fd23cec5222b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1234 microversion: 2.1 time: 0.700025 Sep 16 13:52:19.697597 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 35/60] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:18 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1234 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:19.706588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e22b33f-84c2-4f5e-a66b-ea65d785fbce tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.751082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e22b33f-84c2-4f5e-a66b-ea65d785fbce tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.051445 Sep 16 13:52:19.754089 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 36/61] 10.222.0.60 () {58 vars in 1169 bytes} [Fri Sep 16 13:52:19 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:19.773369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13659f70-65a2-422b-9acb-8536061e296f tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.804008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13659f70-65a2-422b-9acb-8536061e296f tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.034056 Sep 16 13:52:19.810882 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 37/62] 10.222.0.60 () {58 vars in 1177 bytes} [Fri Sep 16 13:52:19 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:19.827185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef5c278f-4ddf-4890-87c6-27df1b89671d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.863756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef5c278f-4ddf-4890-87c6-27df1b89671d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.042686 Sep 16 13:52:19.875654 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 38/63] 10.222.0.60 () {58 vars in 1171 bytes} [Fri Sep 16 13:52:19 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:19.885529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb02802e-4ba6-4685-8b6a-fd0a5ba3c8ae tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.897387 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb02802e-4ba6-4685-8b6a-fd0a5ba3c8ae tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.019933 Sep 16 13:52:19.906544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 39/64] 10.222.0.60 () {58 vars in 1169 bytes} [Fri Sep 16 13:52:19 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:19.912438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36b147c4-3046-4596-a639-7ed2209e18a4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.943113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36b147c4-3046-4596-a639-7ed2209e18a4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.034111 Sep 16 13:52:19.944113 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 40/65] 10.222.0.60 () {58 vars in 1169 bytes} [Fri Sep 16 13:52:19 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:19.975334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:19.975964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:19.988912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:19.989303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:19.989742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:19.990496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:19.990982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:19.991754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:20.767939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:21.337742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:21.353814 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db31fdf0-c938-43f8-b707-4a134f67bbbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 1.382391 Sep 16 13:52:21.354687 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 41/66] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:19 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:21.375041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4816ec0-90eb-482a-b888-e9bc58377178 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.376610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:52:21.377645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:52:21.378728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:52:21.383748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:52:21.384754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:52:21.408411 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4816ec0-90eb-482a-b888-e9bc58377178 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.052922 Sep 16 13:52:21.427953 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 42/67] 10.222.0.60 () {58 vars in 1175 bytes} [Fri Sep 16 13:52:21 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:21.434457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.442597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:21.443252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:21.443894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:21.444023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:21.444918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:21.448934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:21.450071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:21.458563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:21.459315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:21.459916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:21.460828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:21.461454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:21.475202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:21.535502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:52:21.548205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for user ae208d89fa7549198ef91ef307464763 and project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:52:21.584339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:21.590812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:52:21.597838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:52:21.598737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dddac8a2-6b7a-4d82-952b-f471e67d5ada tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1296 microversion: 2.1 time: 0.169116 Sep 16 13:52:21.599862 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 43/68] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:21 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1296 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:21.610124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b78b15b7-2961-4661-b347-e5a7e64bc7cb tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.654233 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b78b15b7-2961-4661-b347-e5a7e64bc7cb tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.047677 Sep 16 13:52:21.666807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 44/69] 10.222.0.60 () {58 vars in 1173 bytes} [Fri Sep 16 13:52:21 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:21.679659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-703a2abc-9610-4e7f-a41c-12eaed75c146 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.725233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4c8f8697-9738-4098-b0ed-f36fccbf69b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.910995 Sep 16 13:52:21.726333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 26/70] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:52:21.737715 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-703a2abc-9610-4e7f-a41c-12eaed75c146 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.062094 Sep 16 13:52:21.744434 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 45/71] 10.222.0.60 () {58 vars in 1169 bytes} [Fri Sep 16 13:52:21 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:21.766131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fa480f9d-4c13-48b0-ab76-f2628f21fd46 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.766829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fa480f9d-4c13-48b0-ab76-f2628f21fd46 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:21.790872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14321e16-f193-4bcb-99b6-8d2523e479f4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.839710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14321e16-f193-4bcb-99b6-8d2523e479f4 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1839318421" status: 202 len: 0 microversion: 2.1 time: 0.078963 Sep 16 13:52:21.853975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 46/72] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:21 2022] DELETE /compute/v2.1/flavors/1839318421 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:21.891115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16d8123a-ee65-4783-acba-96af9b1dbdfe tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:21.990839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16d8123a-ee65-4783-acba-96af9b1dbdfe tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.134390 Sep 16 13:52:21.991679 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 47/73] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:22.021909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e60b5bee-8186-4c80-8d04-bf85231da9b2 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.100061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fa480f9d-4c13-48b0-ab76-f2628f21fd46 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:22.139870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e60b5bee-8186-4c80-8d04-bf85231da9b2 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2105013486" status: 202 len: 0 microversion: 2.1 time: 0.125520 Sep 16 13:52:22.142168 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 48/74] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:22 2022] DELETE /compute/v2.1/flavors/2105013486 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:52:22.168858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fa480f9d-4c13-48b0-ab76-f2628f21fd46 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1213 microversion: 2.1 time: 0.421471 Sep 16 13:52:22.169636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a62e4822-5a59-41a8-80fe-b2c6a7e260cd tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.170682 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 27/75] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:21 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1213 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:22.232591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a62e4822-5a59-41a8-80fe-b2c6a7e260cd tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081331 Sep 16 13:52:22.235832 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 49/76] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:22.299193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8b50940-a92c-4aeb-8a09-2bcf6ea5578c tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-370367773", "id": 1481288882, "os-flavor-access:is_public": "False"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:22.378024 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8b50940-a92c-4aeb-8a09-2bcf6ea5578c tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.100373 Sep 16 13:52:22.381361 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 28/77] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:22 2022] POST /compute/v2.1/flavors => generated 414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:22.413643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a062df0f-7f13-4d1c-9bd5-fd7fd184f6e9 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.439101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.443365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:22.460438 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a062df0f-7f13-4d1c-9bd5-fd7fd184f6e9 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056730 Sep 16 13:52:22.482449 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 29/78] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:22.492632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:22.493770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0840b4e6-7545-47bd-ad4a-c1d41ca0c930 tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.504146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:22.505126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:22.509248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:22.525669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:22.528476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:22.529339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:22.587345 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0840b4e6-7545-47bd-ad4a-c1d41ca0c930 tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098999 Sep 16 13:52:22.608612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 30/79] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:22.615876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4cf50875-ba78-44f9-9888-8cdcf6e696ee tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.678278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4cf50875-ba78-44f9-9888-8cdcf6e696ee tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1481288882" status: 202 len: 0 microversion: 2.1 time: 0.065034 Sep 16 13:52:22.683013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 31/80] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:22 2022] DELETE /compute/v2.1/flavors/1481288882 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:22.701411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:22.703330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:22.723491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:22.737560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:22.740056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:22.745334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:22.749456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:22.765828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:23.081311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:23.095148 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-04822f4a-42a0-4d5b-aeac-8c96c556e2d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1296 microversion: 2.1 time: 0.405823 Sep 16 13:52:23.097401 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 32/81] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:22 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1296 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:23.116854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c961a05d-5157-4259-892a-4a6da4461c9d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:23.164640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c961a05d-5157-4259-892a-4a6da4461c9d tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064469 Sep 16 13:52:23.166575 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 33/82] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:23.199826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-495e313d-722c-4440-8ec2-519ced112c5b tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1983842596", "id": 1410845038, "os-flavor-access:is_public": "True"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:23.270231 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-495e313d-722c-4440-8ec2-519ced112c5b tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.074979 Sep 16 13:52:23.271862 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 34/83] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:23.281429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:23.288128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:23.306423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:23.308050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:23.308896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:23.309926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:23.310648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:23.311706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:23.471106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:23.496397 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-694d7b75-dfa1-4b84-a3eb-66557f3004fa tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1217 microversion: 2.1 time: 0.221673 Sep 16 13:52:23.499989 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 35/84] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:23 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:23.523203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee810500-6e8f-4e3f-a13d-478e4eb64c4e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:23.580456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:23.609404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49e60a31-2829-4a25-a7f0-59ae76d01439 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 1.223745 Sep 16 13:52:23.617604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 50/85] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:22 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:23.666291 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee810500-6e8f-4e3f-a13d-478e4eb64c4e tempest-FlavorsAdminTestJSON-920060970 tempest-FlavorsAdminTestJSON-920060970-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.160370 Sep 16 13:52:23.668006 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 36/86] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:23 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:23.688619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fd255cc-598a-45df-8c6d-df63d1cdc528 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:23.718894 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fd255cc-598a-45df-8c6d-df63d1cdc528 tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1410845038" status: 202 len: 0 microversion: 2.1 time: 0.034027 Sep 16 13:52:23.731478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b6f032b-ea65-4337-b63b-c026c082fd1b tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:23.740043 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 51/87] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:23 2022] DELETE /compute/v2.1/flavors/1410845038 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:23.810570 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b6f032b-ea65-4337-b63b-c026c082fd1b tempest-FlavorsAdminTestJSON-474368587 tempest-FlavorsAdminTestJSON-474368587-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084467 Sep 16 13:52:23.829863 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 37/88] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:24.158654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:24.159736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:24.189450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:24.198096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:24.203012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:24.210550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:24.213095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:24.217822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:24.547323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:24.548490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:24.583649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:24.586376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:24.587859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:24.589297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:24.590909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:24.593023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:24.594925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:24.597710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c65c2a8c-0eac-4259-b774-8e86f3ff8122 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1296 microversion: 2.1 time: 0.449017 Sep 16 13:52:24.603646 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 52/89] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:24 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1296 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:24.664489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:24.666848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:24.697289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:24.701598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:24.705255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:24.707235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:24.712329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:24.717581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:24.821423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:24.856038 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7468e3f-a4a6-44fc-969c-919a8cecb115 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1265 microversion: 2.1 time: 0.320079 Sep 16 13:52:24.857221 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 38/90] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:24 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:25.517653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:25.652452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:25.656496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:25.691722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:25.697835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:25.704486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:25.715123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:25.716282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:25.722037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:26.010978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:26.021521 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e496770-4991-44e6-a9f2-ab970a4ce726 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 1.365595 Sep 16 13:52:26.022337 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 53/91] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:24 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:26.049716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:26.056872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:26.093845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:26.094345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:26.101343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:26.103900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:26.106122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:26.114163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:26.226847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:26.284395 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-caa56412-5905-43b2-9c65-7345fcc5d6f8 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1296 microversion: 2.1 time: 0.644541 Sep 16 13:52:26.289483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 39/92] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:25 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1296 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:26.361644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:26.379423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8eade39-17fe-473c-9fe9-3305a4de23e7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1271 microversion: 2.1 time: 0.340527 Sep 16 13:52:26.395286 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 54/93] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:26 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1271 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:27.074503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:27.075122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:27.082712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:27.099836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:27.101004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:27.108579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:27.110496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:27.111501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:27.336928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:27.338124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:27.365464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:27.371628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:27.372773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:27.377034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:27.380850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:27.382133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:28.012210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:28.029361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58db69ee-a011-4877-ab5e-3320e2d64316 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.700446 Sep 16 13:52:28.050485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 55/94] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:27 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:28.079902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:28.083583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:28.131226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:28.135751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:28.146126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:28.156190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:28.159844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:28.166213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:28.581935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:28.606626 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0268660f-d440-4bd5-805f-fa8f1c846fd4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1271 microversion: 2.1 time: 0.553304 Sep 16 13:52:28.617250 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 56/95] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:28 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1271 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:28.820093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd97ccfc-9d92-4f99-97bf-828e2e752b1f", "tag": "050433d8-4de5-4a0c-9b43-2bfa8858fea9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:28.864367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:28.870169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:28.871372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:28.974222 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Creating event network-changed:050433d8-4de5-4a0c-9b43-2bfa8858fea9 for instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f on n-h1-858129-2 Sep 16 13:52:28.974814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 13:52:28.975213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cdf5d7e0-9b9d-4f02-93ed-2b62d81d967d req-cb88d030-36a9-403f-a03a-a07d1ecf3c6b service nova] Acquired lock "compute-rpcapi-router" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 13:52:28.976551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:28.977185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:28.977822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:28.978880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:28.979394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:28.979828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:29.034948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.rpcapi [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 13:52:29.036000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] Releasing lock "compute-rpcapi-router" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 13:52:29.077867 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40a45da6-a862-4279-a4bb-af8e6086d980 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.457037 Sep 16 13:52:29.082320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 57/96] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:29.090463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:29.117519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:29.130196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:29.131131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:29.132212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:29.135114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:29.136143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:29.137130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:29.729586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:29.801599 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8a54dac9-eef3-4ddb-8c50-8ffefbcb67b1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 2.731238 Sep 16 13:52:29.816203 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 40/97] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:27 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:29.851592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:29.855824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:29.904808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:29.911684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:29.914048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:29.916944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:29.921066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:29.924974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:30.219019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:30.253415 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4da67272-17cc-4580-8473-d8bbd3155f16 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 1.167645 Sep 16 13:52:30.257737 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 58/98] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:29 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:30.401315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:30.413731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b7e98c9-21f6-4c6e-b4cf-208495392396 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1271 microversion: 2.1 time: 0.595873 Sep 16 13:52:30.418319 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 41/99] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:29 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1271 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:30.857121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:30.865440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:30.909206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:30.912867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:30.916759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:30.922856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:30.926751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:30.927635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:31.294887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:31.306497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:31.320055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:31.325867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:31.328917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:31.332262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:31.334315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:31.337538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:31.348757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:31.353412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:31.369733 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a4fc1213-dd5c-4b38-8d72-b4eecfe42558 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.520272 Sep 16 13:52:31.376071 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 59/100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:30 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:31.446436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:31.447139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:31.463094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:31.464870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:31.466995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:31.472657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:31.475003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:31.476266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:31.504958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:32.159952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=18 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:32.491458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:32.508184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-933659ee-fb96-416d-bc65-e664db53aa3c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1271 microversion: 2.1 time: 1.066702 Sep 16 13:52:32.509079 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 60/101] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:31 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1271 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:32.529387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:32.530048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:32.584128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:32.584738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:32.587848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:32.588975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:32.599662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:32.600365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:34.063018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:34.099729 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa028fd8-f8fd-40cc-8a47-22d39733b5ba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 2.801743 Sep 16 13:52:34.114809 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 42/102] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:31 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:34.146617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:34.154419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:34.181622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:34.184798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:34.189296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:34.191649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:34.193839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:34.199122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:34.355193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:34.373777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a4787bf-6736-4daa-a39a-6f8a74c8b895 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 1.849937 Sep 16 13:52:34.376837 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 61/103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:32 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:35.134570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:35.156449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:35.157080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:35.175942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4a3c1f0-8942-41e9-9088-8fac86970914 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 1.065377 Sep 16 13:52:35.179217 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 43/104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:34 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:35.182368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:35.182903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:35.186815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:35.187865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:35.188667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:35.191131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:35.447185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:35.451479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:35.477835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:35.479769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:35.483938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:35.487558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:35.490988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:35.492557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:35.508408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=61 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:35.922072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:35.936655 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19278cc8-9d83-4a59-b02e-bae94e0c3416 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.785338 Sep 16 13:52:35.947358 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 62/105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:35 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:35.994634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:36.030328 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-083afc12-59c1-442c-b7c9-31350c225050 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.608912 Sep 16 13:52:36.078230 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 44/106] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:35 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:36.235862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:36.236973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:36.251684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:36.252508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:36.254686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:36.256895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:36.259961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:36.260652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:36.683742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:36.736789 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3ce9d1b-c972-4a76-ac34-f0c5c8145901 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.493184 Sep 16 13:52:36.740738 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 63/107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:36 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:36.840621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b428e0da-64fc-421b-b6d1-37890f375604 req-1741bf49-030e-4065-adb4-9449a2c80af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d982d4df-1f9f-435c-8087-cc77b84ad5f2", "tag": "e3c36a75-239f-4a95-9dba-c9287661d673"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:36.867511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b428e0da-64fc-421b-b6d1-37890f375604 req-1741bf49-030e-4065-adb4-9449a2c80af4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:36.869735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b428e0da-64fc-421b-b6d1-37890f375604 req-1741bf49-030e-4065-adb4-9449a2c80af4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:36.871988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b428e0da-64fc-421b-b6d1-37890f375604 req-1741bf49-030e-4065-adb4-9449a2c80af4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:36.921825 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b428e0da-64fc-421b-b6d1-37890f375604 req-1741bf49-030e-4065-adb4-9449a2c80af4 service nova] Creating event network-changed:e3c36a75-239f-4a95-9dba-c9287661d673 for instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 on n-h1-858129-2 Sep 16 13:52:36.938840 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b428e0da-64fc-421b-b6d1-37890f375604 req-1741bf49-030e-4065-adb4-9449a2c80af4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107728 Sep 16 13:52:36.944173 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 64/108] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:52:36.967524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:36.969062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:36.990454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:36.992636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:36.993505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:36.996156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:36.998751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:36.999708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:37.475208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:37.509924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-889fee05-d786-4db5-a603-fa77fb465d4b tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.546969 Sep 16 13:52:37.511331 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 65/109] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:36 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:37.533357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:37.536641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:37.557042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:37.564751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:37.569770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:37.574034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:37.583083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:37.585545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:37.982427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724e5281f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:38.010332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.011878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.012362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.016786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.017286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.017730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.143305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:38.161042 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34fe010d-d9f6-47db-9e3a-efd35124dc1b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.644590 Sep 16 13:52:38.161659 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 66/110] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:37 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:38.185626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:38.186305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:38.188239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1dbb0f5c-c5b0-4440-9ee0-94c5bda5f25c tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 1.393110 Sep 16 13:52:38.202625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 45/111] 10.222.0.60 () {58 vars in 1128 bytes} [Fri Sep 16 13:52:36 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:38.207497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724e35c040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:38.213404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.214927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.215393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.216609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.221160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.221604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.225594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.226439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.227112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.228114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.228755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.231273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.315586 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b75b3fb2-bad9-4cd4-9b66-31142cd32fde tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.111753 Sep 16 13:52:38.340550 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 46/112] 10.222.0.60 () {58 vars in 1139 bytes} [Fri Sep 16 13:52:38 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:38.367197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724e419dc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:38.386292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.392479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.392623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.398202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.399169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.399973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.536784 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a370fbdf-fa6d-458c-b1c8-e24cda4ef3ef tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.189177 Sep 16 13:52:38.549673 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 47/113] 10.222.0.60 () {58 vars in 1145 bytes} [Fri Sep 16 13:52:38 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:38.583873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:38.595637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:38.636810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.638324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.640630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.643526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:38.645120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:38.648964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:38.835351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:38.844897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b2214ba-34d0-4aac-ad59-6b08a2d6b0a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.682040 Sep 16 13:52:38.861503 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 67/114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:38 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:39.143921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:39.159111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-344cdca4-c80e-4541-b438-005ceb8677bc tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.585306 Sep 16 13:52:39.160892 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 48/115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:38 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:39.203707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:39.205448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:39.215931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:39.218128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.224838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.225686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:39.226940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.228232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.228927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:39.444767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:39.483378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.486127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.489153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:39.546073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Creating event network-changed:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h2-858129-2 Sep 16 13:52:39.547090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 13:52:39.547817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-07c58edb-7de4-41cc-8c52-baabe26e4aac req-60a0c0fa-b495-4113-9b21-1e48b378b6e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 13:52:39.550525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.559288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:39.566271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.567118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:39.569927 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2194dba5-a08a-4452-b565-ca7765c2548e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.370090 Sep 16 13:52:39.571325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.572075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.572744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:39.577648 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 68/116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:39 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:39.587518 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.compute.rpcapi [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 13:52:39.588870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] Releasing lock "compute-rpcapi-router" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 13:52:39.621212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a61dc92b-f5d2-4324-a330-06221eb58f5c None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180043 Sep 16 13:52:39.622594 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 49/117] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:52:39.891724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:39.894393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:39.908948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.909738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.910191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:39.911635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:39.913284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:39.916372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:40.193905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:40.195928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:40.223024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:40.224362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:40.224908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:40.226859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:40.234901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:40.238011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:40.721443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:40.749390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4c0c7fa-5f43-4fcc-a21e-87b479032c2b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.875553 Sep 16 13:52:40.763617 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 69/118] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:39 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:40.786325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:40.787457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:40.832962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:40.833852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:40.834642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:40.835852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:40.844352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:40.852310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:41.396517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:41.472926 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba2a6ee7-ea37-460e-a29f-0a6c049e225f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 1.278972 Sep 16 13:52:41.491401 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 50/119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:40 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:41.813198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:41.817914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:41.893626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:41.897733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:41.902329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:41.907018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:41.915740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:41.929402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:42.096909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:42.112224 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8177bafe-6a9d-49f9-8324-4ef5f0fb28f5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 1.345167 Sep 16 13:52:42.124324 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 70/120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:40 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:42.533232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:42.534004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:42.560962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:42.561483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:42.561938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:42.563904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:42.564382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:42.564957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:43.111095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:43.137946 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27ab6c9f-65ba-4074-ac33-eb9544f2d3c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 1.336339 Sep 16 13:52:43.155319 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 51/121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:41 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:43.175820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:43.189436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:43.221057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:43.228663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:43.230855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:43.235185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:43.237818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:43.239234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:43.826900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:43.846360 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7f0e7dd-136c-4172-b08a-b89afbe87c1e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 1.317501 Sep 16 13:52:43.851732 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 71/122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:42 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:43.852470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:43.885666 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3feb56ef-0357-4791-b9c8-950746552dbb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.724481 Sep 16 13:52:43.922624 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 52/123] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:43 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:44.286350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Calling method '.version_select at 0x7f724e281d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:44.299276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.302183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.303549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:44.441882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.444927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.446466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:44.512901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.525209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.529999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:44.562153 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b56013dc-925d-410a-be49-917ebb919f18 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.707762 Sep 16 13:52:44.563304 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 72/124] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:44.573468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fc7a8cc-a294-4ed3-ae7a-85886d8ff947 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2056579753", "id": 392986258, "os-flavor-access:is_public": "False"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:44.597174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:44.604835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:44.628606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.635252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.636444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:44.637542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.638394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.640479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:44.707534 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6fc7a8cc-a294-4ed3-ae7a-85886d8ff947 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.644895 Sep 16 13:52:44.718635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 53/125] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:44 2022] POST /compute/v2.1/flavors => generated 436 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:44.732162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Calling method '.version_select at 0x7f724e35cf70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:44.755700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=128643) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 16 13:52:44.757483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.759184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.760745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:44.857498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:44.862597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:44.863605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:45.076369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:45.077329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:45.078088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:45.157789 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab7e2dd2-d66f-4e84-a6dd-963515115287 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h1-858129-2/servers" status: 200 len: 275 microversion: 2.1 time: 0.434178 Sep 16 13:52:45.159339 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 54/126] 10.222.0.60 () {58 vars in 1212 bytes} [Fri Sep 16 13:52:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-858129-2/servers => generated 275 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:45.185300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2d5b1d8-697e-43ed-b364-5dc25ea90a56 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:45.556181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:45.568531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:45.573925 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79929a99-f46f-4757-925a-5e9d43738cb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 1.004608 Sep 16 13:52:45.574857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 73/127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:44 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:45.604844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:45.605926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:45.620598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:45.623087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:45.624275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:45.625673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:45.626758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:45.627501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:45.638231 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2d5b1d8-697e-43ed-b364-5dc25ea90a56 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/392986258/action" status: 200 len: 96 microversion: 2.1 time: 0.475457 Sep 16 13:52:45.647749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 55/128] 10.222.0.60 () {60 vars in 1197 bytes} [Fri Sep 16 13:52:45 2022] POST /compute/v2.1/flavors/392986258/action => generated 96 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:45.658805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:45.659926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:45.670267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:45.671364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:45.672103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:45.673215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:45.674155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:45.675294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.073148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:46.076370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:46.084904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e5406fd-db8e-4a18-9ea9-bec4ce1259d4 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.495929 Sep 16 13:52:46.098742 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c6333bbc-eaf5-4103-9014-2084090ba986 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.435574 Sep 16 13:52:46.099375 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 74/129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:45 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:46.107581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Calling method '.version_select at 0x7f724e2ec280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.107819 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 56/130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:45 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:46.109904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.110392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.110851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.128655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.128904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.129700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.129925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3b7e24c-9a1f-410f-b722-17e05fef49a3 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:46.143277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.147732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.151369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.160076 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-900f7edc-6f2b-4409-866b-8a4562b08a5b tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059211 Sep 16 13:52:46.161258 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 75/131] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:46.173855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Calling method '.version_select at 0x7f724e1ceb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.175721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.176515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.177113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.205693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.206311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.206870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.216007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-309fa76d-7f33-4f45-88be-8f6594c9b1e0 tempest-HypervisorAdminUnderV252Test-2015544447 tempest-HypervisorAdminUnderV252Test-2015544447-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h1-858129-2/search" status: 200 len: 104 microversion: 2.1 time: 0.047314 Sep 16 13:52:46.218801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 76/132] 10.222.0.60 () {58 vars in 1209 bytes} [Fri Sep 16 13:52:46 2022] GET /compute/v2.1/os-hypervisors/n-h1-858129-2/search => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:52:46.239958 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f3b7e24c-9a1f-410f-b722-17e05fef49a3 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project b83cdc4e372e4657a1ee43d6ccfeef2c combination. Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3b7e24c-9a1f-410f-b722-17e05fef49a3 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Request method failure captured: Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/flavors/392986258/action HTTP/1.1 Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 67 Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-pb52-aq_f0DhGev27ppiqkkmcgpte0BwH0zUbnDHG14nMQ-VyFC5a-TKNmd8MCyAswf_tI0kwW9unPpvPRI9SCavvVcD33mO72y-_4vvp9MZmmBucisDWVadMLX0WdHnZuviymMOqvy01waeMfTbNE5KKcxHW4Fo5NnJE9Z1TlWQ Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 116056134bcf4b468d15f5b99eb5944c Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:52:46.335845 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_116056134bcf4b468d15f5b99eb5944c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/116056134bcf4b468d15f5b99eb5944c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/116056134bcf4b468d15f5b99eb5944c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/116056134bcf4b468d15f5b99eb5944c"}]}] Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 116056134bcf4b468d15f5b99eb5944c Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: a21487bd6e4b44fea23560f4816f46f8 Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: {"addTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} Sep 16 13:52:46.338861 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: exception: Flavor access already exists for flavor 29 and project b83cdc4e372e4657a1ee43d6ccfeef2c combination. Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '392986258', 'body': {'addTenantAccess': {'tenant': 'b83cdc4e372e4657a1ee43d6ccfeef2c'}}} Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result.read() Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 13:52:46.340390 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-b83cdc4e372e4657a1ee43d6ccfeef2c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi session.flush() Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 13:52:46.342115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 13:52:46.345141 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 13:52:46.348004 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result.read() Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-b83cdc4e372e4657a1ee43d6ccfeef2c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 16, 13, 52, 46, 230481), 'updated_at': None, 'flavor_id': 29, 'project_id': 'b83cdc4e372e4657a1ee43d6ccfeef2c'}] Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:46.349603 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project b83cdc4e372e4657a1ee43d6ccfeef2c combination. Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:46.351192 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project b83cdc4e372e4657a1ee43d6ccfeef2c combination. Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:52:46.353080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:52:46.355756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project b83cdc4e372e4657a1ee43d6ccfeef2c combination. Sep 16 13:52:46.355756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.355756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3b7e24c-9a1f-410f-b722-17e05fef49a3 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project b83cdc4e372e4657a1ee43d6ccfeef2c combination. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:46.355756 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3b7e24c-9a1f-410f-b722-17e05fef49a3 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/392986258/action" status: 409 len: 152 microversion: 2.1 time: 0.234349 Sep 16 13:52:46.355756 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 57/133] 10.222.0.60 () {60 vars in 1197 bytes} [Fri Sep 16 13:52:46 2022] POST /compute/v2.1/flavors/392986258/action => generated 152 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:52:46.360637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a8892a0-e5b6-46e3-a36f-1ab90696670a tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:46.521602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a8892a0-e5b6-46e3-a36f-1ab90696670a tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/392986258/action" status: 200 len: 21 microversion: 2.1 time: 0.168868 Sep 16 13:52:46.526914 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 77/134] 10.222.0.60 () {60 vars in 1197 bytes} [Fri Sep 16 13:52:46 2022] POST /compute/v2.1/flavors/392986258/action => generated 21 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:46.546682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c43a563-f7d1-4ca3-9cfc-a8faafd1e9e7 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.610655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.611538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:46.618711 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c43a563-f7d1-4ca3-9cfc-a8faafd1e9e7 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/392986258" status: 202 len: 0 microversion: 2.1 time: 0.080806 Sep 16 13:52:46.622567 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 58/135] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:52:46 2022] DELETE /compute/v2.1/flavors/392986258 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:52:46.634199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.634684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.638226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.639526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:46.640042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:46.640569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:46.642502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81f8df43-2edc-4dd7-895a-c4803c334e62 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.694960 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81f8df43-2edc-4dd7-895a-c4803c334e62 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066332 Sep 16 13:52:46.696542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 59/136] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:46.706966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:46.738372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d266637d-2439-47cd-a794-c14781131712 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-442835300", "id": 1836760892, "os-flavor-access:is_public": "True"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:46.776622 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d266637d-2439-47cd-a794-c14781131712 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.043505 Sep 16 13:52:46.778143 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 60/137] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:46 2022] POST /compute/v2.1/flavors => generated 437 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:52:46.800179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91449930-47f8-4c7a-b255-2dd3671736b2 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.816367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-91449930-47f8-4c7a-b255-2dd3671736b2 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91449930-47f8-4c7a-b255-2dd3671736b2 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Request method failure captured: Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/flavors/1836760892/os-flavor-access HTTP/1.1 Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-pb52-aq_f0DhGev27ppiqkkmcgpte0BwH0zUbnDHG14nMQ-VyFC5a-TKNmd8MCyAswf_tI0kwW9unPpvPRI9SCavvVcD33mO72y-_4vvp9MZmmBucisDWVadMLX0WdHnZuviymMOqvy01waeMfTbNE5KKcxHW4Fo5NnJE9Z1TlWQ Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 116056134bcf4b468d15f5b99eb5944c Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:52:46.819311 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_116056134bcf4b468d15f5b99eb5944c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/116056134bcf4b468d15f5b99eb5944c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/116056134bcf4b468d15f5b99eb5944c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/116056134bcf4b468d15f5b99eb5944c"}]}] Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 116056134bcf4b468d15f5b99eb5944c Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: a21487bd6e4b44fea23560f4816f46f8 Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: exception: Access list not available for public flavors. Sep 16 13:52:46.820403 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1836760892'} Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 16 13:52:46.821114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:46.822326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91449930-47f8-4c7a-b255-2dd3671736b2 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:46.824525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91449930-47f8-4c7a-b255-2dd3671736b2 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1836760892/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029204 Sep 16 13:52:46.829115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 61/138] 10.222.0.60 () {58 vars in 1209 bytes} [Fri Sep 16 13:52:46 2022] GET /compute/v2.1/flavors/1836760892/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 13:52:46.839968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0db61ef-f87b-455a-a236-d9a8a36d5afd tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.923488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0db61ef-f87b-455a-a236-d9a8a36d5afd tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1836760892" status: 202 len: 0 microversion: 2.1 time: 0.092693 Sep 16 13:52:46.924870 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 62/139] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:46 2022] DELETE /compute/v2.1/flavors/1836760892 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:46.937493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98673f13-b166-4329-89dd-1c98b9603ee1 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:46.979054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98673f13-b166-4329-89dd-1c98b9603ee1 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046901 Sep 16 13:52:46.980329 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 63/140] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:47.022276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2fb1fd58-39f1-45a3-ad9f-23f31c1c244b tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1795768791", "id": 416706971, "os-flavor-access:is_public": "False"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:47.073516 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2fb1fd58-39f1-45a3-ad9f-23f31c1c244b tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.058376 Sep 16 13:52:47.077031 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 64/141] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:47.111537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:47.128080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-70dbd41d-d187-4503-a8f4-af70b290bfe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.522995 Sep 16 13:52:47.128948 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 78/142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:46 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:47.145323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:47.148549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:47.164382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:47.165145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:47.167014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:47.167014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:47.167489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:47.168431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:47.544319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db3d4277-1ba8-4baf-b5ac-deec7efbf8bf tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:47.555168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-db3d4277-1ba8-4baf-b5ac-deec7efbf8bf tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fb8a0a4e013b468a9da5778e737fa7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83cdc4e372e4657a1ee43d6ccfeef2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db3d4277-1ba8-4baf-b5ac-deec7efbf8bf tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Request method failure captured: Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/flavors/416706971/action HTTP/1.1 Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 67 Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-lmXy1yh_6HRROjHbNuux2d_PsEuE-dgdgVxpVxzyBnV0uVKcAzvlsPiTnYXJxZ1UB4tneyhg8Yyxuzm39w7kVJ6dhbXN4V4Kh2MlTI3LVoQk3DDmZbMH23V0Txm7PHlvd7h1BSnV7t5qv4lsYrx2xay2xsjTHxDD_OquZrd5gZio Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b83cdc4e372e4657a1ee43d6ccfeef2c Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-857119059 Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:52:47.558216 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b83cdc4e372e4657a1ee43d6ccfeef2c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b83cdc4e372e4657a1ee43d6ccfeef2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b83cdc4e372e4657a1ee43d6ccfeef2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b83cdc4e372e4657a1ee43d6ccfeef2c"}]}] Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-857119059 Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b83cdc4e372e4657a1ee43d6ccfeef2c Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-857119059 Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsAccessNegativeTestJSON-857119059-project Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: fb8a0a4e013b468a9da5778e737fa7ff Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-857119059-project Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: {"addTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} Sep 16 13:52:47.560522 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '416706971', 'body': {'addTenantAccess': {'tenant': 'b83cdc4e372e4657a1ee43d6ccfeef2c'}}} Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:52:47.561772 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 16 13:52:47.563581 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:47.565550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db3d4277-1ba8-4baf-b5ac-deec7efbf8bf tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:47.565550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-db3d4277-1ba8-4baf-b5ac-deec7efbf8bf tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] 10.222.0.60 "POST /compute/v2.1/flavors/416706971/action" status: 403 len: 130 microversion: 2.1 time: 0.470504 Sep 16 13:52:47.565550 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 65/143] 10.222.0.60 () {60 vars in 1197 bytes} [Fri Sep 16 13:52:47 2022] POST /compute/v2.1/flavors/416706971/action => generated 130 bytes in 474 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:52:47.580926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:47.583845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:47.609656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:47.610811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:47.615486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:47.617128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:47.618789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:47.619830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:47.775516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:47.796091 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-790f86c4-3a1d-4298-b93c-918d3ae46645 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.665000 Sep 16 13:52:47.797053 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 79/144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:47 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:47.826835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4bd6801-3a82-4084-a9d0-df6ed8f7e8ba tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:47.860890 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4bd6801-3a82-4084-a9d0-df6ed8f7e8ba tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/416706971" status: 202 len: 0 microversion: 2.1 time: 0.061500 Sep 16 13:52:47.864840 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 80/145] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:52:47 2022] DELETE /compute/v2.1/flavors/416706971 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:47.878702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4745c665-ecc0-46fb-973e-b710536704da tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:47.924179 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4745c665-ecc0-46fb-973e-b710536704da tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053617 Sep 16 13:52:47.926792 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 81/146] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:47.964872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3dbc1ebb-6519-4494-a9fe-de0831371338 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2118138381", "id": 1595560980, "os-flavor-access:is_public": "False"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:47.994738 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3dbc1ebb-6519-4494-a9fe-de0831371338 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.034445 Sep 16 13:52:47.997399 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 82/147] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:47 2022] POST /compute/v2.1/flavors => generated 439 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:48.021266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d423098-5cfa-4109-ac94-1bb78a4695de tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:48.207056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:48.218066 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c49988c0-f221-4bf0-9353-8abb419e6689 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.647943 Sep 16 13:52:48.224327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 66/148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:47 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:48.232552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:48.233352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:48.247761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:48.248547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:48.249274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:48.250302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:48.251055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:48.251638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:48.904015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d423098-5cfa-4109-ac94-1bb78a4695de tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1595560980/action" status: 200 len: 97 microversion: 2.1 time: 0.890477 Sep 16 13:52:48.905109 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 83/149] 10.222.0.60 () {60 vars in 1200 bytes} [Fri Sep 16 13:52:48 2022] POST /compute/v2.1/flavors/1595560980/action => generated 97 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:48.922905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:48.924233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:48.948974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:48.957806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:48.958661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:48.959947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:48.960742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:48.961502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:49.025882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:49.075412 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9ec87cf5-6bed-4e47-87e0-1a19fab3cc20 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.849205 Sep 16 13:52:49.076476 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 67/150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:48 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:49.107465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f6848f2-4fab-4087-a0d7-7b06fe556fd7 tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:49.138271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2f6848f2-4fab-4087-a0d7-7b06fe556fd7 tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fb8a0a4e013b468a9da5778e737fa7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83cdc4e372e4657a1ee43d6ccfeef2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f6848f2-4fab-4087-a0d7-7b06fe556fd7 tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Request method failure captured: Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/flavors/1595560980/action HTTP/1.1 Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 70 Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-lmXy1yh_6HRROjHbNuux2d_PsEuE-dgdgVxpVxzyBnV0uVKcAzvlsPiTnYXJxZ1UB4tneyhg8Yyxuzm39w7kVJ6dhbXN4V4Kh2MlTI3LVoQk3DDmZbMH23V0Txm7PHlvd7h1BSnV7t5qv4lsYrx2xay2xsjTHxDD_OquZrd5gZio Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b83cdc4e372e4657a1ee43d6ccfeef2c Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-857119059 Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:52:49.141647 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b83cdc4e372e4657a1ee43d6ccfeef2c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b83cdc4e372e4657a1ee43d6ccfeef2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b83cdc4e372e4657a1ee43d6ccfeef2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b83cdc4e372e4657a1ee43d6ccfeef2c"}]}] Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-857119059 Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b83cdc4e372e4657a1ee43d6ccfeef2c Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-857119059 Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsAccessNegativeTestJSON-857119059-project Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: fb8a0a4e013b468a9da5778e737fa7ff Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-857119059-project Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: {"removeTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} Sep 16 13:52:49.144263 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1595560980', 'body': {'removeTenantAccess': {'tenant': 'b83cdc4e372e4657a1ee43d6ccfeef2c'}}} Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can( Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:52:49.146050 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 16 13:52:49.148273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:49.151090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f6848f2-4fab-4087-a0d7-7b06fe556fd7 tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:49.151090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2f6848f2-4fab-4087-a0d7-7b06fe556fd7 tempest-FlavorsAccessNegativeTestJSON-857119059 tempest-FlavorsAccessNegativeTestJSON-857119059-project] 10.222.0.60 "POST /compute/v2.1/flavors/1595560980/action" status: 403 len: 133 microversion: 2.1 time: 0.066080 Sep 16 13:52:49.157125 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 68/151] 10.222.0.60 () {60 vars in 1200 bytes} [Fri Sep 16 13:52:49 2022] POST /compute/v2.1/flavors/1595560980/action => generated 133 bytes in 80 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:52:49.174746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-589233cc-6f48-4b6d-9c8c-f2a4b863d272 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b83cdc4e372e4657a1ee43d6ccfeef2c"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:49.438103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:49.476826 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1a07bdb-e7d4-4890-9eb1-5706ab01157e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.567652 Sep 16 13:52:49.483336 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 84/152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:48 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:49.511480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:49.513680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:49.524095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:49.524598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:49.525046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:49.526011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:49.533417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:49.534148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:49.585978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:49.777684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-589233cc-6f48-4b6d-9c8c-f2a4b863d272 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1595560980/action" status: 200 len: 21 microversion: 2.1 time: 0.619087 Sep 16 13:52:49.783523 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 69/153] 10.222.0.60 () {60 vars in 1200 bytes} [Fri Sep 16 13:52:49 2022] POST /compute/v2.1/flavors/1595560980/action => generated 21 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:49.791323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-112452d5-79f1-43f2-87c9-bd04d7ef5ac4 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:49.815947 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-112452d5-79f1-43f2-87c9-bd04d7ef5ac4 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1595560980" status: 202 len: 0 microversion: 2.1 time: 0.030892 Sep 16 13:52:49.817990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 70/154] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:49 2022] DELETE /compute/v2.1/flavors/1595560980 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:49.832074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4aaab8a-9bc8-4b56-84b8-4a2ba5faefda tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:49.857528 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4aaab8a-9bc8-4b56-84b8-4a2ba5faefda tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033236 Sep 16 13:52:49.858493 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 71/155] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:49.901443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-87c2f4a3-c0ad-4320-a51f-e64b37c01931 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1525756005", "id": 1080914176, "os-flavor-access:is_public": "False"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:49.945392 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-87c2f4a3-c0ad-4320-a51f-e64b37c01931 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.052349 Sep 16 13:52:49.946064 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 72/156] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:49 2022] POST /compute/v2.1/flavors => generated 439 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:52:49.965094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-587525dd-545e-4588-8b58-6bc7bc9c8217 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0b0fa9fda695496dbae9d23e8b8ab64f"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:50.025918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:50.047858 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2868c4e-e87e-44fe-b9fc-bb3c188f4d5c tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.559989 Sep 16 13:52:50.051742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 85/157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:49 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:50.123314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:50.124946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:50.137153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:50.138140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:50.140181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:50.141875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:50.143050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:50.144854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:50.388600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-587525dd-545e-4588-8b58-6bc7bc9c8217 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] HTTP exception thrown: Flavor access not found for 33 / 0b0fa9fda695496dbae9d23e8b8ab64f combination. Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-587525dd-545e-4588-8b58-6bc7bc9c8217 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Request method failure captured: Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/flavors/1080914176/action HTTP/1.1 Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 70 Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-pb52-aq_f0DhGev27ppiqkkmcgpte0BwH0zUbnDHG14nMQ-VyFC5a-TKNmd8MCyAswf_tI0kwW9unPpvPRI9SCavvVcD33mO72y-_4vvp9MZmmBucisDWVadMLX0WdHnZuviymMOqvy01waeMfTbNE5KKcxHW4Fo5NnJE9Z1TlWQ Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 116056134bcf4b468d15f5b99eb5944c Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:52:50.392010 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_116056134bcf4b468d15f5b99eb5944c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/116056134bcf4b468d15f5b99eb5944c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/116056134bcf4b468d15f5b99eb5944c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/116056134bcf4b468d15f5b99eb5944c"}]}] Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 116056134bcf4b468d15f5b99eb5944c Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-823838806 Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: a21487bd6e4b44fea23560f4816f46f8 Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: {"removeTenantAccess": {"tenant": "0b0fa9fda695496dbae9d23e8b8ab64f"}} Sep 16 13:52:50.394252 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: exception: Flavor access not found for 33 / 0b0fa9fda695496dbae9d23e8b8ab64f combination. Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1080914176', 'body': {'removeTenantAccess': {'tenant': '0b0fa9fda695496dbae9d23e8b8ab64f'}}} Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 16 13:52:50.395801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 0b0fa9fda695496dbae9d23e8b8ab64f combination. Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 0b0fa9fda695496dbae9d23e8b8ab64f combination. Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:50.397929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 0b0fa9fda695496dbae9d23e8b8ab64f combination. Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-587525dd-545e-4588-8b58-6bc7bc9c8217 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Returning 404 to user: Flavor access not found for 33 / 0b0fa9fda695496dbae9d23e8b8ab64f combination. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-587525dd-545e-4588-8b58-6bc7bc9c8217 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1080914176/action" status: 404 len: 124 microversion: 2.1 time: 0.433126 Sep 16 13:52:50.400742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 73/158] 10.222.0.60 () {60 vars in 1200 bytes} [Fri Sep 16 13:52:49 2022] POST /compute/v2.1/flavors/1080914176/action => generated 124 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:52:50.416376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3db724cb-2451-45bc-bada-3b6ac3e72556 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:50.469044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3db724cb-2451-45bc-bada-3b6ac3e72556 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1080914176" status: 202 len: 0 microversion: 2.1 time: 0.061585 Sep 16 13:52:50.470379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 74/159] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:52:50 2022] DELETE /compute/v2.1/flavors/1080914176 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:52:50.480395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4463ec40-8130-452c-81a1-560da6e90726 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:50.523981 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4463ec40-8130-452c-81a1-560da6e90726 tempest-FlavorsAccessNegativeTestJSON-823838806 tempest-FlavorsAccessNegativeTestJSON-823838806-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047786 Sep 16 13:52:50.527114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 75/160] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:52:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:50.545120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:50.546035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:50.563997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:50.564793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:50.566023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:50.567216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:50.567896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:50.569095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:50.843475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:50.873359 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ed38c55-f722-40d9-b73c-9777517db8e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.761428 Sep 16 13:52:50.876113 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 86/161] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:50 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:51.088351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:51.106498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:51.107835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:51.132292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5171f6f3-0b4f-40ee-bbcd-a215aee3f010 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.599986 Sep 16 13:52:51.135825 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 76/162] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:50 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:51.137479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:51.138577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:51.139200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:51.140096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:51.141664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:51.142448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:51.511853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:51.525696 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36895a43-af03-49ff-add2-4ca965ceae6b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.430971 Sep 16 13:52:51.526316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 87/163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:51 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:51.915764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:51.919287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:51.934958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:51.940705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:51.941712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:51.946455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:51.948081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:51.951025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:52.161711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:52.162327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:52.166391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:52.179299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:52.179299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:52.179299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:52.179299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:52.183179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:52.184020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:53.047998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:53.063033 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f2829608-39b2-4c81-8640-7501a60cd017 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 1.163725 Sep 16 13:52:53.068731 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 77/164] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:51 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:53.070483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:53.097030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00d78f6c-fd3c-4439-9aab-6bfc0a72247f tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.939170 Sep 16 13:52:53.105204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:53.108744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:53.109701 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 88/165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:52 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:53.135130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:53.139558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:53.141767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:53.147422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:53.150459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:53.153610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:53.771634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:53.781880 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-021b5ee8-ad39-4adc-9a23-43a4a64a427e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.704044 Sep 16 13:52:53.782815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 78/166] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:53 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:53.824551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Action: 'update', calling method: .version_select at 0x7f724f744790>, body: {"quota_set": {"ram": "5120"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:54.021913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28e040f6-84d2-4016-b866-2b2792d3c93f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:54.046362 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28e040f6-84d2-4016-b866-2b2792d3c93f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.257938 Sep 16 13:52:54.055790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 79/167] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 13:52:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:54.333268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:54.334256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:54.335773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:54.337250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:54.338017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:54.339101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:54.379591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d562ddd8-c81f-427b-8628-207567720b3a tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-36993157", "id": 364251384, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:54.426944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d562ddd8-c81f-427b-8628-207567720b3a tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.366245 Sep 16 13:52:54.447197 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 80/168] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:54 2022] POST /compute/v2.1/flavors => generated 420 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:54.467273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:54.468802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:54.484116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0251fdc5-251f-4c32-8859-1b39aa58d5d5 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2" status: 200 len: 148 microversion: 2.57 time: 1.369502 Sep 16 13:52:54.487817 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 89/169] 10.222.0.60 () {62 vars in 1303 bytes} [Fri Sep 16 13:52:53 2022] PUT /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2 => generated 148 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:52:54.510683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:54.513184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:54.513637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:54.514394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:54.514892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:54.515323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:54.520322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:54.521594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:54.568507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:54.569347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:54.569957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:54.575976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:54.576767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:54.577951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:54.996007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:55.014746 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a311860a-a805-49a9-9dbe-b5e2d65b124d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.563481 Sep 16 13:52:55.043614 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 81/170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:54 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:55.066319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b614386d-d4d5-443d-9722-6e151893b585 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:55.088972 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b614386d-d4d5-443d-9722-6e151893b585 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042869 Sep 16 13:52:55.090676 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 82/171] 10.222.0.60 () {58 vars in 1182 bytes} [Fri Sep 16 13:52:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:52:55.100150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Calling method '.version_select at 0x7f724dff7ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:55.120815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:55.169709 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f064c068-7373-425a-aea4-8b3cffdb94a9 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.676497 Sep 16 13:52:55.171782 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 90/172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:54 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:55.477993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f0cf3400-d678-47cb-81e7-e1d93574f279 req-f490c287-6985-4b87-9d03-5584784870e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd97ccfc-9d92-4f99-97bf-828e2e752b1f", "name": "network-vif-plugged", "status": "completed", "tag": "050433d8-4de5-4a0c-9b43-2bfa8858fea9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:55.499066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f0cf3400-d678-47cb-81e7-e1d93574f279 req-f490c287-6985-4b87-9d03-5584784870e7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:55.500418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f0cf3400-d678-47cb-81e7-e1d93574f279 req-f490c287-6985-4b87-9d03-5584784870e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:55.501442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f0cf3400-d678-47cb-81e7-e1d93574f279 req-f490c287-6985-4b87-9d03-5584784870e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:55.528508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f0cf3400-d678-47cb-81e7-e1d93574f279 req-f490c287-6985-4b87-9d03-5584784870e7 service nova] Creating event network-vif-plugged:050433d8-4de5-4a0c-9b43-2bfa8858fea9 for instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f on n-h1-858129-2 Sep 16 13:52:55.540831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f0cf3400-d678-47cb-81e7-e1d93574f279 req-f490c287-6985-4b87-9d03-5584784870e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365775 Sep 16 13:52:55.542212 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 91/173] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:55.555663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:55.557277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:55.578742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:55.580322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:55.581224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:55.581563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:55.582061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:55.582831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:55.584223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:55.585299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:55.586331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:55.587830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:55.588107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:55.588858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:55.661292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6495e7a3-f345-4e16-b779-62c050970fca tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2/detail" status: 200 len: 463 microversion: 2.57 time: 0.566736 Sep 16 13:52:55.665870 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 83/174] 10.222.0.60 () {60 vars in 1304 bytes} [Fri Sep 16 13:52:55 2022] GET /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2/detail => generated 463 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:52:55.703288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d0ca903-c0a3-494c-9881-df64a90aa166 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2014984687", "id": 1828809638, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:55.736454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=14 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:55.752947 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d0ca903-c0a3-494c-9881-df64a90aa166 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.079110 Sep 16 13:52:55.755584 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 84/175] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:52:55 2022] POST /compute/v2.1/flavors => generated 425 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:55.768778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a341690c-2be5-4978-bc3e-7ff7178e6b1e tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:55.779941 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a341690c-2be5-4978-bc3e-7ff7178e6b1e tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015203 Sep 16 13:52:55.789081 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 85/176] 10.222.0.60 () {58 vars in 1182 bytes} [Fri Sep 16 13:52:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 13:52:55.802521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5ae6c60-8db8-49f2-9c16-56277ffa67e4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Action: 'create', calling method: .version_select at 0x7f724e26f0d0>, body: {"keypair": {"name": "tempest-keypair-599284337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+wW0oQ2/NTvmfqhPU0yOgugJCFNGtlRc7sQtrPVf7eIQr3yCHL1gXcpW+MRvlPAm8oi53Gim+Wa0pUyZIKcVBtFl1iK2X+A299ENT8nnyikoUsuaCuc6Me+BqAYPEwRw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:55.917592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d5ae6c60-8db8-49f2-9c16-56277ffa67e4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Getting quotas for project 3b3640b77c194f6f8b0fb588bd07555c. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:52:55.933767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d5ae6c60-8db8-49f2-9c16-56277ffa67e4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Getting quotas for user 93ad00ee07c44e8e8ff54385234b0fb8 and project 3b3640b77c194f6f8b0fb588bd07555c. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:52:56.019828 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5ae6c60-8db8-49f2-9c16-56277ffa67e4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.224473 Sep 16 13:52:56.030032 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 86/177] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 13:52:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:52:56.042390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Action: 'update', calling method: .version_select at 0x7f724e262310>, body: {"quota_set": {"ram": "2048"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:56.159698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:56.190538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.198952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.201645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.209166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.210259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.214059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.219840 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c4c5cd2-9ad0-4127-9e79-e95bf0dfc14d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.668895 Sep 16 13:52:56.221052 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 92/178] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:55 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:56.235410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:56.238433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:56.261693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.268137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.268971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.270150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.272129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.274330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.361391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.362270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.363109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.364381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.365131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.366236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.472373 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-22b8c52e-1eae-4ee1-8bcd-07e7658759bd tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2?user_id=10a14b0af0f9480a8df53819208e8ec8" status: 200 len: 148 microversion: 2.57 time: 0.440530 Sep 16 13:52:56.478009 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 87/179] 10.222.0.60 () {62 vars in 1384 bytes} [Fri Sep 16 13:52:56 2022] PUT /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2?user_id=10a14b0af0f9480a8df53819208e8ec8 => generated 148 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:52:56.489957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:56.491547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:56.499764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.501022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.501822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.503041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:56.503816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:56.504424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:56.567047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:52:56.785533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:56.803378 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92b18ffa-6be8-4b38-9fd8-4a9451378093 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.580481 Sep 16 13:52:56.804676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 93/180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:56 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:56.810373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa6b4eef-86f1-4318-bbbc-9e3d4a0e3d07 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] Calling method '.version_select at 0x7f724e152c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:56.877748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:56.889813 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16b5abe0-335c-4b4a-bc40-a41247cbea3c tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.409737 Sep 16 13:52:56.891016 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 88/181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:56 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:57.266306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:57.266306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:57.275107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.275896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.276575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:57.279602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.282026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.282720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:57.451152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa6b4eef-86f1-4318-bbbc-9e3d4a0e3d07 tempest-QuotasAdminTestV257-1012128303 tempest-QuotasAdminTestV257-1012128303-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2?user_id=10a14b0af0f9480a8df53819208e8ec8" status: 200 len: 190 microversion: 2.57 time: 0.644498 Sep 16 13:52:57.466616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 94/182] 10.222.0.60 () {60 vars in 1364 bytes} [Fri Sep 16 13:52:56 2022] GET /compute/v2.1/os-quota-sets/6fee4e41bd8b4c589c31f05a883113c2?user_id=10a14b0af0f9480a8df53819208e8ec8 => generated 190 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:52:57.579458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a4ff7d6c-c51f-46fd-8ea1-a35c51aceb09 req-7176ea87-d2a4-482d-acfc-ae3739f0e4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d982d4df-1f9f-435c-8087-cc77b84ad5f2", "name": "network-vif-plugged", "status": "completed", "tag": "e3c36a75-239f-4a95-9dba-c9287661d673"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:52:57.629321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a4ff7d6c-c51f-46fd-8ea1-a35c51aceb09 req-7176ea87-d2a4-482d-acfc-ae3739f0e4e9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.630293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a4ff7d6c-c51f-46fd-8ea1-a35c51aceb09 req-7176ea87-d2a4-482d-acfc-ae3739f0e4e9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.631092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a4ff7d6c-c51f-46fd-8ea1-a35c51aceb09 req-7176ea87-d2a4-482d-acfc-ae3739f0e4e9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:57.674528 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a4ff7d6c-c51f-46fd-8ea1-a35c51aceb09 req-7176ea87-d2a4-482d-acfc-ae3739f0e4e9 service nova] Creating event network-vif-plugged:e3c36a75-239f-4a95-9dba-c9287661d673 for instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 on n-h1-858129-2 Sep 16 13:52:57.698858 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a4ff7d6c-c51f-46fd-8ea1-a35c51aceb09 req-7176ea87-d2a4-482d-acfc-ae3739f0e4e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125851 Sep 16 13:52:57.707299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:57.719177 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 95/183] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:52:57.739293 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fcc8f796-3b82-4a87-97d3-75ffead5b6bf tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1340 microversion: 2.1 time: 0.480190 Sep 16 13:52:57.743298 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 89/184] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:57 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1340 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:52:57.849149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:57.854521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:57.873997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.879943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.880877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:57.882370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.883493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.884435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:57.918502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:57.922846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:57.950746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.952608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.953564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:57.959110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:57.960211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:57.962008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:58.512479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:58.543975 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-725d74e3-1d82-46e2-b6a1-83733066478e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.704735 Sep 16 13:52:58.560249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 96/185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:57 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:58.632759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:58.670300 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4068f171-f589-4345-8a07-9233d005eaa7 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.759110 Sep 16 13:52:58.685899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:57 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:58.787484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:58.792015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:58.816230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:58.817323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:58.819271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:58.821782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:58.823066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:58.824011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.348780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:59.365876 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a7fe98a-5eed-475e-be89-8b57903e0604 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1490 microversion: 2.1 time: 0.605133 Sep 16 13:52:59.378957 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 97/187] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:58 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1490 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:59.596079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:59.597691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:59.608055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:59.608646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:59.611647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.613115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:59.613967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:59.617705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.841522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:59.850927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:59.870297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:59.871280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:59.871792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.873259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:59.874055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:59.874621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.903865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:52:59.918557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3a84bd3-5a92-44a1-930a-78699a759cf2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.327281 Sep 16 13:52:59.920815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 98/188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:59 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:52:59.929322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:52:59.933438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:52:59.955364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:59.955884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:59.956421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.958346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:52:59.958879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:52:59.960478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:52:59.997484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:53:00.220090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba4350d1-9e04-48d4-80c4-af4498d4bedb tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 204 len: 0 microversion: 2.1 time: 0.826467 Sep 16 13:53:00.221298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:00.225563 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 91/189] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:52:59 2022] DELETE /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:53:00.233535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2576202d-6066-4c89-b0ab-6c33e47b2383 req-7a18020d-a1e1-4b7f-a345-311f1c511f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "name": "network-vif-plugged", "status": "completed", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:00.235264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b6789ecc-c072-40d1-bd34-13a3803b234a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1338 microversion: 2.1 time: 0.312668 Sep 16 13:53:00.237081 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 99/190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:52:59 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:00.245239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1225067690", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "1828809638", "adminPass": "***", "networks": [{"uuid": "b46617d1-eed5-4a31-94fb-0270aea57785"}], "security_groups": [{"name": "tempest-securitygroup--1490638984"}], "key_name": "tempest-keypair-599284337", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:00.255742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2576202d-6066-4c89-b0ab-6c33e47b2383 req-7a18020d-a1e1-4b7f-a345-311f1c511f1b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:00.256333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2576202d-6066-4c89-b0ab-6c33e47b2383 req-7a18020d-a1e1-4b7f-a345-311f1c511f1b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:00.256966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2576202d-6066-4c89-b0ab-6c33e47b2383 req-7a18020d-a1e1-4b7f-a345-311f1c511f1b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:00.271014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2576202d-6066-4c89-b0ab-6c33e47b2383 req-7a18020d-a1e1-4b7f-a345-311f1c511f1b service nova] Creating event network-vif-plugged:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h2-858129-2 Sep 16 13:53:00.277527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2576202d-6066-4c89-b0ab-6c33e47b2383 req-7a18020d-a1e1-4b7f-a345-311f1c511f1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049921 Sep 16 13:53:00.279115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 92/191] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:00.284793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:00.285334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:00.313409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:00.313884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:00.314323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:00.315309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:00.315980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:00.316403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:00.725935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:00.736818 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5402dbfa-dfe3-423d-8386-4091de37c176 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1496 microversion: 2.1 time: 0.456346 Sep 16 13:53:00.739639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] validate_networks() for [('b46617d1-eed5-4a31-94fb-0270aea57785', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:00.753922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 93/192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:00 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1496 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:01.225571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5103f1b-d716-4f61-ac1f-f9bb91590030 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-643570766", "ram": 512, "vcpus": 1, "disk": 10, "id": 1125673622, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:01.266988 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5103f1b-d716-4f61-ac1f-f9bb91590030 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.511214 Sep 16 13:53:01.268360 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 94/193] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:01.276802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:01.277724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:01.290978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:01.292674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:01.298635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:01.300461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:01.301624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:01.303055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:01.963949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:01.975290 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9e040428-eec2-4613-a6ae-d0a6fcafb820 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1313 microversion: 2.1 time: 0.702793 Sep 16 13:53:01.975290 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 95/194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:01 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:01.986353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:01.987018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:02.000379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.000794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.001231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.002178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.002452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.003012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.340815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:02.363341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:02.364528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:02.365784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:02.367030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:02.368528 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-096d6e66-c979-4fee-a21f-3ecc2ce10b55 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1487 microversion: 2.1 time: 0.387898 Sep 16 13:53:02.370304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 96/195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:01 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1487 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:02.370702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:02.407796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.408671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.409463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.411029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.411891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.412800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.465788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Getting quotas for project 3b3640b77c194f6f8b0fb588bd07555c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:02.479062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Getting quotas for user 93ad00ee07c44e8e8ff54385234b0fb8 and project 3b3640b77c194f6f8b0fb588bd07555c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:02.516486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:53:02.521256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:53:02.616449 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71ae7bf7-76ba-4b36-8d5f-a971c3cf0486 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.378033 Sep 16 13:53:02.620034 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 100/196] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:53:02.629493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:02.633972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:02.649913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.650489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.650892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.654952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.656418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.656861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.846326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:02.856745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75a82d9b-7228-4b35-a125-5046f0df503e tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1454 microversion: 2.1 time: 0.235397 Sep 16 13:53:02.857351 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 101/197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:02 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1454 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:02.883830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:02.885339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:02.894523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.895624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.896294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:02.897253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:02.897932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:02.898620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:03.159588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fdadb50d-ec57-4f92-8355-e574310526bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:03.177320 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-fdadb50d-ec57-4f92-8355-e574310526bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] HTTP exception thrown: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fdadb50d-ec57-4f92-8355-e574310526bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Request method failure captured: Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/flavors/1125673622/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-5gbYRtjklc0JbbBc3ZrcU-qdG4cg80F1UBNplF--PaLAv2TWgErZt50dIczXEcdY1c0jSke--quRnlhL0V7n9FX_bqWht9UBnA5DO_AL3_1z3jDFu6AEIvg_Sf0N38aQeXNNdvA3o8i6WLOrqjXlDMFrZhXmga2erVmYHrL76-Fs Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:03.187912 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a3ea3fbd07fd465c927f4f4cd48c7eed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}] Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 06d48a5119874b1387a1591940e74963 Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:03.189351 n-d-858129-2 devstack@n-api.service[128643]: exception: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'id': 'hw:cpu_thread_policy'} Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:03.190077 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:03.192052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.193886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fdadb50d-ec57-4f92-8355-e574310526bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Returning 404 to user: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:03.196181 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fdadb50d-ec57-4f92-8355-e574310526bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] 10.222.0.60 "GET /compute/v2.1/flavors/1125673622/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.823418 Sep 16 13:53:03.198099 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 97/198] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 13:53:02 2022] GET /compute/v2.1/flavors/1125673622/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 827 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:03.209223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c6bbb37-64f6-4928-865a-b4acb1d07096 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:03.210327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c6bbb37-64f6-4928-865a-b4acb1d07096 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:03.682949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c6bbb37-64f6-4928-865a-b4acb1d07096 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:03.690109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:03.703481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-106660fc-d188-446c-a80c-591486f81652 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1638 microversion: 2.1 time: 0.837400 Sep 16 13:53:03.707788 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c6bbb37-64f6-4928-865a-b4acb1d07096 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1264 microversion: 2.1 time: 0.507093 Sep 16 13:53:03.711098 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 98/199] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:03 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1264 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:03.717485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b7b08451-a55d-4442-9c34-6f21811b9063 req-40bad79c-50c8-46f4-84bb-d6dca93dda0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd97ccfc-9d92-4f99-97bf-828e2e752b1f", "name": "network-vif-deleted", "tag": "050433d8-4de5-4a0c-9b43-2bfa8858fea9"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:03.724876 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 102/200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:02 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1638 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:03.737107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:03.738308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:03.754601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b7b08451-a55d-4442-9c34-6f21811b9063 req-40bad79c-50c8-46f4-84bb-d6dca93dda0d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:03.763441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:03.764741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:03.765792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:03.767630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:03.767881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b7b08451-a55d-4442-9c34-6f21811b9063 req-40bad79c-50c8-46f4-84bb-d6dca93dda0d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:03.768275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b7b08451-a55d-4442-9c34-6f21811b9063 req-40bad79c-50c8-46f4-84bb-d6dca93dda0d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:03.770028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:03.773277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:03.788353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b7b08451-a55d-4442-9c34-6f21811b9063 req-40bad79c-50c8-46f4-84bb-d6dca93dda0d service nova] Creating event network-vif-deleted:050433d8-4de5-4a0c-9b43-2bfa8858fea9 for instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f on n-h1-858129-2 Sep 16 13:53:03.795102 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b7b08451-a55d-4442-9c34-6f21811b9063 req-40bad79c-50c8-46f4-84bb-d6dca93dda0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082373 Sep 16 13:53:03.800996 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 99/201] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:03.809444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd5974df-972f-4bf7-82c7-1e87f1ef36bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:03.814447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd5974df-972f-4bf7-82c7-1e87f1ef36bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '06d48a5119874b1387a1591940e74963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ea3fbd07fd465c927f4f4cd48c7eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd5974df-972f-4bf7-82c7-1e87f1ef36bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Request method failure captured: Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/flavors/1125673622/os-extra_specs HTTP/1.1 Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 66 Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-5gbYRtjklc0JbbBc3ZrcU-qdG4cg80F1UBNplF--PaLAv2TWgErZt50dIczXEcdY1c0jSke--quRnlhL0V7n9FX_bqWht9UBnA5DO_AL3_1z3jDFu6AEIvg_Sf0N38aQeXNNdvA3o8i6WLOrqjXlDMFrZhXmga2erVmYHrL76-Fs Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:03.816477 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a3ea3fbd07fd465c927f4f4cd48c7eed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}] Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 06d48a5119874b1387a1591940e74963 Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 16 13:53:03.817667 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:03.818323 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 16 13:53:03.819343 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:03.822567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd5974df-972f-4bf7-82c7-1e87f1ef36bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:03.823807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd5974df-972f-4bf7-82c7-1e87f1ef36bc tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] 10.222.0.60 "POST /compute/v2.1/flavors/1125673622/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.021201 Sep 16 13:53:03.825341 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 100/202] 10.222.0.60 () {60 vars in 1224 bytes} [Fri Sep 16 13:53:03 2022] POST /compute/v2.1/flavors/1125673622/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:03.834738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:03.835735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:03.852887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:03.854369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:03.857905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:03.858985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:03.859682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:03.861211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:03.902885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:53:04.054905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:04.065491 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4562b31f-e807-44cc-8a3b-f19c5443778e tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 204 len: 0 microversion: 2.1 time: 0.238459 Sep 16 13:53:04.067260 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 101/203] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:53:03 2022] DELETE /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:53:04.081576 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d83ce87d-8f45-4a4c-a455-21050f56b833 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1463 microversion: 2.1 time: 0.353770 Sep 16 13:53:04.083056 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 103/204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:03 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:04.087379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-713d6f72-4d68-4d71-9dfc-28c916fc91b2 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:04.094516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.096577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:04.113071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.115402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.117053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.120117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.121696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.122837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.149598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-713d6f72-4d68-4d71-9dfc-28c916fc91b2 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1125673622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080019 Sep 16 13:53:04.150448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 102/205] 10.222.0.60 () {60 vars in 1224 bytes} [Fri Sep 16 13:53:04 2022] POST /compute/v2.1/flavors/1125673622/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:53:04.155833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.156762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:04.164203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.164729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.165611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.165985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.166364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.166912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.211077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.212393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.213265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.214191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lazy-loading 'fault' on Instance uuid dd97ccfc-9d92-4f99-97bf-828e2e752b1f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:04.287248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:04.304823 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-078adb71-5ec6-414d-807f-9c0b0fed0032 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 200 len: 1330 microversion: 2.1 time: 0.219826 Sep 16 13:53:04.319346 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 104/206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:04 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 1330 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:04.389530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:04.404663 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75aec10f-1829-4dfb-bf8b-6485d55be33a tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1493 microversion: 2.1 time: 0.252763 Sep 16 13:53:04.406011 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 103/207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:04 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1493 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:04.433951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0a0b7fc-a57d-4c43-b4c4-8fb93210f7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.442573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0a0b7fc-a57d-4c43-b4c4-8fb93210f7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '06d48a5119874b1387a1591940e74963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ea3fbd07fd465c927f4f4cd48c7eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0a0b7fc-a57d-4c43-b4c4-8fb93210f7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Request method failure captured: Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-5gbYRtjklc0JbbBc3ZrcU-qdG4cg80F1UBNplF--PaLAv2TWgErZt50dIczXEcdY1c0jSke--quRnlhL0V7n9FX_bqWht9UBnA5DO_AL3_1z3jDFu6AEIvg_Sf0N38aQeXNNdvA3o8i6WLOrqjXlDMFrZhXmga2erVmYHrL76-Fs Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:04.445397 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a3ea3fbd07fd465c927f4f4cd48c7eed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}] Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 06d48a5119874b1387a1591940e74963 Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:04.447930 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'id': 'hw:numa_nodes'} Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:04.449148 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 16 13:53:04.452231 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.458006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0a0b7fc-a57d-4c43-b4c4-8fb93210f7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:04.459684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0a0b7fc-a57d-4c43-b4c4-8fb93210f7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] 10.222.0.60 "DELETE /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.051659 Sep 16 13:53:04.465179 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 104/208] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 13:53:04 2022] DELETE /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes => generated 124 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:04.476178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-952644a2-d01a-4d8f-b2ad-04c3b685ffc7 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:04.516728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:04.539095 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-952644a2-d01a-4d8f-b2ad-04c3b685ffc7 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1125673622/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066820 Sep 16 13:53:04.546617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 105/209] 10.222.0.60 () {60 vars in 1224 bytes} [Fri Sep 16 13:53:04 2022] POST /compute/v2.1/flavors/1125673622/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 13:53:04.559778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b0e43f0-effb-4b2b-a6ad-65959a2f1fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:04.565175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b0e43f0-effb-4b2b-a6ad-65959a2f1fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '06d48a5119874b1387a1591940e74963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ea3fbd07fd465c927f4f4cd48c7eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b0e43f0-effb-4b2b-a6ad-65959a2f1fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Request method failure captured: Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 22 Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-5gbYRtjklc0JbbBc3ZrcU-qdG4cg80F1UBNplF--PaLAv2TWgErZt50dIczXEcdY1c0jSke--quRnlhL0V7n9FX_bqWht9UBnA5DO_AL3_1z3jDFu6AEIvg_Sf0N38aQeXNNdvA3o8i6WLOrqjXlDMFrZhXmga2erVmYHrL76-Fs Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:04.567182 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a3ea3fbd07fd465c927f4f4cd48c7eed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a3ea3fbd07fd465c927f4f4cd48c7eed"}]}] Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a3ea3fbd07fd465c927f4f4cd48c7eed Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 06d48a5119874b1387a1591940e74963 Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: {"hw:numa_nodes": "1"} Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:04.569592 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:04.572380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 16 13:53:04.574697 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.576625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b0e43f0-effb-4b2b-a6ad-65959a2f1fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:04.576625 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b0e43f0-effb-4b2b-a6ad-65959a2f1fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714 tempest-FlavorsExtraSpecsNegativeTestJSON-904562714-project] 10.222.0.60 "PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015951 Sep 16 13:53:04.576625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 106/210] 10.222.0.60 () {60 vars in 1265 bytes} [Fri Sep 16 13:53:04 2022] PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:04.582336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37af5b5d-c17d-406e-838e-89f915f06c33 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.593017 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-37af5b5d-c17d-406e-838e-89f915f06c33 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] HTTP exception thrown: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37af5b5d-c17d-406e-838e-89f915f06c33 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Request method failure captured: Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/flavors/1125673622/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-7HrNZ24GizU4YlDW-HRwMQ4arco7dOdePLIn0A9jTdpyYsxQUlNuAGsiTCKRzUtGdlP-dlHkN8hTBsK2zElNh7c2gLGLXFtmFgGqQlKW1ADIREVstoeTUAW1Rz5wxLJJWK8eptylJvcdqr9hAiYwdZ7ZtIr6lahiG1RHHVg19_XE Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ba25547c62754bb8bb4b0a6fec4151f9 Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:04.594728 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ba25547c62754bb8bb4b0a6fec4151f9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ba25547c62754bb8bb4b0a6fec4151f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ba25547c62754bb8bb4b0a6fec4151f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ba25547c62754bb8bb4b0a6fec4151f9"}]}] Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ba25547c62754bb8bb4b0a6fec4151f9 Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e4e50007c7974fbd96867de00c633eb0 Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:04.597170 n-d-858129-2 devstack@n-api.service[128643]: exception: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'id': 'hw:cpu_thread_policy'} Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.599125 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37af5b5d-c17d-406e-838e-89f915f06c33 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Returning 404 to user: Flavor 1125673622 has no extra specs with key hw:cpu_thread_policy. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:04.601761 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37af5b5d-c17d-406e-838e-89f915f06c33 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1125673622/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.018892 Sep 16 13:53:04.603393 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 107/211] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 13:53:04 2022] DELETE /compute/v2.1/flavors/1125673622/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:04.608005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-889f0228-3504-401b-98f2-f748eeb84fee tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:04.611821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-889f0228-3504-401b-98f2-f748eeb84fee tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-889f0228-3504-401b-98f2-f748eeb84fee tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Request method failure captured: Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 27 Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-7HrNZ24GizU4YlDW-HRwMQ4arco7dOdePLIn0A9jTdpyYsxQUlNuAGsiTCKRzUtGdlP-dlHkN8hTBsK2zElNh7c2gLGLXFtmFgGqQlKW1ADIREVstoeTUAW1Rz5wxLJJWK8eptylJvcdqr9hAiYwdZ7ZtIr6lahiG1RHHVg19_XE Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ba25547c62754bb8bb4b0a6fec4151f9 Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:04.613088 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ba25547c62754bb8bb4b0a6fec4151f9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ba25547c62754bb8bb4b0a6fec4151f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ba25547c62754bb8bb4b0a6fec4151f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ba25547c62754bb8bb4b0a6fec4151f9"}]}] Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ba25547c62754bb8bb4b0a6fec4151f9 Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e4e50007c7974fbd96867de00c633eb0 Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: {"hw:cpu_policy": "shared"} Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:04.616337 n-d-858129-2 devstack@n-api.service[128643]: exception: Request body and URI mismatch Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.618727 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-889f0228-3504-401b-98f2-f748eeb84fee tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-889f0228-3504-401b-98f2-f748eeb84fee tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011078 Sep 16 13:53:04.621484 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 108/212] 10.222.0.60 () {60 vars in 1265 bytes} [Fri Sep 16 13:53:04 2022] PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 13:53:04.636764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80a31636-5900-4fa0-a270-f415266dd065 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80a31636-5900-4fa0-a270-f415266dd065 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Request method failure captured: Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 49 Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-7HrNZ24GizU4YlDW-HRwMQ4arco7dOdePLIn0A9jTdpyYsxQUlNuAGsiTCKRzUtGdlP-dlHkN8hTBsK2zElNh7c2gLGLXFtmFgGqQlKW1ADIREVstoeTUAW1Rz5wxLJJWK8eptylJvcdqr9hAiYwdZ7ZtIr6lahiG1RHHVg19_XE Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ba25547c62754bb8bb4b0a6fec4151f9 Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:04.663047 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ba25547c62754bb8bb4b0a6fec4151f9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ba25547c62754bb8bb4b0a6fec4151f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ba25547c62754bb8bb4b0a6fec4151f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ba25547c62754bb8bb4b0a6fec4151f9"}]}] Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ba25547c62754bb8bb4b0a6fec4151f9 Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e4e50007c7974fbd96867de00c633eb0 Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 16 13:53:04.665982 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'flavor_id': '1125673622', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance: Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 16 13:53:04.668307 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.672745 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80a31636-5900-4fa0-a270-f415266dd065 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80a31636-5900-4fa0-a270-f415266dd065 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.033437 Sep 16 13:53:04.676305 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 109/213] 10.222.0.60 () {60 vars in 1265 bytes} [Fri Sep 16 13:53:04 2022] PUT /compute/v2.1/flavors/1125673622/os-extra_specs/hw:numa_nodes => generated 117 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 13:53:04.684957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-77cb3192-c1a8-44bc-87c0-237e921cf7a6 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.724392 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-77cb3192-c1a8-44bc-87c0-237e921cf7a6 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1125673622" status: 202 len: 0 microversion: 2.1 time: 0.048276 Sep 16 13:53:04.727429 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 110/214] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:53:04 2022] DELETE /compute/v2.1/flavors/1125673622 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:53:04.748568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f2a8647-15bd-4168-897f-342e29947b9c tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.793444 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f2a8647-15bd-4168-897f-342e29947b9c tempest-FlavorsExtraSpecsNegativeTestJSON-114228130 tempest-FlavorsExtraSpecsNegativeTestJSON-114228130-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.059285 Sep 16 13:53:04.794477 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 111/215] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:53:04 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:04.803557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.805714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:04.817657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.818968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.819940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.821756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.823050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.823898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.909784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:04.910976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:04.925514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:04.928224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.929037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.929744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.932195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:04.932195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:04.932860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:04.940172 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0db8349-16c2-4556-9d56-b56733a06531 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1316 microversion: 2.1 time: 0.143870 Sep 16 13:53:04.940999 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 112/216] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:04 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:05.056033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1385644967", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:05.230817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:05.359904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e525cc6-ff0a-4a0c-8f50-5bfd6d604098 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1614 microversion: 2.1 time: 1.035912 Sep 16 13:53:05.375488 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 105/217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:04 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1614 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:05.406840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:05.408537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:05.422019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:05.424149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:05.425479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:05.427614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:05.428893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:05.429954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:05.461357 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] HTTP exception thrown: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Request method failure captured: Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f HTTP/1.1 Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-EZTrGh_jtxTw7Ofao04pttkheC5qJlxZArOvwb-urvnsgL8-YFS7m3eEFra757gmdbYg4ervze2zEr0sT17nLQVR-5Et3TTWQUegKzLylwEk_Ro6di-WDBzfMMxxVJ3ed8r6iGJVIf-hfKKH48cxfOYowrM_nfUKWHfhbkU_Ydy8 Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:05.484432 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0e233a388154a039a0875867320d4bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0e233a388154a039a0875867320d4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}] Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e483157356e344ff90e2ac23f69c5876 Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:05.486818 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'dd97ccfc-9d92-4f99-97bf-828e2e752b1f'} Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:05.488136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:05.503057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:05.517022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Returning 404 to user: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:05.517022 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-176ee33c-a943-4d96-8ea3-baa30a1359df tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 404 len: 111 microversion: 2.1 time: 0.095886 Sep 16 13:53:05.517022 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 106/218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:05 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:05.517022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:05.517022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:05.520348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:05.520348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:05.520348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:05.520348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:05.521317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:05.521317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:05.802046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:05.803837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:05.805545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:05.806481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:05.814630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:05.823214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c519716c82b84ec5b2e31c3f5b1622dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214fc02f7664f268a03557dc8c5201b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:05.823214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] flavor_id is None. Assuming migration. {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 16 13:53:05.823214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 13:53:05.844318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:05.845894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:05.847579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:05.849072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:05.849997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:05.850857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:05.887219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Getting quotas for project ccd88864435244f8b4c50d71d566fa59. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:05.897322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Getting quotas for user 0e0b384ad6b84f8c8fd0eb4f60c4b0ed and project ccd88864435244f8b4c50d71d566fa59. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:05.920723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:53:05.925641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:53:06.004660 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e0b0b88-c1fb-4ed9-a3c5-cda755cde3a9 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061436 Sep 16 13:53:06.019589 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 113/219] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:53:06.032128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:06.034917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:06.055945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.056669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.057239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.058088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.060311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.060959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.125844 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c1b36d0-26ed-4e6e-987b-ad5bd5192a81 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01/action" status: 202 len: 0 microversion: 2.1 time: 0.633826 Sep 16 13:53:06.128266 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 107/220] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:53:05 2022] POST /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:53:06.136219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-451875753", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:06.219894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:06.502948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:06.531280 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-747e3112-ee4e-4818-8222-4bfd700dfcba tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1493 microversion: 2.1 time: 0.503225 Sep 16 13:53:06.533324 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 114/221] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:06 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1493 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:06.545049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:06.547196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:06.561225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.562902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.563698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.565842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.566852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.567650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.721731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:06.721908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:06.722336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:06.722840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:06.723245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:06.747378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.748058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.748510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.749368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.749838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.750277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.752020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:06.775162 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-66ad9161-3755-4f39-a924-164c259d3e19 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1322 microversion: 2.1 time: 0.240203 Sep 16 13:53:06.781945 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 115/222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:06 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:06.789549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:06.790591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:06.798000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.799106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.800216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.815281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:06.815961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Getting quotas for project b0e233a388154a039a0875867320d4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:06.819613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:06.820477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:06.826748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Getting quotas for user e483157356e344ff90e2ac23f69c5876 and project b0e233a388154a039a0875867320d4bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:06.863050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:53:06.869737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:53:06.991406 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99bf4eef-7abc-4f80-9fea-040e33b8797f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850517 Sep 16 13:53:06.995353 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 108/223] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:53:07.009381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:07.013584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:07.020579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:07.022728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:07.025038 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5cf5fcf4-e3b6-422d-96b7-2fdc36f1d3b1 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1249 microversion: 2.1 time: 0.239000 Sep 16 13:53:07.025785 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 116/224] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:06 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1249 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:07.050573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c66ebc5-5df9-49aa-997b-3f54040e5c44 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:07.053516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:07.054358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c66ebc5-5df9-49aa-997b-3f54040e5c44 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:07.054854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:07.056669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:07.058359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:07.059705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:07.060755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:07.148650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6c66ebc5-5df9-49aa-997b-3f54040e5c44 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:07.158263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c66ebc5-5df9-49aa-997b-3f54040e5c44 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1219 microversion: 2.1 time: 0.121209 Sep 16 13:53:07.161399 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 117/225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:07 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:07.397902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:07.442526 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75e8ff2b-4e42-4922-82b4-c1c48b18bd7f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1472 microversion: 2.1 time: 0.436558 Sep 16 13:53:07.448748 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 109/226] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:07 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1472 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:07.575811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:07.579277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:07.609507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:07.611778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:07.616782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:07.621525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:07.622217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:07.623253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:07.769602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:07.788768 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21cc7893-7fc6-4a15-9d44-8edb2c515623 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1451 microversion: 2.1 time: 0.218711 Sep 16 13:53:07.790033 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 118/227] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:07 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1451 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:07.812934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:07.814097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:07.826865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:07.827876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:07.828811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:07.830058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:07.831158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:07.831920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.052768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:08.057141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:08.087346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.087855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.088281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.091222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.095537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.100157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.359014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:08.372642 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4922bf03-b129-435a-a57a-7e406742804e tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1297 microversion: 2.1 time: 0.325280 Sep 16 13:53:08.375293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 119/228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:08 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1297 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:08.390351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a32899ab-cee7-4cab-a315-121d60f0ae3e req-1d904fc3-53b5-4c64-aa5a-2ac5773b5869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d982d4df-1f9f-435c-8087-cc77b84ad5f2", "name": "network-vif-deleted", "tag": "e3c36a75-239f-4a95-9dba-c9287661d673"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:08.423424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a32899ab-cee7-4cab-a315-121d60f0ae3e req-1d904fc3-53b5-4c64-aa5a-2ac5773b5869 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.423921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a32899ab-cee7-4cab-a315-121d60f0ae3e req-1d904fc3-53b5-4c64-aa5a-2ac5773b5869 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.431812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a32899ab-cee7-4cab-a315-121d60f0ae3e req-1d904fc3-53b5-4c64-aa5a-2ac5773b5869 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.470146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a32899ab-cee7-4cab-a315-121d60f0ae3e req-1d904fc3-53b5-4c64-aa5a-2ac5773b5869 service nova] Creating event network-vif-deleted:e3c36a75-239f-4a95-9dba-c9287661d673 for instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 on n-h1-858129-2 Sep 16 13:53:08.498585 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a32899ab-cee7-4cab-a315-121d60f0ae3e req-1d904fc3-53b5-4c64-aa5a-2ac5773b5869 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111589 Sep 16 13:53:08.499348 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 120/229] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:08.515546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:08.516290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:08.532590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.538503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.538798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.543247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.543753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.544922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.725951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:08.740085 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9ac985d-1523-4009-b198-d237e7ce74d5 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1245 microversion: 2.1 time: 0.236769 Sep 16 13:53:08.740686 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 121/230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:08 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1245 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:08.750290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:08.750938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:08.767896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.768575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.769119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.769924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.770266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.770931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.886212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:08.921416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9b0a3063-1946-4a75-ac03-283a0b8ee685 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 1.118842 Sep 16 13:53:08.923425 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 110/231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:07 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:08.933807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:08.935776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:08.958123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.960090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.962020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:08.963931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:08.964690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:08.965409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.061781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.063174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.064183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.065229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lazy-loading 'fault' on Instance uuid d982d4df-1f9f-435c-8087-cc77b84ad5f2 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:09.153701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdbdad127f14ebcadd865f2eecb04e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63412f6bd59645c5a3c5c5f6f37eb351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:09.172220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a57d279c-d9ec-4316-98b0-80faef1b2749 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 200 len: 1328 microversion: 2.1 time: 0.245764 Sep 16 13:53:09.173826 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 111/232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:08 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 1328 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:09.213421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:09.231886 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba305aa5-3750-4444-9643-d5eaa05e37e2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1472 microversion: 2.1 time: 0.490121 Sep 16 13:53:09.232489 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 122/233] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:08 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:09.419861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:09.420890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:09.436356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:09.449196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.450022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.457334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.459018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.460135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.460810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.655857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:09.685994 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13cdd0c2-c409-4569-b6a1-8d3d58fbe8eb tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1303 microversion: 2.1 time: 0.273382 Sep 16 13:53:09.691333 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 112/234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:09 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1303 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:09.790152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:09.790984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:09.821369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.825404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.827750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.832509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.835501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.836450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.951602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:09.953904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:09.965036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.966370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.967536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.969208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:09.971291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:09.972387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:09.973004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:09.991309 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8b9b35a-217b-4516-9e1f-ff9b09ab7f99 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1293 microversion: 2.1 time: 0.206423 Sep 16 13:53:10.009760 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 123/235] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:09 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1293 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:10.203528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:10.206663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:10.226135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.228620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.231284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.233696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.234867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.236368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.269107 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] HTTP exception thrown: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Request method failure captured: Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 HTTP/1.1 Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-CB7N0yXxJJKX7NRd5IHnZBA3WUWL0CR1KIdG15LnqyvndP5SkR3R6T-yuCcxo0mwTa4w5ZY2LM9TvRAcgqnC8_2e2E826GdipfFD68y02le8_iUil0LyyD25gkmhtF9C8X3ecQNDFQB3m4uNlYYL3JBGaBWe6Fj881e6mO8ir90c Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 63412f6bd59645c5a3c5c5f6f37eb351 Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:10.279219 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63412f6bd59645c5a3c5c5f6f37eb351", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63412f6bd59645c5a3c5c5f6f37eb351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63412f6bd59645c5a3c5c5f6f37eb351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63412f6bd59645c5a3c5c5f6f37eb351"}]}] Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 63412f6bd59645c5a3c5c5f6f37eb351 Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminTestJSON-1719817157-project Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: bbdbdad127f14ebcadd865f2eecb04e9 Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminTestJSON-1719817157-project Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:10.282025 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'd982d4df-1f9f-435c-8087-cc77b84ad5f2'} Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:10.283634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:10.286669 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:10.292931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:10.309899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88ae66f6-11b1-4e51-a9c2-f2abcbb508cb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.368064 Sep 16 13:53:10.311168 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 113/236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:09 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:10.327069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Returning 404 to user: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:10.328851 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56c9a8f8-bfd2-4c16-843d-f1a37e7a3be3 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 404 len: 111 microversion: 2.1 time: 0.133782 Sep 16 13:53:10.330794 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 124/237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:10 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:10.340385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:10.341018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:10.345202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9acfe006-64ff-4d13-85dd-6f5fa259186e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:10.361024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.361532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.362027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.368606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.375633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9acfe006-64ff-4d13-85dd-6f5fa259186e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.375927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.376672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.377824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9acfe006-64ff-4d13-85dd-6f5fa259186e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.379238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9acfe006-64ff-4d13-85dd-6f5fa259186e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.723089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:10.758782 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5707070a-eeb6-427e-9580-ac3e77b18f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1472 microversion: 2.1 time: 0.441982 Sep 16 13:53:10.759776 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 114/238] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:10 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:10.786018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-14634993-3ba9-4b58-aa1f-ae7e96b849bb req-588524da-4db8-435d-bfdc-6a8e66ee2506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db05562-05a5-4b02-9fa7-b13bac0c95e7", "tag": "71516593-1bf8-4d77-99af-64cabba59aa6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:10.818489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-14634993-3ba9-4b58-aa1f-ae7e96b849bb req-588524da-4db8-435d-bfdc-6a8e66ee2506 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.819964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-14634993-3ba9-4b58-aa1f-ae7e96b849bb req-588524da-4db8-435d-bfdc-6a8e66ee2506 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.821631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-14634993-3ba9-4b58-aa1f-ae7e96b849bb req-588524da-4db8-435d-bfdc-6a8e66ee2506 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.851481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-14634993-3ba9-4b58-aa1f-ae7e96b849bb req-588524da-4db8-435d-bfdc-6a8e66ee2506 service nova] Creating event network-changed:71516593-1bf8-4d77-99af-64cabba59aa6 for instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 on n-h2-858129-2 Sep 16 13:53:10.866792 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-14634993-3ba9-4b58-aa1f-ae7e96b849bb req-588524da-4db8-435d-bfdc-6a8e66ee2506 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104626 Sep 16 13:53:10.869319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 115/239] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:10.884388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:10.886313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:10.908517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.911531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.912316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:10.913499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:10.915543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:10.922928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:11.121574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:11.143277 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-242fcbe6-31bd-44be-b745-28fe4a785636 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1303 microversion: 2.1 time: 0.269204 Sep 16 13:53:11.145053 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 116/240] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:10 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1303 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:11.154965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:11.156135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:11.175852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:11.176504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:11.177075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:11.178219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:11.183693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:11.185756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:11.314533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:11.344142 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9c4a291-bd8e-4911-a542-b35ebb0abc6d tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1299 microversion: 2.1 time: 0.196963 Sep 16 13:53:11.345519 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 117/241] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:11 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:11.351319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:11.352757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:11.360419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:11.361404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:11.362071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:11.363365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:11.363930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:11.364686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:11.466571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9acfe006-64ff-4d13-85dd-6f5fa259186e tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 1.129227 Sep 16 13:53:11.471742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 125/242] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:11.494380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-acc48746-b4db-43cb-9bae-23fa64103889 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:11.538240 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-acc48746-b4db-43cb-9bae-23fa64103889 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.052896 Sep 16 13:53:11.540869 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 126/243] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:11.583377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-040866bc-90b9-450a-9d14-417f689fa92c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-625328642"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:11.605210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-040866bc-90b9-450a-9d14-417f689fa92c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid f025cd39-d7c4-41c7-9c94-4588a51de9d8 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:11.664142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-040866bc-90b9-450a-9d14-417f689fa92c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.086016 Sep 16 13:53:11.676868 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 127/244] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:11.695097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1b727753-9bfb-402b-b631-ec2ec992dfd5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:11.718864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b727753-9bfb-402b-b631-ec2ec992dfd5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:11.720888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b727753-9bfb-402b-b631-ec2ec992dfd5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:11.722298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b727753-9bfb-402b-b631-ec2ec992dfd5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.013032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1b727753-9bfb-402b-b631-ec2ec992dfd5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.329366 Sep 16 13:53:12.013956 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 128/245] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:11 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:12.035037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:12.037238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:12.062197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.062873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.064948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.065912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.069110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.069716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.100578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:12.128038 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cfd7d577-c4f3-4fed-b07b-ab60cfa3c19f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.780618 Sep 16 13:53:12.133551 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 118/246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:11 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:12.146027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef6df0e2-b651-496e-8b17-edda4b3c4302 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:12.179527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef6df0e2-b651-496e-8b17-edda4b3c4302 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.043690 Sep 16 13:53:12.193248 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 119/247] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:53:12 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:12.205095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:12.206524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:12.219540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.220299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.220925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.222089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.222960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.224089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.250463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:12.361708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:12.384998 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02789e1c-98f8-4724-bb4e-da14c7849ef2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1472 microversion: 2.1 time: 0.364425 Sep 16 13:53:12.386394 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 129/248] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:12 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:12.406764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf089ec4-518e-4154-9e9a-99d8f3d3a5be tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:12.431159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf089ec4-518e-4154-9e9a-99d8f3d3a5be tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.435103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf089ec4-518e-4154-9e9a-99d8f3d3a5be tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.437676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf089ec4-518e-4154-9e9a-99d8f3d3a5be tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.457729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:12.466533 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d89ee0d-07c4-4192-953a-66352784c737 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.270662 Sep 16 13:53:12.467278 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 120/249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:12 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:12.472184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:12.472798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:12.480687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.481326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.481882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.483067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.483676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.484283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.679296 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf089ec4-518e-4154-9e9a-99d8f3d3a5be tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.289954 Sep 16 13:53:12.681218 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 130/250] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:12.719628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:12.729845 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b742e021-8d85-4497-a604-e98ab09fdb48 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.261294 Sep 16 13:53:12.730665 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 121/251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:12 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:12.738531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d06551cd-4aab-4b9d-8fa6-6b696bb536c8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:12.799087 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d06551cd-4aab-4b9d-8fa6-6b696bb536c8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.065896 Sep 16 13:53:12.801147 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 122/252] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:12 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:12.825344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16452e17-d90b-4d75-9750-9ff42a300e7a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1885671207"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:12.832353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-16452e17-d90b-4d75-9750-9ff42a300e7a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid 22a98e40-1a10-43f2-b119-0a647751c5d9 for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:12.901975 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16452e17-d90b-4d75-9750-9ff42a300e7a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085904 Sep 16 13:53:12.903070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 123/253] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:12.920409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a20a0135-d260-4f95-bc12-cccc66495b1c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:12.934896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20a0135-d260-4f95-bc12-cccc66495b1c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.935570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20a0135-d260-4f95-bc12-cccc66495b1c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.936013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20a0135-d260-4f95-bc12-cccc66495b1c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.950221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Calling method '.version_select at 0x7f724dd57550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:12.952239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.952722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.953162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.972084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.972826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.974152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:12.988364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:12.989094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:12.989950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.008095 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c3b2cbd6-9517-4144-aa8b-6f1968d217c5 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.313159 Sep 16 13:53:13.015179 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 131/254] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:13.026925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Calling method '.version_select at 0x7f724dd57b80>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:13.028800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.029281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.029713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.048918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:13.055795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.056697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.057298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.070221 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f8f25ea-69e0-43fa-9f33-fe18cdfa0759 tempest-HypervisorAdminV228Test-2142466515 tempest-HypervisorAdminV228Test-2142466515-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.048279 Sep 16 13:53:13.071481 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 132/255] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 13:53:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:13.162800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:13.163434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:13.181073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.181836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.182471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.183452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.184078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.184744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.274353 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a20a0135-d260-4f95-bc12-cccc66495b1c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.353424 Sep 16 13:53:13.276510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 124/256] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:12 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:13.296211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-224a1270-db15-4b52-b081-8bacd743d565 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:13.324763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-224a1270-db15-4b52-b081-8bacd743d565 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.030570 Sep 16 13:53:13.326931 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 125/257] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:53:13 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:13.365860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca22f862-18a8-4afa-8fa3-e25e561e2543 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:13.400564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca22f862-18a8-4afa-8fa3-e25e561e2543 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.401569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca22f862-18a8-4afa-8fa3-e25e561e2543 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.402659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca22f862-18a8-4afa-8fa3-e25e561e2543 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.544596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:13.574538 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8ace726-cb81-427d-85e8-ee3a2ac262eb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.414434 Sep 16 13:53:13.576491 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 133/258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:13 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:13.617250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:13.621953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:13.644173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.646678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.651211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.656797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.661021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.662558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.682115 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca22f862-18a8-4afa-8fa3-e25e561e2543 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.338550 Sep 16 13:53:13.694685 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 126/259] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:13 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:13.699690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:13.700593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:13.708469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.709268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.709909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.711017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:13.711707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:13.712434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:13.974505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:13.983486 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4c45412-95b0-437a-9ee0-5c0f94c6ae40 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.296575 Sep 16 13:53:13.984377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 127/260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:13 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:13.994738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-665137c1-128c-463b-aec3-4cb7b76663c0 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:14.068911 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-665137c1-128c-463b-aec3-4cb7b76663c0 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.083352 Sep 16 13:53:14.070314 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 128/261] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:13 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:14.085813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:14.088180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:14.099862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:14.101383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.103193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.104289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:14.106232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.108934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.110136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:14.126900 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1d13670-bcdf-4c68-9fd6-63a80b24cc7d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1472 microversion: 2.1 time: 0.547642 Sep 16 13:53:14.127903 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 134/262] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:13 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:14.150071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16047176-a10e-46bd-9d05-527861390405 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-737653076"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:14.168387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-16047176-a10e-46bd-9d05-527861390405 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid 66a9082e-2af4-4d42-b539-cc8279cb927f for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:14.211684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16047176-a10e-46bd-9d05-527861390405 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069635 Sep 16 13:53:14.226941 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 135/263] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:14 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:14.242160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c565457e-7393-4b8c-a713-223ea7bfde3d tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:14.275896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c565457e-7393-4b8c-a713-223ea7bfde3d tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.278130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c565457e-7393-4b8c-a713-223ea7bfde3d tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.279203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c565457e-7393-4b8c-a713-223ea7bfde3d tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:14.649317 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c565457e-7393-4b8c-a713-223ea7bfde3d tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.418942 Sep 16 13:53:14.662476 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 136/264] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:14 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:14.662476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b6213854-03ec-479b-8e4a-dcd78543aab9 req-b259054e-df36-4370-94ec-ce02fa9a4f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7641e84-cb40-4458-b7a5-94978d4a3a05", "tag": "458794eb-36bb-4f39-b005-d5352e1e1328"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:14.688535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b6213854-03ec-479b-8e4a-dcd78543aab9 req-b259054e-df36-4370-94ec-ce02fa9a4f87 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.689809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b6213854-03ec-479b-8e4a-dcd78543aab9 req-b259054e-df36-4370-94ec-ce02fa9a4f87 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.691145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b6213854-03ec-479b-8e4a-dcd78543aab9 req-b259054e-df36-4370-94ec-ce02fa9a4f87 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:14.725050 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b6213854-03ec-479b-8e4a-dcd78543aab9 req-b259054e-df36-4370-94ec-ce02fa9a4f87 service nova] Creating event network-changed:458794eb-36bb-4f39-b005-d5352e1e1328 for instance a7641e84-cb40-4458-b7a5-94978d4a3a05 on n-h1-858129-2 Sep 16 13:53:14.740808 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b6213854-03ec-479b-8e4a-dcd78543aab9 req-b259054e-df36-4370-94ec-ce02fa9a4f87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086359 Sep 16 13:53:14.742899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 137/265] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:14.763811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:14.766174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:14.785309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.786839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.787898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:14.790986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.792537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.793660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:14.877316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:14.898026 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0f9e1b1-6b80-4e5b-b77d-e9a34b4f4acd tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.825368 Sep 16 13:53:14.909429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 129/266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:14 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:14.946306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-234256de-589b-4d5d-92cf-4a760e59ac7c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:14.967338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234256de-589b-4d5d-92cf-4a760e59ac7c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:14.968422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234256de-589b-4d5d-92cf-4a760e59ac7c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:14.969379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234256de-589b-4d5d-92cf-4a760e59ac7c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.275194 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-234256de-589b-4d5d-92cf-4a760e59ac7c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.350342 Sep 16 13:53:15.289974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 130/267] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:14 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:15.292704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:15.301099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:15.309802 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15e68ee1-b5ee-4a26-844a-814acd0d8203 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.564070 Sep 16 13:53:15.310432 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 138/268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:14 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:15.312184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:15.328933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:15.329445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:15.329893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.330662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:15.331130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:15.331560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.332524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:15.334015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:15.368447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:15.368955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:15.371805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.373283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:15.373777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:15.374212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.869070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:15.876975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:15.879702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:15.901251 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93804b0d-d0af-4115-8d1b-a8fe1d16fcac tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.621399 Sep 16 13:53:15.903411 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 131/269] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:15 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:15.915608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-709a45e8-f794-453e-8487-92c5bc5e0f57 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:15.939001 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c62a29e-74e2-4b28-a5e6-24c85995721b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1472 microversion: 2.1 time: 0.612476 Sep 16 13:53:15.943228 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 139/270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:15 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1472 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:15.954431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:15.955557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:15.967718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:15.968502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:15.969279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.971629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:15.972640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:15.973314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:15.990673 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-709a45e8-f794-453e-8487-92c5bc5e0f57 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.084599 Sep 16 13:53:15.992786 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 132/271] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:15 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:16.021494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724df14e50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.031727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.034820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.035931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.037561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.038906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.040323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.104794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72aa88e7-8a21-460d-9b40-25d484bd1d57 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.100051 Sep 16 13:53:16.122678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 133/272] 10.222.0.60 () {58 vars in 1128 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.155336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ecf97778-32aa-439f-a47e-30f796765697 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073896856"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:16.170425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-ecf97778-32aa-439f-a47e-30f796765697 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid ecaf8be0-8c6d-4a12-9f6b-6d076ce864fe for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:16.214016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ecf97778-32aa-439f-a47e-30f796765697 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083757 Sep 16 13:53:16.214750 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 134/273] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.220435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724df14ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.224446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.225032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.225543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.226600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.233926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.234655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.262999 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c8e77d4-68af-48b6-a050-9516cd266e30 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.047039 Sep 16 13:53:16.264237 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 135/274] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.269081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d6b15910-6ba5-4ce2-923c-5a004292f2db tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.282606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:16.297859 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc9188f7-a1a5-4da6-a596-42a5d9001d2f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.351983 Sep 16 13:53:16.298775 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 140/275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:15 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:16.304108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724dea9f70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.308895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.309646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.310224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.311294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.311976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.312583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.315183 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d6b15910-6ba5-4ce2-923c-5a004292f2db tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.049651 Sep 16 13:53:16.316176 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 136/276] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:16.322435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-880a19e2-65dd-4772-ab98-899c3fbae137 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-456198662"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:16.327591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-880a19e2-65dd-4772-ab98-899c3fbae137 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Generated uuid 57258c05-7715-40f6-85b8-a422c0535b8d for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:16.334810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:16.338150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:16.362201 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-880a19e2-65dd-4772-ab98-899c3fbae137 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.044467 Sep 16 13:53:16.367541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 137/277] 10.222.0.60 () {62 vars in 1205 bytes} [Fri Sep 16 13:53:16 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:16.378438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a71755f8-c820-41ae-bc60-918fbd73ae5f tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.392790 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a71755f8-c820-41ae-bc60-918fbd73ae5f tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a71755f8-c820-41ae-bc60-918fbd73ae5f tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Request method failure captured: Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-GTyTiKr89XNJGMgCmmo-raB0kTHt1LIhCME6q-XIoC7ELuJpiM0O4sM2izk8a_ma4aAUNHvgZ44VloAfXPtTyvO7H5LjmNGVPWpvBAFgd0KqSPXLrp3OCPsulIrqCyk_zF0-ROtcWi7y--_bP62RqYxikVAHs_pWMa3Ser3hQJ74 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:53:16.408409 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2c4874049d144e99a170f86ad5b03271", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}] Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 156f6e0f82d347498c25ae5691f0b052 Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: exception: Aggregate 5 could not be found. Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5'} Sep 16 13:53:16.411215 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:16.413785 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 16 13:53:16.416770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.418976 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df9281d6-4ce9-4829-ad39-d29f1e431bc9 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.110625 Sep 16 13:53:16.421441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a71755f8-c820-41ae-bc60-918fbd73ae5f tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:16.422241 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 141/278] 10.222.0.60 () {58 vars in 1128 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.423750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a71755f8-c820-41ae-bc60-918fbd73ae5f tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.054435 Sep 16 13:53:16.426692 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 138/279] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:16.437197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66c6b647-c189-4ab7-afe2-b94d4a502d26 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1344581461"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:16.437775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.438943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:16.449988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.450960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.451748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.453270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.454135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.454953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.644500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66c6b647-c189-4ab7-afe2-b94d4a502d26 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.215416 Sep 16 13:53:16.653491 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 139/280] 10.222.0.60 () {62 vars in 1210 bytes} [Fri Sep 16 13:53:16 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:16.657732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724df14670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.672163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.673311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.674487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.693810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:16.702586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.703557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.704519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.708150 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b5529b9-10f7-4f30-b31e-dca6be82a4f2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.283422 Sep 16 13:53:16.709333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 142/281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:16.748468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dcec39fb-47c2-45e3-a698-1cf9e4e07e1a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.769912 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3991a3c4-1694-404c-896e-ad965e9f20c3 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h1-858129-2" status: 200 len: 598 microversion: 2.1 time: 0.121553 Sep 16 13:53:16.771267 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 140/282] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-hosts/n-h1-858129-2 => generated 598 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.783568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29f24607-03a1-47f7-9c6a-9cefbf30a9e5 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.784034 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-dcec39fb-47c2-45e3-a698-1cf9e4e07e1a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dcec39fb-47c2-45e3-a698-1cf9e4e07e1a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Request method failure captured: Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-GTyTiKr89XNJGMgCmmo-raB0kTHt1LIhCME6q-XIoC7ELuJpiM0O4sM2izk8a_ma4aAUNHvgZ44VloAfXPtTyvO7H5LjmNGVPWpvBAFgd0KqSPXLrp3OCPsulIrqCyk_zF0-ROtcWi7y--_bP62RqYxikVAHs_pWMa3Ser3hQJ74 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:16.791035 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2c4874049d144e99a170f86ad5b03271", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}] Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 156f6e0f82d347498c25ae5691f0b052 Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: exception: Aggregate 5 could not be found. Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '5'} Sep 16 13:53:16.793526 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:16.795196 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:16.798069 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dcec39fb-47c2-45e3-a698-1cf9e4e07e1a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:16.800733 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dcec39fb-47c2-45e3-a698-1cf9e4e07e1a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.066582 Sep 16 13:53:16.808728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 143/283] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:16.815635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29f24607-03a1-47f7-9c6a-9cefbf30a9e5 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.041723 Sep 16 13:53:16.816299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e1f5b2f2-c651-4d98-a7aa-b405a11a7671 req-fd4ffe1b-4f5d-4c1b-8d8b-fc33b7ee50a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7219766e-07b7-4fcd-872e-2d068006704c", "tag": "bc89dc67-344b-4676-8bdb-3f5bdaca8773"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:16.827980 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 141/284] 10.222.0.60 () {60 vars in 1190 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:16.835200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e1f5b2f2-c651-4d98-a7aa-b405a11a7671 req-fd4ffe1b-4f5d-4c1b-8d8b-fc33b7ee50a3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.836237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e1f5b2f2-c651-4d98-a7aa-b405a11a7671 req-fd4ffe1b-4f5d-4c1b-8d8b-fc33b7ee50a3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.836930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Calling method '.version_select at 0x7f724def5310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:16.837302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e1f5b2f2-c651-4d98-a7aa-b405a11a7671 req-fd4ffe1b-4f5d-4c1b-8d8b-fc33b7ee50a3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.847988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=24 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:16.861273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.862723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.863925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.873054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e1f5b2f2-c651-4d98-a7aa-b405a11a7671 req-fd4ffe1b-4f5d-4c1b-8d8b-fc33b7ee50a3 service nova] Creating event network-changed:bc89dc67-344b-4676-8bdb-3f5bdaca8773 for instance 7219766e-07b7-4fcd-872e-2d068006704c on n-h1-858129-2 Sep 16 13:53:16.891489 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e1f5b2f2-c651-4d98-a7aa-b405a11a7671 req-fd4ffe1b-4f5d-4c1b-8d8b-fc33b7ee50a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080189 Sep 16 13:53:16.891914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.892740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.893570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:16.896724 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 144/285] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.909144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3028ffaa-a60f-4425-a5b8-b4728ce0bb13 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1558656887", "name": "tempest-test_aggregate-1860975952"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:16.919017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-3028ffaa-a60f-4425-a5b8-b4728ce0bb13 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid a191602e-0eee-4bab-bcfe-7403f4a95cff for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:16.928185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a06c85fa-17be-46dc-81a1-59c8f1093f42 tempest-HostsAdminTestJSON-1915210900 tempest-HostsAdminTestJSON-1915210900-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h2-858129-2" status: 200 len: 598 microversion: 2.1 time: 0.102759 Sep 16 13:53:16.938719 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 142/286] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 13:53:16 2022] GET /compute/v2.1/os-hosts/n-h2-858129-2 => generated 598 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:16.941176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-361bfcd3-fb2f-48ef-92cc-db3a1a768872 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:16.959659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-361bfcd3-fb2f-48ef-92cc-db3a1a768872 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:16.962036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-361bfcd3-fb2f-48ef-92cc-db3a1a768872 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:16.962849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-361bfcd3-fb2f-48ef-92cc-db3a1a768872 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.019875 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3028ffaa-a60f-4425-a5b8-b4728ce0bb13 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.121110 Sep 16 13:53:17.021192 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 145/287] 10.222.0.60 () {60 vars in 1165 bytes} [Fri Sep 16 13:53:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:17.054905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:17.057379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:17.079814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.080530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.081282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.091164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.091887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.092906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.165312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=28 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:17.266961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-361bfcd3-fb2f-48ef-92cc-db3a1a768872 tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.336155 Sep 16 13:53:17.268502 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 143/288] 10.222.0.60 () {62 vars in 1232 bytes} [Fri Sep 16 13:53:16 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:17.295161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:17.296475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:17.316657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.317346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.317939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.321780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.324297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.325150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.431577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:17.450520 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e20aa605-428a-4bb6-8e04-17d106145b53 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.419752 Sep 16 13:53:17.450520 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 146/289] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:17 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:17.450520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e17451dc-0e9a-4505-9088-8839e51c5593 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:17.482944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e17451dc-0e9a-4505-9088-8839e51c5593 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.038297 Sep 16 13:53:17.486561 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 147/290] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:17 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:17.508642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ef3daab1-2e48-492a-ac65-7db578799a2e tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:17.558206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef3daab1-2e48-492a-ac65-7db578799a2e tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.560045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef3daab1-2e48-492a-ac65-7db578799a2e tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.561494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef3daab1-2e48-492a-ac65-7db578799a2e tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.725396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:17.750565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-059f5abc-f658-43ad-96a0-e311db4dbc19 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.466058 Sep 16 13:53:17.752656 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 144/291] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:17 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:17.768687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:17.772312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:17.788333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.791116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.793159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.795397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.796966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.806029 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ef3daab1-2e48-492a-ac65-7db578799a2e tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.320369 Sep 16 13:53:17.808736 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 148/292] 10.222.0.60 () {62 vars in 1232 bytes} [Fri Sep 16 13:53:17 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:17.813936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.823677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60f4a21d-c7cb-4704-980f-281d421e3425 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:17.841376 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-60f4a21d-c7cb-4704-980f-281d421e3425 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60f4a21d-c7cb-4704-980f-281d421e3425 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Request method failure captured: Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-GTyTiKr89XNJGMgCmmo-raB0kTHt1LIhCME6q-XIoC7ELuJpiM0O4sM2izk8a_ma4aAUNHvgZ44VloAfXPtTyvO7H5LjmNGVPWpvBAFgd0KqSPXLrp3OCPsulIrqCyk_zF0-ROtcWi7y--_bP62RqYxikVAHs_pWMa3Ser3hQJ74 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:17.844859 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2c4874049d144e99a170f86ad5b03271", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}] Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 156f6e0f82d347498c25ae5691f0b052 Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: exception: Aggregate 7 could not be found. Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7'} Sep 16 13:53:17.847353 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:17.848662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:17.853698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60f4a21d-c7cb-4704-980f-281d421e3425 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:17.858984 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60f4a21d-c7cb-4704-980f-281d421e3425 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.034187 Sep 16 13:53:17.858984 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 149/293] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:53:17 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:17.858984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:17.860518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:17.871773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.873091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.874020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:17.875434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:17.876729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:17.877672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:18.166627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:18.189393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:18.195049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29085efd-d71b-431d-85b4-42ec59517624 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.432243 Sep 16 13:53:18.210442 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 145/294] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:17 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:18.218886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-484cb638-ea7c-4e22-856a-ecec54cef95c tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:18.221090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce41994d-75b2-41c1-ad47-fb2face58135 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.370544 Sep 16 13:53:18.225049 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 150/295] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:17 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:18.232533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08101351-93d7-4f4e-918d-1d7de96a121c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:18.248523 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-08101351-93d7-4f4e-918d-1d7de96a121c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08101351-93d7-4f4e-918d-1d7de96a121c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Request method failure captured: Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-GTyTiKr89XNJGMgCmmo-raB0kTHt1LIhCME6q-XIoC7ELuJpiM0O4sM2izk8a_ma4aAUNHvgZ44VloAfXPtTyvO7H5LjmNGVPWpvBAFgd0KqSPXLrp3OCPsulIrqCyk_zF0-ROtcWi7y--_bP62RqYxikVAHs_pWMa3Ser3hQJ74 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:18.250372 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2c4874049d144e99a170f86ad5b03271", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2c4874049d144e99a170f86ad5b03271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c4874049d144e99a170f86ad5b03271"}]}] Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2c4874049d144e99a170f86ad5b03271 Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310218807 Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 156f6e0f82d347498c25ae5691f0b052 Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminTestJSON-310218807-project-admin Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: exception: Aggregate 7 could not be found. Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7'} Sep 16 13:53:18.252984 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:18.254445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:18.256371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08101351-93d7-4f4e-918d-1d7de96a121c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-08101351-93d7-4f4e-918d-1d7de96a121c tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.025821 Sep 16 13:53:18.263563 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 151/296] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:18.272421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-869fe3e5-cbe4-478b-9e34-3ffab25d9795 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-941239075"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:18.279535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-869fe3e5-cbe4-478b-9e34-3ffab25d9795 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid 1411df93-902f-48e2-a9c0-214fc1bfcaba for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:18.294944 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-484cb638-ea7c-4e22-856a-ecec54cef95c tempest-AggregatesAdminTestV241-1655193020 tempest-AggregatesAdminTestV241-1655193020-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.091065 Sep 16 13:53:18.298866 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 146/297] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 13:53:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:18.374046 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-869fe3e5-cbe4-478b-9e34-3ffab25d9795 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.108599 Sep 16 13:53:18.387407 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 152/298] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:18.393076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e124003-99f9-4753-bc1e-ebcd996f68cc tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:18.414188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e124003-99f9-4753-bc1e-ebcd996f68cc tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.028671 Sep 16 13:53:18.423474 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 147/299] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:53:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:18.438920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b423a114-eaa6-4618-9219-2be8af8cad87 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:18.485094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:18.485898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:18.491190 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b423a114-eaa6-4618-9219-2be8af8cad87 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.058594 Sep 16 13:53:18.493037 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 153/300] 10.222.0.60 () {60 vars in 1191 bytes} [Fri Sep 16 13:53:18 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:18.495959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:18.496467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:18.496908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:18.507589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8498cf3e-b2ab-4820-abcd-675c837ed62a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:18.509283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:18.517866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:18.518535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:18.532134 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8498cf3e-b2ab-4820-abcd-675c837ed62a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.029337 Sep 16 13:53:18.533146 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 154/301] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:53:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:18.549696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4700cb5-5185-40db-825a-f4648563cc83 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:18.624056 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4700cb5-5185-40db-825a-f4648563cc83 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.079650 Sep 16 13:53:18.634136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 155/302] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:18 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:18.646952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67a8b099-d9a5-4b14-9f73-c1c2cb42632a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-879359353", "availability_zone": "tempest-test_az-1362402379"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:18.654679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-67a8b099-d9a5-4b14-9f73-c1c2cb42632a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid 133377bf-fe53-424c-9ae7-cc61caf158bf for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:18.725325 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67a8b099-d9a5-4b14-9f73-c1c2cb42632a tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.087587 Sep 16 13:53:18.727117 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 156/303] 10.222.0.60 () {60 vars in 1165 bytes} [Fri Sep 16 13:53:18 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:18.752141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c235ffad-5052-4e12-88c7-ca53a7e6b4cd tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-879359353_new", "availability_zone": "tempest-test_az-1362402379_new"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:19.050005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:19.114949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c235ffad-5052-4e12-88c7-ca53a7e6b4cd tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.121523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c235ffad-5052-4e12-88c7-ca53a7e6b4cd tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.123627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c235ffad-5052-4e12-88c7-ca53a7e6b4cd tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.177934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:19.193365 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c235ffad-5052-4e12-88c7-ca53a7e6b4cd tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.449775 Sep 16 13:53:19.202773 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 157/304] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 13:53:18 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:19.205015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:19.205577 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c76431b3-71a7-424b-8961-6e53b27056c8 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.724652 Sep 16 13:53:19.206342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:19.207850 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 148/305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:18 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:19.219020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-840aa2f5-0f0d-40d2-914e-ea9f655293f8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:19.220889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.221979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.222757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.224035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.224825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.225558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.250446 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-840aa2f5-0f0d-40d2-914e-ea9f655293f8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.038279 Sep 16 13:53:19.251361 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 149/306] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:53:19 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:19.278748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:19.279825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:19.292958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.293834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.295127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.297524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.298810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.299809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.669805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:19.684724 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e163eb0f-07f4-4f55-bd5e-86d2394f7ecb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.487855 Sep 16 13:53:19.685334 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 158/307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:19 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:19.694249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:19.695745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:19.708377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.710523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.712006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.713753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.714642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.715426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.799550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:19.828058 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3117eece-ac0b-4775-8a80-d9a012818feb tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.574296 Sep 16 13:53:19.836591 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 150/308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:19 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:19.852453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d6f25c27-2b0f-4a91-bbd9-aa87ae16d8f5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:19.906444 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d6f25c27-2b0f-4a91-bbd9-aa87ae16d8f5 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.068000 Sep 16 13:53:19.909031 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 151/309] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:19 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:19.922243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d16f4525-9b30-4101-85af-71f406a86cc5 req-116f552d-5f28-4f34-8528-5ce792c091e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db05562-05a5-4b02-9fa7-b13bac0c95e7", "name": "network-vif-plugged", "status": "completed", "tag": "71516593-1bf8-4d77-99af-64cabba59aa6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:19.935928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d16f4525-9b30-4101-85af-71f406a86cc5 req-116f552d-5f28-4f34-8528-5ce792c091e1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:19.936678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d16f4525-9b30-4101-85af-71f406a86cc5 req-116f552d-5f28-4f34-8528-5ce792c091e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:19.937358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d16f4525-9b30-4101-85af-71f406a86cc5 req-116f552d-5f28-4f34-8528-5ce792c091e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:19.960137 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d16f4525-9b30-4101-85af-71f406a86cc5 req-116f552d-5f28-4f34-8528-5ce792c091e1 service nova] Creating event network-vif-plugged:71516593-1bf8-4d77-99af-64cabba59aa6 for instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 on n-h2-858129-2 Sep 16 13:53:19.972886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d16f4525-9b30-4101-85af-71f406a86cc5 req-116f552d-5f28-4f34-8528-5ce792c091e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055860 Sep 16 13:53:19.976995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 152/310] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:19.998501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7dca01b5-7bfa-495f-aa45-b2426b8207f8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-44691930"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:20.013939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-7dca01b5-7bfa-495f-aa45-b2426b8207f8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Generated uuid 0db40a32-0e7c-4a79-8992-446180f1cab7 for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:20.060210 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7dca01b5-7bfa-495f-aa45-b2426b8207f8 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076977 Sep 16 13:53:20.062478 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 153/311] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:19 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:20.081279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ffb0bde-e3d2-485a-b799-157ebc04dc01 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.102850 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ffb0bde-e3d2-485a-b799-157ebc04dc01 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.022952 Sep 16 13:53:20.104672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:53:20 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:20.129504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca5e8d8a-3836-43db-b688-f7fc6fc23078 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.184346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:20.199609 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca5e8d8a-3836-43db-b688-f7fc6fc23078 tempest-AggregatesAdminTestJSON-310218807 tempest-AggregatesAdminTestJSON-310218807-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.075860 Sep 16 13:53:20.206502 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 155/313] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:20 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:20.209653 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe20e648-6187-4e6e-a29c-7fc53209747e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.522757 Sep 16 13:53:20.210747 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 159/314] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:19 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:20.221553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.223001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:20.246758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.248022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.254270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.255704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:20.261220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.267756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.271467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.272568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.285808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.288366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.292193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.297517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.305681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.310937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.386130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] HTTP exception thrown: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Request method failure captured: Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 HTTP/1.1 Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-CB7N0yXxJJKX7NRd5IHnZBA3WUWL0CR1KIdG15LnqyvndP5SkR3R6T-yuCcxo0mwTa4w5ZY2LM9TvRAcgqnC8_2e2E826GdipfFD68y02le8_iUil0LyyD25gkmhtF9C8X3ecQNDFQB3m4uNlYYL3JBGaBWe6Fj881e6mO8ir90c Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 63412f6bd59645c5a3c5c5f6f37eb351 Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:20.393484 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63412f6bd59645c5a3c5c5f6f37eb351", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63412f6bd59645c5a3c5c5f6f37eb351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63412f6bd59645c5a3c5c5f6f37eb351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63412f6bd59645c5a3c5c5f6f37eb351"}]}] Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 63412f6bd59645c5a3c5c5f6f37eb351 Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AggregatesAdminTestJSON-1719817157-project Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: bbdbdad127f14ebcadd865f2eecb04e9 Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AggregatesAdminTestJSON-1719817157-project Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.396358 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'd982d4df-1f9f-435c-8087-cc77b84ad5f2'} Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:20.397713 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.399887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.402057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Returning 404 to user: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:20.402057 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54debc84-013a-4404-9033-f5f1a9c81e40 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 404 len: 111 microversion: 2.1 time: 0.187302 Sep 16 13:53:20.402057 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 156/315] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:53:20 2022] DELETE /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:20.435478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.440898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] [instance: d982d4df-1f9f-435c-8087-cc77b84ad5f2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:20.461746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.469445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.470446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.473240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.475705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.477979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.560806 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] HTTP exception thrown: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Request method failure captured: Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 HTTP/1.1 Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-CB7N0yXxJJKX7NRd5IHnZBA3WUWL0CR1KIdG15LnqyvndP5SkR3R6T-yuCcxo0mwTa4w5ZY2LM9TvRAcgqnC8_2e2E826GdipfFD68y02le8_iUil0LyyD25gkmhtF9C8X3ecQNDFQB3m4uNlYYL3JBGaBWe6Fj881e6mO8ir90c Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 63412f6bd59645c5a3c5c5f6f37eb351 Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:20.569556 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_63412f6bd59645c5a3c5c5f6f37eb351", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63412f6bd59645c5a3c5c5f6f37eb351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/63412f6bd59645c5a3c5c5f6f37eb351"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/63412f6bd59645c5a3c5c5f6f37eb351"}]}] Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 63412f6bd59645c5a3c5c5f6f37eb351 Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1719817157 Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AggregatesAdminTestJSON-1719817157-project Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: bbdbdad127f14ebcadd865f2eecb04e9 Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AggregatesAdminTestJSON-1719817157-project Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.572860 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'd982d4df-1f9f-435c-8087-cc77b84ad5f2'} Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:20.574493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. Sep 16 13:53:20.576942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:20.579437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:20.579632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] Returning 404 to user: Instance d982d4df-1f9f-435c-8087-cc77b84ad5f2 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:20.579632 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45ca0309-38bf-4d93-a26c-78011ccf6ae6 tempest-AggregatesAdminTestJSON-1719817157 tempest-AggregatesAdminTestJSON-1719817157-project] 10.222.0.60 "GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2" status: 404 len: 111 microversion: 2.1 time: 0.169694 Sep 16 13:53:20.585828 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:20 2022] GET /compute/v2.1/servers/d982d4df-1f9f-435c-8087-cc77b84ad5f2 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:20.590995 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b075964-a80a-4044-9eb5-80a0c0114e89 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.341102 Sep 16 13:53:20.603789 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 160/317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:20 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:20.723770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.725644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:20.735449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.737568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.739115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.741544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.743022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.744094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.858818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:20.864218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:20.884205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.891408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.895848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:20.899927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:20.905414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:20.906647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:21.168002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:21.183926 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9a12311-43cc-4017-9b92-63cff4434bda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.465509 Sep 16 13:53:21.205711 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 158/318] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:20 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:21.257507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:21.259241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:21.273357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:21.274897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:21.276260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:21.279027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:21.279837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:21.280486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:21.340260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:21.359680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aca9eaee-e629-42d7-bee9-29bec5a416bc tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.508910 Sep 16 13:53:21.361074 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 161/319] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:20 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:21.393568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:21.616908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:21.617569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:21.630264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:21.630946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:21.631492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:21.632234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:21.632694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:21.633151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:21.645621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:21.671455 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61e79f8b-3058-4889-a6dd-aa4b0ab22bdc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1390 microversion: 2.1 time: 0.419568 Sep 16 13:53:21.674549 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 159/320] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:21 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1390 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:22.109848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:22.145306 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-42e9ea9d-b854-419a-bfad-c3b91a683ded tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.532453 Sep 16 13:53:22.146390 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 162/321] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:21 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:22.215450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:22.216847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:22.233816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:22.236006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:22.238011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:22.239102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:22.240434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:22.241788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:22.410790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:22.415505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:22.437575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:22.443629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:22.444283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:22.445054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:22.445858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:22.446338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:22.625808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:22.649221 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f297a8c-ec6e-46f6-bddd-990dca17b938 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.439027 Sep 16 13:53:22.654117 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 160/322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:22 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:22.889457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:22.903873 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f682ce7b-2d10-43f0-8cb8-f5e8d67b30ce tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.498608 Sep 16 13:53:22.933732 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 163/323] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:22 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:22.960783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:22.964447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:22.987088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:22.988612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:22.990958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:22.997010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:22.998777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:22.999852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:23.202772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db5d3225-f52a-40fb-b333-de23c111542f tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] Calling method '.version_select at 0x7f724def5820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:23.237555 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db5d3225-f52a-40fb-b333-de23c111542f tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.554974 Sep 16 13:53:23.245442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:23.253672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 161/324] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 13:53:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:23.266018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:23.268458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:23.269215 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4e7cc13-094d-4bfe-8227-83d7c5ea9bb0 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1588 microversion: 2.1 time: 0.333005 Sep 16 13:53:23.272236 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 164/325] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:22 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1588 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:23.282253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:23.284065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:23.285029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:23.285480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0152ade2-9c59-49ee-83b6-d12be6f57c3c tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] Action: 'update', calling method: .version_select at 0x7f724dd523a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:23.286841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:23.287872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:23.289137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:23.697709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:23.709506 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-418d9342-f761-4947-bc88-f96b1576dd35 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 0.453633 Sep 16 13:53:23.720196 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 162/326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:23 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:23.729731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:23.733667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:23.750566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:23.751277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:23.751891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:23.754551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:23.755264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:23.756307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:23.950702 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ab33b00-bfe2-4319-bf77-5eaa82b8facf tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236943 Sep 16 13:53:23.952913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 163/327] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 13:53:23 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7/os-interface => generated 284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:23.978363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-eb20c705-c278-4c25-a49e-c027d4cbfe3e req-1a7a77b0-7360-4497-b150-91687c69a6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7641e84-cb40-4458-b7a5-94978d4a3a05", "name": "network-vif-plugged", "status": "completed", "tag": "458794eb-36bb-4f39-b005-d5352e1e1328"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:24.026771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb20c705-c278-4c25-a49e-c027d4cbfe3e req-1a7a77b0-7360-4497-b150-91687c69a6b1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.028105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb20c705-c278-4c25-a49e-c027d4cbfe3e req-1a7a77b0-7360-4497-b150-91687c69a6b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.030907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb20c705-c278-4c25-a49e-c027d4cbfe3e req-1a7a77b0-7360-4497-b150-91687c69a6b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.082361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-eb20c705-c278-4c25-a49e-c027d4cbfe3e req-1a7a77b0-7360-4497-b150-91687c69a6b1 service nova] Creating event network-vif-plugged:458794eb-36bb-4f39-b005-d5352e1e1328 for instance a7641e84-cb40-4458-b7a5-94978d4a3a05 on n-h1-858129-2 Sep 16 13:53:24.103960 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-eb20c705-c278-4c25-a49e-c027d4cbfe3e req-1a7a77b0-7360-4497-b150-91687c69a6b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146144 Sep 16 13:53:24.109990 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 164/328] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:24.133885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:24.140008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:24.158979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.160264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.161336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.163256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.165625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.167034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.176057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0152ade2-9c59-49ee-83b6-d12be6f57c3c tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.901784 Sep 16 13:53:24.189172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 165/329] 10.222.0.60 () {60 vars in 1206 bytes} [Fri Sep 16 13:53:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:24.217690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:24.218325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:24.232786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.233239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.233796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.242249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.243587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.244047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.254085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:24.793289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:24.825380 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c29ca50-a933-4061-988a-a3aff93e6b8c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.711885 Sep 16 13:53:24.832300 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:24 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:24.836778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:24.845275 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0ad35099-26e8-44ef-bc2c-26a676831a3b tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.665900 Sep 16 13:53:24.855089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8d9ca31-e066-4a17-8f21-40f3d806a041 tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] Calling method '.version_select at 0x7f724de77700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:24.861020 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 166/331] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:24 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:24.875776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:24.878701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:24.892143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.895767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.896522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.897440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:24.897564 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8d9ca31-e066-4a17-8f21-40f3d806a041 tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.060725 Sep 16 13:53:24.900423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 166/332] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 13:53:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:24.901364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:24.902267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:24.925554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a661bd1-bb27-4e2a-af1e-68af6f564835 tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] Action: 'update', calling method: .version_select at 0x7f724de778b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:24.971963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=13,nova_api:INSERT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:25.152185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a661bd1-bb27-4e2a-af1e-68af6f564835 tempest-QuotaClassesAdminTestJSON-916869636 tempest-QuotaClassesAdminTestJSON-916869636-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.235566 Sep 16 13:53:25.152825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 167/333] 10.222.0.60 () {60 vars in 1206 bytes} [Fri Sep 16 13:53:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:25.860631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:25.870472 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0cee99c5-318e-496e-be3b-e6d2f594b6ff tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1323 microversion: 2.1 time: 1.008191 Sep 16 13:53:25.871165 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 167/334] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:24 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1323 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:25.897948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:25.898979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:25.908558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:25.909474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:25.910096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:25.911121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:25.911889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:25.912064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:25.912791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:25.914239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:25.928631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:25.929692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:25.931157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:25.932745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:25.934773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:25.935858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:26.241987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:26.330758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:26.472149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:26.484216 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-724a3659-40f7-45d1-a5d7-d288b2219eb8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.605925 Sep 16 13:53:26.485588 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 168/335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:25 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:26.500854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-be52001b-d948-49ba-94dc-0f62731938f6 req-55cc7b22-2360-4f92-a215-e91e20e91144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7219766e-07b7-4fcd-872e-2d068006704c", "name": "network-vif-plugged", "status": "completed", "tag": "bc89dc67-344b-4676-8bdb-3f5bdaca8773"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:26.515432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-be52001b-d948-49ba-94dc-0f62731938f6 req-55cc7b22-2360-4f92-a215-e91e20e91144 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:26.516271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-be52001b-d948-49ba-94dc-0f62731938f6 req-55cc7b22-2360-4f92-a215-e91e20e91144 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:26.516870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-be52001b-d948-49ba-94dc-0f62731938f6 req-55cc7b22-2360-4f92-a215-e91e20e91144 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:26.537895 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-be52001b-d948-49ba-94dc-0f62731938f6 req-55cc7b22-2360-4f92-a215-e91e20e91144 service nova] Creating event network-vif-plugged:bc89dc67-344b-4676-8bdb-3f5bdaca8773 for instance 7219766e-07b7-4fcd-872e-2d068006704c on n-h1-858129-2 Sep 16 13:53:26.545416 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-be52001b-d948-49ba-94dc-0f62731938f6 req-55cc7b22-2360-4f92-a215-e91e20e91144 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057283 Sep 16 13:53:26.552093 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 169/336] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:26.676098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:26.702895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-60d94729-71ce-443d-9c5a-760eff87befa tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.825700 Sep 16 13:53:26.705201 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 168/337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:25 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:26.925625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:26.927214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:26.957011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:26.959560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:26.960914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:26.961942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:26.962659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:26.963656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.364059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:27.410458 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5dcf8138-c97c-496d-ad8a-e4e05c744a47 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1473 microversion: 2.1 time: 0.500626 Sep 16 13:53:27.426695 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 170/338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:26 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:27.451375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:27.456695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:27.465334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.466089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.466791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.467701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.468184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.468609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.637383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3497daa2-4b9d-41ee-85e9-1004899aa870 tempest-InstanceUsageAuditLogTestJSON-144123360 tempest-InstanceUsageAuditLogTestJSON-144123360-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:27.687261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:27.691533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:27.695000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3497daa2-4b9d-41ee-85e9-1004899aa870 tempest-InstanceUsageAuditLogTestJSON-144123360 tempest-InstanceUsageAuditLogTestJSON-144123360-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16 13:53:27" status: 200 len: 318 microversion: 2.1 time: 0.601540 Sep 16 13:53:27.705058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 169/339] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 13:53:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-16%2013%3A53%3A27 => generated 318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:27.705631 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b08526d-382e-49cc-8a2d-c212d95cee62 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 200 len: 1588 microversion: 2.1 time: 0.276672 Sep 16 13:53:27.707648 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 171/340] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:27 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 1588 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:27.710532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:27.711038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:27.736704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:27.737339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:27.748770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.752868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.753495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.754298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.754833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.755289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.778221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.785139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.786389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.788407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.791463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.792371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.815391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Request method failure captured: Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05/diagnostics HTTP/1.1 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-_TGa7oLpHLt9Lr9BGcl-fW_tB4sOhSyZzP0XhAVl3gafT_XdnoaI9eNFSApWk3G5rjXYxJOG91Fr9_gai4K8M48FKeD0txpOB46W-kLzsjgogB_vQEsqQ2dck7xC2qqz8X99pyAHehoKnx4kwAnGM_joa9zF4OAKqWK63SFBtUL4 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ccd88864435244f8b4c50d71d566fa59 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1001863367 Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:27.826740 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ccd88864435244f8b4c50d71d566fa59", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd88864435244f8b4c50d71d566fa59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ccd88864435244f8b4c50d71d566fa59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd88864435244f8b4c50d71d566fa59"}]}] Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1001863367 Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ccd88864435244f8b4c50d71d566fa59 Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1001863367 Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiagnosticsNegativeTest-1001863367-project Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0e0b384ad6b84f8c8fd0eb4f60c4b0ed Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1001863367-project Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:27.829470 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': 'a7641e84-cb40-4458-b7a5-94978d4a3a05'} Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:27.830754 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:27.833286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:27.837395 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41231000-0c3d-4ad4-80f5-d0174b16c839 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.128882 Sep 16 13:53:27.840642 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 170/341] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 13:53:27 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05/diagnostics => generated 117 bytes in 141 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:27.845641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25e1bb87-5068-4c4a-99ae-2a15a6b66c63 tempest-InstanceUsageAuditLogTestJSON-144123360 tempest-InstanceUsageAuditLogTestJSON-144123360-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:27.869188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25e1bb87-5068-4c4a-99ae-2a15a6b66c63 tempest-InstanceUsageAuditLogTestJSON-144123360 tempest-InstanceUsageAuditLogTestJSON-144123360-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027211 Sep 16 13:53:27.870156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 171/342] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 13:53:27 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:27.876519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:27.877449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:27.885706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.886208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.886680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:27.887676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:27.888313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:27.888908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:28.268350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:28.330936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e5deac2-4458-4873-b30c-cf37877e8da2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.621492 Sep 16 13:53:28.331675 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 172/343] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:27 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:28.360012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:28.360556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:28.377803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:28.392707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:28.394582 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3fdee31-7ffc-4296-846a-73db189e3c90 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1319 microversion: 2.1 time: 0.523050 Sep 16 13:53:28.395402 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 172/344] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:27 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:28.398034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:28.399078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:28.401171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:28.404810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:28.405512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:28.474570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:53:28.625856 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-916b4e10-9c2b-4b81-8392-7da719541be3 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 204 len: 0 microversion: 2.1 time: 0.283063 Sep 16 13:53:28.633222 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 173/345] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:53:28 2022] DELETE /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:53:28.653283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:28.653283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:28.672263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:28.673766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:28.676163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:28.679218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:28.680924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:28.682028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:28.898614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:28.907819 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-42cf65bc-ef7b-452e-b257-dd66c69107a4 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1479 microversion: 2.1 time: 0.270375 Sep 16 13:53:28.909061 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 174/346] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:28 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1479 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:29.060905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-483823a2-124a-412f-8419-9b4bfcb475e3 req-be7974fd-19fb-4151-ac12-5d286597f781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db05562-05a5-4b02-9fa7-b13bac0c95e7", "tag": "71516593-1bf8-4d77-99af-64cabba59aa6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:29.089572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-483823a2-124a-412f-8419-9b4bfcb475e3 req-be7974fd-19fb-4151-ac12-5d286597f781 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.090818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-483823a2-124a-412f-8419-9b4bfcb475e3 req-be7974fd-19fb-4151-ac12-5d286597f781 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.091703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-483823a2-124a-412f-8419-9b4bfcb475e3 req-be7974fd-19fb-4151-ac12-5d286597f781 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.119306 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-483823a2-124a-412f-8419-9b4bfcb475e3 req-be7974fd-19fb-4151-ac12-5d286597f781 service nova] Creating event network-changed:71516593-1bf8-4d77-99af-64cabba59aa6 for instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 on n-h2-858129-2 Sep 16 13:53:29.125780 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-483823a2-124a-412f-8419-9b4bfcb475e3 req-be7974fd-19fb-4151-ac12-5d286597f781 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490864 Sep 16 13:53:29.126837 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 173/347] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:29.379681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:29.380854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:29.392037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.393158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.394124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.396577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.400153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.401876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.704337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:29.715831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3289aff6-2119-4000-86de-8e15c0fce1b6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.341243 Sep 16 13:53:29.717137 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 174/348] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:29 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:29.724170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:29.725063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:29.769300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.770016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.771421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.775143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.778258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.780125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.865098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:29.867881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.868397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.869568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.870389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.870880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.871303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.947089 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36773c11-e4c6-45f6-9981-17ccc250e5c0 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.675533 Sep 16 13:53:29.949362 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1164 bytes} [Fri Sep 16 13:53:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:53:29.954697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:29.955798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:29.973627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.974134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.974620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:29.975366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:29.976001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:29.976435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.253059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:30.284082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66f6a2a1-6d1b-43a7-9dff-ebe011d06910 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1469 microversion: 2.1 time: 0.561918 Sep 16 13:53:30.298617 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 175/350] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:29 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1469 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:30.329721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:30.333783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.338005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.338726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.340471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.341160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.341767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.425774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8fa52de9-7a04-4c08-b658-9bf10fc34f40 tempest-AZAdminV2TestJSON-1349563095 tempest-AZAdminV2TestJSON-1349563095-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.112535 Sep 16 13:53:30.426681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 176/351] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 13:53:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:30.431848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:30.433232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:30.436556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:30.444849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.446825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.447487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.448958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.449634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.450268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.463867 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-356eafcb-8f63-4394-99c0-f55d9c0f3dd6 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1479 microversion: 2.1 time: 0.512171 Sep 16 13:53:30.466303 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 176/352] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:29 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1479 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:30.751468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65ffb8cc-ece7-477d-975b-60e4d7bc8314 tempest-DeleteServersAdminTestJSON-1288812496 tempest-DeleteServersAdminTestJSON-1288812496-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c/action" status: 202 len: 0 microversion: 2.1 time: 0.318980 Sep 16 13:53:30.752835 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 177/353] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:53:30 2022] POST /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:53:30.762631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:30.763896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:30.772067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.772854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.774479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.775541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.777603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.778419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.828536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:30.829311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:30.829904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:30.830719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lazy-loading 'fault' on Instance uuid 7219766e-07b7-4fcd-872e-2d068006704c {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:31.093815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:31.116948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-33b321d4-b949-477d-8f5e-6f10af198ced tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1452 microversion: 2.1 time: 0.359466 Sep 16 13:53:31.118768 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 178/354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:30 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1452 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:31.156538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:31.157636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:31.172732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.173471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.173965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.174951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.175285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.175674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.415312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:31.420550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.421041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.421476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.427423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.428119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.429020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.476030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:31.498934 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab45ed12-a9b0-4673-a2f2-177822f57ceb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.370944 Sep 16 13:53:31.533165 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 179/355] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:31 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:31.537485 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a076ee5-e8b1-43fb-afc6-0f45e50b4b4f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.880724 Sep 16 13:53:31.539138 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 177/356] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 13:53:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:31.562376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:31.563879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:31.578965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:31.590715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:31.600091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.600637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.601051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.602329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.602944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.603250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.612379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.612886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.613389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.614046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.614533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.615328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.683377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:53:31.788221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:31.804091 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-104f1958-7289-4e20-aafb-97a37720dd4f tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1437 microversion: 2.1 time: 0.248457 Sep 16 13:53:31.807743 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 178/357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:31 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1437 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:31.826153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:31.838126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd4f3e5b-229b-4883-aff9-5e51db45073b tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-395477370"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:31.847861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-cd4f3e5b-229b-4883-aff9-5e51db45073b tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid 27a27abe-97c4-4201-aa2f-4a23e72e8ed3 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:31.907525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd4f3e5b-229b-4883-aff9-5e51db45073b tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087580 Sep 16 13:53:31.910437 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 179/358] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:31.927554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-690c1313-f1e7-44a9-99dc-d66694497629 req-8ed8141b-078a-4c5c-b4e8-494798d6b900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7641e84-cb40-4458-b7a5-94978d4a3a05", "name": "network-vif-deleted", "tag": "458794eb-36bb-4f39-b005-d5352e1e1328"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:31.954529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-690c1313-f1e7-44a9-99dc-d66694497629 req-8ed8141b-078a-4c5c-b4e8-494798d6b900 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:31.956186 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72b2b51f-b41d-4066-9e3c-a7d24405a7ef tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 204 len: 0 microversion: 2.1 time: 0.419138 Sep 16 13:53:31.956552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-690c1313-f1e7-44a9-99dc-d66694497629 req-8ed8141b-078a-4c5c-b4e8-494798d6b900 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:31.958095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-690c1313-f1e7-44a9-99dc-d66694497629 req-8ed8141b-078a-4c5c-b4e8-494798d6b900 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:31.959036 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 180/359] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:53:31 2022] DELETE /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:53:31.977610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f2a68ed-aae6-415d-b3ee-4e458d9a6b6e tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:31.989192 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-690c1313-f1e7-44a9-99dc-d66694497629 req-8ed8141b-078a-4c5c-b4e8-494798d6b900 service nova] Creating event network-vif-deleted:458794eb-36bb-4f39-b005-d5352e1e1328 for instance a7641e84-cb40-4458-b7a5-94978d4a3a05 on n-h1-858129-2 Sep 16 13:53:32.001584 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-690c1313-f1e7-44a9-99dc-d66694497629 req-8ed8141b-078a-4c5c-b4e8-494798d6b900 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088505 Sep 16 13:53:32.010078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 180/360] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:32.010450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f2a68ed-aae6-415d-b3ee-4e458d9a6b6e tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.011348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f2a68ed-aae6-415d-b3ee-4e458d9a6b6e tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.012472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f2a68ed-aae6-415d-b3ee-4e458d9a6b6e tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.020010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:32.020733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:32.036630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.038817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.039363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.040114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.042596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.043033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.133788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.147239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.149538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.154612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lazy-loading 'fault' on Instance uuid 7219766e-07b7-4fcd-872e-2d068006704c {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:32.290258 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f2a68ed-aae6-415d-b3ee-4e458d9a6b6e tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.325768 Sep 16 13:53:32.294509 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 181/361] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:31 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:32.314566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:32.334102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.336759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.337644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.399413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:32.405742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-858129-2. Sep 16 13:53:32.417204 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0f35c4f1-21bb-4b40-a85a-8561cf078a25 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1458 microversion: 2.1 time: 0.404728 Sep 16 13:53:32.419730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 181/362] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:32 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1458 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 39 Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:53:32.433074 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: {"add_host": {"host": "n-h1-858129-2"}} Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:32.435637 n-d-858129-2 devstack@n-api.service[128642]: exception: Aggregate 11 already has host n-h1-858129-2. Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-858129-2'}}} Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result.read() Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 13:53:32.437145 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858129-2-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi session.flush() Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 13:53:32.440139 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 13:53:32.444101 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 13:53:32.447064 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result.read() Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858129-2-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 16, 13, 53, 32, 376185), 'updated_at': None, 'host': 'n-h1-858129-2', 'aggregate_id': 11}] Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:32.449388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-858129-2. Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.451569 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-858129-2. Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:32.452799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:32.454044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-858129-2. Sep 16 13:53:32.454044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:32.454044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-858129-2. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:32.454044 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41f9d769-93fc-483d-a87d-f4c5bce4ad61 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.128835 Sep 16 13:53:32.454044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 182/363] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:32 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 16 13:53:32.454351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e89df19-6cc1-4402-a0cd-691dc71076b6 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:32.473867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e89df19-6cc1-4402-a0cd-691dc71076b6 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.474915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e89df19-6cc1-4402-a0cd-691dc71076b6 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.475762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e89df19-6cc1-4402-a0cd-691dc71076b6 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.554059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:32.559117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:32.594188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.595571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.599783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.604189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.605990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.606246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.760724 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e89df19-6cc1-4402-a0cd-691dc71076b6 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.318000 Sep 16 13:53:32.761611 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 182/364] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:32 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:32.773164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4802d33-5289-489e-89bb-645e3bb19722 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:32.804342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4802d33-5289-489e-89bb-645e3bb19722 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.034841 Sep 16 13:53:32.805246 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:32 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 13:53:32.816823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ebe4849-8b65-47c3-b332-7c0d6732b8df tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-161523754"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:32.822254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-8ebe4849-8b65-47c3-b332-7c0d6732b8df tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid 9ad7b198-55e1-49e3-8316-8280345fa5b7 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:32.850764 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ebe4849-8b65-47c3-b332-7c0d6732b8df tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038802 Sep 16 13:53:32.854181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 184/366] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:32.868245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:32.868867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:32.876340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.877211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.877890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.879093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.879799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.880437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.921151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:32.921654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:32.922091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:32.922593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lazy-loading 'fault' on Instance uuid a7641e84-cb40-4458-b7a5-94978d4a3a05 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:32.931852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:32.942485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e5833e5b-703c-4cab-a49a-dac8d6e0df74 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1477 microversion: 2.1 time: 0.396503 Sep 16 13:53:32.943408 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 183/367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:32 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:32.974186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b384ad6b84f8c8fd0eb4f60c4b0ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccd88864435244f8b4c50d71d566fa59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:32.982962 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2392a37a-b740-4637-b631-4d519e231774 tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 200 len: 1313 microversion: 2.1 time: 0.127537 Sep 16 13:53:32.983737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 185/368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:32 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 1313 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:33.407703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8fc51688-cc63-4603-aa17-1c822f13ca41 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:33.416855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8fc51688-cc63-4603-aa17-1c822f13ca41 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0f558938469b42039dd5a27728927085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75009ed46114e84be73f4d86aff9aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8fc51688-cc63-4603-aa17-1c822f13ca41 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Request method failure captured: Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 39 Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_Yvtn2Ft45V-hM42xb-vS12XRlK3n3Gg7HseB3VN6E5iV-_T9Oeij5sYBWRH25b8lqacl0bmMG2MQgpTOHcTZ25Yulr7ehL3_k31uT3k0xeNETTKbaZszjjc-yxKQPR2cqgFbH5-bRdPH1TxFHjaN6roA2s8Eh5OF5kuIXA0C_j4c Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:33.421200 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f75009ed46114e84be73f4d86aff9aaa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}] Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0f558938469b42039dd5a27728927085 Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: {"add_host": {"host": "n-h1-858129-2"}} Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:33.422750 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-858129-2'}}} Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:33.423689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 16 13:53:33.424978 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.426104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8fc51688-cc63-4603-aa17-1c822f13ca41 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:33.426104 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8fc51688-cc63-4603-aa17-1c822f13ca41 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.477582 Sep 16 13:53:33.429054 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 184/369] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:32 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 485 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:33.439054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fcb99c1-6601-4428-bd5a-24c50cd54dfe tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:33.442718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:33.443286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:33.465846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:33.466379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:33.466876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:33.474811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:33.475172 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fcb99c1-6601-4428-bd5a-24c50cd54dfe tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.040721 Sep 16 13:53:33.480789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:33.480789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:33.482394 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 186/370] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:33 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:33.497177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3190731a-8065-4405-bf65-de09c3568549 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-646258525"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:33.504375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-3190731a-8065-4405-bf65-de09c3568549 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid d87884c5-fcd6-436e-8df2-eec5e3517ed4 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:33.534701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:33.535530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:33.536131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:33.536866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lazy-loading 'fault' on Instance uuid 7219766e-07b7-4fcd-872e-2d068006704c {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:33.543856 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3190731a-8065-4405-bf65-de09c3568549 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059721 Sep 16 13:53:33.544958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 187/371] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:33.559865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-326168261"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:33.578534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:33.580232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:33.581614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:33.593815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:33.595413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:33.595870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:33.609788 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-326168261 could not be found. Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 57 Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:33.612347 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: {"add_host": {"host": "tempest-nonexist_host-326168261"}} Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:33.613926 n-d-858129-2 devstack@n-api.service[128643]: exception: Compute host tempest-nonexist_host-326168261 could not be found. Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-326168261'}}} Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-326168261' is not mapped to any cell Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.615246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 16 13:53:33.616612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-326168261 could not be found. Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-326168261 could not be found. Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.618506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-326168261 could not be found. Sep 16 13:53:33.619997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.621893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-326168261 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:33.623140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69c52d54-2122-4dc8-988d-58cee0a83505 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.069321 Sep 16 13:53:33.624293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 188/372] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:33 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:33.637742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4471decf-e33b-454f-9156-039b12d97192 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:33.688451 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4471decf-e33b-454f-9156-039b12d97192 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055828 Sep 16 13:53:33.688863 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 189/373] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:33 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 13:53:33.705559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a382f5fb-c333-4335-9827-d7b9a33e4332 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a382f5fb-c333-4335-9827-d7b9a33e4332 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 283 Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:33.712099 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:33.714596 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:53:33.715705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:33.716849 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.723285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.727393 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:53:33.727393 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:53:33.727393 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 13:53:33.727393 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.727393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a382f5fb-c333-4335-9827-d7b9a33e4332 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:33.728342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a382f5fb-c333-4335-9827-d7b9a33e4332 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.012203 Sep 16 13:53:33.728342 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 190/374] 10.222.0.60 () {60 vars in 1165 bytes} [Fri Sep 16 13:53:33 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:53:33.730997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f6fd7e9-02e4-4bda-98c4-f2819c882e37 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f6fd7e9-02e4-4bda-98c4-f2819c882e37 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 27 Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:33.735687 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: {"aggregate": {"name": ""}} Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:33.742177 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi '' Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:33.747759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 16 13:53:33.754791 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.763197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f6fd7e9-02e4-4bda-98c4-f2819c882e37 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:33.763197 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f6fd7e9-02e4-4bda-98c4-f2819c882e37 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015077 Sep 16 13:53:33.763197 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 191/375] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:33 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:53:33.833992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d108a9e-c9c0-4829-a8a0-0c0fd76deb48 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-255818337"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:33.856286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d108a9e-c9c0-4829-a8a0-0c0fd76deb48 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0f558938469b42039dd5a27728927085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75009ed46114e84be73f4d86aff9aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d108a9e-c9c0-4829-a8a0-0c0fd76deb48 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Request method failure captured: Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 59 Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_Yvtn2Ft45V-hM42xb-vS12XRlK3n3Gg7HseB3VN6E5iV-_T9Oeij5sYBWRH25b8lqacl0bmMG2MQgpTOHcTZ25Yulr7ehL3_k31uT3k0xeNETTKbaZszjjc-yxKQPR2cqgFbH5-bRdPH1TxFHjaN6roA2s8Eh5OF5kuIXA0C_j4c Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:33.863748 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f75009ed46114e84be73f4d86aff9aaa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}] Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 0f558938469b42039dd5a27728927085 Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: {"aggregate": {"name": "tempest-test_aggregate-255818337"}} Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:33.866397 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-255818337'}}} Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:33.868457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:33.870667 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 16 13:53:33.876823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:33.876823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d108a9e-c9c0-4829-a8a0-0c0fd76deb48 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:33.886931 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d108a9e-c9c0-4829-a8a0-0c0fd76deb48 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.128780 Sep 16 13:53:33.886931 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 192/376] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:33 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 137 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:53:34.113257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9089ac2-218e-4b83-8faa-538b13705c16 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Calling method '.version_select at 0x7f724dc33820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:34.165554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:34.258788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:34.273156 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1bd5914b-972a-4815-a11f-cd3a4b8a6bd1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1458 microversion: 2.1 time: 0.835355 Sep 16 13:53:34.274178 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 185/377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:33 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1458 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:34.279980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1f95195-2ad7-41d0-b344-615dad76d2cc tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1610962552"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:34.285345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-c1f95195-2ad7-41d0-b344-615dad76d2cc tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid 858e9ae7-9577-4e04-a851-21dff3ed2365 for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:34.315495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=13,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:34.319962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:34.325361 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9089ac2-218e-4b83-8faa-538b13705c16 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 371 microversion: 2.1 time: 0.430514 Sep 16 13:53:34.330606 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 193/378] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 13:53:33 2022] GET /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:34.350825 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1f95195-2ad7-41d0-b344-615dad76d2cc tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073922 Sep 16 13:53:34.350825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 186/379] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:34.360445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:34.363510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:34.364505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] [instance: a7641e84-cb40-4458-b7a5-94978d4a3a05] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:34.365469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:34.379957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:34.381486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:34.383800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:34.384140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:34.385046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:34.385912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:34.386715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:34.387105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:34.387917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:34.388503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:34.388802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:34.389668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:34.443294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] HTTP exception thrown: Instance a7641e84-cb40-4458-b7a5-94978d4a3a05 could not be found. Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Request method failure captured: Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 HTTP/1.1 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-_TGa7oLpHLt9Lr9BGcl-fW_tB4sOhSyZzP0XhAVl3gafT_XdnoaI9eNFSApWk3G5rjXYxJOG91Fr9_gai4K8M48FKeD0txpOB46W-kLzsjgogB_vQEsqQ2dck7xC2qqz8X99pyAHehoKnx4kwAnGM_joa9zF4OAKqWK63SFBtUL4 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ccd88864435244f8b4c50d71d566fa59 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1001863367 Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:34.446475 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ccd88864435244f8b4c50d71d566fa59", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd88864435244f8b4c50d71d566fa59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ccd88864435244f8b4c50d71d566fa59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccd88864435244f8b4c50d71d566fa59"}]}] Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1001863367 Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ccd88864435244f8b4c50d71d566fa59 Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1001863367 Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiagnosticsNegativeTest-1001863367-project Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0e0b384ad6b84f8c8fd0eb4f60c4b0ed Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1001863367-project Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a7641e84-cb40-4458-b7a5-94978d4a3a05 could not be found. Sep 16 13:53:34.448662 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a7641e84-cb40-4458-b7a5-94978d4a3a05'} Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7641e84-cb40-4458-b7a5-94978d4a3a05 could not be found. Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:34.449364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7641e84-cb40-4458-b7a5-94978d4a3a05 could not be found. Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7641e84-cb40-4458-b7a5-94978d4a3a05 could not be found. Sep 16 13:53:34.450686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.454499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] Returning 404 to user: Instance a7641e84-cb40-4458-b7a5-94978d4a3a05 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:34.456193 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b444876e-d012-453c-abcf-6bed9aaf486c tempest-ServerDiagnosticsNegativeTest-1001863367 tempest-ServerDiagnosticsNegativeTest-1001863367-project] 10.222.0.60 "GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05" status: 404 len: 111 microversion: 2.1 time: 0.104862 Sep 16 13:53:34.457381 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 187/380] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:34 2022] GET /compute/v2.1/servers/a7641e84-cb40-4458-b7a5-94978d4a3a05 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:34.465544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Action: 'update', calling method: .version_select at 0x7f724dab7280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:34.721042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:34.733562 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60d903bf-a0e7-4c28-b383-0c4eee2b27e9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1476 microversion: 2.1 time: 0.400468 Sep 16 13:53:34.734845 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 194/381] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:34 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:34.740567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50dc9962-f587-4b9d-9c63-ab6f908ecaa9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1610962552"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:34.749032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-50dc9962-f587-4b9d-9c63-ab6f908ecaa9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid 497d5a32-9c73-4bd0-8f61-9bd8252a2ca3 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:34.763395 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-50dc9962-f587-4b9d-9c63-ab6f908ecaa9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1610962552 already exists. Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50dc9962-f587-4b9d-9c63-ab6f908ecaa9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 60 Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:34.765205 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: {"aggregate": {"name": "tempest-test_aggregate-1610962552"}} Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:34.766689 n-d-858129-2 devstack@n-api.service[128643]: exception: Aggregate tempest-test_aggregate-1610962552 already exists. Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1610962552'}}} Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 16 13:53:34.767589 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1610962552 already exists. Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:34.768850 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1610962552 already exists. Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1610962552 already exists. Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50dc9962-f587-4b9d-9c63-ab6f908ecaa9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1610962552 already exists. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:34.770183 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50dc9962-f587-4b9d-9c63-ab6f908ecaa9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.030592 Sep 16 13:53:34.771314 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 195/382] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:34 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 32 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:34.779907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71cc2504-7dd9-4f27-b002-7634980c2860 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:34.814055 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71cc2504-7dd9-4f27-b002-7634980c2860 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.040203 Sep 16 13:53:34.815301 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 196/383] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:34 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:34.829442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9c9419e2-b1cc-449a-bd38-c6ac11a7cdd8 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-207553851"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:34.834331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-9c9419e2-b1cc-449a-bd38-c6ac11a7cdd8 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid d041a3cc-5e1a-434a-b0bd-745b97c5f8f6 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:34.896398 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9c9419e2-b1cc-449a-bd38-c6ac11a7cdd8 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073065 Sep 16 13:53:34.897397 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 197/384] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:34.923442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b50780a-f6cf-43a2-bb8d-cbdbb06bab3b tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:34.926445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0b50780a-f6cf-43a2-bb8d-cbdbb06bab3b tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0f558938469b42039dd5a27728927085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75009ed46114e84be73f4d86aff9aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b50780a-f6cf-43a2-bb8d-cbdbb06bab3b tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Request method failure captured: Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_Yvtn2Ft45V-hM42xb-vS12XRlK3n3Gg7HseB3VN6E5iV-_T9Oeij5sYBWRH25b8lqacl0bmMG2MQgpTOHcTZ25Yulr7ehL3_k31uT3k0xeNETTKbaZszjjc-yxKQPR2cqgFbH5-bRdPH1TxFHjaN6roA2s8Eh5OF5kuIXA0C_j4c Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:34.933129 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f75009ed46114e84be73f4d86aff9aaa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}] Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 0f558938469b42039dd5a27728927085 Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 16 13:53:34.936540 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '15'} Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:34.937929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:34.942856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b50780a-f6cf-43a2-bb8d-cbdbb06bab3b tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:34.947287 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b50780a-f6cf-43a2-bb8d-cbdbb06bab3b tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.024205 Sep 16 13:53:34.947287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 198/385] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:34.956282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38bed3be-8034-4e94-aa20-68414567d3fa tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.008839 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38bed3be-8034-4e94-aa20-68414567d3fa tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.064493 Sep 16 13:53:35.012897 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 199/386] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 16 13:53:35.036628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-167ee97a-1e00-4fb8-b13c-5c32eea29320 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.063705 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-167ee97a-1e00-4fb8-b13c-5c32eea29320 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-167ee97a-1e00-4fb8-b13c-5c32eea29320 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:35.067630 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: exception: Aggregate -1 could not be found. Sep 16 13:53:35.068996 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '-1'} Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 13:53:35.069670 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.070792 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-167ee97a-1e00-4fb8-b13c-5c32eea29320 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:35.072731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-167ee97a-1e00-4fb8-b13c-5c32eea29320 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.047925 Sep 16 13:53:35.078616 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 200/387] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:35 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:35.091118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a07f4423-04c4-453b-9572-6c03e8adc0f9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-476369016"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:35.102338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-a07f4423-04c4-453b-9572-6c03e8adc0f9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid 42292995-f1e3-4509-98a3-d3da93491ff8 for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:35.147067 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a07f4423-04c4-453b-9572-6c03e8adc0f9 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065783 Sep 16 13:53:35.162090 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 201/388] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:35.182225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-574037da-8cc5-4194-af1e-12d31d04f144 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.186008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-574037da-8cc5-4194-af1e-12d31d04f144 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0f558938469b42039dd5a27728927085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75009ed46114e84be73f4d86aff9aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-574037da-8cc5-4194-af1e-12d31d04f144 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Request method failure captured: Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_Yvtn2Ft45V-hM42xb-vS12XRlK3n3Gg7HseB3VN6E5iV-_T9Oeij5sYBWRH25b8lqacl0bmMG2MQgpTOHcTZ25Yulr7ehL3_k31uT3k0xeNETTKbaZszjjc-yxKQPR2cqgFbH5-bRdPH1TxFHjaN6roA2s8Eh5OF5kuIXA0C_j4c Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:35.190666 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f75009ed46114e84be73f4d86aff9aaa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}] Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 0f558938469b42039dd5a27728927085 Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 16 13:53:35.192978 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '16'} Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:35.197279 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.202590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-574037da-8cc5-4194-af1e-12d31d04f144 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:35.206361 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-574037da-8cc5-4194-af1e-12d31d04f144 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.023378 Sep 16 13:53:35.206361 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 202/389] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:35 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:35.213533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3cf0b10a-8552-4c8a-8525-7d3ba823f78a tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.246135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.248742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.248742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.249332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.252265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.253368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.266546 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3cf0b10a-8552-4c8a-8525-7d3ba823f78a tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.061948 Sep 16 13:53:35.268059 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 203/390] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:35 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:35.284057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7c8f398-b0d0-40f4-a22b-3bf953dc8118 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.300134 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-e7c8f398-b0d0-40f4-a22b-3bf953dc8118 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7c8f398-b0d0-40f4-a22b-3bf953dc8118 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:35.303577 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: exception: Aggregate -1 could not be found. Sep 16 13:53:35.306585 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '-1'} Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.309085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 16 13:53:35.321290 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.324295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7c8f398-b0d0-40f4-a22b-3bf953dc8118 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:35.324295 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7c8f398-b0d0-40f4-a22b-3bf953dc8118 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030275 Sep 16 13:53:35.324295 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 204/391] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:53:35 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:35.329901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.331047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:35.343620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.344563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.345560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.346970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.348160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.348970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.417809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.418601 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c830ab7-d55b-4f3c-bcbc-835e604e9f4e tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 328 microversion: 2.1 time: 0.959795 Sep 16 13:53:35.419110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.419512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.420333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lazy-loading 'fault' on Instance uuid 7219766e-07b7-4fcd-872e-2d068006704c {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:35.420629 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 188/392] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:34 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 328 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:35.427376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-daad7065-d9d9-4e04-9997-2a7b78d17137 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:35.431636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-daad7065-d9d9-4e04-9997-2a7b78d17137 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0f558938469b42039dd5a27728927085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75009ed46114e84be73f4d86aff9aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-daad7065-d9d9-4e04-9997-2a7b78d17137 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Request method failure captured: Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_Yvtn2Ft45V-hM42xb-vS12XRlK3n3Gg7HseB3VN6E5iV-_T9Oeij5sYBWRH25b8lqacl0bmMG2MQgpTOHcTZ25Yulr7ehL3_k31uT3k0xeNETTKbaZszjjc-yxKQPR2cqgFbH5-bRdPH1TxFHjaN6roA2s8Eh5OF5kuIXA0C_j4c Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:35.442032 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f75009ed46114e84be73f4d86aff9aaa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}] Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0f558938469b42039dd5a27728927085 Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 16 13:53:35.443435 n-d-858129-2 devstack@n-api.service[128642]: action_args: {} Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:35.444153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 16 13:53:35.445179 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:35.447614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-daad7065-d9d9-4e04-9997-2a7b78d17137 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:35.448352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-daad7065-d9d9-4e04-9997-2a7b78d17137 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026152 Sep 16 13:53:35.449451 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 189/393] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:53:35 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:35.469246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3533ee8f-0b0c-400e-8aba-6b1dda86684f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-772205267"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:35.473245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-3533ee8f-0b0c-400e-8aba-6b1dda86684f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid 572e880e-dae8-4aa0-90a7-3dbddc5787dd for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:35.518118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3533ee8f-0b0c-400e-8aba-6b1dda86684f tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049994 Sep 16 13:53:35.523151 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 190/394] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:35.542514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68179316-bec0-413b-9c84-962b5e5675c2 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:35.585034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68179316-bec0-413b-9c84-962b5e5675c2 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.585758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68179316-bec0-413b-9c84-962b5e5675c2 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.586395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68179316-bec0-413b-9c84-962b5e5675c2 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.862785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68179316-bec0-413b-9c84-962b5e5675c2 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.329916 Sep 16 13:53:35.864052 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 191/395] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:35.899880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "name": "network-vif-unplugged", "status": "completed", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:35.953025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:35.957387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:35.958351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:35.964647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:35.998821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] Creating event network-vif-unplugged:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h1-858129-2 Sep 16 13:53:36.002111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a961c018-8de9-4a40-89e4-76779be61ea2 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1458 microversion: 2.1 time: 0.686035 Sep 16 13:53:36.026614 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 205/396] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:35 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1458 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:36.034569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:53:36.054921 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-180f5621-22a4-4951-b501-7384c01abd27 req-5c222232-ced9-416b-9bd2-7064698d974f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.188678 Sep 16 13:53:36.056676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 192/397] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:36.062023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:36.063288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:36.099192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:36.099717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:36.100527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:36.108292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:36.113003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:36.114063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:36.486853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:36.502106 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c1ea2da-0dd2-46f7-adbb-77df6385a135 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1476 microversion: 2.1 time: 0.471831 Sep 16 13:53:36.504005 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 206/398] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:36 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1476 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:36.512520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db2bec4e-f66c-4286-91d5-2e760e997dd0 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:36.517800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-db2bec4e-f66c-4286-91d5-2e760e997dd0 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0f558938469b42039dd5a27728927085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75009ed46114e84be73f4d86aff9aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db2bec4e-f66c-4286-91d5-2e760e997dd0 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Request method failure captured: Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 42 Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_Yvtn2Ft45V-hM42xb-vS12XRlK3n3Gg7HseB3VN6E5iV-_T9Oeij5sYBWRH25b8lqacl0bmMG2MQgpTOHcTZ25Yulr7ehL3_k31uT3k0xeNETTKbaZszjjc-yxKQPR2cqgFbH5-bRdPH1TxFHjaN6roA2s8Eh5OF5kuIXA0C_j4c Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:36.520181 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f75009ed46114e84be73f4d86aff9aaa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f75009ed46114e84be73f4d86aff9aaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f75009ed46114e84be73f4d86aff9aaa"}]}] Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: f75009ed46114e84be73f4d86aff9aaa Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360 Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 0f558938469b42039dd5a27728927085 Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1841094360-project Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: {"remove_host": {"host": "n-h1-858129-2"}} Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:36.521576 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858129-2'}}} Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:36.522564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 16 13:53:36.523843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:36.530654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db2bec4e-f66c-4286-91d5-2e760e997dd0 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:36.532250 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-db2bec4e-f66c-4286-91d5-2e760e997dd0 tempest-AggregatesAdminNegativeTestJSON-1841094360 tempest-AggregatesAdminNegativeTestJSON-1841094360-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.026486 Sep 16 13:53:36.533233 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 207/399] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:36.556048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-116287af-16d6-4261-a6d6-1b51ef5c250c tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:36.575670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116287af-16d6-4261-a6d6-1b51ef5c250c tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:36.576596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116287af-16d6-4261-a6d6-1b51ef5c250c tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:36.578199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116287af-16d6-4261-a6d6-1b51ef5c250c tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:36.785419 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-116287af-16d6-4261-a6d6-1b51ef5c250c tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.233210 Sep 16 13:53:36.805681 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 208/400] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:36.815120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4418b49e-e338-4c58-b64c-f2d9a2a59afb tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:36.862189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4418b49e-e338-4c58-b64c-f2d9a2a59afb tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.053357 Sep 16 13:53:36.879422 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 209/401] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:36 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:36.893453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-451ed164-7117-45d9-a90f-e42c15e8c091 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1179922193"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:36.907219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.aggregate [None req-451ed164-7117-45d9-a90f-e42c15e8c091 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Generated uuid a5d2ec07-14e8-48eb-aa00-d18beb1d071b for aggregate {{(pid=128643) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 13:53:36.920552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1591427883", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:36.975555 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-451ed164-7117-45d9-a90f-e42c15e8c091 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093601 Sep 16 13:53:36.995661 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 210/402] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 13:53:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:37.021179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:37.063072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:37.090169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.090689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.091178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.102707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.103661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.104280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.113473 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.compute.aggregates [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 16 13:53:37.114265 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Request method failure captured: Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 42 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_ayi9Kn_5XiUsCDfi79NsEjRGb-91Qe96kdh_pbXk0_a9Xd_rohycTBkRUCNnUc5dGfSpzyeFAu6o8zZjuV3AOV3qDxT_TphhQsZvZ8bl9R2K91iyTq-HOscFIXW0rP2tmoiLOaLFCwcrvWromdr9ZQCj5832a9tm_32JDRBtKidg Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:37.116769 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e89db0e7c3274537a504574d919a92a7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e89db0e7c3274537a504574d919a92a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e89db0e7c3274537a504574d919a92a7"}]}] Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e89db0e7c3274537a504574d919a92a7 Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-223991642 Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ff512847da9642fb8a611659a80c1593 Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: {"remove_host": {"host": "nonexist_host"}} Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:37.118831 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 16 13:53:37.119698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 16 13:53:37.120828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.122150 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.123767 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:37.123767 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:37.123767 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:37.123767 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:37.123767 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 16 13:53:37.123767 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.125918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:37.127031 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38d5bd67-5c69-4072-9d60-dc3d6bdc56c4 tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.129537 Sep 16 13:53:37.128106 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 211/403] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 13:53:36 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:37.133227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:37.134099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:37.145790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.149069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.149519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.150267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.154214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.154724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.244541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.245199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.245736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.246215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lazy-loading 'fault' on Instance uuid 7219766e-07b7-4fcd-872e-2d068006704c {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:53:37.260231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:37.384042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e483157356e344ff90e2ac23f69c5876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e233a388154a039a0875867320d4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:37.400918 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca711056-f1e6-45b7-8a36-9ab9390dd101 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 200 len: 1309 microversion: 2.1 time: 0.271436 Sep 16 13:53:37.402339 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 212/404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:37 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 1309 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:37.411128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b194c04-1fd0-4d9c-9c09-45a755f1dadc tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:37.477677 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b194c04-1fd0-4d9c-9c09-45a755f1dadc tempest-AggregatesAdminNegativeTestJSON-223991642 tempest-AggregatesAdminNegativeTestJSON-223991642-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.072284 Sep 16 13:53:37.479747 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 213/405] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 13:53:37 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:53:37.534474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:37.535237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:37.550543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.553198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.553810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.567936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.569140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.569677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.656024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:37.656602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:37.657165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:37.657956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:37.658643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:37.679572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.686391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.687191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.688505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:37.689298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:37.690908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:37.753047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Getting quotas for project e58251e2d2b94a47842635bbaacc3811. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:37.765653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Getting quotas for user 7384814015e549f6831f9bbf57e61e13 and project e58251e2d2b94a47842635bbaacc3811. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:37.804893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.utils [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] cores quota exceeded for e58251e2d2b94a47842635bbaacc3811, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128642) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 16 13:53:37.807452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Request method failure captured: Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 145 Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_b4qEEOx7V1wJyXkdTn7HFzr93ZVuV0GFYy1G-uHUgV6ezD0iLK80MQ9RWGCkSZXTWby3sLVlO28BhqS3H0dejldvS9o-ot_sAL3E8O0fcJK9oxODLKwZhCNorQA0zWcuLU1trduwH0HJspQYAGw61Gwg_ssi5u4K0_0p9P6boaOs Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:37.818388 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e58251e2d2b94a47842635bbaacc3811", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}] Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7384814015e549f6831f9bbf57e61e13 Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1591427883", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} Sep 16 13:53:37.819780 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1591427883', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452'}}} Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 13:53:37.821194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.823046 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.825798 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0ad1f53d-3c70-462f-9fe5-c03068fc0f2b tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.748851 Sep 16 13:53:37.828818 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 193/406] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 1764 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:37.840517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Action: 'update', calling method: .version_select at 0x7f724daa3790>, body: {"quota_set": {"cores": 20}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:37.878454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:37.906579 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4059e1e5-4175-4f15-a182-3743fba0daf6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1476 microversion: 2.1 time: 0.375937 Sep 16 13:53:37.908795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 214/407] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:37 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:38.116466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7219766e-07b7-4fcd-872e-2d068006704c", "name": "network-vif-deleted", "tag": "bc89dc67-344b-4676-8bdb-3f5bdaca8773"}, {"name": "network-changed", "server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:38.141197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.142104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.143097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.175427 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Creating event network-vif-deleted:bc89dc67-344b-4676-8bdb-3f5bdaca8773 for instance 7219766e-07b7-4fcd-872e-2d068006704c on n-h1-858129-2 Sep 16 13:53:38.178091 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Creating event network-changed:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h1-858129-2 Sep 16 13:53:38.206522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:53:38.237368 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b69c7ffc-5d15-4c9f-b160-e743b7c0e634 req-6ef29a37-69b6-4bb3-b9ae-85ea575ff455 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.129053 Sep 16 13:53:38.239686 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 215/408] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:38.469012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:38.470842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:38.485992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.487494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.488889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.491014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.493858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.495505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.527708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] HTTP exception thrown: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Request method failure captured: Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c HTTP/1.1 Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-EZTrGh_jtxTw7Ofao04pttkheC5qJlxZArOvwb-urvnsgL8-YFS7m3eEFra757gmdbYg4ervze2zEr0sT17nLQVR-5Et3TTWQUegKzLylwEk_Ro6di-WDBzfMMxxVJ3ed8r6iGJVIf-hfKKH48cxfOYowrM_nfUKWHfhbkU_Ydy8 Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:38.532672 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0e233a388154a039a0875867320d4bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0e233a388154a039a0875867320d4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}] Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e483157356e344ff90e2ac23f69c5876 Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.535335 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7219766e-07b7-4fcd-872e-2d068006704c'} Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:38.537233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.540115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.547498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Returning 404 to user: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:38.547498 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fc6560e-1944-4f4d-ba7f-2d943f081431 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 404 len: 111 microversion: 2.1 time: 0.104795 Sep 16 13:53:38.560391 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 216/409] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:38 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:53:38.576254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:38.577504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:38.592424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.593467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.594073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.595451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.596516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.597536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.634689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] HTTP exception thrown: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Request method failure captured: Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c HTTP/1.1 Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-EZTrGh_jtxTw7Ofao04pttkheC5qJlxZArOvwb-urvnsgL8-YFS7m3eEFra757gmdbYg4ervze2zEr0sT17nLQVR-5Et3TTWQUegKzLylwEk_Ro6di-WDBzfMMxxVJ3ed8r6iGJVIf-hfKKH48cxfOYowrM_nfUKWHfhbkU_Ydy8 Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:38.638436 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0e233a388154a039a0875867320d4bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0e233a388154a039a0875867320d4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}] Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e483157356e344ff90e2ac23f69c5876 Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.640867 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7219766e-07b7-4fcd-872e-2d068006704c'} Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:38.642274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.644936 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.650794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Returning 404 to user: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:38.650794 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7109b222-2c71-4b6f-8cec-cbc2297ab0a1 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 404 len: 111 microversion: 2.1 time: 0.074697 Sep 16 13:53:38.653179 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 217/410] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:53:38 2022] DELETE /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:53:38.671234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:38.675899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: 7219766e-07b7-4fcd-872e-2d068006704c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:38.690490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.691505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.692585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.694455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.696266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.697493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.746826 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] HTTP exception thrown: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Request method failure captured: Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c HTTP/1.1 Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-EZTrGh_jtxTw7Ofao04pttkheC5qJlxZArOvwb-urvnsgL8-YFS7m3eEFra757gmdbYg4ervze2zEr0sT17nLQVR-5Et3TTWQUegKzLylwEk_Ro6di-WDBzfMMxxVJ3ed8r6iGJVIf-hfKKH48cxfOYowrM_nfUKWHfhbkU_Ydy8 Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:38.749286 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0e233a388154a039a0875867320d4bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0e233a388154a039a0875867320d4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}] Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e483157356e344ff90e2ac23f69c5876 Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.750522 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7219766e-07b7-4fcd-872e-2d068006704c'} Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:38.751292 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. Sep 16 13:53:38.752380 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.753347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Returning 404 to user: Instance 7219766e-07b7-4fcd-872e-2d068006704c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:38.753347 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c79ae1f-ec5f-4cf7-a341-300f0e6cecb4 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c" status: 404 len: 111 microversion: 2.1 time: 0.097039 Sep 16 13:53:38.758951 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 218/411] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:38 2022] GET /compute/v2.1/servers/7219766e-07b7-4fcd-872e-2d068006704c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:38.768834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:38.769755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:38.783821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.785122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.785835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.787235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.787894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.789230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.818871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] HTTP exception thrown: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Request method failure captured: Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f HTTP/1.1 Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-EZTrGh_jtxTw7Ofao04pttkheC5qJlxZArOvwb-urvnsgL8-YFS7m3eEFra757gmdbYg4ervze2zEr0sT17nLQVR-5Et3TTWQUegKzLylwEk_Ro6di-WDBzfMMxxVJ3ed8r6iGJVIf-hfKKH48cxfOYowrM_nfUKWHfhbkU_Ydy8 Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:38.822863 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0e233a388154a039a0875867320d4bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0e233a388154a039a0875867320d4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}] Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e483157356e344ff90e2ac23f69c5876 Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.824159 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'dd97ccfc-9d92-4f99-97bf-828e2e752b1f'} Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:38.824819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.825888 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.827001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Returning 404 to user: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:38.827001 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-540be466-0129-4059-9665-93df55b73f92 tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 404 len: 111 microversion: 2.1 time: 0.064638 Sep 16 13:53:38.827001 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 219/412] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:53:38 2022] DELETE /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:38.841757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:38.842942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] [instance: dd97ccfc-9d92-4f99-97bf-828e2e752b1f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:38.877401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.881287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.882682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.885762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.886592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.886750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.887750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.887927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.889981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:38.893271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.894861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:38.901108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:38.945657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] HTTP exception thrown: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Request method failure captured: Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f HTTP/1.1 Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-EZTrGh_jtxTw7Ofao04pttkheC5qJlxZArOvwb-urvnsgL8-YFS7m3eEFra757gmdbYg4ervze2zEr0sT17nLQVR-5Et3TTWQUegKzLylwEk_Ro6di-WDBzfMMxxVJ3ed8r6iGJVIf-hfKKH48cxfOYowrM_nfUKWHfhbkU_Ydy8 Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:38.948946 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0e233a388154a039a0875867320d4bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0e233a388154a039a0875867320d4bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0e233a388154a039a0875867320d4bb"}]}] Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0e233a388154a039a0875867320d4bb Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-353577322 Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e483157356e344ff90e2ac23f69c5876 Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersAdminTestJSON-353577322-project Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.950519 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'dd97ccfc-9d92-4f99-97bf-828e2e752b1f'} Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:38.951350 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. Sep 16 13:53:38.952737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:38.954947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] Returning 404 to user: Instance dd97ccfc-9d92-4f99-97bf-828e2e752b1f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:38.957002 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a09eb8d7-6728-4122-a3a0-5e04b56bb99f tempest-DeleteServersAdminTestJSON-353577322 tempest-DeleteServersAdminTestJSON-353577322-project] 10.222.0.60 "GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f" status: 404 len: 111 microversion: 2.1 time: 0.124320 Sep 16 13:53:38.958116 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 220/413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:38 2022] GET /compute/v2.1/servers/dd97ccfc-9d92-4f99-97bf-828e2e752b1f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:38.981971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:38.983386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:39.001637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:39.005443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:39.012735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:39.014299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:39.015179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:39.015967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:39.127771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02f06bb1-6e68-4c57-8317-bfccde581c0a tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 329 microversion: 2.1 time: 1.299097 Sep 16 13:53:39.139848 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 194/414] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:37 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 329 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:39.156589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3330924-df02-4c66-9f56-094be0e3b617 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Calling method '.version_select at 0x7f724daa38b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:39.339671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:39.354787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-622584bf-6e8b-4910-b73f-1685e6663a7a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1476 microversion: 2.1 time: 0.389191 Sep 16 13:53:39.355728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 221/415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:38 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:40.155574 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3330924-df02-4c66-9f56-094be0e3b617 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 371 microversion: 2.1 time: 1.004129 Sep 16 13:53:40.174003 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 195/416] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 13:53:39 2022] GET /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 371 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:40.178048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Action: 'update', calling method: .version_select at 0x7f724dc570d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:40.386604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:40.388773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:40.404767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:40.406496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:40.407911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:40.410085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:40.411470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:40.412615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:40.637767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:40.640822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:40.642886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:40.645491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:40.646273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:40.646979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:40.685788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:40.821940 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 328 microversion: 2.1 time: 0.647363 Sep 16 13:53:40.824158 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 222/417] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:40 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 328 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:40.826658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:40.829014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c59afa4e-e793-4115-91f4-7ad5abc14ea6 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002866 Sep 16 13:53:40.830109 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 223/418] 10.222.0.60 () {56 vars in 886 bytes} [Fri Sep 16 13:53:40 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 13:53:40.983323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:41.011196 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77c85481-3fac-434e-933f-08c9f041e493 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1474 microversion: 2.1 time: 0.632350 Sep 16 13:53:41.024692 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 196/419] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:40 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1474 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:41.368226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-713061373", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:41.524557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:42.072420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:42.073789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:42.084988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:42.086313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:42.089342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:42.097383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:42.098994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:42.100078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:42.222140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:42.223010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:42.223971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:42.225092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:42.225902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:42.267821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:42.270514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:42.272564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:42.275286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:42.276398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:42.277458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:42.329116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Getting quotas for project e58251e2d2b94a47842635bbaacc3811. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:42.343304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Getting quotas for user 7384814015e549f6831f9bbf57e61e13 and project e58251e2d2b94a47842635bbaacc3811. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:42.381056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.utils [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] instances quota exceeded for e58251e2d2b94a47842635bbaacc3811, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128643) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 16 13:53:42.387839 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Request method failure captured: Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 144 Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_b4qEEOx7V1wJyXkdTn7HFzr93ZVuV0GFYy1G-uHUgV6ezD0iLK80MQ9RWGCkSZXTWby3sLVlO28BhqS3H0dejldvS9o-ot_sAL3E8O0fcJK9oxODLKwZhCNorQA0zWcuLU1trduwH0HJspQYAGw61Gwg_ssi5u4K0_0p9P6boaOs Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:42.408992 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e58251e2d2b94a47842635bbaacc3811", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}] Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7384814015e549f6831f9bbf57e61e13 Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-713061373", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} Sep 16 13:53:42.410512 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-713061373', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452'}}} Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 13:53:42.411189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:42.412183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.413677 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:42.418693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:42.418693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:42.418693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:42.418693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:42.418693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 16 13:53:42.418693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:42.422147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:42.423489 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-823447df-cfa1-4d9e-a2bf-ad37ae448cb7 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.065716 Sep 16 13:53:42.428926 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 224/420] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 1070 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:42.440142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Action: 'update', calling method: .version_select at 0x7f724dbedd30>, body: {"quota_set": {"instances": 10}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:42.873675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:42.885669 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39880562-289d-4fbe-80f1-91b360693181 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1474 microversion: 2.1 time: 0.822751 Sep 16 13:53:42.886565 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 197/421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:42 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1474 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:43.424181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:43.425609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:43.426174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:43.427219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:43.427848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:43.428495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:43.533915 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-683c7163-3f21-4698-8b00-aef4b83d8bf7 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 329 microversion: 2.1 time: 1.098860 Sep 16 13:53:43.536655 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 225/422] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:42 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 329 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:43.564411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-998451a1-a75b-4776-855f-7be93f4e0d62 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Calling method '.version_select at 0x7f724da3b550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:43.936510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:43.937868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:43.961667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:43.966646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:43.967984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:43.969693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:43.974356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:43.979322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:44.007330 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-998451a1-a75b-4776-855f-7be93f4e0d62 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 371 microversion: 2.1 time: 0.460387 Sep 16 13:53:44.014276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 198/423] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 13:53:43 2022] GET /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:44.061355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Action: 'update', calling method: .version_select at 0x7f724daae9d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:44.746843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:44.747558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:44.747815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:44.752528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:44.755012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:44.756860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:44.784281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:44.797918 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d842514a-5c44-47ed-98d9-f34067ddf5da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1471 microversion: 2.1 time: 0.871992 Sep 16 13:53:44.810965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 226/424] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:43 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1471 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:44.824848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:44.825667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:44.853304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:44.866593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:44.867980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:44.869161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:44.871917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:44.872764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:44.916447 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f136032-2f70-4672-8daf-b8f4f254967f tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 325 microversion: 2.1 time: 0.892669 Sep 16 13:53:44.931098 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 199/425] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:44 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 325 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:45.063458 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0febeab2-325b-477d-98fd-872123e89bcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01/action" status: 204 len: 0 microversion: 2.1 time: 0.243847 Sep 16 13:53:45.070767 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 227/426] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:53:44 2022] POST /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01/action => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:53:45.076486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:45.077126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:45.109297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:45.109946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:45.116114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:45.120090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:45.124932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:45.128778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:45.371603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1536074645", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:45.503968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:45.707112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:45.718966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-851ea9d3-44e1-4726-aa57-7516f0dd5483 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1471 microversion: 2.1 time: 0.646807 Sep 16 13:53:45.719819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 200/427] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:45 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1471 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:53:46.255044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:46.256663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:46.257363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:46.258001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:46.258652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:46.302636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:46.303025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:46.303537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:46.304300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:46.305381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:46.305732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:46.375410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Getting quotas for project e58251e2d2b94a47842635bbaacc3811. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:46.399395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Getting quotas for user 7384814015e549f6831f9bbf57e61e13 and project e58251e2d2b94a47842635bbaacc3811. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:46.489227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.utils [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] ram quota exceeded for e58251e2d2b94a47842635bbaacc3811, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128643) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 16 13:53:46.499399 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Request method failure captured: Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 145 Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_b4qEEOx7V1wJyXkdTn7HFzr93ZVuV0GFYy1G-uHUgV6ezD0iLK80MQ9RWGCkSZXTWby3sLVlO28BhqS3H0dejldvS9o-ot_sAL3E8O0fcJK9oxODLKwZhCNorQA0zWcuLU1trduwH0HJspQYAGw61Gwg_ssi5u4K0_0p9P6boaOs Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:46.504167 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e58251e2d2b94a47842635bbaacc3811", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}] Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7384814015e549f6831f9bbf57e61e13 Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1536074645", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} Sep 16 13:53:46.506884 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1536074645', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452'}}} Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 13:53:46.508432 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:46.510621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.513608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:46.522446 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:46.522446 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:46.522446 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:46.522446 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:46.522446 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 16 13:53:46.522446 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:46.525014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:46.530428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a11a451a-d995-4126-91fe-7b185d9e2a6c tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.163755 Sep 16 13:53:46.531810 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 228/428] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 1167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:53:46.544797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Action: 'update', calling method: .version_select at 0x7f724da3bb80>, body: {"quota_set": {"ram": 51200}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:46.748354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:46.749517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:46.764747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:46.767003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:46.769185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:46.772818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:46.774149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:46.775422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:47.392841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=49 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:47.403640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:47.404153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:47.404600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:47.405543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:47.406329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:47.406960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:47.439462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:47.506737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04ffe565-5884-4cd0-ab48-58153c722bb8 tempest-QuotasAdminNegativeTest-263598494 tempest-QuotasAdminNegativeTest-263598494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 200 len: 329 microversion: 2.1 time: 0.969828 Sep 16 13:53:47.515838 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 201/429] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:46 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 329 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:47.527121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0abaf72-bfbb-41b2-97e6-ff41381b2913 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Action: 'update', calling method: .version_select at 0x7f724f3d6f70>, body: {"quota_set": {"ram": 0}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:47.547269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0abaf72-bfbb-41b2-97e6-ff41381b2913 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7384814015e549f6831f9bbf57e61e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58251e2d2b94a47842635bbaacc3811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0abaf72-bfbb-41b2-97e6-ff41381b2913 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Request method failure captured: Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: request: PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 HTTP/1.1 Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 25 Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_b4qEEOx7V1wJyXkdTn7HFzr93ZVuV0GFYy1G-uHUgV6ezD0iLK80MQ9RWGCkSZXTWby3sLVlO28BhqS3H0dejldvS9o-ot_sAL3E8O0fcJK9oxODLKwZhCNorQA0zWcuLU1trduwH0HJspQYAGw61Gwg_ssi5u4K0_0p9P6boaOs Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:47.555048 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e58251e2d2b94a47842635bbaacc3811", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e58251e2d2b94a47842635bbaacc3811"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e58251e2d2b94a47842635bbaacc3811"}]}] Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e58251e2d2b94a47842635bbaacc3811 Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858762316 Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7384814015e549f6831f9bbf57e61e13 Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-QuotasAdminNegativeTest-858762316-project Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: {"quota_set": {"ram": 0}} Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 16 13:53:47.556383 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e58251e2d2b94a47842635bbaacc3811', 'body': {'quota_set': {'ram': 0}}} Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:47.557197 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:47.558266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0abaf72-bfbb-41b2-97e6-ff41381b2913 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:47.559543 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0abaf72-bfbb-41b2-97e6-ff41381b2913 tempest-QuotasAdminNegativeTest-858762316 tempest-QuotasAdminNegativeTest-858762316-project] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811" status: 403 len: 116 microversion: 2.1 time: 0.041731 Sep 16 13:53:47.567320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 202/430] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:53:47 2022] PUT /compute/v2.1/os-quota-sets/e58251e2d2b94a47842635bbaacc3811 => generated 116 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:53:48.249362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:48.266940 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d182f398-585e-49a5-b058-401787bb42b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1471 microversion: 2.1 time: 1.522277 Sep 16 13:53:48.268153 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 229/431] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:46 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1471 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:49.333107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:49.342545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:49.385034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:49.387362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:49.392473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:49.396696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:49.401232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:49.404366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:50.595046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:50.605243 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-060c34e3-fd3a-4ee6-a829-1394de119727 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1471 microversion: 2.1 time: 1.290362 Sep 16 13:53:50.606302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 203/432] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:49 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1471 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:51.073563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Calling method '.version_select at 0x7f724db5faf0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:51.078337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.081197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.083026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.183965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.184829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.188603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.273038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e14f92c-1855-4ae4-9298-bab969b0f505 tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1022557898", "id": 1728835371, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:51.333496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.334878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.335888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.364414 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e14f92c-1855-4ae4-9298-bab969b0f505 tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.756826 Sep 16 13:53:51.373505 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 204/433] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:53:50 2022] POST /compute/v2.1/flavors => generated 468 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:51.386228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.387060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.387696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.390136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-578e3a5f-d3de-4193-b596-06c3f069a7fc req-c34701db-aaa8-4a26-bc9e-02a02a25cfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "name": "network-vif-plugged", "status": "completed", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:51.415674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-578e3a5f-d3de-4193-b596-06c3f069a7fc req-c34701db-aaa8-4a26-bc9e-02a02a25cfa4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.417702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-578e3a5f-d3de-4193-b596-06c3f069a7fc req-c34701db-aaa8-4a26-bc9e-02a02a25cfa4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.425081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-578e3a5f-d3de-4193-b596-06c3f069a7fc req-c34701db-aaa8-4a26-bc9e-02a02a25cfa4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.451486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.452704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.453740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-578e3a5f-d3de-4193-b596-06c3f069a7fc req-c34701db-aaa8-4a26-bc9e-02a02a25cfa4 service nova] Creating event network-vif-plugged:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h1-858129-2 Sep 16 13:53:51.453987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.462396 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-578e3a5f-d3de-4193-b596-06c3f069a7fc req-c34701db-aaa8-4a26-bc9e-02a02a25cfa4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087484 Sep 16 13:53:51.469030 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 205/434] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:51.474569 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16280a94-92fc-4791-a82f-37fa586454d8 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 1.418365 Sep 16 13:53:51.476246 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 230/435] 10.222.0.60 () {60 vars in 1243 bytes} [Fri Sep 16 13:53:50 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:53:51.513527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Calling method '.version_select at 0x7f724db5f430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:51.520366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.521258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.522067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.596880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.597735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.606091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.660631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.661546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.665939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.701640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.702585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.703390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.753280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.754554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.755586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.769526 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d7e10539-cc13-4d07-b557-27c480548f86 tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.264165 Sep 16 13:53:51.771856 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 231/436] 10.222.0.60 () {60 vars in 1222 bytes} [Fri Sep 16 13:53:51 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:51.800723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:51.803215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:51.816717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.817962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.818981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:51.821077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:51.822288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:51.823419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:52.436585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3c2bcd3-91a3-48fc-8e47-0ff3b9f275a2 tempest-FlavorsV261TestJSON-378496638 tempest-FlavorsV261TestJSON-378496638-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:52.463181 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3c2bcd3-91a3-48fc-8e47-0ff3b9f275a2 tempest-FlavorsV261TestJSON-378496638 tempest-FlavorsV261TestJSON-378496638-project] 10.222.0.60 "GET /compute/v2.1/flavors/1728835371" status: 200 len: 468 microversion: 2.61 time: 0.991989 Sep 16 13:53:52.476232 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 206/437] 10.222.0.60 () {60 vars in 1199 bytes} [Fri Sep 16 13:53:51 2022] GET /compute/v2.1/flavors/1728835371 => generated 468 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:52.496380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Calling method '.version_select at 0x7f724da3a3a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:52.500485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:52.500980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:52.502091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:52.557570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:52.561733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:52.564728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:52.565860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:52.571997 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53f996ac-a31b-41dc-a056-e6c2b2132f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1463 microversion: 2.1 time: 0.798268 Sep 16 13:53:52.582852 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 232/438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:51 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1463 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:52.602519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-90312788-2815-4491-b21a-fd3a18d84aed tempest-HypervisorAdminV253TestBase-626452977 tempest-HypervisorAdminV253TestBase-626452977-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/7e0d0936-e33f-46b7-9918-f7cd2fc28cb1" status: 200 len: 792 microversion: 2.53 time: 0.124064 Sep 16 13:53:52.602824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e80368a0-4b25-422a-9383-9993f2ed3a3c tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] Action: 'update', calling method: .version_select at 0x7f724f306dc0>, body: {"flavor": {"description": "new"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:52.611290 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 207/439] 10.222.0.60 () {60 vars in 1298 bytes} [Fri Sep 16 13:53:52 2022] GET /compute/v2.1/os-hypervisors/7e0d0936-e33f-46b7-9918-f7cd2fc28cb1 => generated 792 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:52.649294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:52.655946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:52.680610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:52.685607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:52.688897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:52.698151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:52.699498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:52.700537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:52.746700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e80368a0-4b25-422a-9383-9993f2ed3a3c tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1728835371" status: 200 len: 469 microversion: 2.61 time: 0.155542 Sep 16 13:53:52.747944 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 233/440] 10.222.0.60 () {62 vars in 1219 bytes} [Fri Sep 16 13:53:52 2022] PUT /compute/v2.1/flavors/1728835371 => generated 469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:53:52.767194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-33d3a334-2630-49af-aa2d-38b0b2db8b1e tempest-FlavorsV261TestJSON-378496638 tempest-FlavorsV261TestJSON-378496638-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:52.895552 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-33d3a334-2630-49af-aa2d-38b0b2db8b1e tempest-FlavorsV261TestJSON-378496638 tempest-FlavorsV261TestJSON-378496638-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 7155 microversion: 2.61 time: 0.129438 Sep 16 13:53:52.904070 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 234/441] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:52 2022] GET /compute/v2.1/flavors/detail => generated 7155 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:53:52.936118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f61f2ff9-b088-43a1-8759-d83dd2bacaa5 tempest-FlavorsV261TestJSON-378496638 tempest-FlavorsV261TestJSON-378496638-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:52.999204 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f61f2ff9-b088-43a1-8759-d83dd2bacaa5 tempest-FlavorsV261TestJSON-378496638 tempest-FlavorsV261TestJSON-378496638-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.61 time: 0.071000 Sep 16 13:53:53.007238 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 235/442] 10.222.0.60 () {60 vars in 1166 bytes} [Fri Sep 16 13:53:52 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:53:53.032205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd37a4bf-31a2-4c61-9e8a-7b0ae67e8f53 tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:53.067611 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd37a4bf-31a2-4c61-9e8a-7b0ae67e8f53 tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1728835371" status: 202 len: 0 microversion: 2.61 time: 0.039880 Sep 16 13:53:53.068959 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 236/443] 10.222.0.60 () {60 vars in 1202 bytes} [Fri Sep 16 13:53:53 2022] DELETE /compute/v2.1/flavors/1728835371 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:53:53.077933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a24109d1-124b-415b-a4a3-d6f20170d840 tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:53.086898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:53.118957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a24109d1-124b-415b-a4a3-d6f20170d840 tempest-FlavorsV261TestJSON-2131741764 tempest-FlavorsV261TestJSON-2131741764-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6696 microversion: 2.61 time: 0.044816 Sep 16 13:53:53.120514 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 237/444] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:53 2022] GET /compute/v2.1/flavors/detail => generated 6696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:53:53.530094 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b997f9ae-b3f1-4299-ad1b-16696698272f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1614 microversion: 2.1 time: 0.916369 Sep 16 13:53:53.532994 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 208/445] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:52 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1614 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:53.575231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-324acbe2-2417-4d05-9558-32c5caedd09b tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '.version_select at 0x7f724db5fee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:53.582932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-324acbe2-2417-4d05-9558-32c5caedd09b tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:53.583738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-324acbe2-2417-4d05-9558-32c5caedd09b tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:53.584344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-324acbe2-2417-4d05-9558-32c5caedd09b tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:53.598218 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-324acbe2-2417-4d05-9558-32c5caedd09b tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.027179 Sep 16 13:53:53.599280 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 238/446] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:53:53 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:53:54.554575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-77365933", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:54.753250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:53:56.252961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:53:56.254893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:53:56.255607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:53:56.256371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:53:56.256942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:53:56.288407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:56.290784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:56.292211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:56.294327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:56.301414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:56.302344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:56.343285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:56.348622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=13 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:56.413791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:53:56.436761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for user ae208d89fa7549198ef91ef307464763 and project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:53:56.440937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=30 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:53:56.506189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:53:56.519137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:53:56.635027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Calling method '.version_select at 0x7f724dbcf550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:56.645878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:56.646931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:56.647436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:56.672609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:56.673488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:56.674286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:56.799782 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7535667b-4506-44f3-8dfb-bff56501f842 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.251756 Sep 16 13:53:56.800943 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 209/447] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:53:56.847149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-136940da-6ee5-45e3-833b-ac6e3d98f479 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:56.857408 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-da0ed01b-d74b-43cf-8dcf-94b29dbb2f32 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.868089 Sep 16 13:53:56.860257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-136940da-6ee5-45e3-833b-ac6e3d98f479 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:56.877395 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 239/448] 10.222.0.60 () {58 vars in 1128 bytes} [Fri Sep 16 13:53:55 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:53:57.386163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-136940da-6ee5-45e3-833b-ac6e3d98f479 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:57.452191 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-136940da-6ee5-45e3-833b-ac6e3d98f479 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1211 microversion: 2.1 time: 0.629344 Sep 16 13:53:57.457083 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 210/449] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:56 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1211 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:58.293059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05f36a40-c519-4f6e-9f10-8387d7484aa1 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Calling method '.version_select at 0x7f724dbed0d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.332876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05f36a40-c519-4f6e-9f10-8387d7484aa1 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '968a43b505ab4eb2818785d2b6158c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dacf92a759b4052b1e7297b648cfa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05f36a40-c519-4f6e-9f10-8387d7484aa1 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Request method failure captured: Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_wObH0VWbQiCS3IxU0umqXO41XGiqRN5HDAej__luQEYMB7Xq9eC1tKx7kY3IQecijcCjY4jzCqQZCayamj5WfWwJLg5RwbupPHDVzXBsaZ7KNBueltSKmnkJKd1c2I3SrNkQ7GyLcNXcAmTAJRMfi8b3_wT77NzUujYbZwfaOIoU Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:58.360991 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dacf92a759b4052b1e7297b648cfa53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}] Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 968a43b505ab4eb2818785d2b6158c1a Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 13:53:58.363724 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:58.365406 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 16 13:53:58.368214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.374740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05f36a40-c519-4f6e-9f10-8387d7484aa1 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:58.381069 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05f36a40-c519-4f6e-9f10-8387d7484aa1 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 1.499277 Sep 16 13:53:58.386294 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 240/450] 10.222.0.60 () {58 vars in 1128 bytes} [Fri Sep 16 13:53:56 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 1508 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:58.437597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47d7c431-9f3e-4e3d-bca2-b12324edea3c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Calling method '.version_select at 0x7f724dd46550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.481934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47d7c431-9f3e-4e3d-bca2-b12324edea3c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '968a43b505ab4eb2818785d2b6158c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dacf92a759b4052b1e7297b648cfa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:58.487009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3bd3315-cf41-4b18-b4aa-215582d6df98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.488251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3bd3315-cf41-4b18-b4aa-215582d6df98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47d7c431-9f3e-4e3d-bca2-b12324edea3c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Request method failure captured: Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hosts/n-d-858129-2/reboot HTTP/1.1 Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_wObH0VWbQiCS3IxU0umqXO41XGiqRN5HDAej__luQEYMB7Xq9eC1tKx7kY3IQecijcCjY4jzCqQZCayamj5WfWwJLg5RwbupPHDVzXBsaZ7KNBueltSKmnkJKd1c2I3SrNkQ7GyLcNXcAmTAJRMfi8b3_wT77NzUujYbZwfaOIoU Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:58.497359 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dacf92a759b4052b1e7297b648cfa53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}] Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 968a43b505ab4eb2818785d2b6158c1a Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'n-d-858129-2'} Sep 16 13:53:58.499207 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:58.500595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 16 13:53:58.501954 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.509654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47d7c431-9f3e-4e3d-bca2-b12324edea3c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:58.518539 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47d7c431-9f3e-4e3d-bca2-b12324edea3c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-858129-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.118726 Sep 16 13:53:58.530734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 211/451] 10.222.0.60 () {58 vars in 1188 bytes} [Fri Sep 16 13:53:58 2022] GET /compute/v2.1/os-hosts/n-d-858129-2/reboot => generated 111 bytes in 130 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:58.605428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af2433f3-6da7-4934-a7df-d74d8b6d3176 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Calling method '.version_select at 0x7f724daae670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.649729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-af2433f3-6da7-4934-a7df-d74d8b6d3176 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af2433f3-6da7-4934-a7df-d74d8b6d3176 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:53:58.661373 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'nonexistent_hostname'} Sep 16 13:53:58.664168 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:58.667604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 16 13:53:58.672336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af2433f3-6da7-4934-a7df-d74d8b6d3176 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af2433f3-6da7-4934-a7df-d74d8b6d3176 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.134264 Sep 16 13:53:58.679523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 212/452] 10.222.0.60 () {58 vars in 1212 bytes} [Fri Sep 16 13:53:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:58.696989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fdf8cfc-30c3-45b6-9f6a-965e496ef56c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Calling method '.version_select at 0x7f724dad9040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.720648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fdf8cfc-30c3-45b6-9f6a-965e496ef56c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '968a43b505ab4eb2818785d2b6158c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dacf92a759b4052b1e7297b648cfa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fdf8cfc-30c3-45b6-9f6a-965e496ef56c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Request method failure captured: Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hosts/n-d-858129-2 HTTP/1.1 Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_wObH0VWbQiCS3IxU0umqXO41XGiqRN5HDAej__luQEYMB7Xq9eC1tKx7kY3IQecijcCjY4jzCqQZCayamj5WfWwJLg5RwbupPHDVzXBsaZ7KNBueltSKmnkJKd1c2I3SrNkQ7GyLcNXcAmTAJRMfi8b3_wT77NzUujYbZwfaOIoU Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:53:58.726047 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dacf92a759b4052b1e7297b648cfa53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}] Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 968a43b505ab4eb2818785d2b6158c1a Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'n-d-858129-2'} Sep 16 13:53:58.727981 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:58.729185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 16 13:53:58.730844 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.739489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fdf8cfc-30c3-45b6-9f6a-965e496ef56c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:58.744342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fdf8cfc-30c3-45b6-9f6a-965e496ef56c tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-858129-2" status: 403 len: 109 microversion: 2.1 time: 0.056760 Sep 16 13:53:58.750371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 213/453] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 13:53:58 2022] GET /compute/v2.1/os-hosts/n-d-858129-2 => generated 109 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:53:58.824232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-866b2648-1c80-4de6-807d-45d3eaff427d tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Calling method '.version_select at 0x7f724daae4c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.844108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f3bd3315-cf41-4b18-b4aa-215582d6df98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:58.892771 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3bd3315-cf41-4b18-b4aa-215582d6df98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1211 microversion: 2.1 time: 0.408838 Sep 16 13:53:58.894737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-866b2648-1c80-4de6-807d-45d3eaff427d tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.909172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 241/454] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:58 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1211 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-866b2648-1c80-4de6-807d-45d3eaff427d tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:53:58.917365 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'nonexistent_hostname'} Sep 16 13:53:58.919912 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.922205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:58.924386 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.933694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-866b2648-1c80-4de6-807d-45d3eaff427d tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:58.937823 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-866b2648-1c80-4de6-807d-45d3eaff427d tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.170525 Sep 16 13:53:58.952892 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 214/455] 10.222.0.60 () {58 vars in 1191 bytes} [Fri Sep 16 13:53:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:58.969964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-182e6e7a-90fb-4be3-993d-8d798042ab06 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Calling method '.version_select at 0x7f724db5f8b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:58.978958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-182e6e7a-90fb-4be3-993d-8d798042ab06 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '968a43b505ab4eb2818785d2b6158c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dacf92a759b4052b1e7297b648cfa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-182e6e7a-90fb-4be3-993d-8d798042ab06 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Request method failure captured: Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-hosts/n-d-858129-2/shutdown HTTP/1.1 Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_wObH0VWbQiCS3IxU0umqXO41XGiqRN5HDAej__luQEYMB7Xq9eC1tKx7kY3IQecijcCjY4jzCqQZCayamj5WfWwJLg5RwbupPHDVzXBsaZ7KNBueltSKmnkJKd1c2I3SrNkQ7GyLcNXcAmTAJRMfi8b3_wT77NzUujYbZwfaOIoU Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:58.985048 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dacf92a759b4052b1e7297b648cfa53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}] Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 968a43b505ab4eb2818785d2b6158c1a Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'n-d-858129-2'} Sep 16 13:53:58.987832 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:58.992044 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 16 13:53:58.995564 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.001588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-182e6e7a-90fb-4be3-993d-8d798042ab06 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.004463 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-182e6e7a-90fb-4be3-993d-8d798042ab06 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-858129-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.051861 Sep 16 13:53:59.016829 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 242/456] 10.222.0.60 () {58 vars in 1194 bytes} [Fri Sep 16 13:53:58 2022] GET /compute/v2.1/os-hosts/n-d-858129-2/shutdown => generated 113 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:59.021376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03be2fb4-bfd5-4439-ae6d-c701cd059816 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Calling method '.version_select at 0x7f724daaeb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:59.037118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-03be2fb4-bfd5-4439-ae6d-c701cd059816 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03be2fb4-bfd5-4439-ae6d-c701cd059816 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:53:59.038949 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'nonexistent_hostname'} Sep 16 13:53:59.041697 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:59.043424 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 16 13:53:59.058959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03be2fb4-bfd5-4439-ae6d-c701cd059816 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-03be2fb4-bfd5-4439-ae6d-c701cd059816 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023044 Sep 16 13:53:59.061667 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 215/457] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 13:53:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 13:53:59.066212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50b8c2e8-ec96-45d7-8659-105f27e975e0 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Calling method '.version_select at 0x7f724db61d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:59.066212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50b8c2e8-ec96-45d7-8659-105f27e975e0 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '968a43b505ab4eb2818785d2b6158c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dacf92a759b4052b1e7297b648cfa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50b8c2e8-ec96-45d7-8659-105f27e975e0 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Request method failure captured: Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-hosts/n-d-858129-2/startup HTTP/1.1 Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_wObH0VWbQiCS3IxU0umqXO41XGiqRN5HDAej__luQEYMB7Xq9eC1tKx7kY3IQecijcCjY4jzCqQZCayamj5WfWwJLg5RwbupPHDVzXBsaZ7KNBueltSKmnkJKd1c2I3SrNkQ7GyLcNXcAmTAJRMfi8b3_wT77NzUujYbZwfaOIoU Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:59.066591 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dacf92a759b4052b1e7297b648cfa53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}] Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 968a43b505ab4eb2818785d2b6158c1a Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'n-d-858129-2'} Sep 16 13:53:59.069213 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:59.071413 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 16 13:53:59.083184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.087759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50b8c2e8-ec96-45d7-8659-105f27e975e0 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.087759 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50b8c2e8-ec96-45d7-8659-105f27e975e0 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-858129-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.013736 Sep 16 13:53:59.087759 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 243/458] 10.222.0.60 () {58 vars in 1191 bytes} [Fri Sep 16 13:53:59 2022] GET /compute/v2.1/os-hosts/n-d-858129-2/startup => generated 110 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:59.112022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d8b8d71-6a8e-4285-8b77-450ef77019b8 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Calling method '.version_select at 0x7f724db61c10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:59.155905 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-9d8b8d71-6a8e-4285-8b77-450ef77019b8 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d8b8d71-6a8e-4285-8b77-450ef77019b8 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:59.157796 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'nonexistent_hostname'} Sep 16 13:53:59.160374 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:59.162932 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 16 13:53:59.166046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d8b8d71-6a8e-4285-8b77-450ef77019b8 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d8b8d71-6a8e-4285-8b77-450ef77019b8 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.066846 Sep 16 13:53:59.168635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 244/459] 10.222.0.60 () {58 vars in 1215 bytes} [Fri Sep 16 13:53:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:59.177868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f04943c-ed10-4ef6-91c5-4d1187c65281 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Action: 'update', calling method: .version_select at 0x7f724dbcf430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f04943c-ed10-4ef6-91c5-4d1187c65281 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-hosts/n-d-858129-2 HTTP/1.1 Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 51 Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:59.184337 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: {"status": "enable", "maintenance_mode": "invalid"} Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.187576 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'n-d-858129-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'disable', Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'Enable', Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'Disable', Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance: Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.194521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.199848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f04943c-ed10-4ef6-91c5-4d1187c65281 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f04943c-ed10-4ef6-91c5-4d1187c65281 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-858129-2" status: 400 len: 199 microversion: 2.1 time: 0.017306 Sep 16 13:53:59.204253 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 245/460] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:59 2022] PUT /compute/v2.1/os-hosts/n-d-858129-2 => generated 199 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-13094acb-0c1a-4ec0-8f91-ec58297bd2f0 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Action: 'update', calling method: .version_select at 0x7f724dc2f1f0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-13094acb-0c1a-4ec0-8f91-ec58297bd2f0 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-hosts/n-d-858129-2 HTTP/1.1 Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 51 Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:59.205909 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: {"status": "invalid", "maintenance_mode": "enable"} Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.209916 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'n-d-858129-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'disable', Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'Enable', Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'Disable', Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance: Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.213440 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.219136 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-13094acb-0c1a-4ec0-8f91-ec58297bd2f0 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-13094acb-0c1a-4ec0-8f91-ec58297bd2f0 tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-858129-2" status: 400 len: 189 microversion: 2.1 time: 0.013781 Sep 16 13:53:59.223479 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 246/461] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:59 2022] PUT /compute/v2.1/os-hosts/n-d-858129-2 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:53:59.224408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6650ed56-c41a-44ad-a266-d097432e3437 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Action: 'update', calling method: .version_select at 0x7f724dbcfa60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:59.231573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6650ed56-c41a-44ad-a266-d097432e3437 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '968a43b505ab4eb2818785d2b6158c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dacf92a759b4052b1e7297b648cfa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6650ed56-c41a-44ad-a266-d097432e3437 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Request method failure captured: Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-hosts/n-d-858129-2 HTTP/1.1 Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 50 Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_wObH0VWbQiCS3IxU0umqXO41XGiqRN5HDAej__luQEYMB7Xq9eC1tKx7kY3IQecijcCjY4jzCqQZCayamj5WfWwJLg5RwbupPHDVzXBsaZ7KNBueltSKmnkJKd1c2I3SrNkQ7GyLcNXcAmTAJRMfi8b3_wT77NzUujYbZwfaOIoU Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:53:59.240043 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4dacf92a759b4052b1e7297b648cfa53", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4dacf92a759b4052b1e7297b648cfa53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4dacf92a759b4052b1e7297b648cfa53"}]}] Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 4dacf92a759b4052b1e7297b648cfa53 Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1070991674 Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 968a43b505ab4eb2818785d2b6158c1a Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1070991674-project Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: {"status": "enable", "maintenance_mode": "enable"} Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 16 13:53:59.242714 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'n-d-858129-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:59.244220 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 16 13:53:59.256449 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.259549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6650ed56-c41a-44ad-a266-d097432e3437 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.259549 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6650ed56-c41a-44ad-a266-d097432e3437 tempest-HostsAdminNegativeTestJSON-1070991674 tempest-HostsAdminNegativeTestJSON-1070991674-project] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-858129-2" status: 403 len: 111 microversion: 2.1 time: 0.026021 Sep 16 13:53:59.259549 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 247/462] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:59 2022] PUT /compute/v2.1/os-hosts/n-d-858129-2 => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:53:59.270800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d648fe80-1fbb-40cd-8ccc-6ac7cf51c8ce tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Action: 'update', calling method: .version_select at 0x7f724db301f0>, body: {"status": null, "maintenance_mode": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d648fe80-1fbb-40cd-8ccc-6ac7cf51c8ce tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-hosts/n-d-858129-2 HTTP/1.1 Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 42 Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:59.283218 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: {"status": null, "maintenance_mode": null} Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 16 13:53:59.285660 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'n-d-858129-2', 'body': {'status': None, 'maintenance_mode': None}} Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'disable', Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'Enable', Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'Disable', Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance: Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi None Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.287732 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.293101 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d648fe80-1fbb-40cd-8ccc-6ac7cf51c8ce tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d648fe80-1fbb-40cd-8ccc-6ac7cf51c8ce tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-858129-2" status: 400 len: 127 microversion: 2.1 time: 0.027169 Sep 16 13:53:59.298204 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 248/463] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:53:59 2022] PUT /compute/v2.1/os-hosts/n-d-858129-2 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:53:59.317862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf8e4a30-c7a6-4ca6-8fbb-313290bc264a tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Action: 'update', calling method: .version_select at 0x7f724db61280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:53:59.343220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.hosts [None req-cf8e4a30-c7a6-4ca6-8fbb-313290bc264a tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Enabling host nonexistent_hostname. Sep 16 13:53:59.373615 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-cf8e4a30-c7a6-4ca6-8fbb-313290bc264a tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf8e4a30-c7a6-4ca6-8fbb-313290bc264a tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Request method failure captured: Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 50 Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_z2H2xsJvSp_NrHNxDVEhVeLOSrUzDXt4_nRV68Wl6C-0sQPW1GQdzFSXDObLghDGO3eDwvaDnCMo_KHFASR6hUPFgZGgTxPCzZedLlmxzKHidblP33ayZxOO5JILezvszLOmFpQIDF-7whyMd4Ubz7jlc-R7uXjuI2L87A_UWdRI Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:53:59.375588 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b632aa45f6a3409b8a4a77bd5086a333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b632aa45f6a3409b8a4a77bd5086a333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b632aa45f6a3409b8a4a77bd5086a333"}]}] Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b632aa45f6a3409b8a4a77bd5086a333 Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-937627494 Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f2613ac190ae41799f265dac72172126 Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HostsAdminNegativeTestJSON-937627494-project-admin Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: {"status": "enable", "maintenance_mode": "enable"} Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.377853 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 16 13:53:59.380388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:53:59.381632 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:53:59.384026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf8e4a30-c7a6-4ca6-8fbb-313290bc264a tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:53:59.386610 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf8e4a30-c7a6-4ca6-8fbb-313290bc264a tempest-HostsAdminNegativeTestJSON-937627494 tempest-HostsAdminNegativeTestJSON-937627494-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.065361 Sep 16 13:53:59.386610 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 249/464] 10.222.0.60 () {60 vars in 1211 bytes} [Fri Sep 16 13:53:59 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:53:59.935296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:53:59.936400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:53:59.953088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:59.953760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:59.956762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:53:59.957790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:53:59.958525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:53:59.960243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:00.016237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:00.038466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9dc99a5c-04fa-4774-91e6-eb14364bdd3d tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Action: 'create', calling method: .version_select at 0x7f724dd460d0>, body: {"pool": null} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:00.147094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:00.170281 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0747a1a7-52dd-4e04-ab41-25cd6f8d9ddb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1263 microversion: 2.1 time: 0.240700 Sep 16 13:54:00.183081 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 250/465] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:53:59 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1263 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:54:01.210900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:01.212698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:01.225673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:01.231535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:01.232573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:01.235954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:01.238348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:01.239419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:01.438287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:01.455246 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b47adb68-d88d-4e06-bbee-6938fc4aff33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1269 microversion: 2.1 time: 0.261381 Sep 16 13:54:01.460248 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 251/466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:01 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1269 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:02.963386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1493949271", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:03.136208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:04.139182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:04.139996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:04.141163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:04.142311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:04.146034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:04.177780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:04.185745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:04.187281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:04.189206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:04.190555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:04.193823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:04.269551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Getting quotas for project c425fbef4351482cb4fae31b05007b44. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:04.283624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Getting quotas for user 591f03e87a5f45498a2f1025f41123c8 and project c425fbef4351482cb4fae31b05007b44. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:04.309848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:04.316962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:04.425588 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d02f7da3-99f4-4a17-a5ce-923a2c3d07c8 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095783 Sep 16 13:54:04.428852 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 252/467] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:54:04.448546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:04.449586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:04.477899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:04.478877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:04.479397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:04.480750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:04.481834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:04.482477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:04.763351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:04.792159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b23bdb10-333d-4b2a-9c9d-558b201b2fe5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1269 microversion: 2.1 time: 0.357822 Sep 16 13:54:04.811045 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 253/468] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:04 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1269 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:04.840154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d01eb45-c847-495a-bdd9-b228419a8b73 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:04.841484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d01eb45-c847-495a-bdd9-b228419a8b73 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:05.104629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d01eb45-c847-495a-bdd9-b228419a8b73 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:05.125807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d01eb45-c847-495a-bdd9-b228419a8b73 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1222 microversion: 2.1 time: 0.301023 Sep 16 13:54:05.128053 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 254/469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:04 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1222 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:05.840358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:05.841437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:05.852805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:05.853294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:05.853726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:05.854532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:05.854993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:05.855414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:05.918276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9dc99a5c-04fa-4774-91e6-eb14364bdd3d tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.842926 Sep 16 13:54:05.931683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 216/470] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 13:53:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:05.941115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2692d089-f853-4201-b8b1-14887e6500f9 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Calling method '.version_select at 0x7f724da3ac10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:06.039425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:06.058999 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a4618cd-c71c-4b26-9969-06f50d7f8973 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1269 microversion: 2.1 time: 0.224665 Sep 16 13:54:06.061182 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 255/471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:05 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:06.350903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:06.375299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:06.445672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9a94203-a509-4b60-bd02-cc46c0d81e84 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Calling method '.version_select at 0x7f724dbcf430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:06.448067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9a94203-a509-4b60-bd02-cc46c0d81e84 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'de64ccf2e44e466e853dab3051746ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e427448ddd94e538a574332be0e1672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9a94203-a509-4b60-bd02-cc46c0d81e84 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Request method failure captured: Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_7qAugPTXBvZpzpnKmVUZ0CFRme7_GspPW9HRIVPTTw46159MEeXkLEbG8k7RXxadQMubS_kXqWxi-wC9ev8kjJZ8bxZHOisNMyRyJ_bm9T6Sl99i7dhbfhsd2pTLkFnVceDYBy5QF-RaVpl4ev4-W9RUQU3n2Ab2zC7BmQHOtn1g Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:54:06.467518 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e427448ddd94e538a574332be0e1672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e427448ddd94e538a574332be0e1672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}] Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: de64ccf2e44e466e853dab3051746ccc Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 13:54:06.468817 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:54:06.469662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 16 13:54:06.470705 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:06.471729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9a94203-a509-4b60-bd02-cc46c0d81e84 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:06.471729 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9a94203-a509-4b60-bd02-cc46c0d81e84 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.406848 Sep 16 13:54:06.471729 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 256/472] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 13:54:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 408 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:06.480065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:06.480689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:06.514003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:06.516766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:06.517643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:06.533553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:06.535867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:06.538285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:06.622249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2692d089-f853-4201-b8b1-14887e6500f9 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/6ab4e193-489b-4134-9758-0222624dcbc7" status: 200 len: 141 microversion: 2.1 time: 0.685306 Sep 16 13:54:06.630354 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 217/473] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 13:54:05 2022] GET /compute/v2.1/os-floating-ips/6ab4e193-489b-4134-9758-0222624dcbc7 => generated 141 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:54:06.630354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4599ff74-bed5-47b4-b0d5-cb4a589f8826 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Calling method '.version_select at 0x7f724da3aa60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:06.631396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4599ff74-bed5-47b4-b0d5-cb4a589f8826 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'de64ccf2e44e466e853dab3051746ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e427448ddd94e538a574332be0e1672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4599ff74-bed5-47b4-b0d5-cb4a589f8826 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Request method failure captured: Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_7qAugPTXBvZpzpnKmVUZ0CFRme7_GspPW9HRIVPTTw46159MEeXkLEbG8k7RXxadQMubS_kXqWxi-wC9ev8kjJZ8bxZHOisNMyRyJ_bm9T6Sl99i7dhbfhsd2pTLkFnVceDYBy5QF-RaVpl4ev4-W9RUQU3n2Ab2zC7BmQHOtn1g Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:54:06.640113 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e427448ddd94e538a574332be0e1672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e427448ddd94e538a574332be0e1672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}] Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: de64ccf2e44e466e853dab3051746ccc Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: action_args: {} Sep 16 13:54:06.642341 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:54:06.643144 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 16 13:54:06.644567 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:06.646129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4599ff74-bed5-47b4-b0d5-cb4a589f8826 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:06.646129 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4599ff74-bed5-47b4-b0d5-cb4a589f8826 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.016957 Sep 16 13:54:06.650889 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 218/474] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:54:06 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:06.668759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72d68102-eac3-4648-9acf-6bfcbce7c80d tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Calling method '.version_select at 0x7f724da3a0d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:06.987493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:07.014292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f70848dc-2c2a-4267-ab64-505130566824 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1274 microversion: 2.1 time: 0.543126 Sep 16 13:54:07.018379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 257/475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:06 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1274 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:07.028737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84334679-69a5-4075-a452-77703b0ca20a tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Calling method '.version_select at 0x7f724dbcf430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:07.035391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84334679-69a5-4075-a452-77703b0ca20a tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'de64ccf2e44e466e853dab3051746ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e427448ddd94e538a574332be0e1672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84334679-69a5-4075-a452-77703b0ca20a tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Request method failure captured: Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_7qAugPTXBvZpzpnKmVUZ0CFRme7_GspPW9HRIVPTTw46159MEeXkLEbG8k7RXxadQMubS_kXqWxi-wC9ev8kjJZ8bxZHOisNMyRyJ_bm9T6Sl99i7dhbfhsd2pTLkFnVceDYBy5QF-RaVpl4ev4-W9RUQU3n2Ab2zC7BmQHOtn1g Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:54:07.037527 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e427448ddd94e538a574332be0e1672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e427448ddd94e538a574332be0e1672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}] Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: de64ccf2e44e466e853dab3051746ccc Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 13:54:07.039094 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:54:07.039864 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 16 13:54:07.040960 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:07.045333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84334679-69a5-4075-a452-77703b0ca20a tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:07.046890 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-84334679-69a5-4075-a452-77703b0ca20a tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027086 Sep 16 13:54:07.049876 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 258/476] 10.222.0.60 () {58 vars in 1179 bytes} [Fri Sep 16 13:54:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:07.438826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=15 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:07.534063 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72d68102-eac3-4648-9acf-6bfcbce7c80d tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.881505 Sep 16 13:54:07.556136 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 219/477] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:54:06 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:07.584472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:07.585778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:07.622088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:07.623277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:07.626478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:07.630598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:07.632198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:07.636718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:07.735260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Calling method '.version_select at 0x7f724dd523a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:07.737451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:07.738062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:07.738644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:07.764960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:07.765824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:07.766514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:07.779771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:07.780634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:07.781462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:07.826569 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e76bebc8-46e4-41a8-94ae-0840262b5abf tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.756927 Sep 16 13:54:07.826569 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 259/478] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:54:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:08.074711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724db61160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:08.076663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:08.077131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:08.077759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:08.111623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:08.112132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:08.112852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:08.141179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:08.144332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:08.149630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:08.167493 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be63bea7-b692-426b-9591-0638e143bda2 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.341313 Sep 16 13:54:08.172543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 260/479] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:54:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:08.189966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6dd688c4-396f-42ea-8548-40136758d00d tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Calling method '.version_select at 0x7f724db611f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:08.711667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:08.757189 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d6d8ae21-0609-4ec0-9ef9-5f5cd72a03f8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1311 microversion: 2.1 time: 1.198908 Sep 16 13:54:08.759175 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 220/480] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:07 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1311 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:08.770392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2afff3a3-a810-4d76-8787-318308045d1f tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Calling method '.version_select at 0x7f724da14700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:08.776038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2afff3a3-a810-4d76-8787-318308045d1f tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'de64ccf2e44e466e853dab3051746ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e427448ddd94e538a574332be0e1672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2afff3a3-a810-4d76-8787-318308045d1f tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Request method failure captured: Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_7qAugPTXBvZpzpnKmVUZ0CFRme7_GspPW9HRIVPTTw46159MEeXkLEbG8k7RXxadQMubS_kXqWxi-wC9ev8kjJZ8bxZHOisNMyRyJ_bm9T6Sl99i7dhbfhsd2pTLkFnVceDYBy5QF-RaVpl4ev4-W9RUQU3n2Ab2zC7BmQHOtn1g Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:54:08.779895 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e427448ddd94e538a574332be0e1672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e427448ddd94e538a574332be0e1672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}] Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: de64ccf2e44e466e853dab3051746ccc Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1'} Sep 16 13:54:08.781373 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:54:08.782169 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 16 13:54:08.783537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:08.790779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2afff3a3-a810-4d76-8787-318308045d1f tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:08.790779 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2afff3a3-a810-4d76-8787-318308045d1f tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021474 Sep 16 13:54:08.790779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 221/481] 10.222.0.60 () {58 vars in 1173 bytes} [Fri Sep 16 13:54:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:08.796035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:08.797451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:08.813499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:08.814819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:08.816691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:08.826177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:08.828357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:08.829609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:09.988947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:10.029151 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98fca5ee-4f80-4dcb-90aa-d827b372e229 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1280 microversion: 2.1 time: 1.241047 Sep 16 13:54:10.033560 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 222/482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:08 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1280 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:10.045792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724da14d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:10.053488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:10.057061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:10.057704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:10.096242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:10.096749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:10.097198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:10.124804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:10.125305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:10.126449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:10.141289 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17713161-ad2b-4cdf-8ae7-f9609b7c6e36 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.105819 Sep 16 13:54:10.156896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 223/483] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 13:54:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:10.170247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d5f8103-a27f-4e75-a9ff-8d0e4183d3cb tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Calling method '.version_select at 0x7f724da14550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:10.175642 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7d5f8103-a27f-4e75-a9ff-8d0e4183d3cb tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] HTTP exception thrown: Hypervisor with ID '6dc2081d-90f3-4c61-8939-51ab6ade0d4b' could not be found. Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d5f8103-a27f-4e75-a9ff-8d0e4183d3cb tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Request method failure captured: Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/6dc2081d-90f3-4c61-8939-51ab6ade0d4b/uptime HTTP/1.1 Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_95mTa85bhO_11mizIAK4f4SLbaKSgKl4w3jutUTnzTtwqxInZX20AIz9Z5cMuF5F4LDDb3VTrtS0mXx0WM0h80eetIovho52o5ccb3WwznzP8jVAwTeempBVoOdSWe59ZBo0aFI1E4-OaoOExsNKzYaIQ_pdUySU6Ybdo1oymAbA Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 79c84de0a9b0413da5df452c9d397052 Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1244780209 Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:54:10.187745 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79c84de0a9b0413da5df452c9d397052", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79c84de0a9b0413da5df452c9d397052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79c84de0a9b0413da5df452c9d397052"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79c84de0a9b0413da5df452c9d397052"}]}] Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1244780209 Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 79c84de0a9b0413da5df452c9d397052 Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1244780209 Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7123cce9585847b58f1dc42c7bdb8d9f Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: exception: Hypervisor with ID '6dc2081d-90f3-4c61-8939-51ab6ade0d4b' could not be found. Sep 16 13:54:10.189330 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '6dc2081d-90f3-4c61-8939-51ab6ade0d4b'} Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6dc2081d-90f3-4c61-8939-51ab6ade0d4b' Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 16 13:54:10.191301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6dc2081d-90f3-4c61-8939-51ab6ade0d4b' could not be found. Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:10.193266 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6dc2081d-90f3-4c61-8939-51ab6ade0d4b' could not be found. Sep 16 13:54:10.194698 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:10.196632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d5f8103-a27f-4e75-a9ff-8d0e4183d3cb tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Returning 404 to user: Hypervisor with ID '6dc2081d-90f3-4c61-8939-51ab6ade0d4b' could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:10.199566 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d5f8103-a27f-4e75-a9ff-8d0e4183d3cb tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/6dc2081d-90f3-4c61-8939-51ab6ade0d4b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.041482 Sep 16 13:54:10.201321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 224/484] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 13:54:10 2022] GET /compute/v2.1/os-hypervisors/6dc2081d-90f3-4c61-8939-51ab6ade0d4b/uptime => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:10.216504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4c1163ff-c06e-41e7-8671-8c7c4e5c37b5 req-862aeec2-2c9c-47a5-8ad0-2a2c50bd55d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a74a7af-9736-478c-8d65-a331a8aec11d", "tag": "63d31d28-e16d-4175-8c59-5ef3ebed49bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:10.246244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4c1163ff-c06e-41e7-8671-8c7c4e5c37b5 req-862aeec2-2c9c-47a5-8ad0-2a2c50bd55d8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:10.247158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4c1163ff-c06e-41e7-8671-8c7c4e5c37b5 req-862aeec2-2c9c-47a5-8ad0-2a2c50bd55d8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:10.247780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4c1163ff-c06e-41e7-8671-8c7c4e5c37b5 req-862aeec2-2c9c-47a5-8ad0-2a2c50bd55d8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:10.266312 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4c1163ff-c06e-41e7-8671-8c7c4e5c37b5 req-862aeec2-2c9c-47a5-8ad0-2a2c50bd55d8 service nova] Creating event network-changed:63d31d28-e16d-4175-8c59-5ef3ebed49bc for instance 9a74a7af-9736-478c-8d65-a331a8aec11d on n-h1-858129-2 Sep 16 13:54:10.307882 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4c1163ff-c06e-41e7-8671-8c7c4e5c37b5 req-862aeec2-2c9c-47a5-8ad0-2a2c50bd55d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104336 Sep 16 13:54:10.318838 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 225/485] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:10.324886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:10.325673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:10.339384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:10.340144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:10.340858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:10.341759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:10.343154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:10.344244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.247711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:11.261354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-528d05a6-e612-4b7c-b10e-8d95ede5a528 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1311 microversion: 2.1 time: 0.941079 Sep 16 13:54:11.262296 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 226/486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:10 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1311 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:11.276472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724da14790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:11.280680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.282654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.283798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.346252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.348052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.349195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.369182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.369908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.370536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.378528 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19ae7284-8963-4e78-b254-dbcccad4ee60 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.113412 Sep 16 13:54:11.379763 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 227/487] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:54:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:11.386268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Calling method '.version_select at 0x7f724da14550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:11.390262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.391738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.392620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.424487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.425435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.426198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.447329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.448371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.449211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.460666 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d87be41a-1595-480a-a761-7d4e13eef961 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079406 Sep 16 13:54:11.461942 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 228/488] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:54:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:11.470534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:11.471537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:11.484098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.484922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.485965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.487510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:11.488450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:11.489153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:11.695277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:11.705687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-83141e4c-1c67-4b95-a0b9-1121f0eb46ad tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1280 microversion: 2.1 time: 0.242290 Sep 16 13:54:11.707180 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 229/489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:11 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:11.973910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Action: 'update', calling method: .version_select at 0x7f724daae0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:12.071452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.072250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.081344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.082765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.083544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.084511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.194285 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1067162-da98-4c57-bfa9-3ecee6872e78 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8" status: 200 len: 240 microversion: 2.36 time: 0.485093 Sep 16 13:54:12.207853 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 230/490] 10.222.0.60 () {62 vars in 1303 bytes} [Fri Sep 16 13:54:11 2022] PUT /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8 => generated 240 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:12.217424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724dd46c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:12.225429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.225971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.226978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.276670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.277547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.278393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.300006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1a8e519-897d-46f4-a04a-4ba8031f460a tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.089805 Sep 16 13:54:12.301586 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 231/491] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:54:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:12.315727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c2418b0-3c88-4285-8314-4eb411b75978 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Calling method '.version_select at 0x7f724da14430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:12.320111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2c2418b0-3c88-4285-8314-4eb411b75978 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'de64ccf2e44e466e853dab3051746ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e427448ddd94e538a574332be0e1672', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c2418b0-3c88-4285-8314-4eb411b75978 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Request method failure captured: Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_7qAugPTXBvZpzpnKmVUZ0CFRme7_GspPW9HRIVPTTw46159MEeXkLEbG8k7RXxadQMubS_kXqWxi-wC9ev8kjJZ8bxZHOisNMyRyJ_bm9T6Sl99i7dhbfhsd2pTLkFnVceDYBy5QF-RaVpl4ev4-W9RUQU3n2Ab2zC7BmQHOtn1g Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:54:12.323443 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e427448ddd94e538a574332be0e1672", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e427448ddd94e538a574332be0e1672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e427448ddd94e538a574332be0e1672"}]}] Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 5e427448ddd94e538a574332be0e1672 Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046 Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: de64ccf2e44e466e853dab3051746ccc Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1779034046-project Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1'} Sep 16 13:54:12.324828 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:54:12.325603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 16 13:54:12.327183 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:12.329092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c2418b0-3c88-4285-8314-4eb411b75978 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:12.329092 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c2418b0-3c88-4285-8314-4eb411b75978 tempest-HypervisorAdminNegativeTestJSON-1779034046 tempest-HypervisorAdminNegativeTestJSON-1779034046-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022385 Sep 16 13:54:12.330643 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 232/492] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:54:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:12.336090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Calling method '.version_select at 0x7f724daa3310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:12.434255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.435175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.435943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.437537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.438396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.439369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.477470 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66e5d91e-aef8-422d-8e8b-8ab4fcd26cab tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8/detail" status: 200 len: 672 microversion: 2.36 time: 0.144380 Sep 16 13:54:12.478489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 233/493] 10.222.0.60 () {60 vars in 1304 bytes} [Fri Sep 16 13:54:12 2022] GET /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8/detail => generated 672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:12.484485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:12.485644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:12.502516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.503484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.504187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:12.505575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:12.506330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:12.507340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.245614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:13.264367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c2d557c-46e6-407a-ade9-984b01dd3981 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1311 microversion: 2.1 time: 0.783855 Sep 16 13:54:13.311909 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 234/494] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:12 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1311 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:13.336789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64fb3646-8078-4e5b-9971-8f55786cf1ad tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724da14550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:13.343539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fb3646-8078-4e5b-9971-8f55786cf1ad tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.344739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fb3646-8078-4e5b-9971-8f55786cf1ad tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.345815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fb3646-8078-4e5b-9971-8f55786cf1ad tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.392530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-64fb3646-8078-4e5b-9971-8f55786cf1ad tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.076141 Sep 16 13:54:13.402441 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 235/495] 10.222.0.60 () {58 vars in 1179 bytes} [Fri Sep 16 13:54:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:13.407116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afda29cb-6adc-46e1-92cf-8dcd6cbbd0e0 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Calling method '.version_select at 0x7f724da14af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:13.414151 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6dd688c4-396f-42ea-8548-40136758d00d tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/6ab4e193-489b-4134-9758-0222624dcbc7" status: 202 len: 0 microversion: 2.1 time: 5.239255 Sep 16 13:54:13.418953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-afda29cb-6adc-46e1-92cf-8dcd6cbbd0e0 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] HTTP exception thrown: Hypervisor with ID 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466' could not be found. Sep 16 13:54:13.420595 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 261/496] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:54:08 2022] DELETE /compute/v2.1/os-floating-ips/6ab4e193-489b-4134-9758-0222624dcbc7 => generated 0 bytes in 5247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afda29cb-6adc-46e1-92cf-8dcd6cbbd0e0 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Request method failure captured: Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466 HTTP/1.1 Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_95mTa85bhO_11mizIAK4f4SLbaKSgKl4w3jutUTnzTtwqxInZX20AIz9Z5cMuF5F4LDDb3VTrtS0mXx0WM0h80eetIovho52o5ccb3WwznzP8jVAwTeempBVoOdSWe59ZBo0aFI1E4-OaoOExsNKzYaIQ_pdUySU6Ybdo1oymAbA Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 79c84de0a9b0413da5df452c9d397052 Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1244780209 Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:54:13.426742 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79c84de0a9b0413da5df452c9d397052", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79c84de0a9b0413da5df452c9d397052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79c84de0a9b0413da5df452c9d397052"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79c84de0a9b0413da5df452c9d397052"}]}] Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1244780209 Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 79c84de0a9b0413da5df452c9d397052 Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1244780209 Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7123cce9585847b58f1dc42c7bdb8d9f Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: exception: Hypervisor with ID 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466' could not be found. Sep 16 13:54:13.429288 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466'} Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466' Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 16 13:54:13.431493 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:54:13.435480 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466' could not be found. Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466' could not be found. Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:13.442024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afda29cb-6adc-46e1-92cf-8dcd6cbbd0e0 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] Returning 404 to user: Hypervisor with ID 'ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466' could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:13.444118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-afda29cb-6adc-46e1-92cf-8dcd6cbbd0e0 tempest-HypervisorAdminNegativeTestJSON-1244780209 tempest-HypervisorAdminNegativeTestJSON-1244780209-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466" status: 404 len: 123 microversion: 2.1 time: 0.042714 Sep 16 13:54:13.445299 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 236/497] 10.222.0.60 () {58 vars in 1257 bytes} [Fri Sep 16 13:54:13 2022] GET /compute/v2.1/os-hypervisors/ec1fb58a-ec2a-458c-96cd-f9f1dd7cf466 => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:13.467789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Action: 'update', calling method: .version_select at 0x7f724db31940>, body: {"quota_set": {"ram": "2048"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:13.470140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:13.476201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:13.488796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:13.537159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.540484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.541517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.549172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.550429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.551234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.766784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.767671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.768435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.771859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.772794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.774085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.915919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.916398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.916848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:13.917716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:13.918123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:13.918594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:14.125153 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f9fb9c9-869e-4d58-8623-94baddc4ffe0 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8?user_id=d70e5b9ec41c4ffdb54e406e151c6d7e" status: 200 len: 240 microversion: 2.36 time: 0.689240 Sep 16 13:54:14.138551 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 262/498] 10.222.0.60 () {62 vars in 1384 bytes} [Fri Sep 16 13:54:13 2022] PUT /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8?user_id=d70e5b9ec41c4ffdb54e406e151c6d7e => generated 240 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:14.150734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724db5fee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:14.153270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:14.166359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:14.167334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:14.203518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:14.206382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:14.207602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:14.245814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:14.246314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:14.246793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:14.269002 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d72e58bb-c640-4a6e-b086-5f65084eb250 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.128613 Sep 16 13:54:14.295666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 263/499] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:54:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:14.321611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-968d33e5-a68d-4de3-9c50-f11c8830389c tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Action: 'create', calling method: .version_select at 0x7f724db5ff70>, body: {"pool": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:14.664130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:14.690699 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53f133e9-9794-474d-a446-402201dcaa04 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1322 microversion: 2.1 time: 1.243310 Sep 16 13:54:14.693184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 237/500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:13 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1322 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:14.719985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff126211-e7b3-4b6a-820d-89783bb21862 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] Calling method '.version_select at 0x7f724da14af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:15.473406 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff126211-e7b3-4b6a-820d-89783bb21862 tempest-QuotasAdminTestV236-672219509 tempest-QuotasAdminTestV236-672219509-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8?user_id=d70e5b9ec41c4ffdb54e406e151c6d7e" status: 200 len: 282 microversion: 2.36 time: 0.777948 Sep 16 13:54:15.476289 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 238/501] 10.222.0.60 () {60 vars in 1364 bytes} [Fri Sep 16 13:54:14 2022] GET /compute/v2.1/os-quota-sets/7daf9ba460a9400eb41673a89b9de8e8?user_id=d70e5b9ec41c4ffdb54e406e151c6d7e => generated 282 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:15.486394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724da143a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:15.490005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:15.490820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:15.491928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:15.517984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:15.518865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:15.520081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:15.532022 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-382afd3e-a341-4364-bf6d-7017ffe1d103 tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.053736 Sep 16 13:54:15.535281 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 239/502] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:54:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:15.543715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:15.544750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:15.555488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:15.556633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:15.557654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:15.558945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:15.559829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:15.560463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:16.211936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:16.232205 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-022c0b23-743b-4572-9ba7-9b7edc0e2221 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1311 microversion: 2.1 time: 0.694725 Sep 16 13:54:16.234461 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 240/503] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:15 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1311 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:16.244012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724da3ab80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:16.246109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:16.246636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:16.247786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:16.265353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:16.266319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:16.267757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:16.283764 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b786ec9d-a0e3-4c72-8d0b-6127050caa3d tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.046678 Sep 16 13:54:16.287334 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 241/504] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 13:54:16 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:16.305439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:16.307138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:16.328158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:16.329729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:16.330364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:16.331746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:16.332843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:16.334719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:17.293595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:17.310456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-695f35ae-a28b-4b83-9d60-39d361b57e8c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1322 microversion: 2.1 time: 1.020011 Sep 16 13:54:17.312995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 242/505] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:16 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1322 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:17.327077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Calling method '.version_select at 0x7f724daae040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:17.333289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:17.334372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:17.335539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:17.373577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:17.374107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:17.375726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:17.411207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:17.412386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:17.415472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:17.463740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4cfd245f-9c83-48c4-8c0e-acdc28b3880c tempest-HypervisorAdminTestJSON-1238332857 tempest-HypervisorAdminTestJSON-1238332857-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.149112 Sep 16 13:54:17.470191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 243/506] 10.222.0.60 () {58 vars in 1173 bytes} [Fri Sep 16 13:54:17 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:17.490607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8970672a-e44a-4590-b227-e1423bcdaaeb req-251d028a-6a22-4008-ae52-c2cca994dd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc", "tag": "12597ee0-4d47-47b7-b883-373c3d2c3e30"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:17.517016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8970672a-e44a-4590-b227-e1423bcdaaeb req-251d028a-6a22-4008-ae52-c2cca994dd6c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:17.521035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8970672a-e44a-4590-b227-e1423bcdaaeb req-251d028a-6a22-4008-ae52-c2cca994dd6c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:17.522338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8970672a-e44a-4590-b227-e1423bcdaaeb req-251d028a-6a22-4008-ae52-c2cca994dd6c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:17.559618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8970672a-e44a-4590-b227-e1423bcdaaeb req-251d028a-6a22-4008-ae52-c2cca994dd6c service nova] Creating event network-changed:12597ee0-4d47-47b7-b883-373c3d2c3e30 for instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc on n-h2-858129-2 Sep 16 13:54:17.568521 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8970672a-e44a-4590-b227-e1423bcdaaeb req-251d028a-6a22-4008-ae52-c2cca994dd6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093739 Sep 16 13:54:17.569762 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 244/507] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:17.581386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:17.587380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:17.608181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:17.608681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:17.609127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:17.614466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:17.615012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:17.616993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:18.399468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:18.403585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:18.416155 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d72c5816-ca8e-4756-aa0a-2b8a44c245ca tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1311 microversion: 2.1 time: 0.835287 Sep 16 13:54:18.416683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 245/508] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:17 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1311 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:18.438680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b66fec74-d000-49cb-bb03-350a8fd7aa6a req-4f74edd2-8cb6-449b-a4e3-fbc9aec0836e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a74a7af-9736-478c-8d65-a331a8aec11d", "name": "network-vif-plugged", "status": "completed", "tag": "63d31d28-e16d-4175-8c59-5ef3ebed49bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:18.451532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b66fec74-d000-49cb-bb03-350a8fd7aa6a req-4f74edd2-8cb6-449b-a4e3-fbc9aec0836e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:18.452154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b66fec74-d000-49cb-bb03-350a8fd7aa6a req-4f74edd2-8cb6-449b-a4e3-fbc9aec0836e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:18.452474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b66fec74-d000-49cb-bb03-350a8fd7aa6a req-4f74edd2-8cb6-449b-a4e3-fbc9aec0836e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:18.465770 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b66fec74-d000-49cb-bb03-350a8fd7aa6a req-4f74edd2-8cb6-449b-a4e3-fbc9aec0836e service nova] Creating event network-vif-plugged:63d31d28-e16d-4175-8c59-5ef3ebed49bc for instance 9a74a7af-9736-478c-8d65-a331a8aec11d on n-h1-858129-2 Sep 16 13:54:18.471588 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b66fec74-d000-49cb-bb03-350a8fd7aa6a req-4f74edd2-8cb6-449b-a4e3-fbc9aec0836e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053469 Sep 16 13:54:18.476952 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 246/509] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:18.482836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:18.483939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:18.490966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:18.492705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:18.493415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:18.494389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:18.495148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:18.496531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:19.204920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:19.221844 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7792ba54-50a3-4dae-8f82-0605fc1d0390 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1322 microversion: 2.1 time: 0.743259 Sep 16 13:54:19.223334 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 247/510] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:18 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1322 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:19.736621 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-968d33e5-a68d-4de3-9c50-f11c8830389c tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.439835 Sep 16 13:54:19.737526 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 264/511] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 13:54:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:19.743261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:19.744161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:19.778693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:19.779256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:19.779707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:19.781293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:19.781918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:19.782356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:19.860351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1920951769", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "72957846-66c4-4f63-b24e-6ce8e865631e"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:20.051439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] validate_networks() for [('72957846-66c4-4f63-b24e-6ce8e865631e', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:20.340248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:20.357657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3df147b5-f5f9-4ee5-b577-b816d4a84f5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1311 microversion: 2.1 time: 0.618666 Sep 16 13:54:20.363065 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 265/512] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:19 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1311 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:20.372087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b738cb3-7711-400a-b5ec-a1e0e788f302 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Calling method '.version_select at 0x7f724dbed820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:21.500665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:21.501460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:21.501853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:21.502605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:21.503152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:21.519979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:21.522025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:21.522865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:21.528478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:21.530370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:21.531668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:21.582058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:21.600873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for user 916231d4d6114380b4e48d428d6dd843 and project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:21.634712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:21.638199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:21.756121 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a217d556-5dcf-404b-be23-2e596d102caa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.531254 Sep 16 13:54:21.759561 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 248/513] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 13:54:21.775141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:21.776029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:21.796520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:21.797902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:21.798212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:21.802207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:21.803565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:21.804231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:22.810133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:22.835033 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ead38482-cc48-4860-8207-cdd7b8b5270a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1322 microversion: 2.1 time: 1.063516 Sep 16 13:54:22.857182 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 249/514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:21 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1322 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:23.465179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1442859852", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:23.645594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:23.894266 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b738cb3-7711-400a-b5ec-a1e0e788f302 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c" status: 202 len: 0 microversion: 2.1 time: 3.527211 Sep 16 13:54:23.896234 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 266/515] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:54:20 2022] DELETE /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c => generated 0 bytes in 3532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:23.914503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:23.918062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:23.931734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:23.932746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:23.933393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:23.935032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:23.935699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:23.936393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:23.968272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:24.109288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=22 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:24.225171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:24.226007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:24.226007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:24.227034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:24.227466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:24.234181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:24.246169 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e016e353-6847-4af3-b3fe-d7d67988ffeb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1460 microversion: 2.1 time: 0.347704 Sep 16 13:54:24.246819 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 267/516] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:23 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1460 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:24.265171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:24.265664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:24.266101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:24.266952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:24.267415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:24.267844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:24.271809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:24.272427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:24.283160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:24.283964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:24.284715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:24.285730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:24.286374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:24.286998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:24.313829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Getting quotas for project 0be8e21f9d2d436285f91238eb580125. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:24.323007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Getting quotas for user f7b24d82070f42f59776a115147e9678 and project 0be8e21f9d2d436285f91238eb580125. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:24.349791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:24.353469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:24.377134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:24.390483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:24.392854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:24.394833 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-85d56610-84bc-4cb9-aec5-ba4f4f1d76e7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1320 microversion: 2.25 time: 0.146920 Sep 16 13:54:24.395983 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 268/517] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:24 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:24.444112 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0716533f-a447-4a4c-86c3-213826aef44f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585280 Sep 16 13:54:24.459463 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 250/518] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:54:24.468641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:24.470647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:24.485180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:24.485970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:24.486629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:24.487562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:24.488325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:24.489014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:24.724776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:24.737919 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ebdc48a-753a-4a6a-9871-21b9e1ec9345 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1322 microversion: 2.1 time: 0.276542 Sep 16 13:54:24.746452 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 251/519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:24 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:24.748580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ecd603a-2781-479a-bbec-04052386ae58 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Calling method '.version_select at 0x7f724da1b550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:24.759785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d28160e9-e7ee-438f-8ec7-d49d82290088 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] Action: 'create', calling method: .version_select at 0x7f724daf9550>, body: {"security_group": {"name": "tempest-securitygroup-1364376155", "description": "tempest-description-1136260320"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:24.815277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-3ecd603a-2781-479a-bbec-04052386ae58 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a6622326-94a6-4b52-b0d0-b5b00858b04c could not be found", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:54:24.816759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3ecd603a-2781-479a-bbec-04052386ae58 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] HTTP exception thrown: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ecd603a-2781-479a-bbec-04052386ae58 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Request method failure captured: Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c HTTP/1.1 Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_2OVywC7f-fyJ3wiNGfcww2fqfqp1kLn1NGyqtH9bUndpu9dfeX-GY47rmJxGfD15Rc6u44gfas4jwg1NiE-Q1Ha9RVxjWjnZo6l31huO1noIB2FnoklBmBOjLcH8v5bVfKXh2L-jlYbb0JyddbztmZ2NECPKM3cjoG5NpT_ignes Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b3a85e8d3a5a496e8820c9c39eb30dca Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FloatingIPsTestJSON-1589217039 Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:54:24.847334 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b3a85e8d3a5a496e8820c9c39eb30dca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3a85e8d3a5a496e8820c9c39eb30dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b3a85e8d3a5a496e8820c9c39eb30dca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3a85e8d3a5a496e8820c9c39eb30dca"}]}] Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FloatingIPsTestJSON-1589217039 Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b3a85e8d3a5a496e8820c9c39eb30dca Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1589217039 Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FloatingIPsTestJSON-1589217039-project Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 950de8f470de4b8c806ce50d7cf90be6 Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FloatingIPsTestJSON-1589217039-project Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: exception: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a6622326-94a6-4b52-b0d0-b5b00858b04c'} Sep 16 13:54:24.848810 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:54:24.849629 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a6622326-94a6-4b52-b0d0-b5b00858b04c could not be found Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b55b04e-0199-43e3-9696-41cf76382ed0'] Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c. Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:24.852705 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:54:24.854317 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:54:24.855810 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:24.855810 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:24.855810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ecd603a-2781-479a-bbec-04052386ae58 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Returning 404 to user: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:24.855810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ecd603a-2781-479a-bbec-04052386ae58 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c" status: 404 len: 111 microversion: 2.1 time: 0.109326 Sep 16 13:54:24.860524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 252/520] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 13:54:24 2022] GET /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:24.939868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-330d2c62-9f5f-4ee5-92ad-314b304bb193 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Action: 'create', calling method: .version_select at 0x7f724d8cc820>, body: {"keypair": {"name": "tempest-keypair-541771548", "type": "ssh", "user_id": "a849e9ee7b7c459faea581fecf4c61e0", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiO0u3wsengzPCOvYv/b3bEbu3LG5HQV1DxnZwKhUzxM+37/zQUVqXgsSmdYf6Kgt9COCgqjTqA7foRmhHBlLMsYP1hzf8JwBruDZaTg1bY0Io/vsCf1sEmCABhZ5DuHA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:24.980305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-330d2c62-9f5f-4ee5-92ad-314b304bb193 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Getting quotas for project 70051a71b117439f918de5b1b10c2974. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:24.995874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-330d2c62-9f5f-4ee5-92ad-314b304bb193 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Getting quotas for user 2a6df511bd6a46189be753cb6b90b435 and project 70051a71b117439f918de5b1b10c2974. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:25.055414 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-330d2c62-9f5f-4ee5-92ad-314b304bb193 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.188613 Sep 16 13:54:25.064186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 253/521] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 13:54:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:54:25.073818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:25.077763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:25.089258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:25.090158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:25.091332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:25.093308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:25.094184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:25.095040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:25.326060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:25.338944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 13:54:25.355829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:25.359138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:25.360460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:25.371252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:25.374083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:25.377080 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d28160e9-e7ee-438f-8ec7-d49d82290088 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.978797 Sep 16 13:54:25.377080 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 269/522] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 13:54:24 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:25.382226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-200239295", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:25.485893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:25.562120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bad99d0f-ca87-4b00-99f9-386359375ae1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d/action" status: 202 len: 0 microversion: 2.1 time: 0.496284 Sep 16 13:54:25.562881 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 254/523] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:54:25 2022] POST /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:25.568452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e012d2ce-5b65-42aa-ab3c-6dc4b0c0fe10 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Calling method '.version_select at 0x7f724daa3dc0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:25.694795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-e012d2ce-5b65-42aa-ab3c-6dc4b0c0fe10 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a6622326-94a6-4b52-b0d0-b5b00858b04c could not be found", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:54:25.696268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e012d2ce-5b65-42aa-ab3c-6dc4b0c0fe10 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] HTTP exception thrown: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e012d2ce-5b65-42aa-ab3c-6dc4b0c0fe10 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Request method failure captured: Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c HTTP/1.1 Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_2OVywC7f-fyJ3wiNGfcww2fqfqp1kLn1NGyqtH9bUndpu9dfeX-GY47rmJxGfD15Rc6u44gfas4jwg1NiE-Q1Ha9RVxjWjnZo6l31huO1noIB2FnoklBmBOjLcH8v5bVfKXh2L-jlYbb0JyddbztmZ2NECPKM3cjoG5NpT_ignes Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b3a85e8d3a5a496e8820c9c39eb30dca Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FloatingIPsTestJSON-1589217039 Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:54:25.699295 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b3a85e8d3a5a496e8820c9c39eb30dca", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3a85e8d3a5a496e8820c9c39eb30dca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b3a85e8d3a5a496e8820c9c39eb30dca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3a85e8d3a5a496e8820c9c39eb30dca"}]}] Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FloatingIPsTestJSON-1589217039 Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b3a85e8d3a5a496e8820c9c39eb30dca Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1589217039 Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FloatingIPsTestJSON-1589217039-project Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 950de8f470de4b8c806ce50d7cf90be6 Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FloatingIPsTestJSON-1589217039-project Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: exception: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a6622326-94a6-4b52-b0d0-b5b00858b04c'} Sep 16 13:54:25.701029 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:54:25.702212 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a6622326-94a6-4b52-b0d0-b5b00858b04c could not be found Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93a47e32-12f3-41db-9e1b-4e5aa7f5fe5f'] Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c. Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:25.703376 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:54:25.704686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:54:25.705815 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c Sep 16 13:54:25.705815 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:54:25.707680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e012d2ce-5b65-42aa-ab3c-6dc4b0c0fe10 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] Returning 404 to user: Floating IP not found for ID a6622326-94a6-4b52-b0d0-b5b00858b04c {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:25.708819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e012d2ce-5b65-42aa-ab3c-6dc4b0c0fe10 tempest-FloatingIPsTestJSON-1589217039 tempest-FloatingIPsTestJSON-1589217039-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c" status: 404 len: 111 microversion: 2.1 time: 0.144731 Sep 16 13:54:25.709968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 255/524] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:54:25 2022] DELETE /compute/v2.1/os-floating-ips/a6622326-94a6-4b52-b0d0-b5b00858b04c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:25.717193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5892229-21a6-4aef-8053-00ce2edba0de tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Action: 'create', calling method: .version_select at 0x7f724d8ccc10>, body: {"keypair": {"name": "tempest-keypair-1908528449", "type": "ssh", "user_id": "a849e9ee7b7c459faea581fecf4c61e0", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0CYHdeGA2pWuNbVwXKdhbOVffHmij9NiXJxrRlBIgcf6qwggJGXPJv3PcEMxmZlY8+P5KXySyA/J59IwD2kuNBwm7mfKM0yoeiTLUuJXwE0C8tgqwcPL3bVm3ruqZG2w=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:25.741676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d5892229-21a6-4aef-8053-00ce2edba0de tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Getting quotas for project 70051a71b117439f918de5b1b10c2974. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:25.749843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d5892229-21a6-4aef-8053-00ce2edba0de tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Getting quotas for user 2a6df511bd6a46189be753cb6b90b435 and project 70051a71b117439f918de5b1b10c2974. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:25.823688 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5892229-21a6-4aef-8053-00ce2edba0de tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.111692 Sep 16 13:54:25.824298 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 256/525] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 13:54:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:54:25.833911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3308ef7-a429-4b12-a147-00b61dc24b98 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] Action: 'create', calling method: .version_select at 0x7f724d818040>, body: {"security_group": {"name": "tempest-securitygroup-664150671", "description": "tempest-description-1934212511"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:26.241739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:26.243538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:26.244718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:26.245474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:26.249600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:26.253254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:26.272474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:26.273866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:26.275063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:26.277796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:26.279581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:26.280724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:26.335619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Getting quotas for project 0be8e21f9d2d436285f91238eb580125. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:26.349023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Getting quotas for user f7b24d82070f42f59776a115147e9678 and project 0be8e21f9d2d436285f91238eb580125. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:26.357796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3308ef7-a429-4b12-a147-00b61dc24b98 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.532398 Sep 16 13:54:26.358757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 257/526] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 13:54:25 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:26.377382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:26.380732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:26.394191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:26.397655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:26.442614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:26.443558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:26.444743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:26.445822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:26.447762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:26.449941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:26.489873 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd463127-b094-4796-8ede-ce6a65b643cc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111724 Sep 16 13:54:26.495929 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 270/527] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:54:26.525791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:26.527129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:26.561509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:26.562009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:26.562465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:26.563188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:26.563653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:26.564063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:27.381423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:27.386331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:27.426755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:27.427993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8734e849-0029-4630-9235-09731cd9276e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1469 microversion: 2.1 time: 0.921636 Sep 16 13:54:27.429313 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 271/528] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:26 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1469 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:27.432678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:27.435333 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-908917ad-87a8-4cf5-968b-488da5efb278 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1362 microversion: 2.25 time: 1.075233 Sep 16 13:54:27.436958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 258/529] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:26 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1362 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:27.447772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-009e2521-1ae2-417a-8b40-cb298ca07812 req-03e9861e-e291-4d90-9f9a-805be15bc078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc", "name": "network-vif-plugged", "status": "completed", "tag": "12597ee0-4d47-47b7-b883-373c3d2c3e30"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:27.450221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:27.451697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:27.469957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:27.472418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:27.473635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:27.475714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:27.477234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:27.478552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:27.491878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-009e2521-1ae2-417a-8b40-cb298ca07812 req-03e9861e-e291-4d90-9f9a-805be15bc078 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:27.493304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-009e2521-1ae2-417a-8b40-cb298ca07812 req-03e9861e-e291-4d90-9f9a-805be15bc078 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:27.494113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-009e2521-1ae2-417a-8b40-cb298ca07812 req-03e9861e-e291-4d90-9f9a-805be15bc078 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:27.524578 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-009e2521-1ae2-417a-8b40-cb298ca07812 req-03e9861e-e291-4d90-9f9a-805be15bc078 service nova] Creating event network-vif-plugged:12597ee0-4d47-47b7-b883-373c3d2c3e30 for instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc on n-h2-858129-2 Sep 16 13:54:27.534830 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-009e2521-1ae2-417a-8b40-cb298ca07812 req-03e9861e-e291-4d90-9f9a-805be15bc078 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102721 Sep 16 13:54:27.536871 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 272/530] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:27.554221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a261f91a-aa90-4355-a55e-b6daf2134358 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Calling method '.version_select at 0x7f724db31550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:27.582836 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a261f91a-aa90-4355-a55e-b6daf2134358 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-541771548?user_id=a849e9ee7b7c459faea581fecf4c61e0" status: 200 len: 511 microversion: 2.10 time: 0.038152 Sep 16 13:54:27.585625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 273/531] 10.222.0.60 () {60 vars in 1337 bytes} [Fri Sep 16 13:54:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-541771548?user_id=a849e9ee7b7c459faea581fecf4c61e0 => generated 511 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:27.887496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93b1e8fd-6ae5-473b-8a08-c6c3fe905b7b tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] Action: 'create', calling method: .version_select at 0x7f724db31280>, body: {"security_group": {"name": "tempest-securitygroup-112760612", "description": "tempest-description-1202939943"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:28.186915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:28.199349 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c3a0924-d284-466a-9916-28dc22554d10 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1322 microversion: 2.1 time: 0.760455 Sep 16 13:54:28.200296 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 259/532] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:27 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:28.207206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:28.208112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:28.216793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:28.218497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:28.219097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:28.220329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:28.223298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:28.224379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:28.344594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:28.355330 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2b6ce0d3-6403-4dd1-8dff-5ec910480699 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1217 microversion: 2.1 time: 0.153780 Sep 16 13:54:28.356249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 260/533] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:28 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:28.362790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3ab3ec2b-fea5-4656-9bbc-d6ce51519413 req-c1a9aaa9-ed00-4c41-bb40-14dada707a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b983bc33-1516-4759-a425-b6aea92b77d1", "tag": "03b52866-a109-4c4b-8a4b-d69af987c2b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:28.370119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:28.377936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3ab3ec2b-fea5-4656-9bbc-d6ce51519413 req-c1a9aaa9-ed00-4c41-bb40-14dada707a86 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:28.378683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3ab3ec2b-fea5-4656-9bbc-d6ce51519413 req-c1a9aaa9-ed00-4c41-bb40-14dada707a86 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:28.379241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3ab3ec2b-fea5-4656-9bbc-d6ce51519413 req-c1a9aaa9-ed00-4c41-bb40-14dada707a86 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:28.394727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3ab3ec2b-fea5-4656-9bbc-d6ce51519413 req-c1a9aaa9-ed00-4c41-bb40-14dada707a86 service nova] Creating event network-changed:03b52866-a109-4c4b-8a4b-d69af987c2b5 for instance b983bc33-1516-4759-a425-b6aea92b77d1 on n-h1-858129-2 Sep 16 13:54:28.402266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3ab3ec2b-fea5-4656-9bbc-d6ce51519413 req-c1a9aaa9-ed00-4c41-bb40-14dada707a86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044322 Sep 16 13:54:28.403626 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 261/534] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:28.410152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a335ebdc-5623-4f9a-a7e2-b3b822d6f8be tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Action: 'create', calling method: .version_select at 0x7f724d8cca60>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1067442341", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgCpE8lrur4zEilZ4/18CtpiCfQB21UHOiTBMcpKG4LV6AGcWfcWWgaptKlBLjefk0SK6B/1Y4uBI9r5I+9gLRTGySVXP640RZ5FRHA1OveEurpGSrzfncbrM1UmySvYA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:28.428282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a335ebdc-5623-4f9a-a7e2-b3b822d6f8be tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Getting quotas for project 70051a71b117439f918de5b1b10c2974. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:28.435572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a335ebdc-5623-4f9a-a7e2-b3b822d6f8be tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Getting quotas for user 2a6df511bd6a46189be753cb6b90b435 and project 70051a71b117439f918de5b1b10c2974. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:28.470302 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a335ebdc-5623-4f9a-a7e2-b3b822d6f8be tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.064938 Sep 16 13:54:28.470986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 262/535] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 13:54:28 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:54:28.476641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:28.477797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:28.486113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:28.486657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:28.487090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:28.487809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:28.488258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:28.488675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:29.008711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:29.024858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93b1e8fd-6ae5-473b-8a08-c6c3fe905b7b tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.435834 Sep 16 13:54:29.026291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6763b53a-d502-4202-8774-8994060ff6b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1469 microversion: 2.1 time: 0.553473 Sep 16 13:54:29.028422 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 274/536] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 13:54:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:29.042139 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 263/537] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:28 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1469 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:29.050068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8b46181-82e1-416e-a977-c0d6e6ed10f4 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Calling method '.version_select at 0x7f724d8984c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:29.060562 n-d-858129-2 devstack@n-api.service[128642]: WARNING oslo_db.sqlalchemy.utils [None req-e8b46181-82e1-416e-a977-c0d6e6ed10f4 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 13:54:29.067290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:29.068533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:29.080055 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8b46181-82e1-416e-a977-c0d6e6ed10f4 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs?user_id=a849e9ee7b7c459faea581fecf4c61e0" status: 200 len: 725 microversion: 2.10 time: 0.035858 Sep 16 13:54:29.083555 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 264/538] 10.222.0.60 () {60 vars in 1259 bytes} [Fri Sep 16 13:54:29 2022] GET /compute/v2.1/os-keypairs?user_id=a849e9ee7b7c459faea581fecf4c61e0 => generated 725 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:29.095743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:29.096165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b8db9ba-ceb8-4c13-b2d8-f5a93fe5bf5f tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] Action: 'create', calling method: .version_select at 0x7f724d7c0790>, body: {"security_group": {"name": "tempest-securitygroup-856021365", "description": "tempest-description-1049088789"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:29.097046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:29.097816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:29.098685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:29.099346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:29.100103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:29.577096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:29.626358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:29.628265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:29.634586 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8cbf0b93-c9c0-48f3-8cb4-47e8c4341013 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1362 microversion: 2.25 time: 0.598263 Sep 16 13:54:29.637316 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 275/539] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:29 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:29.652620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-92a9d9e5-1f33-4189-99c3-2e1969c1fa75 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Calling method '.version_select at 0x7f724daf9d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:29.704589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-92a9d9e5-1f33-4189-99c3-2e1969c1fa75 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1067442341" status: 204 len: 0 microversion: 2.10 time: 0.060498 Sep 16 13:54:29.705791 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 276/540] 10.222.0.60 () {60 vars in 1325 bytes} [Fri Sep 16 13:54:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1067442341 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:54:29.711903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:29.712750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:29.720615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:29.721102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:29.721810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:29.722906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:29.724385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:29.725090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:29.931373 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b8db9ba-ceb8-4c13-b2d8-f5a93fe5bf5f tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.834089 Sep 16 13:54:29.938145 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 265/541] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 13:54:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:29.962873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:29.970872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:29.995675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:29.997014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:29.997812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:29.999154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:29.999990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:30.001000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:30.240581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:30.261971 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa13b08f-b868-4f23-87cf-b22329ca4115 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1209 microversion: 2.1 time: 0.317713 Sep 16 13:54:30.264419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 266/542] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:29 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1209 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:30.304279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ace31a3-4acf-4e10-b131-96f6e577b6f8 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Calling method '.version_select at 0x7f724d7c0820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:30.380011 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ace31a3-4acf-4e10-b131-96f6e577b6f8 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908528449?user_id=a849e9ee7b7c459faea581fecf4c61e0" status: 204 len: 0 microversion: 2.10 time: 0.110218 Sep 16 13:54:30.385065 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 267/543] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 13:54:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908528449?user_id=a849e9ee7b7c459faea581fecf4c61e0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:54:30.396954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7c9ac3e-103c-4bc9-97bc-1b9ca32e8325 tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] Calling method '.version_select at 0x7f724d7c0d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:30.445665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:30.463006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=93 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:30.480073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32ef8c98-dfc4-4250-afbc-a8a3c073228e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1472 microversion: 2.1 time: 0.766954 Sep 16 13:54:30.494955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 277/544] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:29 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1472 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:30.500974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:30.502218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:30.512376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:30.513207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:30.514367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:30.515399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:30.516052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:30.517021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:31.027556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:31.046606 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b33f6ae-50f5-4f9a-a378-fb81f4f12009 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1469 microversion: 2.1 time: 0.549405 Sep 16 13:54:31.047901 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 278/545] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:30 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1469 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:31.058336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7361389-7500-4963-b4aa-345fc0920791 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] Calling method '.version_select at 0x7f724db61ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:31.111390 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7361389-7500-4963-b4aa-345fc0920791 tempest-KeyPairsV210TestJSON-1790900377 tempest-KeyPairsV210TestJSON-1790900377-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541771548?user_id=a849e9ee7b7c459faea581fecf4c61e0" status: 204 len: 0 microversion: 2.10 time: 0.061267 Sep 16 13:54:31.113213 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 279/546] 10.222.0.60 () {60 vars in 1340 bytes} [Fri Sep 16 13:54:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541771548?user_id=a849e9ee7b7c459faea581fecf4c61e0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:54:31.316669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed3e7f5d-9361-4b9c-aa4a-1ee2b0a63732 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:31.319644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed3e7f5d-9361-4b9c-aa4a-1ee2b0a63732 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] [instance: f28cc053-762a-4ae9-ad1d-6b764bc2de3b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:31.354741 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-ed3e7f5d-9361-4b9c-aa4a-1ee2b0a63732 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] HTTP exception thrown: Instance f28cc053-762a-4ae9-ad1d-6b764bc2de3b could not be found. Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed3e7f5d-9361-4b9c-aa4a-1ee2b0a63732 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Request method failure captured: Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/f28cc053-762a-4ae9-ad1d-6b764bc2de3b/action HTTP/1.1 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 15 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_5QY8JmWcevF1kru7afC52uRpR14woNTZ1JsNRzqm-snBqn75uKz1UwcWRLUXHCz9Nx3b7dA5EO412z2p5NlKLCrUKv8-gzy6Xfwe9junYWLy5j6IgxvgsnWlI91R2nsKc3xGvajqHP1tlyRv11i5aMKMyjnLqxVYxN6OGAsAeXP0 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:54:31.369301 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_392e2a3e135c4e38b7e6b17ec0a70124", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}] Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: acc74fefe0c64e7ebe490933f4f5f783 Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: {"migrate": {}} Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:54:31.371079 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f28cc053-762a-4ae9-ad1d-6b764bc2de3b could not be found. Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f28cc053-762a-4ae9-ad1d-6b764bc2de3b', 'body': {'migrate': {}}} Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28cc053-762a-4ae9-ad1d-6b764bc2de3b could not be found. Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:54:31.372051 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28cc053-762a-4ae9-ad1d-6b764bc2de3b could not be found. Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28cc053-762a-4ae9-ad1d-6b764bc2de3b could not be found. Sep 16 13:54:31.373605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:54:31.377131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed3e7f5d-9361-4b9c-aa4a-1ee2b0a63732 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Returning 404 to user: Instance f28cc053-762a-4ae9-ad1d-6b764bc2de3b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:54:31.378651 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed3e7f5d-9361-4b9c-aa4a-1ee2b0a63732 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f28cc053-762a-4ae9-ad1d-6b764bc2de3b/action" status: 404 len: 111 microversion: 2.1 time: 0.259775 Sep 16 13:54:31.379615 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 280/547] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:54:31 2022] POST /compute/v2.1/servers/f28cc053-762a-4ae9-ad1d-6b764bc2de3b/action => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:54:31.416541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:31.424651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:31.448511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:31.451573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:31.452612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:31.454225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:31.456108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:31.457774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:32.733021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:32.746945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:32.751401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:32.755634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f99323aa-95f1-415a-ab67-4217334c9e81 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1362 microversion: 2.25 time: 1.365927 Sep 16 13:54:32.756467 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 281/548] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:31 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1362 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:32.764181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:32.765128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:32.774296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:32.775270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:32.775937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:32.777599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:32.778542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:32.778994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:32.897862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:32.912212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-13b88f58-7107-48f2-b08b-00631d055159 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1271 microversion: 2.1 time: 0.153386 Sep 16 13:54:32.927036 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 282/549] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:32 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:32.947108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-458299353", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:33.023221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:34.143496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:34.145012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:34.145855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:34.147609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:34.148323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:34.165163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:34.166346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:34.179204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:34.183808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:34.185567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:34.186637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:34.274768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Getting quotas for project c425fbef4351482cb4fae31b05007b44. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:34.294045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:34.310661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Getting quotas for user 591f03e87a5f45498a2f1025f41123c8 and project c425fbef4351482cb4fae31b05007b44. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:34.332109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:34.335506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:34.433240 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c7b3ae9-fb8e-4c7a-8fa7-adbd6516a67a tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503862 Sep 16 13:54:34.435396 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 283/550] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:54:34.463250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:34.466925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:34.498093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:34.499415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:34.500422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:34.503516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:34.504673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:34.505866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:35.428742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:35.457896 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c901af2-7f05-4223-8ac8-4b4c88d1409f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 1.018900 Sep 16 13:54:35.461763 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 284/551] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:34 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:35.481858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-afd2bba9-6ecb-4a5c-9816-37859ebe19fc req-92544941-1851-4e8a-9771-ef55eaa2b28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b983bc33-1516-4759-a425-b6aea92b77d1", "name": "network-vif-plugged", "status": "completed", "tag": "03b52866-a109-4c4b-8a4b-d69af987c2b5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:35.526931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-afd2bba9-6ecb-4a5c-9816-37859ebe19fc req-92544941-1851-4e8a-9771-ef55eaa2b28c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:35.533740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-afd2bba9-6ecb-4a5c-9816-37859ebe19fc req-92544941-1851-4e8a-9771-ef55eaa2b28c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:35.536875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-afd2bba9-6ecb-4a5c-9816-37859ebe19fc req-92544941-1851-4e8a-9771-ef55eaa2b28c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:35.601245 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-afd2bba9-6ecb-4a5c-9816-37859ebe19fc req-92544941-1851-4e8a-9771-ef55eaa2b28c service nova] Creating event network-vif-plugged:03b52866-a109-4c4b-8a4b-d69af987c2b5 for instance b983bc33-1516-4759-a425-b6aea92b77d1 on n-h1-858129-2 Sep 16 13:54:35.621519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-afd2bba9-6ecb-4a5c-9816-37859ebe19fc req-92544941-1851-4e8a-9771-ef55eaa2b28c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154656 Sep 16 13:54:35.630177 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 285/552] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:35.672199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:35.674901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:35.697864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:35.698982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:35.700024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:35.701687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:35.703009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:35.704126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:36.188795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:36.212673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:36.216465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:36.218831 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41e5fdd0-2416-40de-93d9-23b6629a392b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1362 microversion: 2.25 time: 0.585625 Sep 16 13:54:36.230447 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 286/553] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:35 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:36.242835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e22a91ce-5ec3-4d73-a619-33f2bda9165f req-9e3208e7-b09e-4f64-8376-d052dcff409c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:36.270294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e22a91ce-5ec3-4d73-a619-33f2bda9165f req-9e3208e7-b09e-4f64-8376-d052dcff409c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:36.271154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e22a91ce-5ec3-4d73-a619-33f2bda9165f req-9e3208e7-b09e-4f64-8376-d052dcff409c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:36.271975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e22a91ce-5ec3-4d73-a619-33f2bda9165f req-9e3208e7-b09e-4f64-8376-d052dcff409c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:36.299825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e22a91ce-5ec3-4d73-a619-33f2bda9165f req-9e3208e7-b09e-4f64-8376-d052dcff409c service nova] Creating event network-changed:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:54:36.307550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e22a91ce-5ec3-4d73-a619-33f2bda9165f req-9e3208e7-b09e-4f64-8376-d052dcff409c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085113 Sep 16 13:54:36.309190 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 287/554] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:36.314806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:36.315671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:36.323479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:36.323990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:36.324585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:36.325434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:36.325975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:36.326585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:36.657311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:36.689794 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eff01cfa-a43c-4f6d-a478-d613af501c23 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 0.378624 Sep 16 13:54:36.693855 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 288/555] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:36 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:36.709376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:36.715288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:36.730995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:36.743759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:36.744915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:36.746206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:36.747055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:36.747835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:36.981535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:37.016889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bea4db37-db7c-457a-820c-658d8993d827 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1273 microversion: 2.1 time: 0.320648 Sep 16 13:54:37.018572 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 289/556] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:36 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:37.029291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-eab43695-d859-4b6d-b274-f69016b0da4f req-f07ead90-18b9-4430-839f-dd4da071d83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9273f24-7349-4e30-ae09-0cffb2856d33", "tag": "804a3871-b28d-4c94-9928-649d033a5921"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:37.066976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eab43695-d859-4b6d-b274-f69016b0da4f req-f07ead90-18b9-4430-839f-dd4da071d83a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.067817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eab43695-d859-4b6d-b274-f69016b0da4f req-f07ead90-18b9-4430-839f-dd4da071d83a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.068599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eab43695-d859-4b6d-b274-f69016b0da4f req-f07ead90-18b9-4430-839f-dd4da071d83a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:37.098698 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-eab43695-d859-4b6d-b274-f69016b0da4f req-f07ead90-18b9-4430-839f-dd4da071d83a service nova] Creating event network-changed:804a3871-b28d-4c94-9928-649d033a5921 for instance b9273f24-7349-4e30-ae09-0cffb2856d33 on n-h1-858129-2 Sep 16 13:54:37.124305 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-eab43695-d859-4b6d-b274-f69016b0da4f req-f07ead90-18b9-4430-839f-dd4da071d83a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101580 Sep 16 13:54:37.125661 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 290/557] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:37.134572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:37.135729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:37.143582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.144603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.145214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:37.147171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.147957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.150672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:37.475041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:37.495273 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ce64dfa-47d5-49e9-b746-08a23f2eff12 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 0.367379 Sep 16 13:54:37.497167 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 291/558] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:37 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:37.504397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:37.505190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:37.513762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.514601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.515249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:37.516820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.517310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.517747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:37.819283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:37.830285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:37.831812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:37.835016 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-962c1dd0-7e83-4c01-ab2e-b8ee199513c3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1362 microversion: 2.25 time: 0.333735 Sep 16 13:54:37.851029 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 292/559] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:37 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:37.860141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:37.860849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:37.870770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.871950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.872675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:37.873738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:37.874471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:37.875167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:38.159610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7c9ac3e-103c-4bc9-97bc-1b9ca32e8325 tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11055 microversion: 2.1 time: 7.772697 Sep 16 13:54:38.160755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 268/560] 10.222.0.60 () {58 vars in 1191 bytes} [Fri Sep 16 13:54:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11055 bytes in 7774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:38.166074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:38.166713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:38.182806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:38.183308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:38.183927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:38.185523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:38.189167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:38.189934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:38.194645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:38.216352 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00977d31-8823-4347-b2c3-73f40c636a94 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 0.360141 Sep 16 13:54:38.218148 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 293/561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:37 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:38.232117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1bc5d1a7-96f6-4926-a820-c72f6e3bc98b tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] Calling method '.version_select at 0x7f724da8edc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:38.381222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:38.390452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13ac6502-030e-4361-a758-8da48367e63f tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1273 microversion: 2.1 time: 0.228467 Sep 16 13:54:38.391681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 269/562] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:38 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:38.469534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=38 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:38.685507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-599431248", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:38.687782 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1bc5d1a7-96f6-4926-a820-c72f6e3bc98b tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.463607 Sep 16 13:54:38.689868 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 294/563] 10.222.0.60 () {58 vars in 1191 bytes} [Fri Sep 16 13:54:38 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:38.723596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:38.724336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:38.735899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:38.736727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:38.737320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:38.738288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:38.738989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:38.739568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:38.792158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:39.234280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:39.251907 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-72592963-68f6-443d-b7a1-d80e8f8a4fcd tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 0.557428 Sep 16 13:54:39.252508 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 295/564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:38 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:39.257572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82c5f924-2299-47af-ba88-3eeb03c0d99d tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] Calling method '.version_select at 0x7f724dacdb80>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:39.440057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:39.440805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:39.442162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:39.443050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:39.443836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:39.468108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:39.468606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:39.469905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:39.471619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:39.472712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:39.473468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:39.502660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:39.527423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:39.568544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:39.576009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:39.680170 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c008f63-d902-451e-9e48-191e4427cdc4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215327 Sep 16 13:54:39.681647 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 270/565] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:54:39.687921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:39.689174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:39.696313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:39.697124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:39.697759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:39.698767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:39.699464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:39.699891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:39.921079 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82c5f924-2299-47af-ba88-3eeb03c0d99d tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/9e37dfb1-c06e-4855-ad20-cb8fe810c292" status: 202 len: 0 microversion: 2.1 time: 0.667197 Sep 16 13:54:39.921673 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 296/566] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 13:54:39 2022] DELETE /compute/v2.1/os-security-groups/9e37dfb1-c06e-4855-ad20-cb8fe810c292 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:39.930255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:39.931198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:39.950097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:39.950897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:39.951502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:39.952506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:39.953195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:39.953821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.246789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:40.265162 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9a3419a-6a11-4fa5-9552-cf4b7808048d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 0.341949 Sep 16 13:54:40.265772 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 297/567] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:39 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:40.271184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:40.272140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:40.288466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:40.289586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:40.289980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.290742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:40.291205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:40.304008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.308677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:40.321565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:40.324193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:40.328175 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0696dbf0-69a7-41c1-b657-4ad4a73a7946 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1362 microversion: 2.25 time: 0.644688 Sep 16 13:54:40.329570 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 271/568] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:39 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:40.339764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dbb1e292-e53b-441c-a602-2ad456a8814b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:40.340942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dbb1e292-e53b-441c-a602-2ad456a8814b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:40.419939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dbb1e292-e53b-441c-a602-2ad456a8814b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:40.436812 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dbb1e292-e53b-441c-a602-2ad456a8814b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1216 microversion: 2.1 time: 0.103748 Sep 16 13:54:40.437979 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 272/569] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:40 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:40.449374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-151d746b-aab6-41c4-9f17-a6cf48c7a4c4 tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] Calling method '.version_select at 0x7f724d8e05e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:40.459645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:40.469820 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-daa3e821-8709-435d-a2ca-76231782231d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1279 microversion: 2.1 time: 0.202569 Sep 16 13:54:40.470600 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 298/570] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:40 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:40.479205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:40.480138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:40.510624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:40.511212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:40.513447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.526159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:40.528860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:40.529312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.569865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:54:40.642446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:40.693281 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8bbe1ec-8d43-4a61-b8d5-77a3435bdb4e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 204 len: 0 microversion: 2.1 time: 0.220118 Sep 16 13:54:40.695222 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 299/571] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:54:40 2022] DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:54:40.704173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:40.704999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:40.711787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:40.712729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:40.713414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.714378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:40.715837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:40.715837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:40.919074 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-151d746b-aab6-41c4-9f17-a6cf48c7a4c4 tempest-SecurityGroupsTestAdminJSON-1053365361 tempest-SecurityGroupsTestAdminJSON-1053365361-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/78c538a4-29fe-40a2-992a-f0c446752e72" status: 202 len: 0 microversion: 2.1 time: 0.478294 Sep 16 13:54:40.920433 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 273/572] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 13:54:40 2022] DELETE /compute/v2.1/os-security-groups/78c538a4-29fe-40a2-992a-f0c446752e72 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:40.933493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1834087450", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "364251384", "adminPass": "***", "networks": [{"uuid": "b46617d1-eed5-4a31-94fb-0270aea57785"}], "security_groups": [{"name": "tempest-securitygroup--1490638984"}], "key_name": "tempest-keypair-599284337", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:40.981291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:41.006563 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d4f75ce-adf9-44d3-9de3-1496ba344450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 0.308036 Sep 16 13:54:41.007374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 300/573] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:40 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:41.015846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7f34e93-f982-40c0-a124-48e7d41482b0 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] Calling method '.version_select at 0x7f724dbedca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:41.129228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] validate_networks() for [('b46617d1-eed5-4a31-94fb-0270aea57785', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:54:41.456151 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7f34e93-f982-40c0-a124-48e7d41482b0 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3a3a24f8-f8d9-41b3-a922-fe021b7c7469" status: 202 len: 0 microversion: 2.1 time: 0.446343 Sep 16 13:54:41.459201 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 301/574] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 13:54:41 2022] DELETE /compute/v2.1/os-security-groups/3a3a24f8-f8d9-41b3-a922-fe021b7c7469 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:41.471606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:41.473075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:41.492528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:41.494619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:41.495957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:41.503128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:41.504706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:41.506040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.120440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:42.122306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:54:42.123159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:54:42.123848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:54:42.125101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:54:42.127034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:54:42.135495 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f01f6879-7ecd-4b7f-ba0f-ba3a0580ad30 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 0.674207 Sep 16 13:54:42.136096 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 302/575] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:41 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:42.155725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:42.156425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:42.166503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:42.167339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:42.168134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.169528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:42.170236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:42.171977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.181197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:42.182997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:42.187567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.192877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:42.195739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:42.200624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.320707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Getting quotas for project 3b3640b77c194f6f8b0fb588bd07555c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:54:42.333876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Getting quotas for user 93ad00ee07c44e8e8ff54385234b0fb8 and project 3b3640b77c194f6f8b0fb588bd07555c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:54:42.363160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:54:42.369474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:54:42.521755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:42.527009 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fac3ad98-f68b-45a2-b68f-6e696cfab69a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.604836 Sep 16 13:54:42.545584 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 274/576] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:54:42.563360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:42.574785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:42.575036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:42.587733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:42.588769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:42.589824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.590888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:42.591544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:42.592225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:42.605823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:42.610025 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab961184-2984-4704-bb21-61dec634b918 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1557 microversion: 2.25 time: 0.456805 Sep 16 13:54:42.615849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 303/577] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:42 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1557 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:42.658519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-628209e3-005e-4805-94a9-693bc70fbf34 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] Calling method '.version_select at 0x7f724db5faf0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:42.921794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:43.013903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5b14540-86ed-43f6-938f-d88c9e3663d6 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1268 microversion: 2.1 time: 0.461860 Sep 16 13:54:43.034298 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 275/578] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:42 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1268 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:43.056447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:43.057748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:43.067177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:43.067814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:43.068354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:43.069186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:43.069751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:43.070307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:43.420145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:43.433851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1fcaef04-a5f6-463f-9e81-a29245d4734e tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.406363 Sep 16 13:54:43.434502 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 276/579] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:43 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:43.452179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:43.453212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:43.461454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:43.467582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:43.468043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:43.468805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:43.469267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:43.469768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:43.529139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:44.229735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:44.324412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:44.492219 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-628209e3-005e-4805-94a9-693bc70fbf34 tempest-SecurityGroupsTestAdminJSON-1146242587 tempest-SecurityGroupsTestAdminJSON-1146242587-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a0531d3f-2964-481d-9dba-b1393f4adcbb" status: 202 len: 0 microversion: 2.1 time: 1.843745 Sep 16 13:54:44.494891 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 304/580] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 13:54:42 2022] DELETE /compute/v2.1/os-security-groups/a0531d3f-2964-481d-9dba-b1393f4adcbb => generated 0 bytes in 1854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:54:44.506849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:44.511585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:44.527423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:44.529128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:44.530221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:44.533542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:44.535025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:44.536692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:44.582485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:44.616562 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1969023-521c-4bf6-87cb-3d5531ce91d0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 1.180558 Sep 16 13:54:44.624745 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 277/581] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:43 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:45.001045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:45.030083 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d28b3cbb-bb08-4e40-b37b-af473d03411c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1314 microversion: 2.1 time: 0.532607 Sep 16 13:54:45.031296 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 305/582] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:44 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:45.073170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:45.074521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:45.086663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:45.087703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:45.089001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:45.090419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:45.091373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:45.092243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:45.578288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:45.580713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:45.609219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:45.613454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:45.618483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:45.622012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:45.632770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:45.634281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.067646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:46.101690 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bace1b8d-4a2d-49c9-86e2-84277dac5749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 1.051414 Sep 16 13:54:46.119201 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 306/583] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:45 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:46.145257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:46.146874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:46.163878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:46.167849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.169099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.170143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.171951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.173062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.174116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.430313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:46.463157 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1a1b5e5-01b1-4b27-9a36-20e7dfe1a0ea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1274 microversion: 2.1 time: 0.341828 Sep 16 13:54:46.467040 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 307/584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:46 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:46.491519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:46.493769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:46.516724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.532997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.535394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.536735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.539719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid b983bc33-1516-4759-a425-b6aea92b77d1 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:54:46.543967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.547371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.677171 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86ce28b6-56b5-44b8-bcc5-4941acb50a1e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 2050 microversion: 2.25 time: 2.044209 Sep 16 13:54:46.678787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 278/585] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:44 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 2050 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:46.684914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7a1e1b40-c382-47c1-91e4-97ec477f9db4 req-99ea25c6-e986-4577-b316-43b94afbd9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a", "tag": "f4ae5020-0120-48e6-bc85-a15a538b3f62"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:46.707671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a1e1b40-c382-47c1-91e4-97ec477f9db4 req-99ea25c6-e986-4577-b316-43b94afbd9a8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.712582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a1e1b40-c382-47c1-91e4-97ec477f9db4 req-99ea25c6-e986-4577-b316-43b94afbd9a8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.713200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a1e1b40-c382-47c1-91e4-97ec477f9db4 req-99ea25c6-e986-4577-b316-43b94afbd9a8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.735715 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7a1e1b40-c382-47c1-91e4-97ec477f9db4 req-99ea25c6-e986-4577-b316-43b94afbd9a8 service nova] Creating event network-changed:f4ae5020-0120-48e6-bc85-a15a538b3f62 for instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a on n-h2-858129-2 Sep 16 13:54:46.743166 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7a1e1b40-c382-47c1-91e4-97ec477f9db4 req-99ea25c6-e986-4577-b316-43b94afbd9a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061520 Sep 16 13:54:46.744845 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 279/586] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:46.752474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:46.753544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:46.771290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.772689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.774121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:46.776019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:46.778526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:46.781557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.279501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:47.302233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7977c3d-56f4-421e-9286-c37db7912596 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.829341 Sep 16 13:54:47.303423 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 308/587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:46 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:47.310597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:47.311786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:47.346080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.347249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.347893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.348929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.349789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.351298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.459176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:47.486662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1cecc782-07a3-4b04-94a3-7cadf225fc41 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 0.739935 Sep 16 13:54:47.487342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 280/588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:46 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:47.500844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:47.501584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:47.510775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.511370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.511896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.513056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.513834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.514527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.632810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:47.660321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee1508ab-4ffa-44e7-90d3-f94339527e0b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1320 microversion: 2.1 time: 0.355350 Sep 16 13:54:47.661529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 309/589] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:47 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:47.683537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e8e1be7d-fc04-48ee-8bd5-c18e40fe9f6e req-48e186a8-b6ff-4d16-9ead-834366feee72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9273f24-7349-4e30-ae09-0cffb2856d33", "name": "network-vif-plugged", "status": "completed", "tag": "804a3871-b28d-4c94-9928-649d033a5921"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:47.730097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e8e1be7d-fc04-48ee-8bd5-c18e40fe9f6e req-48e186a8-b6ff-4d16-9ead-834366feee72 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.731343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e8e1be7d-fc04-48ee-8bd5-c18e40fe9f6e req-48e186a8-b6ff-4d16-9ead-834366feee72 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.732134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e8e1be7d-fc04-48ee-8bd5-c18e40fe9f6e req-48e186a8-b6ff-4d16-9ead-834366feee72 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.770706 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e8e1be7d-fc04-48ee-8bd5-c18e40fe9f6e req-48e186a8-b6ff-4d16-9ead-834366feee72 service nova] Creating event network-vif-plugged:804a3871-b28d-4c94-9928-649d033a5921 for instance b9273f24-7349-4e30-ae09-0cffb2856d33 on n-h1-858129-2 Sep 16 13:54:47.783006 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e8e1be7d-fc04-48ee-8bd5-c18e40fe9f6e req-48e186a8-b6ff-4d16-9ead-834366feee72 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114046 Sep 16 13:54:47.784876 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 310/590] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:47.796145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:47.797805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:47.812252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.813587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.814712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:47.816493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:47.817445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:47.818210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:48.706607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid b983bc33-1516-4759-a425-b6aea92b77d1 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:54:48.769459 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-700a5e28-f70a-4f40-a8fb-b671b2444ecb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 2050 microversion: 2.25 time: 1.273661 Sep 16 13:54:48.770059 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 281/591] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:54:47 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 2050 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:54:48.775421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:48.776326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:48.783512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:48.784304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:48.784936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:48.785939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:48.786597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:48.787178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:49.114308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:49.132663 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7a08557-25fd-42ad-a17f-5daab35261c2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 1.344413 Sep 16 13:54:49.133578 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 311/592] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:47 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:49.149784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:49.150724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:49.163459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:49.165356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:49.165356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:49.166033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:49.166520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:49.167434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:49.331940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:49.348483 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79aecf44-0649-49d9-a619-572d26e60a00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.574631 Sep 16 13:54:49.350094 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 282/593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:48 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:49.370670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:49.372173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:49.383319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:49.387220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:49.389558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:49.392665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:49.394616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:49.396685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:49.822798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:49.833554 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1dacfe0-70c6-4ead-ac0e-1eac24e64176 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.698491 Sep 16 13:54:49.836076 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 312/594] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:49 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:49.850891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:49.852271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:49.863049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:49.867225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:49.868838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:49.871583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:49.873055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:49.875156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.018284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:50.031646 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b271a26c-47ba-444a-af89-b6c2290797ce tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 0.679956 Sep 16 13:54:50.042441 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 283/595] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:49 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:50.044105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:50.048614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.054155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.059177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.060606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.061375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.062066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.140091 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a5b1dc20-7a6f-44a9-b458-df810baee6bd tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.106263 Sep 16 13:54:50.140722 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 284/596] 10.222.0.60 () {60 vars in 1217 bytes} [Fri Sep 16 13:54:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:54:50.145641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2a88b188-0ed8-4399-9a2c-9cf60ade8d41 req-7bfbc70b-3ab2-434c-9bb3-ad7167d11edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "name": "network-vif-plugged", "status": "completed", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:50.161141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2a88b188-0ed8-4399-9a2c-9cf60ade8d41 req-7bfbc70b-3ab2-434c-9bb3-ad7167d11edd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.162026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2a88b188-0ed8-4399-9a2c-9cf60ade8d41 req-7bfbc70b-3ab2-434c-9bb3-ad7167d11edd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.162899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2a88b188-0ed8-4399-9a2c-9cf60ade8d41 req-7bfbc70b-3ab2-434c-9bb3-ad7167d11edd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.185036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2a88b188-0ed8-4399-9a2c-9cf60ade8d41 req-7bfbc70b-3ab2-434c-9bb3-ad7167d11edd service nova] Creating event network-vif-plugged:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:54:50.192814 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2a88b188-0ed8-4399-9a2c-9cf60ade8d41 req-7bfbc70b-3ab2-434c-9bb3-ad7167d11edd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050517 Sep 16 13:54:50.196120 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 285/597] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:50.211969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a5953952-a25f-474b-bd40-a27f35dca4ad req-cad8ba98-d4eb-4adc-97f6-f1c83f438acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db05562-05a5-4b02-9fa7-b13bac0c95e7", "name": "network-vif-deleted", "tag": "71516593-1bf8-4d77-99af-64cabba59aa6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:50.233654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a5953952-a25f-474b-bd40-a27f35dca4ad req-cad8ba98-d4eb-4adc-97f6-f1c83f438acf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.235091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a5953952-a25f-474b-bd40-a27f35dca4ad req-cad8ba98-d4eb-4adc-97f6-f1c83f438acf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.236185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a5953952-a25f-474b-bd40-a27f35dca4ad req-cad8ba98-d4eb-4adc-97f6-f1c83f438acf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.270808 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a5953952-a25f-474b-bd40-a27f35dca4ad req-cad8ba98-d4eb-4adc-97f6-f1c83f438acf service nova] Creating event network-vif-deleted:71516593-1bf8-4d77-99af-64cabba59aa6 for instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 on n-h2-858129-2 Sep 16 13:54:50.280835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a5953952-a25f-474b-bd40-a27f35dca4ad req-cad8ba98-d4eb-4adc-97f6-f1c83f438acf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082165 Sep 16 13:54:50.284328 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 286/598] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:50.313188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:50.313933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:50.324791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.325563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.326171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.327151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.327812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.328422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.343118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:50.376370 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73a91e86-a331-4f07-8a12-4187eacba1d7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 0.534629 Sep 16 13:54:50.378575 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 313/599] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:49 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:50.400742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858129-2", "block_migration": "auto"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:50.406363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:50.423594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.426521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.427839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.429671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.430959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.432087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.649701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:50.666835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-436a75ed-3b43-4320-a794-b3bf21ca6fc8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1313 microversion: 2.1 time: 0.381103 Sep 16 13:54:50.670373 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 287/600] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:50 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:50.680519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:50.682392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:50.720519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.727110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.732282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:50.733410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:50.736664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:50.737454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:51.115826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:51.140312 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da068d76-3404-496e-8124-b30ad3ab4abf tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.465177 Sep 16 13:54:51.142438 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 288/601] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:50 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:51.152880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:51.154396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:51.168245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:51.169576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:51.170733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:51.173946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:51.175371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:51.176528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:51.204937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'flavor' on Instance uuid b983bc33-1516-4759-a425-b6aea92b77d1 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:54:51.490091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Going to try to live migrate instance to n-h2-858129-2 {{(pid=128643) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 13:54:51.627343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:51.663341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8269ee09-a935-4193-9190-5aeb71fbc603 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.518671 Sep 16 13:54:51.667436 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 289/602] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:51 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:51.689333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:51.690988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:51.715767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:51.717520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:51.720025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:51.721982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:51.725193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:51.730517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:52.352568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=14 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:53.594568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:53.633000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce273916-e9a0-426f-90ea-7423bf156d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1474 microversion: 2.1 time: 1.959228 Sep 16 13:54:53.634606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 290/603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:51 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1474 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:53.663516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:53.674579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:53.701241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:53.738444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:53.739396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:53.740688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:53.741428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:53.742586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:53.743372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:54.108106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:54.119287 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-969aba3b-0c56-4b98-8c68-0716e601361b tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 0.480076 Sep 16 13:54:54.138167 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 291/604] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:53 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:54.146223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:54.147454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:54.163167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:54.171542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:54.173268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:54.175533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:54.176544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:54.177305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:54.768600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:54.824054 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46ccb2de-67b2-494f-b375-2f224c94024c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1462 microversion: 2.1 time: 0.683428 Sep 16 13:54:54.833895 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 292/605] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:54 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1462 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:54.869029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:54.873832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:54.910664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:54.915498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:54.916932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:54.925993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:54.927679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:54.928758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:55.741315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:55.768020 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-90f13330-9739-41fc-af91-9814878a6ac1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.927773 Sep 16 13:54:55.770595 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 293/606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:54 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:55.799567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:55.801481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:55.842912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:55.846040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:55.862985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:55.865595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:55.869593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:55.870844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:56.754669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:56.769876 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46359756-4ca6-4405-a102-5818e2959a06 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.996338 Sep 16 13:54:56.770847 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 294/607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:55 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:56.780337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7c829abf-e0d3-4446-a598-6d2054d477ce req-c80b3302-003a-43f8-9b94-20fd30a4ab43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68a841c-ac0a-44de-9d0e-7d1fdafdf730", "tag": "04613bc1-5986-48d4-9629-aca916266b90"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:56.831534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7c829abf-e0d3-4446-a598-6d2054d477ce req-c80b3302-003a-43f8-9b94-20fd30a4ab43 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:56.834775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7c829abf-e0d3-4446-a598-6d2054d477ce req-c80b3302-003a-43f8-9b94-20fd30a4ab43 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:56.835703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7c829abf-e0d3-4446-a598-6d2054d477ce req-c80b3302-003a-43f8-9b94-20fd30a4ab43 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:56.855322 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7c829abf-e0d3-4446-a598-6d2054d477ce req-c80b3302-003a-43f8-9b94-20fd30a4ab43 service nova] Creating event network-changed:04613bc1-5986-48d4-9629-aca916266b90 for instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 on n-h1-858129-2 Sep 16 13:54:56.861704 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7c829abf-e0d3-4446-a598-6d2054d477ce req-c80b3302-003a-43f8-9b94-20fd30a4ab43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088825 Sep 16 13:54:56.862647 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 295/608] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:56.869171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:56.870234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:56.878978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:56.879649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:56.880281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:56.881168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:56.881790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:56.882353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:56.945917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:54:57.346746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:57.383870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-084b7d74-1cda-4f6a-8d60-7177368eca3b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1473 microversion: 2.1 time: 0.519327 Sep 16 13:54:57.384962 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 296/609] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:56 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1473 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:57.448752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:57.450958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:57.466072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:57.467217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:57.467818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:57.469973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:57.482954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:57.483711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:58.145695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:58.168343 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2b4e357b-9348-4f20-a833-cdecf21beb86 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1463 microversion: 2.1 time: 0.743057 Sep 16 13:54:58.220294 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 297/610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:57 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1463 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:58.238879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:58.241334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:58.254820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:58.256063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:58.257067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:58.259253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:58.260702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:58.262148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:58.668889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:58.684159 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb58ca24-2486-402d-aee6-a32651aacdff tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 0.452615 Sep 16 13:54:58.686932 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 298/611] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:58 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:58.699637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-60bad63a-52a6-47c1-a7ea-3fc4bc4d0b31 req-1d46fab9-d5eb-4b76-9426-3ab194d5a79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ba0e96-0970-4dbb-b9cc-a082824df96f", "tag": "bf14938d-0606-4211-bad3-6350e8faa4a7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:58.734637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-60bad63a-52a6-47c1-a7ea-3fc4bc4d0b31 req-1d46fab9-d5eb-4b76-9426-3ab194d5a79d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:58.737377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-60bad63a-52a6-47c1-a7ea-3fc4bc4d0b31 req-1d46fab9-d5eb-4b76-9426-3ab194d5a79d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:58.738733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-60bad63a-52a6-47c1-a7ea-3fc4bc4d0b31 req-1d46fab9-d5eb-4b76-9426-3ab194d5a79d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:58.781897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-60bad63a-52a6-47c1-a7ea-3fc4bc4d0b31 req-1d46fab9-d5eb-4b76-9426-3ab194d5a79d service nova] Creating event network-changed:bf14938d-0606-4211-bad3-6350e8faa4a7 for instance f6ba0e96-0970-4dbb-b9cc-a082824df96f on n-h2-858129-2 Sep 16 13:54:58.792302 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-60bad63a-52a6-47c1-a7ea-3fc4bc4d0b31 req-1d46fab9-d5eb-4b76-9426-3ab194d5a79d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102556 Sep 16 13:54:58.793446 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 299/612] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:58.805302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:58.807335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:58.817498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:58.819436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:58.822615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:58.824856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:58.825977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:58.829780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:59.002249 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a79e78f1-abea-4cf3-842a-5888276250cf tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1/action" status: 202 len: 0 microversion: 2.25 time: 8.621555 Sep 16 13:54:59.007505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 314/613] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:54:50 2022] POST /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1/action => generated 0 bytes in 8628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:54:59.014779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:59.016982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:59.034235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:59.035060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:59.035701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:59.036648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:59.037291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:59.038906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:59.216204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:59.228794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0f9244c-d89c-46ab-aa17-3f7281799d3b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.433941 Sep 16 13:54:59.230509 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 300/614] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:58 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:59.238066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-bbe3b278-056e-498c-b5fe-1833b5173aa4 req-e68f861c-d06c-492a-bb07-01b5bbe5d3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a", "name": "network-vif-plugged", "status": "completed", "tag": "f4ae5020-0120-48e6-bc85-a15a538b3f62"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:59.252963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bbe3b278-056e-498c-b5fe-1833b5173aa4 req-e68f861c-d06c-492a-bb07-01b5bbe5d3d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:59.253726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bbe3b278-056e-498c-b5fe-1833b5173aa4 req-e68f861c-d06c-492a-bb07-01b5bbe5d3d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:59.254371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bbe3b278-056e-498c-b5fe-1833b5173aa4 req-e68f861c-d06c-492a-bb07-01b5bbe5d3d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:59.300175 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-bbe3b278-056e-498c-b5fe-1833b5173aa4 req-e68f861c-d06c-492a-bb07-01b5bbe5d3d6 service nova] Creating event network-vif-plugged:f4ae5020-0120-48e6-bc85-a15a538b3f62 for instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a on n-h2-858129-2 Sep 16 13:54:59.306544 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-bbe3b278-056e-498c-b5fe-1833b5173aa4 req-e68f861c-d06c-492a-bb07-01b5bbe5d3d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073214 Sep 16 13:54:59.307660 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 301/615] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:54:59.321860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:54:59.322333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:54:59.336257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:59.336937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:59.337385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:59.338129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:54:59.338630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:54:59.339065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:54:59.434764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:54:59.444816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cea54b36-0c6e-4f90-b686-fb9e270f9daa tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.435081 Sep 16 13:54:59.445754 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 315/616] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:59 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:54:59.470442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1451250911", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ad55c464-a245-4276-880c-b5bbd0bce53e"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:54:59.635202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:55:00.029725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:00.041374 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f436d6d1-928e-4ec5-8cf4-003e6e3b5692 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1473 microversion: 2.1 time: 0.732193 Sep 16 13:55:00.042968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 302/617] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:54:59 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1473 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:00.048811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:00.049696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:00.057778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:00.058749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:00.059567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:00.060478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:00.061322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:00.061925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:00.091290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:00.784425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:00.803082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:00.807893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:00.809800 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed9c7623-d251-4e6b-b876-2a69defdc1f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.765554 Sep 16 13:55:00.810975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 303/618] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:00 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:00.835501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:00.836990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:00.845103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:55:00.845649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:55:00.846008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:55:00.846446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:55:00.846874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:55:00.859783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:00.860369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:00.860826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:00.864390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:00.864886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:00.865337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:00.866111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:00.868396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:00.868909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:00.869620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:00.875055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:00.875813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:00.960245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Getting quotas for project 0be8e21f9d2d436285f91238eb580125. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:00.974992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Getting quotas for user f7b24d82070f42f59776a115147e9678 and project 0be8e21f9d2d436285f91238eb580125. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:00.999691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:55:01.004009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:55:01.084832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9430dadb-4f05-40d8-90b4-2987eccf26c5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625135 Sep 16 13:55:01.091563 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 316/619] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:55:01.214694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-515144c0-60fa-42f0-ad61-9df7a237b159 tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Calling method '.version_select at 0x7f724da5caf0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:01.304985 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-515144c0-60fa-42f0-ad61-9df7a237b159 tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.211323 Sep 16 13:55:01.305844 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 317/620] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 13:55:01 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:01.312150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:01.312785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:01.353212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:01.358778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:01.360000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:01.361524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:01.376724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:01.377380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:01.386917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:01.405731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:01.422745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd50cb74-e9be-48cb-98e5-06d832953707 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 0.587155 Sep 16 13:55:01.442058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 304/621] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:00 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:01.470815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:01.472262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:01.485941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:01.487170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:01.488222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:01.491164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:01.491164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:01.491685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:02.119253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:02.131877 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f665619c-58e0-4fba-b7ad-1c285e44f288 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.824650 Sep 16 13:55:02.134787 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 318/622] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:01 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:02.143867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:02.149821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:02.170097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:02.171340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:02.172312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:02.173541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:02.174963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:02.175631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.075700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:03.109159 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7822f6b3-01e5-4841-8e65-56c2d84f1540 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 1.651404 Sep 16 13:55:03.111242 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 305/623] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:01 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:03.120999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:03.122448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:03.137081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.138973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.140086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.142379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.155338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.157946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.378669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:03.390567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:03.395084 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da9d6fc0-d873-4e7b-857f-89c972851597 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1266 microversion: 2.1 time: 0.281305 Sep 16 13:55:03.395883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 306/624] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:03 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:03.419201 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc5fe3e0-b334-4a26-b127-2ae560d7b374 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1473 microversion: 2.1 time: 1.282336 Sep 16 13:55:03.420896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 319/625] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:02 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1473 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:03.425904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79924740-fc8c-4b9e-834f-53e9cf06d05d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Action: 'create', calling method: .version_select at 0x7f724d6fe700>, body: {"pool": "non_exist_pool"} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:03.438049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a74a7af-9736-478c-8d65-a331a8aec11d", "name": "network-vif-unplugged", "status": "completed", "tag": "63d31d28-e16d-4175-8c59-5ef3ebed49bc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:03.462480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.464039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.468613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.507083 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] Creating event network-vif-unplugged:63d31d28-e16d-4175-8c59-5ef3ebed49bc for instance 9a74a7af-9736-478c-8d65-a331a8aec11d on n-h1-858129-2 Sep 16 13:55:03.512556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-79924740-fc8c-4b9e-834f-53e9cf06d05d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] HTTP exception thrown: Floating IP pool not found. Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79924740-fc8c-4b9e-834f-53e9cf06d05d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Request method failure captured: Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 26 Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIAzRLO03H_xAkELL_yuxujhpVd4hQjsf_xGXUFJhw3Z0Z2NXFpS6krIj7W-_JVzFynHzDXCojGWAS-w0CPGpFjraw06il8lqGfQfvH-riDotltIJ6z6pGi4o4C0P4Z1otcNITU9xY-DXCzSniAwOko_MdeHETEauJQVMgpd2T_AxFI Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 75a55775699e443897f8cacbbd0d32d2 Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1116507523 Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:55:03.514830 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_75a55775699e443897f8cacbbd0d32d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/75a55775699e443897f8cacbbd0d32d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/75a55775699e443897f8cacbbd0d32d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/75a55775699e443897f8cacbbd0d32d2"}]}] Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1116507523 Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 75a55775699e443897f8cacbbd0d32d2 Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1116507523 Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FloatingIPsNegativeTestJSON-1116507523-project Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2e4dcbdeb6a6421381325417e4c181a0 Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1116507523-project Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: {"pool": "non_exist_pool"} Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: exception: Floating IP pool not found. Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 16 13:55:03.517762 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:03.519741 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79924740-fc8c-4b9e-834f-53e9cf06d05d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Returning 404 to user: Floating IP pool not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:03.522283 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79924740-fc8c-4b9e-834f-53e9cf06d05d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.121354 Sep 16 13:55:03.527379 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 307/626] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 13:55:03 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:55:03.531557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] Instance 9a74a7af-9736-478c-8d65-a331a8aec11d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:55:03.535554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:03.536313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:03.544876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1a02341d-5402-4e4e-ba14-b2502c852a56 req-fb7e9dff-86fa-4ab8-adc0-0ecf56af2d61 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121596 Sep 16 13:55:03.545219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.545804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.546323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.547457 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 320/627] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:03.547909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.548449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.549119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.559584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:03.561279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:03.573438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.574863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.575948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.577644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.578733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.579684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.821680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:03.856070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:03.866201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:03.881192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82246622-5183-48b7-adcc-788a1389116d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.352224 Sep 16 13:55:03.898440 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 308/628] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:03 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:03.931934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:03.935405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:03.962249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.969326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.970370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:03.971843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:03.979629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:03.980679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:04.297684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:04.324525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-884bae9f-d90c-4195-8f39-9491989b5597 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 0.773686 Sep 16 13:55:04.330757 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 321/629] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:03 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:04.353318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43e4028d-9c1a-467b-8409-231378231e1d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Calling method '.version_select at 0x7f724d9f14c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:04.473938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-43e4028d-9c1a-467b-8409-231378231e1d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9e5d004f-e98c-499f-b51a-2810641dc652 could not be found", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 13:55:04.475058 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-43e4028d-9c1a-467b-8409-231378231e1d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] HTTP exception thrown: Floating IP not found for ID 9e5d004f-e98c-499f-b51a-2810641dc652 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43e4028d-9c1a-467b-8409-231378231e1d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Request method failure captured: Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-floating-ips/9e5d004f-e98c-499f-b51a-2810641dc652 HTTP/1.1 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAzRLO03H_xAkELL_yuxujhpVd4hQjsf_xGXUFJhw3Z0Z2NXFpS6krIj7W-_JVzFynHzDXCojGWAS-w0CPGpFjraw06il8lqGfQfvH-riDotltIJ6z6pGi4o4C0P4Z1otcNITU9xY-DXCzSniAwOko_MdeHETEauJQVMgpd2T_AxFI Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 75a55775699e443897f8cacbbd0d32d2 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1116507523 Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:55:04.479471 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_75a55775699e443897f8cacbbd0d32d2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/75a55775699e443897f8cacbbd0d32d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/75a55775699e443897f8cacbbd0d32d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/75a55775699e443897f8cacbbd0d32d2"}]}] Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1116507523 Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 75a55775699e443897f8cacbbd0d32d2 Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1116507523 Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsNegativeTestJSON-1116507523-project Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2e4dcbdeb6a6421381325417e4c181a0 Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1116507523-project Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: exception: Floating IP not found for ID 9e5d004f-e98c-499f-b51a-2810641dc652 Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9e5d004f-e98c-499f-b51a-2810641dc652'} Sep 16 13:55:04.481070 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 13:55:04.481993 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9e5d004f-e98c-499f-b51a-2810641dc652 could not be found Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7696021e-f8ef-4adf-a6ed-7867ade9239f'] Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9e5d004f-e98c-499f-b51a-2810641dc652. Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:04.483354 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9e5d004f-e98c-499f-b51a-2810641dc652 Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:55:04.484779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:55:04.486201 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9e5d004f-e98c-499f-b51a-2810641dc652 Sep 16 13:55:04.486201 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:04.487337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43e4028d-9c1a-467b-8409-231378231e1d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] Returning 404 to user: Floating IP not found for ID 9e5d004f-e98c-499f-b51a-2810641dc652 {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:04.488376 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43e4028d-9c1a-467b-8409-231378231e1d tempest-FloatingIPsNegativeTestJSON-1116507523 tempest-FloatingIPsNegativeTestJSON-1116507523-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/9e5d004f-e98c-499f-b51a-2810641dc652" status: 404 len: 111 microversion: 2.1 time: 0.155676 Sep 16 13:55:04.490847 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 322/630] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:55:04 2022] DELETE /compute/v2.1/os-floating-ips/9e5d004f-e98c-499f-b51a-2810641dc652 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:55:04.502859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:04.504016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:04.531861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:04.532751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:04.533793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:04.535480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:04.536815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:04.537625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:04.587970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:04.638620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3e8c89d-b6ff-4c4a-b674-dad8566f044c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.748774 Sep 16 13:55:04.642858 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 309/631] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:03 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:04.665319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:04.668843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:04.702080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:04.703302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:04.707667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:04.709476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:04.711296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:04.712361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:04.938959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:04.963375 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a15bd91c-2f1e-4034-9920-99efa941d034 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1274 microversion: 2.1 time: 0.316743 Sep 16 13:55:04.973609 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 310/632] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:04 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1274 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:04.986367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:04.987289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:04.994727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:04.995378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:04.995911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:04.996901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:04.997633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:04.998286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:05.259487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:05.273598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a22ea1d0-86d9-4263-8134-a7e1f6e11595 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1321 microversion: 2.1 time: 0.780281 Sep 16 13:55:05.274355 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 323/633] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:04 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1321 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:05.279601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:05.290981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:05.313480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:05.322857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:05.323483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:05.324360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:05.324985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:05.325483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:05.711684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:05.747396 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ffefb2f0-d3d2-4c04-a71b-4ac5049c4f6f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1471 microversion: 2.1 time: 0.770152 Sep 16 13:55:05.752891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 311/634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:04 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1471 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:05.767071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:05.768656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:05.785191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:05.788068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:05.789982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:05.791577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:05.794386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:05.795884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:05.952418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:06.001222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:06.012102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:06.031636 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-679c1bed-8d51-4150-be51-a38e245edfa1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.754435 Sep 16 13:55:06.033690 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 324/635] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:05 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:06.050610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:06.053766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:06.088178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:06.093000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:06.095991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:06.102078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:06.109714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:06.110973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:07.271142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:07.289385 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4e55ff4-83e8-4f00-93c5-314fd1224fe8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 1.251700 Sep 16 13:55:07.319581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 325/636] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:06 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:07.334709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:07.336200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:07.347806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:07.349124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:07.350114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:07.351720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:07.352797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:07.353795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:07.448203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:07.485861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8859db96-c098-4ee0-bf6b-27e125579db2 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 1.727904 Sep 16 13:55:07.515787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 312/637] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:05 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:07.540462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:07.548967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:07.564367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:07.568218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:07.569481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:07.571631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:07.573094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:07.574214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:07.660587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:07.691704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d872918d-397e-41d2-a506-ad088d62118a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1272 microversion: 2.1 time: 0.363725 Sep 16 13:55:07.723872 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 326/638] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:07 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1272 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:07.739534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:07.748024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:07.780792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:07.793921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:07.795800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:07.796988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:07.797765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:07.798498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:08.769456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:08.806582 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c2e2b09-df70-4208-abfe-736e72385aac tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1470 microversion: 2.1 time: 1.281991 Sep 16 13:55:08.812596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:08.843129 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 313/639] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:07 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1470 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:08.860984 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21f73f0e-9f86-496b-9cab-d86acdb74c50 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1468 microversion: 2.1 time: 1.135199 Sep 16 13:55:08.863269 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 327/640] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:07 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1468 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:08.863521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:08.864634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:08.895753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:08.897056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:08.902778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:08.904652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:08.917890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:08.919234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:08.921651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:08.924486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:08.951858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:08.952771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:08.953573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:08.954891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:08.956027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:08.957142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:09.608843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:09.637329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:09.638977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:09.640256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24f638d9-18de-4e24-ba7b-864a22d3f28d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.795764 Sep 16 13:55:09.660631 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 314/641] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:08 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:09.665981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:09.673898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:09.689796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:09.701859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:09.702372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:09.702850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:09.703589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:09.704058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:09.704484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:09.706034 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23434114-7f66-49f0-b659-c48e84ee7c45 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 0.839645 Sep 16 13:55:09.708843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 328/642] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:08 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:09.725250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:09.726254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:09.771420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:09.774983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:09.775837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:09.776907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:09.779670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:09.780463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:09.791719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:10.819520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:10.854846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:10.859595 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28335128-aeed-463d-81f6-de4ab84bae9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 1.147737 Sep 16 13:55:10.865825 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 329/643] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:09 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:10.876576 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6165bfb2-66d5-4bd0-81b7-7329a1d7d319 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 1.214642 Sep 16 13:55:10.886984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 315/644] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:09 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:10.890976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:10.892461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:10.905226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:10.907112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:10.927535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:10.927866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:10.928326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:10.931840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:10.933011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:10.943758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:10.944182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:10.947048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:10.949556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:10.950950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:10.951552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:10.956045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:10.958284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:11.057924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:11.081084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lazy-loading 'flavor' on Instance uuid 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:55:11.261160 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a80ee5d4-8c0d-4e93-abce-41bddf1b0cdd tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a/action" status: 202 len: 0 microversion: 2.1 time: 0.379890 Sep 16 13:55:11.266034 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 330/645] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:10 2022] POST /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:55:11.306743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2dde0f0a-0203-4d87-8d5d-c3b21c64f913 req-5c647783-b7e5-4979-9178-4007290d03aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba0e96-0970-4dbb-b9cc-a082824df96f", "name": "network-vif-plugged", "status": "completed", "tag": "bf14938d-0606-4211-bad3-6350e8faa4a7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:11.344297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2dde0f0a-0203-4d87-8d5d-c3b21c64f913 req-5c647783-b7e5-4979-9178-4007290d03aa service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:11.346146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2dde0f0a-0203-4d87-8d5d-c3b21c64f913 req-5c647783-b7e5-4979-9178-4007290d03aa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:11.348177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2dde0f0a-0203-4d87-8d5d-c3b21c64f913 req-5c647783-b7e5-4979-9178-4007290d03aa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:11.349122 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e2591be-1da8-4823-9774-5ddf2e154dd7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d/action" status: 204 len: 0 microversion: 2.1 time: 0.458913 Sep 16 13:55:11.352174 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 316/646] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:10 2022] POST /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d/action => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:11.378274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:11.384914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:11.400502 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2dde0f0a-0203-4d87-8d5d-c3b21c64f913 req-5c647783-b7e5-4979-9178-4007290d03aa service nova] Creating event network-vif-plugged:bf14938d-0606-4211-bad3-6350e8faa4a7 for instance f6ba0e96-0970-4dbb-b9cc-a082824df96f on n-h2-858129-2 Sep 16 13:55:11.411640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:11.415226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:11.416157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:11.420895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:11.421104 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2dde0f0a-0203-4d87-8d5d-c3b21c64f913 req-5c647783-b7e5-4979-9178-4007290d03aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141330 Sep 16 13:55:11.427224 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 331/647] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:11.433469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:11.434547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:11.450927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:11.452183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:11.473702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:11.479116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:11.480643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:11.482036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:11.482985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:11.483758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:12.325330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:12.361585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:12.365285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:12.369209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91ddb7dc-ab2d-4087-a22d-1c379d7f148b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 1.013772 Sep 16 13:55:12.382391 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 317/648] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:11 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:12.392647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:12.393484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:12.410709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:12.412205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:12.413077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:12.414968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:12.415734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:12.416371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:12.716326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:12.763361 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e4c1bc2-f2ad-4876-bb52-77f703fef9a0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1316 microversion: 2.1 time: 1.333652 Sep 16 13:55:12.775979 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 332/649] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:11 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1316 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:12.802230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:12.807679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:12.864692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:12.869142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:12.883103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:12.890095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:12.892884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:12.895944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:14.777907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:14.801670 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61486f3f-0210-40d8-8645-f2b69a9fd17a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1468 microversion: 2.1 time: 2.023667 Sep 16 13:55:14.820595 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 333/650] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:12 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1468 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:14.849753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0f1f9cf4-2989-4d5e-9c03-dac264c8c797 req-d631dbc0-db2d-4766-9391-a7c002d4571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b983bc33-1516-4759-a425-b6aea92b77d1", "name": "network-vif-unplugged", "status": "completed", "tag": "03b52866-a109-4c4b-8a4b-d69af987c2b5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:14.898322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0f1f9cf4-2989-4d5e-9c03-dac264c8c797 req-d631dbc0-db2d-4766-9391-a7c002d4571c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:14.899477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0f1f9cf4-2989-4d5e-9c03-dac264c8c797 req-d631dbc0-db2d-4766-9391-a7c002d4571c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:14.900232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0f1f9cf4-2989-4d5e-9c03-dac264c8c797 req-d631dbc0-db2d-4766-9391-a7c002d4571c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:14.953696 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0f1f9cf4-2989-4d5e-9c03-dac264c8c797 req-d631dbc0-db2d-4766-9391-a7c002d4571c service nova] Creating event network-vif-unplugged:03b52866-a109-4c4b-8a4b-d69af987c2b5 for instance b983bc33-1516-4759-a425-b6aea92b77d1 on n-h1-858129-2 Sep 16 13:55:14.967162 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0f1f9cf4-2989-4d5e-9c03-dac264c8c797 req-d631dbc0-db2d-4766-9391-a7c002d4571c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150631 Sep 16 13:55:14.972518 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 334/651] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:14.986073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:14.988813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:15.002882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:15.004322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:15.005322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:15.008654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:15.009818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:15.012086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:15.675589 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca812757-a9ac-4d82-a4a3-3365775c3d57 tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1629 microversion: 2.1 time: 3.289597 Sep 16 13:55:15.678350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 318/652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:12 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1629 bytes in 3295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:15.694127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:15.695163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:15.708715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:15.712576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:15.715002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:15.720737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:15.721352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:15.725589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:16.370864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:16.395622 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c51eeb8b-9b4c-44cb-9999-4b957846311e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 1.420867 Sep 16 13:55:16.406965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 335/653] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:14 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:16.416685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-deeba0d1-239a-4ec3-8ae5-079a68af07bf req-86fa8bce-4844-4692-866e-a1458bf570d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf45248f-cf76-486d-96ef-2e4b7cbf8d62", "tag": "7f09331d-e342-4d47-ad44-0085c26d3267"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:16.433207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:16.438184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-deeba0d1-239a-4ec3-8ae5-079a68af07bf req-86fa8bce-4844-4692-866e-a1458bf570d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:16.439449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-deeba0d1-239a-4ec3-8ae5-079a68af07bf req-86fa8bce-4844-4692-866e-a1458bf570d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:16.440444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-deeba0d1-239a-4ec3-8ae5-079a68af07bf req-86fa8bce-4844-4692-866e-a1458bf570d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:16.463356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:16.468032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-deeba0d1-239a-4ec3-8ae5-079a68af07bf req-86fa8bce-4844-4692-866e-a1458bf570d6 service nova] Creating event network-changed:7f09331d-e342-4d47-ad44-0085c26d3267 for instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 on n-h2-858129-2 Sep 16 13:55:16.478769 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-deeba0d1-239a-4ec3-8ae5-079a68af07bf req-86fa8bce-4844-4692-866e-a1458bf570d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068923 Sep 16 13:55:16.480353 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 336/654] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:16.493533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:16.495802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:16.513954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:16.515328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:16.516437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:16.518042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:16.519259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:16.520272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:16.718292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:16.738273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3eb93e3-0c51-44b0-9618-b0ac5eea70b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 1.058207 Sep 16 13:55:16.741222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 319/655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:15 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:16.760732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68a841c-ac0a-44de-9d0e-7d1fdafdf730", "name": "network-vif-plugged", "status": "completed", "tag": "04613bc1-5986-48d4-9629-aca916266b90"}, {"server_uuid": "9a74a7af-9736-478c-8d65-a331a8aec11d", "name": "network-vif-plugged", "status": "completed", "tag": "63d31d28-e16d-4175-8c59-5ef3ebed49bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:16.787370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:16.787868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:16.788318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:16.816388 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Creating event network-vif-plugged:04613bc1-5986-48d4-9629-aca916266b90 for instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 on n-h1-858129-2 Sep 16 13:55:16.821725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Creating event network-vif-plugged:63d31d28-e16d-4175-8c59-5ef3ebed49bc for instance 9a74a7af-9736-478c-8d65-a331a8aec11d on n-h1-858129-2 Sep 16 13:55:16.843007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] Instance 9a74a7af-9736-478c-8d65-a331a8aec11d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:55:16.878285 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-73329e81-b28c-433b-8b65-d764f75aa6ed req-619e1487-4a5b-41c0-9873-08e42050751f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.133385 Sep 16 13:55:16.880320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 320/656] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:16.899891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:16.904435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:16.928685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:16.929903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:16.931267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:16.934106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:16.938611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:16.940129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:17.142029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:17.157176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:17.159879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:17.161499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3956611b-7ce4-44bf-b4e0-10a4f71fa3b0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.678639 Sep 16 13:55:17.163580 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 337/657] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:16 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:17.174773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:17.180165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:17.201522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:17.204366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:17.206822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:17.208637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:17.212254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:17.213633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:17.789303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:17.823961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c149cf1b-d8f1-4e0f-804e-682dd485b258 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1466 microversion: 2.1 time: 0.938561 Sep 16 13:55:17.827920 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 321/658] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:16 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1466 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:17.842349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:17.850445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:17.863675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:17.864533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:17.868205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:17.872059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:17.872880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:17.873513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:17.926211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:17.957646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97dd52b9-4c0f-49db-ac1b-b44dd7ba9338 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1468 microversion: 2.1 time: 0.791987 Sep 16 13:55:17.959538 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 338/659] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:17 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1468 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:17.982833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-36bb61a8-7309-4045-bb20-e36991b21026 req-39e9ded4-8626-4264-92c3-e65d677869d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b983bc33-1516-4759-a425-b6aea92b77d1", "tag": "03b52866-a109-4c4b-8a4b-d69af987c2b5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:18.034463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-36bb61a8-7309-4045-bb20-e36991b21026 req-39e9ded4-8626-4264-92c3-e65d677869d3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:18.036187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-36bb61a8-7309-4045-bb20-e36991b21026 req-39e9ded4-8626-4264-92c3-e65d677869d3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:18.037769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-36bb61a8-7309-4045-bb20-e36991b21026 req-39e9ded4-8626-4264-92c3-e65d677869d3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:18.069880 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-36bb61a8-7309-4045-bb20-e36991b21026 req-39e9ded4-8626-4264-92c3-e65d677869d3 service nova] Creating event network-changed:03b52866-a109-4c4b-8a4b-d69af987c2b5 for instance b983bc33-1516-4759-a425-b6aea92b77d1 on n-h1-858129-2 Sep 16 13:55:18.084700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-36bb61a8-7309-4045-bb20-e36991b21026 req-39e9ded4-8626-4264-92c3-e65d677869d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119902 Sep 16 13:55:18.088690 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 339/660] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:18.115410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:18.121392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:18.151684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:18.153294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:18.155744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:18.160033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:18.163373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:18.167401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:18.584783 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-07e03f79-0e75-48a7-9ef4-2f086fd9ca8b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1612 microversion: 2.1 time: 0.755185 Sep 16 13:55:18.585395 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 322/661] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:17 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1612 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:18.605239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:18.606125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:18.624638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:18.634957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:18.639001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:18.640607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:18.641407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:18.642161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:18.818670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:18.842371 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9b19059-5813-490f-b5e4-4557984bb73b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 0.738709 Sep 16 13:55:18.875350 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 340/662] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:18 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:19.590113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:19.610715 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9347b6cc-7928-4c6f-aba6-fa4b643676b6 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1388 microversion: 2.1 time: 1.018846 Sep 16 13:55:19.616665 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 323/663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:18 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1388 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:19.645832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:19.651626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:19.693600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:19.696292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:19.699091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:19.707299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:19.709584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:19.710905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:19.816955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:19.819981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:19.832220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:19.833664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:19.835725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:19.837691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:19.838938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:19.840065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:20.384092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:20.406266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:20.409239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:20.412523 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62e20a3c-b511-414a-b8c4-131e5c653fef tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.790595 Sep 16 13:55:20.415025 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 324/664] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:19 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:20.428392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:20.430553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:20.450028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:20.451374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:20.452442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:20.454276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:20.455531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:20.457106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:20.531395 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a while it is in vm_state suspended Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Request method failure captured: Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a/action HTTP/1.1 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 15 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_5QY8JmWcevF1kru7afC52uRpR14woNTZ1JsNRzqm-snBqn75uKz1UwcWRLUXHCz9Nx3b7dA5EO412z2p5NlKLCrUKv8-gzy6Xfwe9junYWLy5j6IgxvgsnWlI91R2nsKc3xGvajqHP1tlyRv11i5aMKMyjnLqxVYxN6OGAsAeXP0 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:55:20.533697 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_392e2a3e135c4e38b7e6b17ec0a70124", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}] Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: acc74fefe0c64e7ebe490933f4f5f783 Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: {"migrate": {}} Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:55:20.536373 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'migrate' instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a while it is in vm_state suspended Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a', 'body': {'migrate': {}}} Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a in vm_state suspended. Cannot resize while the instance is in this state. Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:20.539362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a while it is in vm_state suspended Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:20.543818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a while it is in vm_state suspended Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Returning 409 to user: Cannot 'migrate' instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a while it is in vm_state suspended {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-000f65fb-0c1a-4061-ad56-74654c10781b tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a/action" status: 409 len: 148 microversion: 2.1 time: 0.118938 Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 325/665] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:20 2022] POST /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a/action => generated 148 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:55:20.552514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:20.553736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:20.553942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:20.556727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:20.557018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:20.557764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:20.558247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:20.558932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:21.635447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:21.653748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8badc120-d451-4761-80dc-de52dd2d4a6c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1460 microversion: 2.1 time: 1.115577 Sep 16 13:55:21.655875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 326/666] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:20 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1460 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:21.667319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:21.670590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:21.688199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:21.689678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:21.691505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:21.692817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:21.693381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:21.696922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:21.755179 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8707bee2-f4e3-4730-a4a0-05ec693dee34 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1617 microversion: 2.1 time: 2.878042 Sep 16 13:55:21.776327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 341/667] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:18 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1617 bytes in 2900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:21.810002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eebc8a7a-77a7-410b-8f90-026cb915792a tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eebc8a7a-77a7-410b-8f90-026cb915792a tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Request method failure captured: Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc/action HTTP/1.1 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 39 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_5QY8JmWcevF1kru7afC52uRpR14woNTZ1JsNRzqm-snBqn75uKz1UwcWRLUXHCz9Nx3b7dA5EO412z2p5NlKLCrUKv8-gzy6Xfwe9junYWLy5j6IgxvgsnWlI91R2nsKc3xGvajqHP1tlyRv11i5aMKMyjnLqxVYxN6OGAsAeXP0 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:55:21.826393 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_392e2a3e135c4e38b7e6b17ec0a70124", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}] Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: acc74fefe0c64e7ebe490933f4f5f783 Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: {"os-resetState": {"state": "invalid"}} Sep 16 13:55:21.828898 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:21.830251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:55:21.832879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 16 13:55:21.838582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:21.838582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eebc8a7a-77a7-410b-8f90-026cb915792a tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:21.838582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eebc8a7a-77a7-410b-8f90-026cb915792a tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc/action" status: 400 len: 144 microversion: 2.1 time: 0.052525 Sep 16 13:55:21.838582 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 342/668] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:21 2022] POST /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc/action => generated 144 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:55:21.860096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:21.861202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:21.870880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:21.871384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:21.871827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:21.872544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:21.873009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:21.873458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:22.471545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:22.477916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:22.488931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-edc34ab9-39f7-4990-9e8d-bfe9f9680aec tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 0.830785 Sep 16 13:55:22.497311 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4152c6ce-51a7-43fa-8a87-00a6040b4d7a tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1586 microversion: 2.1 time: 0.656964 Sep 16 13:55:22.498899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 343/669] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:21 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1586 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:22.507036 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 327/670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:21 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:22.534485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:22.538012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:22.551758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:22.552758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:22.553665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:22.556231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:22.557350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:22.558492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:22.765395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f6c9b2f-e40a-4bce-ae34-7d848bf275a6 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724daa3700>, body: {"keypair": {"name": "tempest-keypair-2116744450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO13UewwLRykAOeypiDYGIJpaBFqOGomnVYyITGtabV3pCCBqh8KoGO9U1MWFvEwoeaw6uM5Z/j6rq2zB4WZ//j5KLWSBKY0yg5XD0kfzwjwyFa2sZv5/yd+glHvRbf1TQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:22.795349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8f6c9b2f-e40a-4bce-ae34-7d848bf275a6 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:22.806689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8f6c9b2f-e40a-4bce-ae34-7d848bf275a6 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:22.851547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f6c9b2f-e40a-4bce-ae34-7d848bf275a6 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.341698 Sep 16 13:55:22.852681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 328/671] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:22.862357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:22.863539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:22.876182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:22.877058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:22.877851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:22.879193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:22.880046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:22.880821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:22.949023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:22.958757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:22.960320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:22.961973 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28124e5c-49d9-4945-899b-ca5931541513 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.461403 Sep 16 13:55:22.971077 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 344/672] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:22 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:22.983489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d60c73d5-0499-41be-8bd2-1a83676d96a9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: .version_select at 0x7f724d9f10d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1134261367", "policies": ["affinity"]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:23.020079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d60c73d5-0499-41be-8bd2-1a83676d96a9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:23.030393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d60c73d5-0499-41be-8bd2-1a83676d96a9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:23.130184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d60c73d5-0499-41be-8bd2-1a83676d96a9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:23.136585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d60c73d5-0499-41be-8bd2-1a83676d96a9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:23.151416 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d60c73d5-0499-41be-8bd2-1a83676d96a9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.177449 Sep 16 13:55:23.151922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 345/673] 10.222.0.60 () {60 vars in 1174 bytes} [Fri Sep 16 13:55:22 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:23.157021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56bff1a6-0be6-4b43-b033-974f9088b41f tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56bff1a6-0be6-4b43-b033-974f9088b41f tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Request method failure captured: Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc/action HTTP/1.1 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 31 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_5QY8JmWcevF1kru7afC52uRpR14woNTZ1JsNRzqm-snBqn75uKz1UwcWRLUXHCz9Nx3b7dA5EO412z2p5NlKLCrUKv8-gzy6Xfwe9junYWLy5j6IgxvgsnWlI91R2nsKc3xGvajqHP1tlyRv11i5aMKMyjnLqxVYxN6OGAsAeXP0 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:55:23.160711 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_392e2a3e135c4e38b7e6b17ec0a70124", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}] Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: acc74fefe0c64e7ebe490933f4f5f783 Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: {"os-resetState": {"state": 1}} Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:55:23.163288 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc', 'body': {'os-resetState': {'state': 1}}} Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 1 Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:23.164943 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 16 13:55:23.170818 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.175350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56bff1a6-0be6-4b43-b033-974f9088b41f tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:23.175350 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56bff1a6-0be6-4b43-b033-974f9088b41f tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc/action" status: 400 len: 120 microversion: 2.1 time: 0.009308 Sep 16 13:55:23.175350 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 346/674] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:23 2022] POST /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc/action => generated 120 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:55:23.175350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:23.175350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:23.185590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:23.186339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:23.187047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:23.188107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:23.188719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:23.189437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:23.222484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:23.244831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dca07c4d-ebfb-4832-a192-a0f35d14ee59 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1460 microversion: 2.1 time: 0.389830 Sep 16 13:55:23.249809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 329/675] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:22 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1460 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:23.276859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-671a1d42-7374-4161-bb85-bd392c9fe965 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724da3aa60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:23.298950 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-671a1d42-7374-4161-bb85-bd392c9fe965 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-2116744450" status: 200 len: 512 microversion: 2.2 time: 0.040132 Sep 16 13:55:23.300846 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 330/676] 10.222.0.60 () {60 vars in 1258 bytes} [Fri Sep 16 13:55:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2116744450 => generated 512 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:23.318829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10488ab0-a884-4974-8916-5a84a93f85ac tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:23.320550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-10488ab0-a884-4974-8916-5a84a93f85ac tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Failed to fetch instance by id 999 {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 13:55:23.321122 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-10488ab0-a884-4974-8916-5a84a93f85ac tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10488ab0-a884-4974-8916-5a84a93f85ac tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Request method failure captured: Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 37 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_5QY8JmWcevF1kru7afC52uRpR14woNTZ1JsNRzqm-snBqn75uKz1UwcWRLUXHCz9Nx3b7dA5EO412z2p5NlKLCrUKv8-gzy6Xfwe9junYWLy5j6IgxvgsnWlI91R2nsKc3xGvajqHP1tlyRv11i5aMKMyjnLqxVYxN6OGAsAeXP0 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:55:23.328359 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_392e2a3e135c4e38b7e6b17ec0a70124", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/392e2a3e135c4e38b7e6b17ec0a70124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/392e2a3e135c4e38b7e6b17ec0a70124"}]}] Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 392e2a3e135c4e38b7e6b17ec0a70124 Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-581714298 Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: acc74fefe0c64e7ebe490933f4f5f783 Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminNegativeTestJSON-581714298-project-admin Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: {"os-resetState": {"state": "error"}} Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:55:23.331292 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 999 could not be found. Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:55:23.333188 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10488ab0-a884-4974-8916-5a84a93f85ac tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:23.337017 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-10488ab0-a884-4974-8916-5a84a93f85ac tempest-ServersAdminNegativeTestJSON-581714298 tempest-ServersAdminNegativeTestJSON-581714298-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.029342 Sep 16 13:55:23.339046 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 331/677] 10.222.0.60 () {60 vars in 1179 bytes} [Fri Sep 16 13:55:23 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 13:55:23.347104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-803ad541-00da-4bb3-83c6-631052e6dbb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'create', calling method: .version_select at 0x7f724d711a60>, body: {"keypair": {"name": "tempest-keypair-2060106077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlaJlqSiWtIst4epAGSoiLEmqmRpl4i/Hp3H4cb6vvj1mr5fo49eBNbsN6OW27AudrGIObaccZZLdefDEdGnwvNVi8E86SQ/7+Xelsh/62PLBtNZW9pPtfT22jOn8iwEQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:23.368360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-803ad541-00da-4bb3-83c6-631052e6dbb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for project c67843449c98450aa14d5889893ceeb4. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:23.375113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-803ad541-00da-4bb3-83c6-631052e6dbb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for user ae208d89fa7549198ef91ef307464763 and project c67843449c98450aa14d5889893ceeb4. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:23.402243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4725d7ed-e6e1-4bd4-a4d8-47cf1c94b9af tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231864 Sep 16 13:55:23.403694 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 347/678] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 13:55:23 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:23.410940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50140689-e32a-444e-801a-4517e4761b2c tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d9f1dc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:23.422039 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-803ad541-00da-4bb3-83c6-631052e6dbb2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072742 Sep 16 13:55:23.423213 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 332/679] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 13:55:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:23.431162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1401863743", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "460842ce-b822-44a7-975f-a2f21d9cbe29"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:23.452417 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50140689-e32a-444e-801a-4517e4761b2c tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116744450" status: 204 len: 0 microversion: 2.2 time: 0.046467 Sep 16 13:55:23.463816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:23.465574 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 348/680] 10.222.0.60 () {60 vars in 1261 bytes} [Fri Sep 16 13:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116744450 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:23.477291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:23.478170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:23.494810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:23.496496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:23.497590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:23.500790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:23.501933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:23.503051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:23.512975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:55:23.562897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:55:23.728784 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1dd6e343-b4ca-48e8-80c6-485d58e3ef00 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 204 len: 0 microversion: 2.1 time: 0.260800 Sep 16 13:55:23.729639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 349/681] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:55:23 2022] DELETE /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:23.736101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ded0ef3-802f-4cd6-8374-a696db076c15 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724d8dfd30>, body: {"keypair": {"name": "tempest-keypair-1623290779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ49uqDHo1/8LxA1P+YfTpoT/ZQHHsq1GQ8AicLptjQk8qBtDi8JhDnhti2yOMaAe1tGuFZUn/jlKPffp9U1h//wrxjTa0VQD/4p86I/d/P1cMUHHg4CFRMi1c9KrguvCw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:23.755414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6ded0ef3-802f-4cd6-8374-a696db076c15 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:23.763649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6ded0ef3-802f-4cd6-8374-a696db076c15 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:23.802987 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ded0ef3-802f-4cd6-8374-a696db076c15 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.071247 Sep 16 13:55:23.810226 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 350/682] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:23.812653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:23.814088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:23.825421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:23.827063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:23.827407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:23.828805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:23.830169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:23.830709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:24.179052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:55:24.186357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:55:24.188806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:55:24.189893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:55:24.192241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:55:24.234278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:24.274265 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa7137fa-3181-48e4-8473-1606bc890749 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 0.467792 Sep 16 13:55:24.280501 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 351/683] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:23 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:24.302857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:24.309543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:24.310374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:24.313702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:24.314788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:24.318908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:24.319982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:24.322663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:24.342446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:24.344057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:24.345154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:24.346742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:24.347822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:24.348869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:24.374962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:24.381519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:24.399941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Going to run 2 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:55:24.402694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:55:24.467787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128642) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 16 13:55:24.512045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:24.519500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:24.582086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:24.589621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:24.612893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=956d23ad-d927-4fbe-ba93-40e436b3284c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:55:24.684277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:24.691622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:24.765781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:24.780371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:24.855793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-882d5032-9701-4edb-aec5-f4f19f2914eb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.430835 Sep 16 13:55:24.863087 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 333/684] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:55:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1439 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:24.874001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2504f0ba-1e2b-41e7-8901-4777cf425cfd tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d732c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:24.923362 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2504f0ba-1e2b-41e7-8901-4777cf425cfd tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623290779" status: 204 len: 0 microversion: 2.2 time: 0.058000 Sep 16 13:55:24.931659 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 334/685] 10.222.0.60 () {60 vars in 1261 bytes} [Fri Sep 16 13:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623290779 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:24.936855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:24.938178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:24.965630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:24.967238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:24.968312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:24.969860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:24.971297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:24.972816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:25.585734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:25.596297 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19260814-c4d2-4659-8f65-8f303a62bd3d tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1467 microversion: 2.1 time: 1.314140 Sep 16 13:55:25.599481 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 352/686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:24 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1467 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:25.614090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:25.630290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:25.631167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Searching by: {'deleted': False, 'project_id': 'da29b469d8554f0993b35628a9a05d89'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:25.685932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:25.692983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:25.693618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:25.695749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:25.696234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:25.696666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:25.759968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:25.803125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:25.813451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:25.821663 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ffce430b-6522-4c85-aeb0-2bc4c7904a48 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.893969 Sep 16 13:55:25.822784 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 335/687] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:24 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:25.838317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:55:25.841025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5af32a99-5b9f-4137-80d4-bbe2d66ea71a tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724d711700>, body: {"keypair": {"name": "tempest-keypair-1469191324", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:25.906300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5af32a99-5b9f-4137-80d4-bbe2d66ea71a tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:25.926512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5af32a99-5b9f-4137-80d4-bbe2d66ea71a tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:26.004505 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5af32a99-5b9f-4137-80d4-bbe2d66ea71a tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.180176 Sep 16 13:55:26.005814 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 336/688] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:25 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:26.014441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:26.015110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:26.038821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:26.039409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:26.041658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:26.043217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:26.043803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:26.044158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:26.129199 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37f2156a-5756-457d-b840-07eb082f94f1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.528128 Sep 16 13:55:26.131668 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 353/689] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 13:55:25 2022] GET /compute/v2.1/servers => generated 1003 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:26.142586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-71ad22bb-2e0f-45ee-bd8f-f1571f5f562b req-96da56b2-45ba-4f80-bed0-d6ae0f37855c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf45248f-cf76-486d-96ef-2e4b7cbf8d62", "name": "network-vif-plugged", "status": "completed", "tag": "7f09331d-e342-4d47-ad44-0085c26d3267"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:26.165472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-71ad22bb-2e0f-45ee-bd8f-f1571f5f562b req-96da56b2-45ba-4f80-bed0-d6ae0f37855c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:26.166947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-71ad22bb-2e0f-45ee-bd8f-f1571f5f562b req-96da56b2-45ba-4f80-bed0-d6ae0f37855c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:26.168260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-71ad22bb-2e0f-45ee-bd8f-f1571f5f562b req-96da56b2-45ba-4f80-bed0-d6ae0f37855c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:26.200480 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-71ad22bb-2e0f-45ee-bd8f-f1571f5f562b req-96da56b2-45ba-4f80-bed0-d6ae0f37855c service nova] Creating event network-vif-plugged:7f09331d-e342-4d47-ad44-0085c26d3267 for instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 on n-h2-858129-2 Sep 16 13:55:26.211613 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-71ad22bb-2e0f-45ee-bd8f-f1571f5f562b req-96da56b2-45ba-4f80-bed0-d6ae0f37855c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076614 Sep 16 13:55:26.213635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 354/690] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:26.228753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c00d208c-1391-4426-b52d-0f9b024a2b5c tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d8828b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:26.282608 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c00d208c-1391-4426-b52d-0f9b024a2b5c tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469191324" status: 204 len: 0 microversion: 2.2 time: 0.064356 Sep 16 13:55:26.285526 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 355/691] 10.222.0.60 () {60 vars in 1261 bytes} [Fri Sep 16 13:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469191324 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:26.300213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71bcacdf-d34a-4552-bcdd-eb648f3e9f7e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:26.301814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71bcacdf-d34a-4552-bcdd-eb648f3e9f7e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:26.519744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71bcacdf-d34a-4552-bcdd-eb648f3e9f7e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:26.533781 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71bcacdf-d34a-4552-bcdd-eb648f3e9f7e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1219 microversion: 2.1 time: 0.246170 Sep 16 13:55:26.534492 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 356/692] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:26 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1219 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:26.548155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36382b52-a58c-43ba-8d50-b9ba5f054843 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724d8abe50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2048686044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEDrNVmjVc4Y6zd24bVQDLoBD+kyCncLmarwLEG3n/4mt/rfiyqjtdKB23TWWGZumSUJjTk+vzMhMugBH6o5+h1cSrt21sqQ/qwGb6wnQagyjtCN2DAmfW+TaDe3gd3lg=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:26.562174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:26.577573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-977fcbfa-3c8f-4756-9bb3-a511aca32cae tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 0.567186 Sep 16 13:55:26.580450 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 337/693] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:26 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:26.614149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-36382b52-a58c-43ba-8d50-b9ba5f054843 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:26.634821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-36382b52-a58c-43ba-8d50-b9ba5f054843 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:26.635910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:26.636689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:26.649006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:26.649917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:26.650598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:26.655243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:26.656097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:26.665238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:26.691293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:26.766628 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36382b52-a58c-43ba-8d50-b9ba5f054843 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.221741 Sep 16 13:55:26.769260 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 357/694] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:26 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:26.806205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f23a4d8b-0c43-4c91-aa41-05826d39b0ea tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724db5ff70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1740648753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMkFnnQ5J44fg0PfinMrKDp6LVGq6JTYSGMRMtBzexKVwGNxm2z+j2hs0WEgxI6fIo/Zl6QiifdYQJtgeIHueADUCazUl4zKsQ6Vbi0VsVI6Xv1dpEKMAJPKuzACqXqfA=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:26.849279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:26.904644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f23a4d8b-0c43-4c91-aa41-05826d39b0ea tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:26.914915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f23a4d8b-0c43-4c91-aa41-05826d39b0ea tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:26.970106 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f23a4d8b-0c43-4c91-aa41-05826d39b0ea tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.180749 Sep 16 13:55:26.970753 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 358/695] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:26 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 16 13:55:26.981180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:26.981993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:27.004752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:27.016772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:27.020490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:27.021990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:27.026185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:27.027185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:27.900682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:27.909626 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d4d6e65-526b-441c-90d5-14863c01394c tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1467 microversion: 2.1 time: 1.277825 Sep 16 13:55:27.914704 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 338/696] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:26 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1467 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:55:27.929065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5a0c52c6-afda-410e-9f2d-79a747dbc89e tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724da3a670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-271562145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmf/IAFYGnq8Xyl5TgdjS8LQwJ4qSVwcQIEJB/ULTVpbrL0HUvGsMYu/z0+IfIX9PJphju3jOmN63cjebbzWJg8ADHWq0ipjRlQYoyHX4zUy9zOB9E7Qcb59MbvT8c2MA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:27.967672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5a0c52c6-afda-410e-9f2d-79a747dbc89e tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:27.977033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5a0c52c6-afda-410e-9f2d-79a747dbc89e tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:27.982894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:28.043326 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5a0c52c6-afda-410e-9f2d-79a747dbc89e tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.127199 Sep 16 13:55:28.045278 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 339/697] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:27 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:28.052682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:28.063792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:28.075438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:28.075944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:28.076388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:28.081789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:28.082383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:28.082865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:28.448478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:28.463776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:28.466583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:28.472119 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-65992cec-8d60-43db-8ded-fb9a71e75003 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 1.499847 Sep 16 13:55:28.490990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 359/698] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:26 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:28.505978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c1977d0c-08d6-44ec-a8fb-9331eaff1fff req-9a14f7aa-e8ca-4df4-add0-ad17b2c924fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68a841c-ac0a-44de-9d0e-7d1fdafdf730", "tag": "04613bc1-5986-48d4-9629-aca916266b90"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:28.520668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1977d0c-08d6-44ec-a8fb-9331eaff1fff req-9a14f7aa-e8ca-4df4-add0-ad17b2c924fd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:28.521161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1977d0c-08d6-44ec-a8fb-9331eaff1fff req-9a14f7aa-e8ca-4df4-add0-ad17b2c924fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:28.521734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1977d0c-08d6-44ec-a8fb-9331eaff1fff req-9a14f7aa-e8ca-4df4-add0-ad17b2c924fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:28.552299 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c1977d0c-08d6-44ec-a8fb-9331eaff1fff req-9a14f7aa-e8ca-4df4-add0-ad17b2c924fd service nova] Creating event network-changed:04613bc1-5986-48d4-9629-aca916266b90 for instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 on n-h1-858129-2 Sep 16 13:55:28.569401 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c1977d0c-08d6-44ec-a8fb-9331eaff1fff req-9a14f7aa-e8ca-4df4-add0-ad17b2c924fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071336 Sep 16 13:55:28.570525 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 360/699] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:28.581925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:28.589780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:28.638837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:28.640972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:28.641984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:28.644790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:28.646183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:28.647704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:28.960127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:28.969553 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2959310-534a-433b-b3d0-77a02769b615 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1271 microversion: 2.1 time: 0.396057 Sep 16 13:55:28.987079 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 361/700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:28 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1271 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:28.993735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:28.994914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:29.001613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:29.002541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:29.003330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:29.004336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:29.005050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:29.005700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:29.090325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:29.123218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-822c1902-d331-4b39-9073-e40c16cd1a34 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1586 microversion: 2.1 time: 1.074696 Sep 16 13:55:29.144031 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 340/701] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:28 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1586 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:29.157302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09fde593-d076-47fc-869f-de78f86f8ebf tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724daa3700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:29.168470 n-d-858129-2 devstack@n-api.service[128642]: WARNING oslo_db.sqlalchemy.utils [None req-09fde593-d076-47fc-869f-de78f86f8ebf tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 13:55:29.189611 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09fde593-d076-47fc-869f-de78f86f8ebf tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.044316 Sep 16 13:55:29.192806 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 341/702] 10.222.0.60 () {60 vars in 1177 bytes} [Fri Sep 16 13:55:29 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:29.206061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:29.214526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:29.241459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:29.243989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:29.245654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:29.248876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:29.249736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:29.250565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:30.195061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:30.199037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:30.214912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:30.253512 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c611fc0f-988e-4fcb-9901-586ae5ef5b84 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1467 microversion: 2.1 time: 1.058741 Sep 16 13:55:30.266632 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 342/703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:29 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1467 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:30.272755 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d2a60c31-6832-4098-b5bf-8068490d2318 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1314 microversion: 2.1 time: 1.283840 Sep 16 13:55:30.285741 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 362/704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:28 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1314 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:30.350599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dacc17c5-04fa-4154-bee2-be57eb9e7acf tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d7119d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:30.375566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:30.376679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:30.413394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:30.417260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:30.418193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:30.420484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:30.420737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:30.421896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:30.442472 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dacc17c5-04fa-4154-bee2-be57eb9e7acf tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-271562145" status: 204 len: 0 microversion: 2.2 time: 0.172254 Sep 16 13:55:30.461824 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 343/705] 10.222.0.60 () {60 vars in 1318 bytes} [Fri Sep 16 13:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-271562145 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:30.476317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d6f7c77e-b07f-41e4-8ea2-9086c8f27ffc req-27567504-526f-4fd4-b4f0-36af81be8585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a", "name": "network-vif-unplugged", "status": "completed", "tag": "f4ae5020-0120-48e6-bc85-a15a538b3f62"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:30.503773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6f7c77e-b07f-41e4-8ea2-9086c8f27ffc req-27567504-526f-4fd4-b4f0-36af81be8585 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:30.504364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6f7c77e-b07f-41e4-8ea2-9086c8f27ffc req-27567504-526f-4fd4-b4f0-36af81be8585 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:30.504879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6f7c77e-b07f-41e4-8ea2-9086c8f27ffc req-27567504-526f-4fd4-b4f0-36af81be8585 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:30.533232 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d6f7c77e-b07f-41e4-8ea2-9086c8f27ffc req-27567504-526f-4fd4-b4f0-36af81be8585 service nova] Creating event network-vif-unplugged:f4ae5020-0120-48e6-bc85-a15a538b3f62 for instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a on n-h2-858129-2 Sep 16 13:55:30.540385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d6f7c77e-b07f-41e4-8ea2-9086c8f27ffc req-27567504-526f-4fd4-b4f0-36af81be8585 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081228 Sep 16 13:55:30.551516 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 344/706] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:30.558341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:30.559954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:30.567351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:30.568120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:30.568725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:30.569652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:30.570876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:30.571468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:30.798823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:30.832056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a9fc212-becc-4866-b0e4-20fbe6419da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1277 microversion: 2.1 time: 0.271098 Sep 16 13:55:30.833680 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 345/707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:30 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:30.856825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6532b0b7-6466-4afb-a638-882c19c88de4 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d6a4820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:30.881300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6532b0b7-6466-4afb-a638-882c19c88de4 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1740648753" status: 204 len: 0 microversion: 2.2 time: 0.045806 Sep 16 13:55:30.883307 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 346/708] 10.222.0.60 () {60 vars in 1321 bytes} [Fri Sep 16 13:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1740648753 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:30.905113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf9daf72-0696-4a4c-afc6-4cbabf818c03 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d6ecaf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:30.951974 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf9daf72-0696-4a4c-afc6-4cbabf818c03 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2048686044" status: 204 len: 0 microversion: 2.2 time: 0.043207 Sep 16 13:55:30.956163 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 347/709] 10.222.0.60 () {60 vars in 1321 bytes} [Fri Sep 16 13:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2048686044 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:30.987430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e2b77e0-23f1-4899-bc03-1431ba6d60c9 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724d75fdc0>, body: {"keypair": {"name": "tempest-keypair-1057056230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJt/KV5EB2/mfUOtzTOcUIklf418Pf4I2gJ8xA1ZM3lj1gVr6lCJ3Hs1Bl07TunnQ1W7+vlPezPngyD2L2qhnW8F2a8m6S/4McnkfUXt5d5PSJQzObQhj9GXBBWtI48xA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:31.071101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5e2b77e0-23f1-4899-bc03-1431ba6d60c9 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:31.085195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5e2b77e0-23f1-4899-bc03-1431ba6d60c9 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:31.157779 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e2b77e0-23f1-4899-bc03-1431ba6d60c9 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.183038 Sep 16 13:55:31.164987 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 348/710] 10.222.0.60 () {62 vars in 1199 bytes} [Fri Sep 16 13:55:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:55:31.188630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d16119f8-e16d-43fa-83bd-0e5d9622cb63 req-5c1d2a6a-40e0-48a4-b62e-7e0aa6c5f2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a", "name": "network-vif-deleted", "tag": "f4ae5020-0120-48e6-bc85-a15a538b3f62"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:31.223926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d16119f8-e16d-43fa-83bd-0e5d9622cb63 req-5c1d2a6a-40e0-48a4-b62e-7e0aa6c5f2e7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:31.231693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d16119f8-e16d-43fa-83bd-0e5d9622cb63 req-5c1d2a6a-40e0-48a4-b62e-7e0aa6c5f2e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:31.235007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d16119f8-e16d-43fa-83bd-0e5d9622cb63 req-5c1d2a6a-40e0-48a4-b62e-7e0aa6c5f2e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:31.236199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:31.250571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:31.256569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:31.258178 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4bd5f306-f143-4be9-8d55-ac4a5c787b7e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.914785 Sep 16 13:55:31.267236 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 363/711] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:30 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:31.272464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23b11bd3-90f7-4b00-942e-77a53b52e75a tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d8dfaf0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.277861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d16119f8-e16d-43fa-83bd-0e5d9622cb63 req-5c1d2a6a-40e0-48a4-b62e-7e0aa6c5f2e7 service nova] Creating event network-vif-deleted:f4ae5020-0120-48e6-bc85-a15a538b3f62 for instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a on n-h2-858129-2 Sep 16 13:55:31.293068 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d16119f8-e16d-43fa-83bd-0e5d9622cb63 req-5c1d2a6a-40e0-48a4-b62e-7e0aa6c5f2e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124848 Sep 16 13:55:31.299468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 349/712] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:31.302883 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23b11bd3-90f7-4b00-942e-77a53b52e75a tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1057056230" status: 200 len: 513 microversion: 2.2 time: 0.034178 Sep 16 13:55:31.311169 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 364/713] 10.222.0.60 () {60 vars in 1258 bytes} [Fri Sep 16 13:55:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1057056230 => generated 513 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:31.316280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.317389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-964875fc-7ea8-4430-a169-26ae273263f4 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d7381f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.318226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:31.332294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:31.333132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:31.334336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:31.336494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:31.337626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:31.338906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:31.341860 n-d-858129-2 devstack@n-api.service[128643]: WARNING oslo_db.sqlalchemy.utils [None req-964875fc-7ea8-4430-a169-26ae273263f4 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 13:55:31.366699 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-964875fc-7ea8-4430-a169-26ae273263f4 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.054241 Sep 16 13:55:31.374069 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 365/714] 10.222.0.60 () {60 vars in 1177 bytes} [Fri Sep 16 13:55:31 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:31.385671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.386625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:31.414149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:31.416079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:31.420510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:31.422354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:31.426737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:31.432910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:31.567580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:31.590873 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cc82028f-62f8-458c-8e9b-ad0bb47e83ae tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 200 len: 1297 microversion: 2.1 time: 0.287510 Sep 16 13:55:31.592706 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 350/715] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:31 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 1297 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:31.603329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1441e280-9edf-4a75-bef2-0a263e938c6d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '.version_select at 0x7f724d8e0670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.611246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1441e280-9edf-4a75-bef2-0a263e938c6d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:31.613701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1441e280-9edf-4a75-bef2-0a263e938c6d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:31.614969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1441e280-9edf-4a75-bef2-0a263e938c6d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:31.646044 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1441e280-9edf-4a75-bef2-0a263e938c6d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1184 microversion: 2.1 time: 0.050396 Sep 16 13:55:31.648735 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 351/716] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 13:55:31 2022] GET /compute/v2.1/os-migrations => generated 1184 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:31.659860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da15d3da-8f99-4a96-a06a-8a2c337d8511 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d7c05e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.712519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da15d3da-8f99-4a96-a06a-8a2c337d8511 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057056230" status: 204 len: 0 microversion: 2.2 time: 0.060670 Sep 16 13:55:31.714095 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 352/717] 10.222.0.60 () {60 vars in 1261 bytes} [Fri Sep 16 13:55:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057056230 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:31.725119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74e5598a-5ef8-49e8-9ab1-406c83802b26 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:31.735851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74e5598a-5ef8-49e8-9ab1-406c83802b26 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018822 Sep 16 13:55:31.736633 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 353/718] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 13:55:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:31.752993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Action: 'create', calling method: .version_select at 0x7f724d6a4af0>, body: {"keypair": {"name": "tempest-keypair-474914354", "type": "x509"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:31.802727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:31.821118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:31.849181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.processutils [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmps2gnfwkb/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps2gnfwkb/temp.key -subj /CN=f94acff09a63440f9ab6f99447280505 -extensions v3_req_client {{(pid=128642) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 16 13:55:31.929069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:31.945879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d685898b-e04d-47df-9f67-25687fa1eb92 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1464 microversion: 2.1 time: 0.569928 Sep 16 13:55:31.947110 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 366/719] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:31 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:31.956519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9ae0e419-48c8-4bf8-8108-0d03db44db23 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-262555684", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:31.998260 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9ae0e419-48c8-4bf8-8108-0d03db44db23 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.048817 Sep 16 13:55:32.000013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 367/720] 10.222.0.60 () {60 vars in 1146 bytes} [Fri Sep 16 13:55:31 2022] POST /compute/v2.1/flavors => generated 498 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:32.011755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.013383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:32.026119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.027195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.028148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.029542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.030596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.031470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.032711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.processutils [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmps2gnfwkb/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps2gnfwkb/temp.key -subj /CN=f94acff09a63440f9ab6f99447280505 -extensions v3_req_client" returned: 0 in 0.183s {{(pid=128642) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 16 13:55:32.035342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.processutils [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmps2gnfwkb/temp.key -password pass: {{(pid=128642) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 16 13:55:32.061054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.processutils [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] CMD "openssl pkcs12 -export -inkey /tmp/tmps2gnfwkb/temp.key -password pass:" returned: 0 in 0.025s {{(pid=128642) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 16 13:55:32.182132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:32.190803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:32.205412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Getting quotas for user f94acff09a63440f9ab6f99447280505 and project 445bbb7498c74e3f8f9ba5f469f0225d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:32.212855 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b100ebe4-3e51-493f-a924-1d4e0ad81e93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1277 microversion: 2.1 time: 0.210410 Sep 16 13:55:32.214950 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 368/721] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:32.246070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a05706c1-d641-4ed7-90de-9215639d1e69 tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.507351 Sep 16 13:55:32.248973 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 354/722] 10.222.0.60 () {62 vars in 1198 bytes} [Fri Sep 16 13:55:31 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 511 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:32.259743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a81bf2c7-8cf6-42b1-a539-d75a85faeb35 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.280247 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a81bf2c7-8cf6-42b1-a539-d75a85faeb35 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028549 Sep 16 13:55:32.282300 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 355/723] 10.222.0.60 () {58 vars in 1182 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:32.291319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25ec0f44-cc10-4d68-83a9-d5fba0354e9d tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d711940>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.308623 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25ec0f44-cc10-4d68-83a9-d5fba0354e9d tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-474914354" status: 200 len: 1533 microversion: 2.2 time: 0.023890 Sep 16 13:55:32.311783 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 356/724] 10.222.0.60 () {60 vars in 1255 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-474914354 => generated 1533 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:32.322666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.324564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:32.358800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.359985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.362392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.365614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.370243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.371266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.674527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.689244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'deleted': False, 'project_id': 'a489175a50564b41989d4465fb325ce0'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:32.708271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.709001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.709697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.711620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.712430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.713010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.824239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:32.869163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:32.875421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:32.878380 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f56f696c-e61c-4d27-b34b-346c3932961f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1567 microversion: 2.25 time: 0.562014 Sep 16 13:55:32.896287 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 357/725] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1567 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:32.926101 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b37d7ab-c868-42d0-8877-135bfeaa3982 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.709613 Sep 16 13:55:32.938558 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 369/726] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:32.938558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.938558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:32.955918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.957113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.957419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2bbfe26c-7bfe-41c1-a07f-ace16d23b5ff tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d732820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:32.957596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.969916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:32.969916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:32.969916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:32.988475 n-d-858129-2 devstack@n-api.service[128642]: WARNING oslo_db.sqlalchemy.utils [None req-2bbfe26c-7bfe-41c1-a07f-ace16d23b5ff tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 13:55:33.000342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] HTTP exception thrown: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a could not be found. Sep 16 13:55:33.003200 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2bbfe26c-7bfe-41c1-a07f-ace16d23b5ff tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.093445 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Request method failure captured: Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a HTTP/1.1 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_4M0ZudxpPKLnkog6V_rtUqy238JHMINdZtmXWgLeYSSDrRKvyiZYvM8UcHSINrcV4I-VTZ-GprSuxnlOcoJQwcbTcu_09lNP9VTU30oxPx4GGRj-46kEk3LYZ1vrUwqsnvetf_Xvf3lfp5Req5-AxdAfWfz3R1Fq5ok4F6VD51IQ Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c425fbef4351482cb4fae31b05007b44 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1772019057 Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:55:33.010486 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c425fbef4351482cb4fae31b05007b44", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c425fbef4351482cb4fae31b05007b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c425fbef4351482cb4fae31b05007b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c425fbef4351482cb4fae31b05007b44"}]}] Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1772019057 Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c425fbef4351482cb4fae31b05007b44 Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1772019057 Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdminNegativeTestJSON-1772019057-project Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 591f03e87a5f45498a2f1025f41123c8 Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1772019057-project Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a could not be found. Sep 16 13:55:33.013134 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a'} Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a could not be found. Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:33.016465 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a could not be found. Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a could not be found. Sep 16 13:55:33.020496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:55:33.023897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Returning 404 to user: Instance 4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:33.023897 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bad6a173-37e7-472b-a513-cf739dc15c98 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a" status: 404 len: 111 microversion: 2.1 time: 0.076362 Sep 16 13:55:33.023897 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 370/727] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/servers/4b5d2be3-3cdd-4d27-b5bd-db3878d68e6a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:55:33.024534 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 358/728] 10.222.0.60 () {60 vars in 1177 bytes} [Fri Sep 16 13:55:32 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:33.033483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:33.048316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'deleted': False} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:33.070637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:33.071401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:33.072723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:33.075500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:33.076106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:33.078703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:33.303682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c620b0ec-b9ce-4875-bbe7-d1cace2f642e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Action: 'create', calling method: .version_select at 0x7f724d78d5e0>, body: {"keypair": {"name": "tempest-keypair-2021153059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNegsA0IILSkgQBzeWr8qev3Jbcm5kcCkukTlObwTHhyqSvPUCBW56aMaMjZTfLbAZNXHPfXiQRTdqabECaWbpvS3FtyT8SjCDX4Crj1h6iTgNDclCidoCM6iRQENDqJpQ=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:33.329111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:55:33.371633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c620b0ec-b9ce-4875-bbe7-d1cace2f642e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Getting quotas for project eb701055c61a4eb29a1d36c197c42b70. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:33.388467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c620b0ec-b9ce-4875-bbe7-d1cace2f642e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Getting quotas for user b476e900905a4f238a64e2ffd34e1159 and project eb701055c61a4eb29a1d36c197c42b70. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:33.484905 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c620b0ec-b9ce-4875-bbe7-d1cace2f642e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.466773 Sep 16 13:55:33.487680 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 371/729] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 13:55:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:33.511985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1694011243", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "123b7628-1548-488b-a042-8ea034288f3f"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:33.655884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:55:33.678237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:33.678808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:33.679877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:34.736399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:55:34.737417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:55:34.737417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:55:34.737824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:55:34.738438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:55:34.750289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:34.751122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:34.751730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:34.752745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:34.753408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:34.754157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:34.781634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:34.790779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for user ae208d89fa7549198ef91ef307464763 and project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:34.809337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:55:34.812129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:55:34.890359 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35097947-ea19-4c52-a2aa-8aeb4579130a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388614 Sep 16 13:55:34.891702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 372/730] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:55:34.897210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:34.898917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:34.907776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:34.909186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:34.910081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:34.911299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:34.912039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:34.913186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:34.961212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:55:35.128678 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cc4d92c6-7125-4365-a94e-6368722f66d6 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17686 microversion: 2.1 time: 2.103157 Sep 16 13:55:35.129462 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 359/731] 10.222.0.60 () {58 vars in 1171 bytes} [Fri Sep 16 13:55:33 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17686 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:55:35.138897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-566ff3d9-6474-4283-95fb-7a8f4d1062fa tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] Calling method '.version_select at 0x7f724d6ec670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:35.225300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-566ff3d9-6474-4283-95fb-7a8f4d1062fa tempest-KeyPairsV22TestJSON-2118017860 tempest-KeyPairsV22TestJSON-2118017860-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474914354" status: 204 len: 0 microversion: 2.2 time: 0.094485 Sep 16 13:55:35.231716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 360/732] 10.222.0.60 () {60 vars in 1258 bytes} [Fri Sep 16 13:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474914354 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:35.245038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:35.250135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:35.323926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:35.327341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:35.329340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:35.330595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:35.349970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:35.352290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:35.397167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1c46007-02ab-4ff1-b75b-3887d3e34dfd tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 204 len: 0 microversion: 2.1 time: 0.503912 Sep 16 13:55:35.401416 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 373/733] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:55:34 2022] DELETE /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:55:35.410729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:35.411605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:35.442695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:35.443240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:35.443701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:35.444563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:35.445197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:35.445743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.192978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:36.218443 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d02c093b-b71b-4f5e-ba76-54eaaf3c8580 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.985057 Sep 16 13:55:36.234058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 361/734] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:35 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:36.236221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:36.236943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:36.245303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.245993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.246476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.247213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.247950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.248618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.345430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:36.395947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:36.403036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:36.414607 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c62257bd-4d1c-401d-8159-67a41aa6a286 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1557 microversion: 2.25 time: 1.010839 Sep 16 13:55:36.421894 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 374/735] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:35 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1557 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:36.439536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:36.468057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'deleted': False, 'project_id': 'a489175a50564b41989d4465fb325ce0'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:36.479084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.480466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.481909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.483977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.485712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.486812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.568836 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-07dde122-ee4b-4c29-a241-d8e1fd5116a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?tenant_id=0be8e21f9d2d436285f91238eb580125" status: 200 len: 15 microversion: 2.1 time: 0.142924 Sep 16 13:55:36.583716 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 375/736] 10.222.0.60 () {58 vars in 1231 bytes} [Fri Sep 16 13:55:36 2022] GET /compute/v2.1/servers/detail?tenant_id=0be8e21f9d2d436285f91238eb580125 => generated 15 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:36.594777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:36.594777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:36.606663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.609170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.609621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.610385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.610908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.611335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.747529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:36.753413 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-389c5193-46b2-48aa-b510-672fcee80fa5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1283 microversion: 2.1 time: 0.533229 Sep 16 13:55:36.769424 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 362/737] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:36 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1283 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:36.775161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-40454e0a-dce9-4391-bb12-372346daa5c1 req-f7ee3649-ca63-4187-ab8c-f3a1d2576b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956d23ad-d927-4fbe-ba93-40e436b3284c", "tag": "781106b3-9349-4ccb-9d64-9bae8c575ddc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:36.808527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-40454e0a-dce9-4391-bb12-372346daa5c1 req-f7ee3649-ca63-4187-ab8c-f3a1d2576b3e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.810559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-40454e0a-dce9-4391-bb12-372346daa5c1 req-f7ee3649-ca63-4187-ab8c-f3a1d2576b3e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.811786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-40454e0a-dce9-4391-bb12-372346daa5c1 req-f7ee3649-ca63-4187-ab8c-f3a1d2576b3e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.866682 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-40454e0a-dce9-4391-bb12-372346daa5c1 req-f7ee3649-ca63-4187-ab8c-f3a1d2576b3e service nova] Creating event network-changed:781106b3-9349-4ccb-9d64-9bae8c575ddc for instance 956d23ad-d927-4fbe-ba93-40e436b3284c on n-h1-858129-2 Sep 16 13:55:36.884671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-40454e0a-dce9-4391-bb12-372346daa5c1 req-f7ee3649-ca63-4187-ab8c-f3a1d2576b3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113810 Sep 16 13:55:36.889344 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 363/738] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:36.902213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7a37276-3ff7-43f7-82c2-f6af40f8dcce tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '.version_select at 0x7f724d8cca60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:36.928526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a37276-3ff7-43f7-82c2-f6af40f8dcce tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.930834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a37276-3ff7-43f7-82c2-f6af40f8dcce tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.931828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a37276-3ff7-43f7-82c2-f6af40f8dcce tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.943261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7a37276-3ff7-43f7-82c2-f6af40f8dcce tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.052153 Sep 16 13:55:36.944571 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 364/739] 10.222.0.60 () {60 vars in 1184 bytes} [Fri Sep 16 13:55:36 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:36.949817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:36.956579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'tenant_id': '0be8e21f9d2d436285f91238eb580125', 'deleted': False} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:36.973907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.974670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.977807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:36.979080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:36.979723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:36.980618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:37.139180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:55:37.203873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:37.234009 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b2a614d0-8104-459b-a981-31217ea68a6b tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1478 microversion: 2.1 time: 0.650411 Sep 16 13:55:37.262627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 376/740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:36 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1478 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:37.274703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:37.277573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:37.286126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:37.287266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:37.309146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:37.314090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:37.315150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:37.315995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:37.396548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:37.398901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:37.400618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:38.247046 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c7a9a8e-873d-4615-ba77-f67ca81ec2de tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0be8e21f9d2d436285f91238eb580125" status: 200 len: 4825 microversion: 2.1 time: 1.300683 Sep 16 13:55:38.253184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 365/741] 10.222.0.60 () {58 vars in 1257 bytes} [Fri Sep 16 13:55:36 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0be8e21f9d2d436285f91238eb580125 => generated 4825 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:38.286304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:38.289777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:38.305389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:38.334301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:38.335702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:38.336728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:38.352177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:38.353348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:38.354099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:38.359099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid b983bc33-1516-4759-a425-b6aea92b77d1 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:55:38.495479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d01f582-a9a3-415a-a97f-f47cfa229a72 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 2050 microversion: 2.25 time: 1.230276 Sep 16 13:55:38.496688 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 377/742] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:37 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 2050 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:38.504520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:38.505178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:38.512787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:38.513597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:38.514431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:38.515382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:38.516053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:38.516705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:39.052415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:39.078945 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed730d91-e612-43cf-b15c-ba6ce5770ab1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1331 microversion: 2.1 time: 0.580586 Sep 16 13:55:39.088528 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 378/743] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:38 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1331 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:39.106795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1a7c4efb-ec65-4c78-9c96-4313a0c9e3cb req-c6c06725-53b5-461a-823c-79546f9c2af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d86e2c-0f16-4456-95aa-b7157dd71e84", "tag": "5a5c4d29-5f39-418a-8e4c-c849bfda0612"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:39.164225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1a7c4efb-ec65-4c78-9c96-4313a0c9e3cb req-c6c06725-53b5-461a-823c-79546f9c2af1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:39.164954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1a7c4efb-ec65-4c78-9c96-4313a0c9e3cb req-c6c06725-53b5-461a-823c-79546f9c2af1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:39.167957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1a7c4efb-ec65-4c78-9c96-4313a0c9e3cb req-c6c06725-53b5-461a-823c-79546f9c2af1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:39.227866 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1a7c4efb-ec65-4c78-9c96-4313a0c9e3cb req-c6c06725-53b5-461a-823c-79546f9c2af1 service nova] Creating event network-changed:5a5c4d29-5f39-418a-8e4c-c849bfda0612 for instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 on n-h1-858129-2 Sep 16 13:55:39.260347 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1a7c4efb-ec65-4c78-9c96-4313a0c9e3cb req-c6c06725-53b5-461a-823c-79546f9c2af1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164885 Sep 16 13:55:39.268008 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 379/744] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:39.306477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:39.309066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:39.355000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:39.357382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:39.358187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:39.364096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:39.365096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:39.376620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:39.378003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:39.405461 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97b31058-db5c-4c61-9477-84ecd8720554 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 1.148443 Sep 16 13:55:39.427155 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 366/745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:38 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:39.436794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:39.448123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'tenant_id': 'a489175a50564b41989d4465fb325ce0', 'deleted': False} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:39.456645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:39.457374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:39.458036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:39.459218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:39.459946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:39.461326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:39.510231 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e8074d7-153a-47f0-81c5-d07c7455b73e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a489175a50564b41989d4465fb325ce0" status: 200 len: 15 microversion: 2.1 time: 0.080241 Sep 16 13:55:39.512517 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 367/746] 10.222.0.60 () {58 vars in 1257 bytes} [Fri Sep 16 13:55:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a489175a50564b41989d4465fb325ce0 => generated 15 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:39.533402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591f03e87a5f45498a2f1025f41123c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c425fbef4351482cb4fae31b05007b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:39.554825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1422421630", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "72957846-66c4-4f63-b24e-6ce8e865631e"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:39.555993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1dd787ae-bd31-4685-863d-44b247de2ffb tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 200 len: 1436 microversion: 2.1 time: 0.276653 Sep 16 13:55:39.556596 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 380/747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:39 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 1436 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:39.606909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2140293203", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f5ded7ba-8171-497d-ae0f-60a8d6711993"}], "security_groups": [{"name": "tempest-securitygroup--1069125917"}], "key_name": "tempest-keypair-2021153059", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:39.759890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] validate_networks() for [('72957846-66c4-4f63-b24e-6ce8e865631e', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:55:40.097328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] validate_networks() for [('f5ded7ba-8171-497d-ae0f-60a8d6711993', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:55:41.161739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:55:41.162560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:55:41.162976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:55:41.163602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:55:41.164127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:55:41.174625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.175119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.175562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.176338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.176794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.177222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.200447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:41.208038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for user 916231d4d6114380b4e48d428d6dd843 and project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:41.235747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:55:41.240983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:55:41.376965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-acdb40d3-3a3f-4115-bbca-86fa697d3d09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.856015 Sep 16 13:55:41.378518 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 368/748] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 13:55:41.411356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2955f8c-5b3f-4e52-b5c0-563a7af33d0e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:41.434077 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f2955f8c-5b3f-4e52-b5c0-563a7af33d0e tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.038073 Sep 16 13:55:41.436544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 369/749] 10.222.0.60 () {58 vars in 1189 bytes} [Fri Sep 16 13:55:41 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:41.470354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8b0879ee-a3da-4d5c-834b-7e239b362eb7 req-af972792-1cf1-437f-b09a-d4f363f6270b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc", "name": "network-vif-deleted", "tag": "12597ee0-4d47-47b7-b883-373c3d2c3e30"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:41.506168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:55:41.507056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:55:41.507765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:55:41.508446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:55:41.508900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:55:41.534298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b0879ee-a3da-4d5c-834b-7e239b362eb7 req-af972792-1cf1-437f-b09a-d4f363f6270b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.535762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.536276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b0879ee-a3da-4d5c-834b-7e239b362eb7 req-af972792-1cf1-437f-b09a-d4f363f6270b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.538191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b0879ee-a3da-4d5c-834b-7e239b362eb7 req-af972792-1cf1-437f-b09a-d4f363f6270b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.539886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.541067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.544231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.547829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.548547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.583851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8b0879ee-a3da-4d5c-834b-7e239b362eb7 req-af972792-1cf1-437f-b09a-d4f363f6270b service nova] Creating event network-vif-deleted:12597ee0-4d47-47b7-b883-373c3d2c3e30 for instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc on n-h2-858129-2 Sep 16 13:55:41.603835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8b0879ee-a3da-4d5c-834b-7e239b362eb7 req-af972792-1cf1-437f-b09a-d4f363f6270b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165269 Sep 16 13:55:41.606445 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 370/750] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:41.611511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Getting quotas for project eb701055c61a4eb29a1d36c197c42b70. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:55:41.615809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:41.617940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:41.626269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Getting quotas for user b476e900905a4f238a64e2ffd34e1159 and project eb701055c61a4eb29a1d36c197c42b70. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:55:41.632194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:41.632676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.634030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.635154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.637406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:41.639639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:41.640964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:41.661568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:55:41.665908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:55:41.802133 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d4e4b4ff-9647-4e01-9d4d-9eb03df9344c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.243763 Sep 16 13:55:41.818115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 381/751] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:55:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:55:42.175908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Calling method '.version_select at 0x7f724d9751f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:42.210922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:42.213675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:42.214296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:42.218369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:42.221201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:42.222052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:42.301748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69598201-2f7a-453d-86ea-8b6dd02d2a05 tempest-AbsoluteLimitsTestJSON-968182050 tempest-AbsoluteLimitsTestJSON-968182050-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.492534 Sep 16 13:55:42.320384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 382/752] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 16 13:55:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:42.329980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:42.331781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:42.342261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:42.343304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:42.344069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:42.344977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:42.345645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:42.346860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.011973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.025607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf3d27f2-b96d-4633-887f-986687c03f70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 1.416601 Sep 16 13:55:43.031906 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 371/753] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:41 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:43.037372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:43.042245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] [instance: f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:43.053454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.054189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.055205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.056423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.057374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.058034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.079120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] HTTP exception thrown: Instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc could not be found. Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Request method failure captured: Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc HTTP/1.1 Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_4M0ZudxpPKLnkog6V_rtUqy238JHMINdZtmXWgLeYSSDrRKvyiZYvM8UcHSINrcV4I-VTZ-GprSuxnlOcoJQwcbTcu_09lNP9VTU30oxPx4GGRj-46kEk3LYZ1vrUwqsnvetf_Xvf3lfp5Req5-AxdAfWfz3R1Fq5ok4F6VD51IQ Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c425fbef4351482cb4fae31b05007b44 Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1772019057 Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:55:43.083121 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c425fbef4351482cb4fae31b05007b44", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c425fbef4351482cb4fae31b05007b44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c425fbef4351482cb4fae31b05007b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c425fbef4351482cb4fae31b05007b44"}]}] Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1772019057 Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c425fbef4351482cb4fae31b05007b44 Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1772019057 Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminNegativeTestJSON-1772019057-project Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 591f03e87a5f45498a2f1025f41123c8 Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1772019057-project Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc could not be found. Sep 16 13:55:43.086317 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc'} Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc could not be found. Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:55:43.088287 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc could not be found. Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc could not be found. Sep 16 13:55:43.092207 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:55:43.106586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] Returning 404 to user: Instance f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:55:43.106586 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b2a46f0-5f81-4092-93f7-dfeaec1874a0 tempest-ServersAdminNegativeTestJSON-1772019057 tempest-ServersAdminNegativeTestJSON-1772019057-project] 10.222.0.60 "GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc" status: 404 len: 111 microversion: 2.1 time: 0.062108 Sep 16 13:55:43.108155 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 372/754] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:43 2022] GET /compute/v2.1/servers/f7f6f9f2-3e7c-4adc-b3dd-ae2b18b1adfc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:55:43.119866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:43.121766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:43.135365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.137290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.137955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.139097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.139998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.140636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.293883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.297248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:43.298994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.317387 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8f9a4bd-f767-46c7-b4a7-a034ca1ab576 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.995788 Sep 16 13:55:43.319180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.321160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.322881 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e587593d-3f3f-4114-8323-26705bee1604 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1314 microversion: 2.25 time: 0.212788 Sep 16 13:55:43.323467 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 373/755] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:43 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:43.329038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:43.331029 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 383/756] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:42 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:43.335053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:43.353400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.354064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.354742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.355585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.356168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.356609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.369815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:43.375598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:43.389180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.391434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.391947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.392715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.397315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.398825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.472350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ab07f64-2a3a-47b2-84c4-534edb4bd2a3 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 0 microversion: 2.1 time: 0.147522 Sep 16 13:55:43.473355 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 374/757] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:43 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:55:43.487608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:43.494540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.495716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '0be8e21f9d2d436285f91238eb580125'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:43.503066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.503996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.504628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.505614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.506274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.506985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.522242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:43.530543 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb2c4792-6b61-4bd5-b545-f81ed6b40bc7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1238 microversion: 2.1 time: 0.191112 Sep 16 13:55:43.542933 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 384/758] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:43 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1238 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:43.601596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:55:43.748995 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-047cd8f8-d3cd-4adf-b98d-5a50dc95b937 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.269778 Sep 16 13:55:43.750653 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 375/759] 10.222.0.60 () {58 vars in 1150 bytes} [Fri Sep 16 13:55:43 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:43.769230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:43.780449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:43.799907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.801398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.802160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.803182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:43.803853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:43.805004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:43.864155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:43.953123 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fcde23b0-5fe8-47dc-9aaf-2c41ae4ca59b tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 0 microversion: 2.1 time: 0.189890 Sep 16 13:55:43.959923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 385/760] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:43 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:55:43.968628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:43.985852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:44.005383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.007041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.009171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.010863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.012039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.014210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.069217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:44.070448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:44.084978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.086141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.086662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.087404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.088217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.088657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.472409 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86e6a719-3e8e-4339-b0dd-26a6010879bb tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1614 microversion: 2.1 time: 0.510568 Sep 16 13:55:44.474036 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 376/761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:43 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1614 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:44.489990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6dab642d-fef6-4215-93ce-5c72d2940202 req-1aa6d112-012e-4498-990c-be8124430ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a526b21-b479-4b47-a733-3a9757f8c368", "tag": "76355775-4b09-4831-b8c9-526859e22a89"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:44.513527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6dab642d-fef6-4215-93ce-5c72d2940202 req-1aa6d112-012e-4498-990c-be8124430ed4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.514766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6dab642d-fef6-4215-93ce-5c72d2940202 req-1aa6d112-012e-4498-990c-be8124430ed4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.515469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6dab642d-fef6-4215-93ce-5c72d2940202 req-1aa6d112-012e-4498-990c-be8124430ed4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.538102 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6dab642d-fef6-4215-93ce-5c72d2940202 req-1aa6d112-012e-4498-990c-be8124430ed4 service nova] Creating event network-changed:76355775-4b09-4831-b8c9-526859e22a89 for instance 0a526b21-b479-4b47-a733-3a9757f8c368 on n-h2-858129-2 Sep 16 13:55:44.545946 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6dab642d-fef6-4215-93ce-5c72d2940202 req-1aa6d112-012e-4498-990c-be8124430ed4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063974 Sep 16 13:55:44.550968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 377/762] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:44.556440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:44.562083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:44.563353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:44.571509 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-381c699f-6358-4319-b383-4d57922393f4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.506904 Sep 16 13:55:44.575122 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 386/763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:44 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:55:44.575408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.576627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.577397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.578741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.579538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.580877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.586796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:44.587783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:44.595711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.597033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.597544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.598571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.599113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.599610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.893034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:44.910029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:44.914622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:44.917638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a8eb739d-4d1c-4fbe-bd6b-66e68f92cab8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1314 microversion: 2.25 time: 0.340121 Sep 16 13:55:44.921113 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 387/764] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:44 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:44.933809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:44.936660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:44.952292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.952801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.953241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:44.953962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:44.954438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:44.959582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.182381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:45.192019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d0a844d-d804-46b0-ac02-3c02731018c4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.639302 Sep 16 13:55:45.192655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 378/765] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:44 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:45.198213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:45.199123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:45.215559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.216393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.217075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.218082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.218581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.219105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.301320 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3c64c5e-2bf1-4245-825a-6077a17b46a9 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1614 microversion: 2.1 time: 0.378655 Sep 16 13:55:45.301916 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 388/766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:44 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1614 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:45.332350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:45.344850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'host': 'n-h2-858129-2', 'deleted': False} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:45.350992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.353238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.353897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.355101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.355795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.356563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.377258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:45.393972 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-219a47bd-a298-4934-b963-47d0996ad2f8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1238 microversion: 2.1 time: 0.199759 Sep 16 13:55:45.400306 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 379/767] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:45 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1238 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:45.504947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:55:45.582570 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd91438c-9308-49fb-a7e0-9de891abc496 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=n-h2-858129-2&all_tenants=1" status: 200 len: 1654 microversion: 2.1 time: 0.259255 Sep 16 13:55:45.583597 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 389/768] 10.222.0.60 () {58 vars in 1190 bytes} [Fri Sep 16 13:55:45 2022] GET /compute/v2.1/servers?host=n-h2-858129-2&all_tenants=1 => generated 1654 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:45.597676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:45.607629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:45.613979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.614730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.615483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.616636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.617416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.618113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.620349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:45.620999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:45.640319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.644220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.647069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.651136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.654703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.655307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.716896 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4014b097-ae38-43fb-9bde-4d9db3234d17 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.123575 Sep 16 13:55:45.725809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 380/769] 10.222.0.60 () {58 vars in 1196 bytes} [Fri Sep 16 13:55:45 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:55:45.733427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:45.736154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:45.744183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.745066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.745863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.746980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.747905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.748492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.887726 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52559f61-7b57-4306-94ae-cbaebf3bd9af tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 0 microversion: 2.1 time: 0.158753 Sep 16 13:55:45.889099 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 381/770] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:45 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:55:45.902745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:45.907622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:45.916770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.917368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.918370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:45.919258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:45.919796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:45.920334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.027194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:46.053086 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b36d5027-e6a7-4f8a-9e68-dc6c7d19e26a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.434951 Sep 16 13:55:46.055024 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 390/771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:45 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:46.058547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:55:46.058547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:55:46.058547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:55:46.058547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:55:46.058547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:55:46.064124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:46.066242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:46.073735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.074638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.075419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.076458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.077837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.078562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.200910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:46.201491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:46.209259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.209627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.210136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.211605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.212140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.212609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.227735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:46.230615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:46.232730 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ee34616-7a42-4df3-b49b-a42251144155 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1314 microversion: 2.25 time: 0.172801 Sep 16 13:55:46.234817 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 391/772] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:46 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:46.259198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:46.262601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:46.272448 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb4d7cda-1819-4100-b0e3-506da98ea6de tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 1067 microversion: 2.1 time: 0.376344 Sep 16 13:55:46.286666 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 382/773] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:55:45 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 1067 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 16 13:55:46.300078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.301258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.302274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:46.302942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.303115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:46.304979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.307126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.312885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.319775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.321547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.322043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.322837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.324246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.324669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.899551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:46.901200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:46.929018 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d712b6eb-6174-4b6c-ad57-12f12178afb3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.692216 Sep 16 13:55:46.930976 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 392/774] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:46 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:46.935438 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05d9ad54-bcc1-478f-b605-505e6d5faf7a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.638930 Sep 16 13:55:46.943290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:46.945947 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 383/775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:46 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:46.959122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:46.972108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.973231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.974491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:46.975952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:46.977553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:46.978510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:47.092299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:47.093460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:47.124049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:47.125240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:47.126105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:47.128742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:47.133459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:47.135047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:47.312694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:47.341916 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce088ac6-b635-4088-874b-da04928651ef tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1294 microversion: 2.1 time: 0.408085 Sep 16 13:55:47.355214 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 393/776] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:46 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1294 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:47.366613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:47.367448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:47.380688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:47.381551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:47.383473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:47.384666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:47.385415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:47.387058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:47.509281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:47.541609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:47.544773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:47.548847 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4daf782-24ad-49b3-9e41-13e9603fac14 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1320 microversion: 2.25 time: 0.191074 Sep 16 13:55:47.590314 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 394/777] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:47 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:47.911848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-fea3c1a1-acc7-417c-8ccd-d546bac04572 req-acede18f-9263-45fd-ad65-1504ae29abfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956d23ad-d927-4fbe-ba93-40e436b3284c", "name": "network-vif-plugged", "status": "completed", "tag": "781106b3-9349-4ccb-9d64-9bae8c575ddc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:47.951196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fea3c1a1-acc7-417c-8ccd-d546bac04572 req-acede18f-9263-45fd-ad65-1504ae29abfd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:47.952537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fea3c1a1-acc7-417c-8ccd-d546bac04572 req-acede18f-9263-45fd-ad65-1504ae29abfd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:47.953684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fea3c1a1-acc7-417c-8ccd-d546bac04572 req-acede18f-9263-45fd-ad65-1504ae29abfd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:47.986793 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-fea3c1a1-acc7-417c-8ccd-d546bac04572 req-acede18f-9263-45fd-ad65-1504ae29abfd service nova] Creating event network-vif-plugged:781106b3-9349-4ccb-9d64-9bae8c575ddc for instance 956d23ad-d927-4fbe-ba93-40e436b3284c on n-h1-858129-2 Sep 16 13:55:48.000509 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-fea3c1a1-acc7-417c-8ccd-d546bac04572 req-acede18f-9263-45fd-ad65-1504ae29abfd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095532 Sep 16 13:55:48.002081 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 395/778] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:48.003637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:48.010998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:48.012303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:48.014307 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1df23309-e226-4c56-bc44-07a8d3c78dfb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.930955 Sep 16 13:55:48.017779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 384/779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:47 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:48.034107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.035411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:48.036273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:48.037860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.039166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.040090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.040734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.041871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.049316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.050168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.050891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.051886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.052636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.054331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.538481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:48.555466 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0874e899-3b27-44c4-8c54-09c73fd95d00 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.549999 Sep 16 13:55:48.558033 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 396/780] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:48 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:48.563789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:48.564700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:48.572790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.574391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.575078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.576025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.580649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.584263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.725727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:48.753075 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9fbcb0a7-d080-4769-ae72-3211eefb0329 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.732623 Sep 16 13:55:48.756068 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 385/781] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:48 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:48.794735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:48.815274 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3196f56e-039e-42b6-ab36-c0e1768f84b5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1300 microversion: 2.1 time: 0.255365 Sep 16 13:55:48.825504 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 397/782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:48 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1300 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:48.851656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:48.855136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:48.870972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.872215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.874070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:48.875784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:48.876927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:48.877957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.144947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.151383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.152085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.152570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.159641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.160412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.160943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.205024 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13fbe180-0044-49f8-bcad-d48708f3366b tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.435886 Sep 16 13:55:49.207115 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 386/783] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 13:55:48 2022] GET /compute/v2.1/os-services => generated 944 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:49.228144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.229034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:49.244455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.247036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.251552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.254883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.258139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.260399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.273373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:49.274082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:49.288046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:49.294558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:49.297563 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7565fc1c-09be-4dab-96fb-1d350b800f6b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.468813 Sep 16 13:55:49.303219 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 398/784] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:48 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:49.340442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.369827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.375780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.377905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.379886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.386027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.389636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.429630 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41ad32e3-4cd9-4bb0-a8c4-5a2c82368dd9 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-858129-2" status: 200 len: 578 microversion: 2.1 time: 0.122781 Sep 16 13:55:49.431083 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 399/785] 10.222.0.60 () {58 vars in 1172 bytes} [Fri Sep 16 13:55:49 2022] GET /compute/v2.1/os-services?host=n-d-858129-2 => generated 578 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:49.458113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.463306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.463911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.464476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.465396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.466470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.467038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.501256 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15f3530b-d2dd-4832-ac88-914f78d0c228 tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047778 Sep 16 13:55:49.502645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 400/786] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 13:55:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:55:49.537102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.546638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.547589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.548912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.551107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.551553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.552451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.617748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2f40561f-51c2-4be4-b493-7695e75890bc tempest-ServicesAdminTestJSON-856132120 tempest-ServicesAdminTestJSON-856132120-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.092694 Sep 16 13:55:49.622657 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 401/787] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 13:55:49 2022] GET /compute/v2.1/os-services => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:55:49.641983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.642599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:49.661496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.662374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.664570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.667286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.668139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.668927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.672703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:49.689416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a518e273-7eab-43f8-89db-be8ad307761d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.479664 Sep 16 13:55:49.707836 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 387/788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:49 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:49.806775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:49.808586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:49.833985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.836067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.837609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:49.839332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:49.840549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:49.841556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:50.923307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:50.944859 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-718b8a2e-4778-4b0d-b0bd-6b23c368a4c5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 1.320513 Sep 16 13:55:50.945748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 402/789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:49 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:50.950913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:50.951771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:50.964711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:50.965593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:50.966209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:50.967183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:50.970976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:50.971719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:51.014944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:51.026627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:51.027742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-243cb054-1168-4775-898a-f8e3274325a5 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 1.235754 Sep 16 13:55:51.028557 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 388/790] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:49 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:51.034045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:51.039073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:51.056994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:51.058029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:51.058628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:51.059493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:51.060084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:51.070870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:51.146623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:51.161969 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3c0faa01-a70b-4708-b259-d7a174b6ea2f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1300 microversion: 2.1 time: 0.214847 Sep 16 13:55:51.162708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 403/791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:50 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:51.180723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:51.181457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:51.193799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:51.194303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:51.195382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:51.196122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:51.196590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:51.197021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:51.221290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=60 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:51.434902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:51.455084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:51.457162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:51.458700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b013ca44-903e-4479-af85-1eddc3f91897 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.428865 Sep 16 13:55:51.459880 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 389/792] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:51 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:51.607818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:51.620965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-92a70cc2-eccc-4417-aa6a-6b2f969bb6ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.457079 Sep 16 13:55:51.621583 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 404/793] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:51 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:51.987996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:51.988864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:52.000169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.000673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.001168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.002103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.002604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.003034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.065929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:52.067040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:52.075745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.077098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.077769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.079379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.080309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.080912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.204439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=40 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:52.483938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:52.494718 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75ba5ab3-affb-41b5-8b48-dc6c728f31d7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.438915 Sep 16 13:55:52.516364 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 405/794] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:52 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:55:52.526059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:52.527128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:52.535300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.536249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.537096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.538111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.539395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.540655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.575102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:52.598834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d45597f-6539-4ea8-a22d-ce3d8a734d60 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.615097 Sep 16 13:55:52.601672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 390/795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:51 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:52.613748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:52.615949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:52.628499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.629722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.630507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.631797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:52.634203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:52.635273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:52.995742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:53.018372 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4332113-7bdb-4d47-a7e2-c9b2b532cdbf tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.507662 Sep 16 13:55:53.019441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 406/796] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:52 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:53.030256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:53.031405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:53.044265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.045885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.046747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:53.048041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.049288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.050155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:53.096322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:53.115731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:53.120090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:53.121923 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5d3b01e-aca2-4884-9f83-2ab3cd57f880 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.518191 Sep 16 13:55:53.142273 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 391/797] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:52 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:53.340043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:53.368149 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-22bf1c12-9392-4d18-9643-decf20f48eda tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.345721 Sep 16 13:55:53.372674 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 407/798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:53 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:53.477878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fa58acf7-8160-4276-bcaa-63a09a33b096 req-34d4a4cb-6bbf-4235-b340-57ff168247d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d86e2c-0f16-4456-95aa-b7157dd71e84", "name": "network-vif-plugged", "status": "completed", "tag": "5a5c4d29-5f39-418a-8e4c-c849bfda0612"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:53.497007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa58acf7-8160-4276-bcaa-63a09a33b096 req-34d4a4cb-6bbf-4235-b340-57ff168247d5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.498896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa58acf7-8160-4276-bcaa-63a09a33b096 req-34d4a4cb-6bbf-4235-b340-57ff168247d5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.499432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa58acf7-8160-4276-bcaa-63a09a33b096 req-34d4a4cb-6bbf-4235-b340-57ff168247d5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:53.520154 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fa58acf7-8160-4276-bcaa-63a09a33b096 req-34d4a4cb-6bbf-4235-b340-57ff168247d5 service nova] Creating event network-vif-plugged:5a5c4d29-5f39-418a-8e4c-c849bfda0612 for instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 on n-h1-858129-2 Sep 16 13:55:53.527108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:53.527741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fa58acf7-8160-4276-bcaa-63a09a33b096 req-34d4a4cb-6bbf-4235-b340-57ff168247d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055708 Sep 16 13:55:53.528821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 392/799] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:53.529582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:53.550342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.552106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.553310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:53.558821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.559432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.559890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:53.627779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:53.628623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:53.644211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.647028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.650576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:53.653626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:53.658530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:53.660623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.048373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.081965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0731e058-3c1a-4b4c-9f4d-a4d484f4836f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.562254 Sep 16 13:55:54.083019 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 408/800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:53 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:54.088564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.088815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-203ee9c7-874b-4019-b511-abee5e69ffa7 req-2b8e6467-1989-4c99-9bee-d882b71f7579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d670bb-8f4c-42da-9277-256a3d31ecca", "tag": "2a647267-4c40-4719-85cd-866bc9adb22d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:54.099443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-203ee9c7-874b-4019-b511-abee5e69ffa7 req-2b8e6467-1989-4c99-9bee-d882b71f7579 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.100307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-203ee9c7-874b-4019-b511-abee5e69ffa7 req-2b8e6467-1989-4c99-9bee-d882b71f7579 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.101488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-203ee9c7-874b-4019-b511-abee5e69ffa7 req-2b8e6467-1989-4c99-9bee-d882b71f7579 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.114064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e464a00-8dac-438d-84b2-29e3c82c4598 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.491510 Sep 16 13:55:54.115821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 393/801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:53 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:54.121757 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-203ee9c7-874b-4019-b511-abee5e69ffa7 req-2b8e6467-1989-4c99-9bee-d882b71f7579 service nova] Creating event network-changed:2a647267-4c40-4719-85cd-866bc9adb22d for instance a0d670bb-8f4c-42da-9277-256a3d31ecca on n-h1-858129-2 Sep 16 13:55:54.131594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:54.133066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:54.133220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-203ee9c7-874b-4019-b511-abee5e69ffa7 req-2b8e6467-1989-4c99-9bee-d882b71f7579 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048671 Sep 16 13:55:54.134141 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 409/802] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:54.141041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.143004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.143004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.144685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.145497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.146529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.149395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:54.150117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:54.168507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.169429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.170329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.172173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.174515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.175204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.508731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.527844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.532339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.535092 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80eaceb1-571e-43c0-8130-8dbd82daa919 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.390547 Sep 16 13:55:54.542272 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 410/803] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:54 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:54.549392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:54.550243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:54.552464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.558984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.559775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.560419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.562774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:54.563691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:54.564324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:54.579851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3859f94e-b8e3-4cd2-961d-a7d0e2fec2d8 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.459886 Sep 16 13:55:54.580756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 394/804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:54 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:54.837486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:54.853527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4833244c-5b17-44eb-b3ab-664eac6fe745 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.309207 Sep 16 13:55:54.886695 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 411/805] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:54 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:55.110387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:55.112909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:55.135130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.135928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.136570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.140141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.140863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.141463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.144282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:55.148353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:55.173817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.176312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.180777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.188601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.189921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.191108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.487122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:55.502883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-10fa4b4f-4f88-4a38-8e3d-2998fa3b8df2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.401550 Sep 16 13:55:55.528031 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 395/806] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:55 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:55.572162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:55.577254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:55.577884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:55.593454 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32328039-6129-412a-9288-a7b6607f2e64 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1319 microversion: 2.1 time: 0.457159 Sep 16 13:55:55.613035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 412/807] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:55 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:55.615559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.615923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.620943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.622435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.624404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.625454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.633251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5e00cc3a-3783-4598-83b3-78c627214b30 req-c1254a0a-863f-4190-b1b7-55e442094192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a526b21-b479-4b47-a733-3a9757f8c368", "name": "network-vif-plugged", "status": "completed", "tag": "76355775-4b09-4831-b8c9-526859e22a89"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:55.651317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5e00cc3a-3783-4598-83b3-78c627214b30 req-c1254a0a-863f-4190-b1b7-55e442094192 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.654090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5e00cc3a-3783-4598-83b3-78c627214b30 req-c1254a0a-863f-4190-b1b7-55e442094192 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.658994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5e00cc3a-3783-4598-83b3-78c627214b30 req-c1254a0a-863f-4190-b1b7-55e442094192 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.691655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5e00cc3a-3783-4598-83b3-78c627214b30 req-c1254a0a-863f-4190-b1b7-55e442094192 service nova] Creating event network-vif-plugged:76355775-4b09-4831-b8c9-526859e22a89 for instance 0a526b21-b479-4b47-a733-3a9757f8c368 on n-h2-858129-2 Sep 16 13:55:55.705321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5e00cc3a-3783-4598-83b3-78c627214b30 req-c1254a0a-863f-4190-b1b7-55e442094192 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089922 Sep 16 13:55:55.707228 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 413/808] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:55.718256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:55.719321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:55.730183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.730994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.731760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:55.732695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:55.733334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:55.733916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.128902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:56.149988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:56.167058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:56.177501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:56.184564 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb6cf6bb-6c2e-422c-9dec-072bbf9c5d2d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.614743 Sep 16 13:55:56.195515 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ceb5fea2-4892-4129-930b-67957ae852a5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.485173 Sep 16 13:55:56.197384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 414/809] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:55 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:56.200725 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 396/810] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:55 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:56.216899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-403a14b0-e24c-4eb5-ad90-b397ffc3dcc9 req-c6246418-47bc-4bf1-b5f1-3b11e15d61d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98", "tag": "e79f32ee-c133-461d-98f9-33ec125ea86c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:55:56.220381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:56.221761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:56.235597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-403a14b0-e24c-4eb5-ad90-b397ffc3dcc9 req-c6246418-47bc-4bf1-b5f1-3b11e15d61d8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.236624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.237299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-403a14b0-e24c-4eb5-ad90-b397ffc3dcc9 req-c6246418-47bc-4bf1-b5f1-3b11e15d61d8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.237532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.238213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-403a14b0-e24c-4eb5-ad90-b397ffc3dcc9 req-c6246418-47bc-4bf1-b5f1-3b11e15d61d8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.238605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.239940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.240795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.242125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.266733 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-403a14b0-e24c-4eb5-ad90-b397ffc3dcc9 req-c6246418-47bc-4bf1-b5f1-3b11e15d61d8 service nova] Creating event network-changed:e79f32ee-c133-461d-98f9-33ec125ea86c for instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 on n-h1-858129-2 Sep 16 13:55:56.280955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-403a14b0-e24c-4eb5-ad90-b397ffc3dcc9 req-c6246418-47bc-4bf1-b5f1-3b11e15d61d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078415 Sep 16 13:55:56.283097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 397/811] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:55:56.495883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:56.505396 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0eaec46a-0e76-45cf-9cd6-9bac14b29978 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.299449 Sep 16 13:55:56.524883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 415/812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:56 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:56.535400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:56.536698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:56.546184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.547249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.547917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.548913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.549466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.549980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.626907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:56.629154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:56.642322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.643371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.644283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.646594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:56.647595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:56.648500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:56.951749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:56.960480 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27fc50e1-b5e8-4aef-8e16-ff23d2192c9a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.429470 Sep 16 13:55:56.961084 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 398/813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:56 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:55:57.042691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.063668 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4988e3ea-794c-4f53-a586-ae459855e303 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1469 microversion: 2.1 time: 0.449551 Sep 16 13:55:57.067189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 416/814] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:56 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:57.107503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:57.108132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:57.119467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.120507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.121412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.123327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.127745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.128566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.219662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:57.220747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:57.237003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.238185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.240109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.241285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.243126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.244748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.468282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.476956 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27f16ede-33cb-46cd-b4a1-0ee995281f96 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1469 microversion: 2.1 time: 0.373788 Sep 16 13:55:57.477965 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 399/815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:57 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:57.496720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:57.497724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:57.511115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.511885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.512637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.513726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.519391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.520135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.553812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.562948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.566668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.568340 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc7f39f9-25a2-4419-afa3-d04c4b5d2949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.356006 Sep 16 13:55:57.569166 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 417/816] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:57 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:57.610098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:57.620541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.622915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Searching by: {'reservation_id': 'r-eioxueog', 'deleted': False, 'project_id': 'da29b469d8554f0993b35628a9a05d89'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:55:57.633644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.635677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.636741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.638708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.639703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.640656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.736180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=21 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:57.884176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:57.893629 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b90612e7-5671-4618-a1c5-d07f8bdf91a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.414570 Sep 16 13:55:57.894719 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 400/817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:57 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:57.934637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:55:57.948507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:57.949877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:57.982930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.983921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.987396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:57.989439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:57.991136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:57.994967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.044068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:58.054335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.054940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.055583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.384964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:58.389723 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01fac7fb-a591-4a60-a015-acd7b295b40c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-eioxueog" status: 200 len: 2931 microversion: 2.1 time: 0.807696 Sep 16 13:55:58.390757 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 418/818] 10.222.0.60 () {58 vars in 1197 bytes} [Fri Sep 16 13:55:57 2022] GET /compute/v2.1/servers/detail?reservation_id=r-eioxueog => generated 2931 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:58.403528 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79ac1575-e0a0-4f69-8cfa-2584ad140a7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1379 microversion: 2.1 time: 0.486757 Sep 16 13:55:58.403528 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 401/819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:57 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1379 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:58.404032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:58.406685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:58.418249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.419224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.420774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.422123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.422580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f11949c-eab2-4367-bbd1-09d1c25aebad tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:58.423334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.423999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.503682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.server_groups [None req-7f11949c-eab2-4367-bbd1-09d1c25aebad tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Querying cell 08ea4950-b373-4785-aced-301964963f98(cell1) for 2 instances {{(pid=128643) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 13:55:58.504922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11949c-eab2-4367-bbd1-09d1c25aebad tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.532602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11949c-eab2-4367-bbd1-09d1c25aebad tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.537992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11949c-eab2-4367-bbd1-09d1c25aebad tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.648475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f11949c-eab2-4367-bbd1-09d1c25aebad tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/460842ce-b822-44a7-975f-a2f21d9cbe29" status: 200 len: 266 microversion: 2.1 time: 0.218740 Sep 16 13:55:58.648475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 419/820] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:55:58 2022] GET /compute/v2.1/os-server-groups/460842ce-b822-44a7-975f-a2f21d9cbe29 => generated 266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:55:58.652872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:58.653863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:58.665048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.665574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:58.666155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.669580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.670880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.671581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.672215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.684367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e9c4b6e-703f-4538-96d9-2fa294854342 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.283942 Sep 16 13:55:58.685013 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 402/821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:58 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:58.698582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:58.700576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:58.711353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.712504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.713201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:58.714637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:58.715361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:58.716025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.155032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:59.164844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:59.175354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:59.177069 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1260f360-d8dc-4ea3-9611-394883d17f61 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.538158 Sep 16 13:55:59.178318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:59.187311 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 420/822] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:55:58 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:55:59.205267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:59.206681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:59.216904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:59.234553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:59.237197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:59.239708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.243054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:59.244163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:59.244823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.261318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:55:59.354384 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81d60ced-7a3c-4465-8cf2-915606bea5ea tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1620 microversion: 2.1 time: 0.665999 Sep 16 13:55:59.370911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 403/823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:58 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1620 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:59.390035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:59.392833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:59.409276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:59.409781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:59.411705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.413187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:59.413759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:59.416168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.855111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:55:59.867404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-117f9b1c-abe2-4815-85cf-389a41448db9 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1620 microversion: 2.1 time: 0.484480 Sep 16 13:55:59.868226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 404/824] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:59 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1620 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:59.875339 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aca472a4-bf8e-452e-944b-abe5cfd8d0e9 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.680788 Sep 16 13:55:59.877671 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 421/825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:59 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:55:59.905698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:55:59.906395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:55:59.922003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:59.926646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:59.927434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.928214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:55:59.928695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:55:59.929211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:55:59.966715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:00.079639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db85593f-b3d0-4666-95e2-a22dd3516a4d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Action: 'create', calling method: .version_select at 0x7f724dea1d30>, body: {"keypair": {"name": "tempest-keypair-1097487598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXsnLdeF1358Lnkb9GzcUGX4XXa0rnUCXl+oUMfEQAlGPwte5wqncOLPpCjbZkF6wkViS0mCZZL6BAuyYO79TVCVKO4USwxLf8KMFAYsTC7nNJcuW4NWrWmRmxXVe38sQ=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:00.112412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-db85593f-b3d0-4666-95e2-a22dd3516a4d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Getting quotas for project 454a349170e442479ba080adf1ae35b9. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:00.123961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-db85593f-b3d0-4666-95e2-a22dd3516a4d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Getting quotas for user 1114d1f26bd44cae99ecd59f1ccfd683 and project 454a349170e442479ba080adf1ae35b9. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:00.163259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-db85593f-b3d0-4666-95e2-a22dd3516a4d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283778 Sep 16 13:56:00.164979 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 422/826] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 13:55:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:00.175971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:00.177411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:00.193673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:00.195082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:00.198381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:00.200664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:00.201754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:00.203522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:00.467742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:00.519102 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a665451-1d58-4c90-8b84-ba52e046834d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1529 microversion: 2.1 time: 0.640957 Sep 16 13:56:00.542449 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 405/827] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:55:59 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1529 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:00.542449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c834185e-f628-4e93-8542-f31212d7881a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: .version_select at 0x7f724d75f3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-968805187", "policies": ["anti-affinity"]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:00.547727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:00.585277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-c834185e-f628-4e93-8542-f31212d7881a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:00.595855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-c834185e-f628-4e93-8542-f31212d7881a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:00.750951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-c834185e-f628-4e93-8542-f31212d7881a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:00.760839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-c834185e-f628-4e93-8542-f31212d7881a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:00.786353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:00.794675 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c834185e-f628-4e93-8542-f31212d7881a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.267197 Sep 16 13:56:00.807733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 406/828] 10.222.0.60 () {60 vars in 1174 bytes} [Fri Sep 16 13:56:00 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:00.813091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:00.813726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:00.814487 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2600de5-9fda-40d2-9117-723a2c9b1d33 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.640580 Sep 16 13:56:00.819428 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 423/829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:00 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:00.836095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:00.836604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:00.836802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:00.837079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:00.837787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:00.838249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:00.838772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:00.843687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:00.867798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:00.869039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:00.872044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:00.873898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:00.874462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:00.878445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:01.460031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:01.474762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:01.478128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:01.480598 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a10b3eb-e5f5-4568-9deb-a4b87a00b8f2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.671415 Sep 16 13:56:01.483260 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 407/830] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:00 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:01.492320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:01.493692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:01.504390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:01.510319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:01.511184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:01.511906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:01.513083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:01.513844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:01.515687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:01.536622 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd77f410-d08f-4f55-b718-e802f7f082e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1529 microversion: 2.1 time: 0.715442 Sep 16 13:56:01.539854 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 424/831] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:00 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1529 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:01.561148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1466833490", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4c6193b7-737c-4cb7-9549-4193f760d81f"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:01.688570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:56:02.196835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:02.212802 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d70fca7-7c15-4369-b833-6c8a8236419d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.727537 Sep 16 13:56:02.214489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 408/832] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:01 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:02.226446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea027eeb-35f9-4b56-9938-1bc9e3fcf04e tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:02.283203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea027eeb-35f9-4b56-9938-1bc9e3fcf04e tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/123b7628-1548-488b-a042-8ea034288f3f" status: 202 len: 0 microversion: 2.1 time: 0.067053 Sep 16 13:56:02.284468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 409/833] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:56:02 2022] DELETE /compute/v2.1/flavors/123b7628-1548-488b-a042-8ea034288f3f => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:56:02.290112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:02.291517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:02.300168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:02.300980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:02.302520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:02.303534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:02.304820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:02.305463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:02.532624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:56:02.533549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:56:02.534195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:56:02.534859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:56:02.535457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:56:02.564742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:02.565833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:02.573945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:02.575241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:02.575777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:02.576373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:02.619521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:02.644218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:02.687357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Going to run 2 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:56:02.690994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:56:02.785340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128643) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 16 13:56:02.860627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:02.872535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:02.991189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:03.012204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:03.047433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=074e9fe3-9449-49c8-9153-0999ee84f2a3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:56:03.114318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:03.151688 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2bfd4a11-6c91-4a2f-a1e8-b4a99b062f71 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.859215 Sep 16 13:56:03.152868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 410/834] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:02 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:03.162038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e963c7c9-9738-481d-8e8d-9b04a8f364df tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:03.197958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:03.220346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:03.265331 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e963c7c9-9738-481d-8e8d-9b04a8f364df tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.109733 Sep 16 13:56:03.267708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 411/835] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:56:03 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:03.291244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:03.292898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:03.317348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:03.318751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:03.318951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:03.320442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:03.322024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:03.323868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:03.324508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:03.332737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'server_group_members'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:03.411957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75dc18ce-9dea-4f05-960a-92fdbeca623f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.869992 Sep 16 13:56:03.412916 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 425/836] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:56:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 1872 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 16 13:56:03.419838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-573689898", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "45989d85-966b-4c9d-a258-a1df0b340948"}], "security_groups": [{"name": "tempest-securitygroup--1883038261"}], "key_name": "tempest-keypair-1097487598", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:03.768060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] validate_networks() for [('45989d85-966b-4c9d-a258-a1df0b340948', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:56:04.038030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:04.058509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:04.063928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:04.067992 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c853a3b5-3a77-47ee-aa46-bf4a6c521143 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.796314 Sep 16 13:56:04.087749 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 412/837] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:03 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:04.115807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:04.119227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:04.131737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:04.132901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:04.133921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:04.135489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:04.136603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:04.137606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:04.706452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:04.719789 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55c87331-ca0d-43c1-b7ce-a683760119f2 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.630018 Sep 16 13:56:04.722919 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 413/838] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:04 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:04.741862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:04.750719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:04.774973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:04.775877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:04.777220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:04.779169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:04.780329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:04.781348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:04.861534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:04.884792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Old instance type tempest-test_resize_flavor_-262555684, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 13:56:04.915438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:56:04.915620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:56:04.916439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:56:04.917167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:56:04.917594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Getting quotas for project 454a349170e442479ba080adf1ae35b9. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:04.918337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:56:04.925379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Getting quotas for user 1114d1f26bd44cae99ecd59f1ccfd683 and project 454a349170e442479ba080adf1ae35b9. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:04.947312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:04.959437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:56:04.961185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:56:04.963086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:56:04.964816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:56:04.965507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:56:04.990658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:04.993653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:04.995804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:04.997927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:04.998698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:04.999530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:05.031719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Getting quotas for project 454a349170e442479ba080adf1ae35b9. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:05.042443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Getting quotas for user 1114d1f26bd44cae99ecd59f1ccfd683 and project 454a349170e442479ba080adf1ae35b9. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:05.075000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:56:05.082271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:56:05.171314 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1474e8c9-d232-48b9-bbce-3879d37f67ff tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368/action" status: 202 len: 0 microversion: 2.1 time: 0.446906 Sep 16 13:56:05.180205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 414/839] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:56:04 2022] POST /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:56:05.191563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:05.204669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:05.205368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Searching by: {'deleted': False, 'project_id': 'da29b469d8554f0993b35628a9a05d89'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:56:05.293542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:05.293542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:05.297217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:05.298929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:05.300553 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f23a1b48-f715-4f2f-b7c5-b2409c272f1e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.882111 Sep 16 13:56:05.307159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:05.308157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:05.308703 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 426/840] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:56:03 2022] POST /compute/v2.1/servers => generated 407 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:56:05.356228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:05.357248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:05.422884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:05.423787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:05.431662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:05.440020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:05.441164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:05.441914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:05.694141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:56:06.161723 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdb9d94c-5c54-4cbf-9da8-6dcd06578acd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.979643 Sep 16 13:56:06.171910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 415/841] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 13:56:05 2022] GET /compute/v2.1/servers => generated 1665 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:06.193941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:06.195749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:06.218100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:06.221316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:06.222040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:06.225519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:06.226882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:06.228924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:06.232707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:06.285560 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8e19a829-d381-4205-8d1b-26fadbe29fa4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1471 microversion: 2.1 time: 0.963808 Sep 16 13:56:06.288211 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 427/842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:05 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1471 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:06.325335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:06.327023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:06.380646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:06.381146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:06.381578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:06.382983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:06.392117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:06.392609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:06.977846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:06.997446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:07.011978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:07.021115 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c8e86ea8-b39d-46d9-9b6a-5e13720ea961 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.845183 Sep 16 13:56:07.023474 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 416/843] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:06 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:07.047069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:07.047691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:07.072939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:07.080270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:07.081053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:07.082261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:07.084533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:07.086358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:07.447890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:07.459964 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8cea776-6c2d-4d58-b7ab-e4f630e7f180 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1273 microversion: 2.1 time: 0.432128 Sep 16 13:56:07.467590 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 417/844] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:07 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:07.483625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:07.484248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:07.492964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:07.516560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:07.517746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:07.518525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:07.524074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:07.524756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:07.525386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:07.545205 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e995b33-2a11-4e25-93e8-bea34bfba217 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 1.235218 Sep 16 13:56:07.567987 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 428/845] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:06 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:07.623157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:07.627825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:07.681819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:07.685605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:07.689707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:07.709559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:07.713621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:07.722857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.209206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:08.249364 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f11850b-a93b-4a3b-b8d6-39703bfccc94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1271 microversion: 2.1 time: 0.678008 Sep 16 13:56:08.255747 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 429/846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:07 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1271 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:08.279565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4e353fd5-42ec-424d-9bf0-9da18a39e596 req-342fa30b-c3b1-44df-8fdc-08a5849be862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d670bb-8f4c-42da-9277-256a3d31ecca", "name": "network-vif-plugged", "status": "completed", "tag": "2a647267-4c40-4719-85cd-866bc9adb22d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:08.350774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4e353fd5-42ec-424d-9bf0-9da18a39e596 req-342fa30b-c3b1-44df-8fdc-08a5849be862 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.352982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4e353fd5-42ec-424d-9bf0-9da18a39e596 req-342fa30b-c3b1-44df-8fdc-08a5849be862 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.354007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4e353fd5-42ec-424d-9bf0-9da18a39e596 req-342fa30b-c3b1-44df-8fdc-08a5849be862 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.407407 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4e353fd5-42ec-424d-9bf0-9da18a39e596 req-342fa30b-c3b1-44df-8fdc-08a5849be862 service nova] Creating event network-vif-plugged:2a647267-4c40-4719-85cd-866bc9adb22d for instance a0d670bb-8f4c-42da-9277-256a3d31ecca on n-h1-858129-2 Sep 16 13:56:08.434546 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4e353fd5-42ec-424d-9bf0-9da18a39e596 req-342fa30b-c3b1-44df-8fdc-08a5849be862 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175302 Sep 16 13:56:08.442898 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 430/847] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:08.456593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:08.460888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:08.486617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.490592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.491607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.496397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.498582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.514278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.781146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:08.793936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d972b93-b9c9-482e-bd86-4f42f40149df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 1.324141 Sep 16 13:56:08.794899 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 418/848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:07 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:08.804399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:08.812297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:08.830597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.831101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.831539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.832280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.832866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.833150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.942264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:08.952787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-51686e75-d7da-4cf9-b18c-f304bb86c0e8 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.508014 Sep 16 13:56:08.953386 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 431/849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:08 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:08.977284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:08.977912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:08.990341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.991014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.992125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:08.993027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:08.994770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:08.995464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.107284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:09.124182 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0ea48a7b-1354-4d70-8e1a-29faeca7e12d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1321 microversion: 2.1 time: 0.151714 Sep 16 13:56:09.139748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 432/850] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:08 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:09.156764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:09.158234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:09.161165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:09.171144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:09.174441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.174792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:09.176323 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba5e1e95-d5de-4728-8c09-209c1d634d50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.380032 Sep 16 13:56:09.177553 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 419/851] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:08 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:09.180464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.182042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.183240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.183938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.184613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.309580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:09.310237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:09.320500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.321005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.321644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.322437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.322987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.323500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.704278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:09.719264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a4b7a29-6956-48d6-aecb-6471a0f53e3d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1277 microversion: 2.1 time: 0.414798 Sep 16 13:56:09.721410 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 420/852] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:09 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1277 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:09.819480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:09.821540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:09.822204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:09.829820 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8242ed7-f0d5-460c-bac0-d10bebafb36f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.688406 Sep 16 13:56:09.842663 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 433/853] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:09 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:09.842910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.842910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.842910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.842910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.843236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.843236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.981508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:09.984311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:09.995001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.995802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.996420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:09.997673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:09.998493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:09.999160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.082646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.092914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa7fe14b-645a-4442-9bab-dfeff6f15b82 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.278920 Sep 16 13:56:10.097819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 421/854] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:09 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:10.161995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:10.163406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:10.173529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.174608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.175274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.180071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.181234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.184449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.313467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.328725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6306b01d-26ac-47e2-acd8-6515c36e4b98 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1329 microversion: 2.1 time: 0.170693 Sep 16 13:56:10.329734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 422/855] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:10 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1329 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:10.331557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.339694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:10.341105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:10.348223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.348855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.350512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.353104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.353801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.354238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.357726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:10.366708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19af834c-8905-4f19-8e45-91ac1a206ff0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.387812 Sep 16 13:56:10.396236 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 434/856] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:09 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:10.614302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.625859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.628643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.630117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5af55a1-d03c-46d5-9614-984045b3b83a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1362 microversion: 2.25 time: 0.298992 Sep 16 13:56:10.631447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 423/857] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:10 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:10.687765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-97c5850b-1c9d-4aa9-8783-ed54a21ed40b req-efe56695-9fa3-4bfa-a3ad-4eb156066747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98", "name": "network-vif-plugged", "status": "completed", "tag": "e79f32ee-c133-461d-98f9-33ec125ea86c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:10.711673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-97c5850b-1c9d-4aa9-8783-ed54a21ed40b req-efe56695-9fa3-4bfa-a3ad-4eb156066747 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.712952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-97c5850b-1c9d-4aa9-8783-ed54a21ed40b req-efe56695-9fa3-4bfa-a3ad-4eb156066747 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.714087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-97c5850b-1c9d-4aa9-8783-ed54a21ed40b req-efe56695-9fa3-4bfa-a3ad-4eb156066747 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.739059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-97c5850b-1c9d-4aa9-8783-ed54a21ed40b req-efe56695-9fa3-4bfa-a3ad-4eb156066747 service nova] Creating event network-vif-plugged:e79f32ee-c133-461d-98f9-33ec125ea86c for instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 on n-h1-858129-2 Sep 16 13:56:10.749975 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-97c5850b-1c9d-4aa9-8783-ed54a21ed40b req-efe56695-9fa3-4bfa-a3ad-4eb156066747 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080584 Sep 16 13:56:10.751717 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 435/858] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:10.762226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:10.764268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:10.772623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.774271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.775148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.776497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.777171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.777829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.787567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:10.865333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:10.868771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:10.883510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.884905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.886781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.888492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:10.889216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:10.890986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:10.894531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:10.901473 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8584137-7b4a-4c81-8b55-6c0610f1a2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1277 microversion: 2.1 time: 0.144822 Sep 16 13:56:10.915382 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 424/859] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:10 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:11.055602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1609251733", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:11.161966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:11.172687 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9c3fffb-6bde-40f3-921a-2e77f4faa832 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.318904 Sep 16 13:56:11.177768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 436/860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:10 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:11.188471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:11.192952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:11.211509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:11.215240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:11.232601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:11.240191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:11.244280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:11.246167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] validate_networks() for [('b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:56:11.250032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:11.627775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:11.639265 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e5f48411-afb0-4a65-8909-9a9fa19ba9e6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.459918 Sep 16 13:56:11.640127 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 437/861] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:11 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:11.646548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:11.647570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:11.654962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:11.655561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:11.656365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:11.657457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:11.658200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:11.658888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:11.792231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:11.813104 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86afa34d-aef0-4a6c-8e96-52613bab59be tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1329 microversion: 2.1 time: 0.171417 Sep 16 13:56:11.826442 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 438/862] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:11 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1329 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:11.826442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:11.826442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:11.830010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:11.830010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:11.830010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:11.830458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:11.830631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:11.831283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.216208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:12.233479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f2f65f93-f8b5-4815-9acc-18b47c21c506 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.417739 Sep 16 13:56:12.235047 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 439/863] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:11 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:12.245675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:12.247437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:12.259586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.260802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.261917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.263923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.265020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.266006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.289321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:56:12.290811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:56:12.291534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:56:12.292535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:56:12.293191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:56:12.308521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.309641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.310859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.313309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.316042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.316909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.345400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:12.352186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for user f410179d3cca47dbb7ea031494bd1b07 and project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:12.371873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:56:12.374849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:56:12.460103 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-506a9a42-52d1-4b58-8a50-4ee770796ca1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.540771 Sep 16 13:56:12.465403 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 425/864] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:56:12.486524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:12.487531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:12.510949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.511711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.512508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.513838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.514724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.515496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.571872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:12.582866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:12.584841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:12.586893 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-deba07da-8757-40f0-b442-8fd034c18775 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1558 microversion: 2.25 time: 0.350127 Sep 16 13:56:12.587639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 440/865] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:12 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1558 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:12.592874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:12.593735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:12.615924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.618042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.618042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.618863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:12.619866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:12.620554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:12.648187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:12.949400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:12.964102 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-84e767c2-9cec-4ff6-8967-c0dbbfe475d5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.375291 Sep 16 13:56:12.965443 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 441/866] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:12 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:12.967386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:12.972423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d628579d-64d4-4f9b-bb6a-a5b3b5ee0a8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:12.979595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d628579d-64d4-4f9b-bb6a-a5b3b5ee0a8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:12.995069 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-345688cd-cda5-4202-8d7f-aaecbca7345f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.526927 Sep 16 13:56:12.996038 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 426/867] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:12 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:13.006775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:13.008407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:13.031601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.032461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.033111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.034045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.034886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.035703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.130005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d628579d-64d4-4f9b-bb6a-a5b3b5ee0a8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:13.140572 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d628579d-64d4-4f9b-bb6a-a5b3b5ee0a8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1208 microversion: 2.1 time: 0.173171 Sep 16 13:56:13.141789 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 442/868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:12 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:13.149044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:13.169665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:13.180563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.191590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.196325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.197208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.197783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.202354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.401543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:56:13.461893 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f5b031cc-94ef-4f1d-90f5-a11cb59a7ebe tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 2051 microversion: 2.25 time: 0.461348 Sep 16 13:56:13.474437 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 427/869] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:12 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 2051 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:13.483084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-18f5bfec-0226-46e0-8ae8-e5d32b82e70c req-4cd98274-192f-4819-beb4-84f60242b1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "name": "network-vif-unplugged", "status": "completed", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:13.515931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18f5bfec-0226-46e0-8ae8-e5d32b82e70c req-4cd98274-192f-4819-beb4-84f60242b1d5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.520219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18f5bfec-0226-46e0-8ae8-e5d32b82e70c req-4cd98274-192f-4819-beb4-84f60242b1d5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.521064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18f5bfec-0226-46e0-8ae8-e5d32b82e70c req-4cd98274-192f-4819-beb4-84f60242b1d5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.551591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-18f5bfec-0226-46e0-8ae8-e5d32b82e70c req-4cd98274-192f-4819-beb4-84f60242b1d5 service nova] Creating event network-vif-unplugged:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:56:13.561360 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-18f5bfec-0226-46e0-8ae8-e5d32b82e70c req-4cd98274-192f-4819-beb4-84f60242b1d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097205 Sep 16 13:56:13.564328 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 428/870] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:13.571739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:13.583278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-88c1129a-60fb-49e4-9a35-698352fa8893 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1368 microversion: 2.1 time: 0.438505 Sep 16 13:56:13.587171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:13.604125 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 443/871] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:13 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1368 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:13.604591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:13.612870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:13.614421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:13.622426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.623390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.624189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.625194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.625905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.626025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.626636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.627000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.627130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.627807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.628263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.628689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.803128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:13.823902 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e771ba1-1799-42aa-8fae-69427fdd9f18 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1329 microversion: 2.1 time: 0.246434 Sep 16 13:56:13.834904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 429/872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:13 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1329 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:13.845590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:13.847622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:13.853526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:13.863496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.863998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.864570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.865401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:13.865758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:13.866180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:13.874178 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2f2c05e3-8c41-488a-a4f7-cfa92c839fb2 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.264594 Sep 16 13:56:13.875785 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 444/873] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:13 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:14.006114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:14.007264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:14.024742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.026087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.027141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.029233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.031567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.032334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.525603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:56:14.527093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:14.537524 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-da3e3919-450c-47a2-b37f-c7d0b1c19769 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.538026 Sep 16 13:56:14.550001 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 445/874] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:13 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:14.555929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:14.556697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:14.568587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.569205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.569818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.570808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.571383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.574662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ef92709-b227-4831-8509-0b28ed43dd08 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 2051 microversion: 2.25 time: 0.737159 Sep 16 13:56:14.575529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.576269 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 430/875] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:13 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 2051 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:14.587661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:14.588088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:14.612215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.613103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.615144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.615885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.630383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.631276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.893394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:14.909798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a88d5c18-3b4d-4641-aa1a-b3e107113166 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1204 microversion: 2.1 time: 0.331497 Sep 16 13:56:14.911325 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 431/876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:14 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1204 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:14.916445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-18350636-b9e1-49c5-94de-48b21ed983be req-27e748b3-6a25-43c7-9d92-ebec55a08407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343a95db-843b-4fb8-85a3-9440a605b38e", "tag": "e8225a0e-7ec1-44b5-812c-bba0be636c1b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:14.928900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:14.932670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18350636-b9e1-49c5-94de-48b21ed983be req-27e748b3-6a25-43c7-9d92-ebec55a08407 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.933657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18350636-b9e1-49c5-94de-48b21ed983be req-27e748b3-6a25-43c7-9d92-ebec55a08407 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.934271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18350636-b9e1-49c5-94de-48b21ed983be req-27e748b3-6a25-43c7-9d92-ebec55a08407 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.952259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-18350636-b9e1-49c5-94de-48b21ed983be req-27e748b3-6a25-43c7-9d92-ebec55a08407 service nova] Creating event network-changed:e8225a0e-7ec1-44b5-812c-bba0be636c1b for instance 343a95db-843b-4fb8-85a3-9440a605b38e on n-h1-858129-2 Sep 16 13:56:14.958177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-18350636-b9e1-49c5-94de-48b21ed983be req-27e748b3-6a25-43c7-9d92-ebec55a08407 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045164 Sep 16 13:56:14.959484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 432/877] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:14.965760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:14.970013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.970868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.971524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.972327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:14.972793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:14.973220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:14.993894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:15.005835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a92697f2-e8b5-4ec4-85f3-b818c4eaae8f tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044311 Sep 16 13:56:15.006334 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b9e500c-f606-45cb-aa56-09c4b64a9cca tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.453743 Sep 16 13:56:15.007958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 433/878] 10.222.0.60 () {60 vars in 1217 bytes} [Fri Sep 16 13:56:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:56:15.010922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 446/879] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:14 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:15.016833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:15.017758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.022863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:15.024530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.030029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=5 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:15.035372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.036178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.036801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.038017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.039304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.040040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.041517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.042034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.042515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.044798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.045285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.045721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.190669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:15.209002 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b659e570-154d-4f7c-bfb1-04c96a7d2b75 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1327 microversion: 2.1 time: 0.196485 Sep 16 13:56:15.222629 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 447/880] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:15 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:15.231848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:15.232782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.243220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.243734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.244431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.245544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.246224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.246857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.286049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:15.303276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9867846d-83ff-458e-90b1-b57e93a74d62 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1559 microversion: 2.1 time: 0.293964 Sep 16 13:56:15.319025 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 434/881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:15 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1559 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:15.339215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:15.340229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.350101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.350797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.351800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.352604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.353097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.353827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.483767 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-90e41991-2bd7-49ef-a07c-1153429d4ae4 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca/action" status: 202 len: 0 microversion: 2.25 time: 0.162842 Sep 16 13:56:15.488404 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 435/882] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:56:15 2022] POST /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:56:15.527517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:15.531905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:15.532993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.544365 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61aa3d15-be79-4396-baa2-8e3e497c6000 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.321738 Sep 16 13:56:15.545225 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 448/883] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:15 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:15.558305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:15.560311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.577570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.581407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.581407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.584123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.584816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.586885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.593346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.594508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.595341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.605997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.606786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.608883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.792192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7265c9b6-34c5-491b-a133-576e1667f1a4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.302766 Sep 16 13:56:15.801736 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 436/884] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 13:56:15 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-interface => generated 285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:15.809069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:15.810248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:15.879238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.880066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.880794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.887696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:15.888556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:15.889312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:15.964500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:56:16.003659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-354fc140-6df4-44b5-8eb9-b51c5b2d9f86 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 2056 microversion: 2.25 time: 0.456779 Sep 16 13:56:16.015862 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 449/885] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:15 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 2056 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:16.029031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:16.030225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:16.048015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.053507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.054880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.056196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.058859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.059667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.220009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:16.239254 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23095b13-5b85-4eaa-97c6-25f4ef35c512 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1204 microversion: 2.1 time: 0.221908 Sep 16 13:56:16.241773 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 450/886] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:16 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1204 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:16.268537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:16.269262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:16.304776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.305573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.306345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.315841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.317563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.320879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.572245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:16.587534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba3f8877-b83c-4286-a871-4cc31607fc66 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.791715 Sep 16 13:56:16.588714 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 437/887] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:15 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:16.595642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:16.596495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:16.610268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.614194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.615028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.616032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.616888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.617644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.821649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:16.836278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b2d8b963-de4a-4b44-8cb0-2a2a93c14525 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.591051 Sep 16 13:56:16.849908 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 451/888] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:16 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:16.862776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:16.866641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:16.875854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.876390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.876950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:16.877946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:16.878680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:16.879423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:17.389092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:17.422298 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9a50efb-639a-4cbc-9fed-4c07fe582907 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1327 microversion: 2.1 time: 0.830230 Sep 16 13:56:17.428061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 438/889] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:16 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1327 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:17.449557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:17.451018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:17.481348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:17.481861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:17.482305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:17.483081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:17.484231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:17.484675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:17.791007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:17.800265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:56:17.803025 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b892c28e-aede-40a2-95f3-df614da27802 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.950001 Sep 16 13:56:17.806517 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 452/890] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:16 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:17.814982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:17.817077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:17.825346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4d3b067-70a3-4274-9dc4-459866c67255 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 2036 microversion: 2.25 time: 0.389153 Sep 16 13:56:17.834028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:17.839621 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 439/891] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:17 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 2036 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:17.842547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:17.846178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:17.847335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:17.848162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:17.852739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:17.866075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:17.866933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:17.884225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:17.884850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:17.885359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:17.886171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:17.886747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:17.887254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:18.002189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:18.012908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5bd3ab63-9948-4295-877a-ae2c01595a5d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1260 microversion: 2.1 time: 0.201794 Sep 16 13:56:18.030451 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 453/892] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:17 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:18.034266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858129-2", "block_migration": "auto"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:18.037891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:18.055575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:18.056678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:18.057312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:18.061211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:18.061877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:18.062510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:18.138445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'flavor' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:56:18.207885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Going to try to live migrate instance to n-h2-858129-2 {{(pid=128643) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 13:56:18.297518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:18.300093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:18.314990 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6df4beba-bf72-4681-8862-29d9ed21e7f9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.471492 Sep 16 13:56:18.322744 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 440/893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:17 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:18.338181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:18.353870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:18.374147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:18.375976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:18.377523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:18.379518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:18.380830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:18.385150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:18.792387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:18.809906 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b387591c-763f-4778-be0b-096ff7640f95 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.484724 Sep 16 13:56:18.820620 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 441/894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:18 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:18.831832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:18.833144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:18.876881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:18.877785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:18.883004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:18.884550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:18.885436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:18.886243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:19.678202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:19.697707 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-681dd12f-f61b-4174-a1ed-04580d240004 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.875130 Sep 16 13:56:19.702166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 442/895] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:18 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:19.709214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:19.731347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:19.753777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:19.758394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:19.759535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:19.761096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:19.762248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:19.763382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:20.015670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:20.026825 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac1c6a09-3c27-4a2d-a711-87e61992c595 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.323022 Sep 16 13:56:20.027444 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 443/896] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:19 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:20.045239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:20.046900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:20.062986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:20.063680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:20.064145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:20.068505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:20.069275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:20.073088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:20.209694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:20.225592 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9eb84223-2c0d-42e7-b840-5dcd2cb1d9fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1266 microversion: 2.1 time: 0.193522 Sep 16 13:56:20.245532 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 444/897] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:20 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:20.245532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:20.245532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:20.266522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:20.266522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:20.266522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:20.267341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:20.267844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:20.271516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:20.906578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:20.921464 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f03fb0bd-11aa-4141-ad0b-488a0280bab3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1538 microversion: 2.1 time: 0.687622 Sep 16 13:56:20.922692 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 445/898] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:20 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1538 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:20.947628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:20.948968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:20.966309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:20.967264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:20.967746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:20.969490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:20.969979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:20.970431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:21.484462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:21.513240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71e915dc-f66d-4130-9310-976485efca10 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.587758 Sep 16 13:56:21.515186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 446/899] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:20 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:21.525647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9125a923-55fe-4d59-8317-e090942c708e req-95b04d31-dac2-44b3-8dbf-38e8009b18a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98", "tag": "e79f32ee-c133-461d-98f9-33ec125ea86c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:21.554957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9125a923-55fe-4d59-8317-e090942c708e req-95b04d31-dac2-44b3-8dbf-38e8009b18a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:21.555532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9125a923-55fe-4d59-8317-e090942c708e req-95b04d31-dac2-44b3-8dbf-38e8009b18a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:21.556114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9125a923-55fe-4d59-8317-e090942c708e req-95b04d31-dac2-44b3-8dbf-38e8009b18a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:21.571763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9125a923-55fe-4d59-8317-e090942c708e req-95b04d31-dac2-44b3-8dbf-38e8009b18a4 service nova] Creating event network-changed:e79f32ee-c133-461d-98f9-33ec125ea86c for instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 on n-h1-858129-2 Sep 16 13:56:21.578949 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9125a923-55fe-4d59-8317-e090942c708e req-95b04d31-dac2-44b3-8dbf-38e8009b18a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061844 Sep 16 13:56:21.580744 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 447/900] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:21.587925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d6452b0d-54d0-4874-9ccf-544dd9203cde req-4b0c9475-f4c9-4bda-8ce0-ecb87224abd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "name": "network-vif-plugged", "status": "completed", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:21.604912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6452b0d-54d0-4874-9ccf-544dd9203cde req-4b0c9475-f4c9-4bda-8ce0-ecb87224abd9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:21.605420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6452b0d-54d0-4874-9ccf-544dd9203cde req-4b0c9475-f4c9-4bda-8ce0-ecb87224abd9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:21.605863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6452b0d-54d0-4874-9ccf-544dd9203cde req-4b0c9475-f4c9-4bda-8ce0-ecb87224abd9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:21.632515 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d6452b0d-54d0-4874-9ccf-544dd9203cde req-4b0c9475-f4c9-4bda-8ce0-ecb87224abd9 service nova] Creating event network-vif-plugged:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:56:21.639859 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d6452b0d-54d0-4874-9ccf-544dd9203cde req-4b0c9475-f4c9-4bda-8ce0-ecb87224abd9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057278 Sep 16 13:56:21.644804 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 448/901] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:21.652341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:21.653210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:21.661898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:21.662527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:21.663124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:21.664448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:21.665092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:21.665533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:22.266732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:22.291267 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81f2f25a-ef26-4472-81dc-ba27b4c21c48 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.644480 Sep 16 13:56:22.293066 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 449/902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:21 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:22.306300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:22.308562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:22.322581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:22.323912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:22.324973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:22.326657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:22.328044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:22.329157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:22.391915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:23.135075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=40 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:23.206561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:23.241071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4ad3c95-5bba-4e0d-8b08-e425a66306c7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.944699 Sep 16 13:56:23.243540 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 450/903] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:22 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:23.253406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:23.254915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:23.267174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.268739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.269379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.270446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.271424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.271876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.336673 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f28b40e0-a307-4081-812f-5d9e18636fca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca/action" status: 202 len: 0 microversion: 2.25 time: 5.314344 Sep 16 13:56:23.337977 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 454/904] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:56:18 2022] POST /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca/action => generated 0 bytes in 5316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:56:23.343850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8aa53b96-4f4e-4997-8c67-43ab96ab817d req-b073a5ac-9c2b-48ca-bc26-393ed708339f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074e9fe3-9449-49c8-9153-0999ee84f2a3", "tag": "f47e6241-6644-4a56-b0dd-ffda96bd59f2"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:23.360686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8aa53b96-4f4e-4997-8c67-43ab96ab817d req-b073a5ac-9c2b-48ca-bc26-393ed708339f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.361494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8aa53b96-4f4e-4997-8c67-43ab96ab817d req-b073a5ac-9c2b-48ca-bc26-393ed708339f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.362380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8aa53b96-4f4e-4997-8c67-43ab96ab817d req-b073a5ac-9c2b-48ca-bc26-393ed708339f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.392847 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8aa53b96-4f4e-4997-8c67-43ab96ab817d req-b073a5ac-9c2b-48ca-bc26-393ed708339f service nova] Creating event network-changed:f47e6241-6644-4a56-b0dd-ffda96bd59f2 for instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 on n-h2-858129-2 Sep 16 13:56:23.404600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8aa53b96-4f4e-4997-8c67-43ab96ab817d req-b073a5ac-9c2b-48ca-bc26-393ed708339f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064693 Sep 16 13:56:23.405960 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 455/905] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:23.415293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:23.416389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:23.426797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.427807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.428449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.430360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.431187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.433734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.543194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:23.555408 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c3e3b83-f5a9-44b4-94c4-34ebfb05719e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.309913 Sep 16 13:56:23.556496 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 451/906] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:23 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:23.562544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:23.563953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:23.573044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.573656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.574208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.575104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.575675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.576173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.893251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:23.902126 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-526f6c69-23fd-41fe-b0d5-37d8eb50c6c6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.494475 Sep 16 13:56:23.902781 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 456/907] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:23 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:23.907542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:23.908185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:23.916881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.917337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.917697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.918458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.918906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:23.919325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:23.941878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:23.964917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:23.972177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e06b51c-a665-49a4-abd7-c342c4c191de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.414168 Sep 16 13:56:23.972790 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 452/908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:23 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:23.981642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:23.981642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:23.999460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:23.999971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.000413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.001140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.001786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.002221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.246696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:24.255947 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f10a6b8f-1356-4551-af2e-be2b4cd80a35 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.352002 Sep 16 13:56:24.256717 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 457/909] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:23 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:24.265819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0a3967b7-263f-43ca-a03d-7afc9fa4c439 req-63f994ba-3bc8-4eec-a56c-182e5788c65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5508ca6-96e8-447b-9bfd-6ce805d6418f", "tag": "ebcf9954-db11-4079-925a-2c4309e336c9"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:24.285673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0a3967b7-263f-43ca-a03d-7afc9fa4c439 req-63f994ba-3bc8-4eec-a56c-182e5788c65e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.286975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0a3967b7-263f-43ca-a03d-7afc9fa4c439 req-63f994ba-3bc8-4eec-a56c-182e5788c65e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.288048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0a3967b7-263f-43ca-a03d-7afc9fa4c439 req-63f994ba-3bc8-4eec-a56c-182e5788c65e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.325011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:24.328037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0a3967b7-263f-43ca-a03d-7afc9fa4c439 req-63f994ba-3bc8-4eec-a56c-182e5788c65e service nova] Creating event network-changed:ebcf9954-db11-4079-925a-2c4309e336c9 for instance e5508ca6-96e8-447b-9bfd-6ce805d6418f on n-h2-858129-2 Sep 16 13:56:24.342342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0a3967b7-263f-43ca-a03d-7afc9fa4c439 req-63f994ba-3bc8-4eec-a56c-182e5788c65e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083099 Sep 16 13:56:24.344905 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 458/910] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:24.349966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:24.354942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:24.357165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:24.358100 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3952b604-9cb5-47a8-b567-9c5ff15dd256 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.383193 Sep 16 13:56:24.358801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:24.361759 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 453/911] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:23 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:24.372440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.373463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.374396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.375871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.376846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.377744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.552206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:24.560942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-778a80f2-c2eb-44c3-a756-d0cbb803532b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.212458 Sep 16 13:56:24.561545 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 459/912] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:24 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:24.583078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:24.584017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:24.591958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.592448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.592882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.593612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.594073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.594531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.759363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:24.767710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85b4a1dc-51f1-47e9-b01b-9bee441052a7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.192076 Sep 16 13:56:24.768312 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 454/913] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:24 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:24.928676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:24.929571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:24.938447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.938954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.939463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:24.940333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:24.940927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:24.941416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.018867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:25.020428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:25.026309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:25.034043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.034740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.035529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.036754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.037351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.037798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.218567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.236044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-647d5963-83b7-4cb2-ad84-cada226b8312 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.312289 Sep 16 13:56:25.237337 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 460/914] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:24 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:25.270452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b6c69dee-180c-411e-a0be-8c007d45f67c req-4781efdf-a488-4ec7-99d7-26007374950e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343a95db-843b-4fb8-85a3-9440a605b38e", "name": "network-vif-plugged", "status": "completed", "tag": "e8225a0e-7ec1-44b5-812c-bba0be636c1b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:25.282226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b6c69dee-180c-411e-a0be-8c007d45f67c req-4781efdf-a488-4ec7-99d7-26007374950e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.282760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b6c69dee-180c-411e-a0be-8c007d45f67c req-4781efdf-a488-4ec7-99d7-26007374950e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.283195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b6c69dee-180c-411e-a0be-8c007d45f67c req-4781efdf-a488-4ec7-99d7-26007374950e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.301640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b6c69dee-180c-411e-a0be-8c007d45f67c req-4781efdf-a488-4ec7-99d7-26007374950e service nova] Creating event network-vif-plugged:e8225a0e-7ec1-44b5-812c-bba0be636c1b for instance 343a95db-843b-4fb8-85a3-9440a605b38e on n-h1-858129-2 Sep 16 13:56:25.307789 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b6c69dee-180c-411e-a0be-8c007d45f67c req-4781efdf-a488-4ec7-99d7-26007374950e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040744 Sep 16 13:56:25.308618 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 461/915] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:25.312980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.313703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:25.314443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:25.321299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.321799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.322238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.323082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.323736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.323993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.328152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eee5cc64-8321-4764-b1e1-e63c3c44cd20 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.316866 Sep 16 13:56:25.329335 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 455/916] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:25 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:25.408672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:25.409827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:25.427963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.428626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.429751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.430650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.431229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.431815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.580023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.598198 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5be310b7-bbda-4b11-829d-d9bb67789758 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.288041 Sep 16 13:56:25.599652 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 462/917] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:25 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:25.607359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-45e42c7e-deda-4422-a89b-7fb22c394b1b req-c1591d3b-86ee-4843-bdfe-c44496f0cfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cdbfcc-18c8-4219-9fb2-c40f4517a561", "tag": "38c9b12a-5066-4ee6-baea-15e720a6984a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:25.628700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45e42c7e-deda-4422-a89b-7fb22c394b1b req-c1591d3b-86ee-4843-bdfe-c44496f0cfa9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.629399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45e42c7e-deda-4422-a89b-7fb22c394b1b req-c1591d3b-86ee-4843-bdfe-c44496f0cfa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.629939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45e42c7e-deda-4422-a89b-7fb22c394b1b req-c1591d3b-86ee-4843-bdfe-c44496f0cfa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.650453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45e42c7e-deda-4422-a89b-7fb22c394b1b req-c1591d3b-86ee-4843-bdfe-c44496f0cfa9 service nova] Creating event network-changed:38c9b12a-5066-4ee6-baea-15e720a6984a for instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 on n-h2-858129-2 Sep 16 13:56:25.659228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-45e42c7e-deda-4422-a89b-7fb22c394b1b req-c1591d3b-86ee-4843-bdfe-c44496f0cfa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056277 Sep 16 13:56:25.660078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 463/918] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:25.666840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:25.667808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:25.675458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.676236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.676859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.677856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.678549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.679221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.692472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.707598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.711372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.713595 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-abd73724-1706-403c-a77a-074790ad721f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.311508 Sep 16 13:56:25.714978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 456/919] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:25 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:25.794710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:25.795719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:25.807260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.808170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.808951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.810238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:25.811109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:25.811879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:25.868323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:25.882835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5740eca9-a064-48a5-9393-07f916ab2095 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.221154 Sep 16 13:56:25.883695 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 464/920] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:25 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:26.009119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.023498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dabd9a87-4ebd-4bef-991c-0f25c39d23b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.234323 Sep 16 13:56:26.024546 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 457/921] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:25 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:26.265564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:26.266264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:26.272919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.273605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.273929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.274891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.275395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.275966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.356033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:26.357082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:26.365527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.366166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.369128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.370699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.371330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.371883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.458116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.468129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1eed15bb-5ca4-4189-a2bb-bc71bc3aa7da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.206927 Sep 16 13:56:26.468757 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 465/922] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:26 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:26.581766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.584226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:26.592383 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61983e68-fa02-471c-84f1-ab33ddf09bb4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1319 microversion: 2.1 time: 0.243165 Sep 16 13:56:26.592973 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 458/923] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:26 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:26.635776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:26.636460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:26.644431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.644934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.645377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.646103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.646600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.647064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.748461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:26.749114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:26.756058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.756565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.757008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.757841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.758312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.758774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.877997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.889067 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-887b5314-0035-40d6-8845-9ee3ae56236e tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.258497 Sep 16 13:56:26.890679 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 466/924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:26 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:26.931459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:26.932105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:26.938576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:26.946749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.947622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.948396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.949686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:26.950582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:26.951361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:26.960191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.969859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.971837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:26.973382 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42a8bce0-055c-4572-9287-5efc0ab24949 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.229304 Sep 16 13:56:26.974097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 459/925] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:26 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:27.051293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:27.052137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:27.060006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.060693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.061265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.062519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.063349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.063966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.191804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:27.201761 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7e7e76a-7bf0-4fef-9365-00e7ea133c96 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1477 microversion: 2.1 time: 0.279722 Sep 16 13:56:27.202416 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 467/926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:26 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:27.262227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:27.270984 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-38a1f43c-20e1-4d45-84c5-8f88b4b802b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.227409 Sep 16 13:56:27.271583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 460/927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:27 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:27.506942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:27.508041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:27.519379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.520018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.520565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.521439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.521994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.522628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.622457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:27.623933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:27.636202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.637108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.638103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.639629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.641682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.642601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.824056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:27.842923 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8f91fc2-cf7b-4af9-8c03-5f09b82dc17c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.342581 Sep 16 13:56:27.844659 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 468/928] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:27 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:27.906992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:27.916316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e60f6e8-5f67-417a-8dbf-eabd4a230fc3 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1469 microversion: 2.1 time: 0.301929 Sep 16 13:56:27.916924 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 461/929] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:27 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:27.923242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:27.923957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:27.934441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.935037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.935566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.936716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.937246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.937736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.960292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:27.961471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:27.972300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.973170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.973968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:27.975283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:27.976624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:27.977378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.157469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.174563 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c97f58de-0f3f-4e70-be12-b1245ef5e319 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.255218 Sep 16 13:56:28.175603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 469/930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:27 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:28.185514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:28.186970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:28.198941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.199850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.200615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.202008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.203098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.203915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.227471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.238576 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-471cd2ba-50ad-40d2-8c4f-35d56b4d769c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.285674 Sep 16 13:56:28.239743 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 462/931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:27 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:28.245899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:28.246734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:28.254143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.254828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.255398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.256230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.256802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.257405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.450338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.467233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.470843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.473111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-65f73c50-c639-4b8c-bea2-17aa730d48d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.295718 Sep 16 13:56:28.474702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 470/932] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:28 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:28.483151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:28.484327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:28.491697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.495601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.496370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.497083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.498265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.499094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.500029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.502334 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9da74dad-b59e-42be-8198-13145b7d6c48 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1463 microversion: 2.1 time: 0.261308 Sep 16 13:56:28.503478 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 463/933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:28 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:28.530744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:28.531839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:28.542843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.543712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.544422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.545692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.546558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.547368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.716998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.732512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-72ac50bc-7c56-4ee7-ae62-5a10cdd228a3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.256239 Sep 16 13:56:28.733760 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 471/934] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:28 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:28.786464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:28.796386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec8870a0-7506-469f-80cb-178c79c84208 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1463 microversion: 2.1 time: 0.273175 Sep 16 13:56:28.797061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 464/935] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:28 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1463 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:28.820858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:28.823891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:28.830657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.831156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.831600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.832318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.832776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.833204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.869447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:28.870548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:28.879695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.881069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.881608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.883115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:28.883656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:28.884244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:28.949286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:56:28.950051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:56:28.951043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:56:28.951713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:56:28.952478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:56:29.085807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.088821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:29.095963 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f39a42a9-f9ec-45fd-a88e-e4ae7b05c416 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.231445 Sep 16 13:56:29.097249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 465/936] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:28 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:29.103158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.104419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.105494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.106874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.107748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.108586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.166526 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52fc2364-dbb4-47ea-a538-369467f114ca tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 1067 microversion: 2.1 time: 0.349545 Sep 16 13:56:29.167621 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 472/937] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:56:28 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 1067 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 16 13:56:29.194221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:29.195566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:29.207656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.208387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.209163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.210481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.211476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.212505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.224488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:29.225814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:29.237106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.238120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.239038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.240431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.241898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.243115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.475232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.484128 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b7cf1daf-07d1-44de-b25f-b89d81296257 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.296599 Sep 16 13:56:29.484701 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 466/938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:29 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:29.486181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.489696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:29.490314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:29.500187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.501262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.502064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.503279 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46ca85ba-3b12-423c-8f71-338cfce29ba6 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.287116 Sep 16 13:56:29.503613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.504548 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 473/939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:29 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:29.504670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.505430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.513469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:29.514082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:29.520767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.521258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.521689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.522424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.522888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.523510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.528774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:29.727871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.736551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0d37d68-4cfc-4e46-aa2a-0fc2691372de tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.250788 Sep 16 13:56:29.736871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.737589 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 467/940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:29 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:29.746921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.748421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.749626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53a7282b-901e-4efc-bc12-0cdaa3c491d1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.240435 Sep 16 13:56:29.750188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 474/941] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:29 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:29.772401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:29.773595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:29.780927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.780927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.781375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.782019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:29.782511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:29.782934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:29.931471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:29.940082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1a1737d-a983-4666-8268-98a1c6f9b339 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.172982 Sep 16 13:56:29.940712 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 468/942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:29 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:30.139612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:30.140233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:30.147595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.148629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.149062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.149779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.150225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.150672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.345991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:30.354621 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9bfa241-27db-400f-83e3-16b82d968d5b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.218909 Sep 16 13:56:30.355234 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 475/943] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:30 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:30.508728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:30.509295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:30.515918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.516479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.517069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.518010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.518652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.519281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.537473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:30.538545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:30.546790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.547297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.547830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.548560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.549018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.549443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.768115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:30.779187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:30.782284 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71bfc491-894c-48e3-ace7-9f8b940a21d4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.277871 Sep 16 13:56:30.783333 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 469/944] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:30 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:30.791042 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df3e74e6-91c0-42ed-92d7-3b2bb0a3c1af tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.260396 Sep 16 13:56:30.806719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 476/945] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:30 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:30.807001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:30.807001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:30.807317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:30.807317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:30.811384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.812495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.813502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.814718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.815464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.816049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.817221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.818112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.818959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:30.820434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:30.821323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:30.822465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.047604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:31.054780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:31.060660 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4b1a9d6-28fa-44ea-8f18-7e8bc167bf23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.275699 Sep 16 13:56:31.061649 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 470/946] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:30 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:31.070062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:31.070571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:31.071306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:31.073175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:31.075409 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb49caf7-79ff-416b-8cde-4e0998b6e9b8 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.281873 Sep 16 13:56:31.076513 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 477/947] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:30 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:31.082624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.083507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.084309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.085681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.086569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.087354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.286695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:31.301564 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9d6663d-2b9b-4e14-b9c2-704123118cf0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.238075 Sep 16 13:56:31.302664 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 471/948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:31 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:31.380578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:31.381350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:31.388201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.388738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.389221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.389969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.390500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.391018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.535564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:31.546174 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-361fe616-8f99-43a5-8828-521865d2f564 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.169570 Sep 16 13:56:31.546790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 478/949] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:31 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:31.825677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:31.826736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:31.831402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:31.832840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:31.836765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.837460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.838064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.838895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.839119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.839382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.839550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.839810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.840131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:31.840513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:31.840962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:31.841379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.091585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.095096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.106364 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-51f808f8-29ad-460b-b9c3-5a64fe3a1c41 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.278491 Sep 16 13:56:32.106866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bee8a579-585c-47ba-818b-9bd15c95a087 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.288494 Sep 16 13:56:32.107717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 472/950] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:31 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:32.113254 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 479/951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:31 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:32.123942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:32.125392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:32.130894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:32.131656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:32.138232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.138727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.139242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.139549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.139754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.140563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.141201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.141707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.142161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.142348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.143341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.144234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.406814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.415895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88fc9bcd-d414-4557-adee-0a605dbb73d5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.292732 Sep 16 13:56:32.416500 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 473/952] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:32 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:32.421207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c257dc39-554e-4c0a-b8b5-8212f4c57814 req-9fd5d515-ccb4-460d-b74c-b57339c99d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5508ca6-96e8-447b-9bfd-6ce805d6418f", "name": "network-vif-plugged", "status": "completed", "tag": "ebcf9954-db11-4079-925a-2c4309e336c9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:32.423525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.431798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c257dc39-554e-4c0a-b8b5-8212f4c57814 req-9fd5d515-ccb4-460d-b74c-b57339c99d88 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.432276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c257dc39-554e-4c0a-b8b5-8212f4c57814 req-9fd5d515-ccb4-460d-b74c-b57339c99d88 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.432898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c257dc39-554e-4c0a-b8b5-8212f4c57814 req-9fd5d515-ccb4-460d-b74c-b57339c99d88 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.441298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.445820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.446107 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c257dc39-554e-4c0a-b8b5-8212f4c57814 req-9fd5d515-ccb4-460d-b74c-b57339c99d88 service nova] Creating event network-vif-plugged:ebcf9954-db11-4079-925a-2c4309e336c9 for instance e5508ca6-96e8-447b-9bfd-6ce805d6418f on n-h2-858129-2 Sep 16 13:56:32.447415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05838666-6c45-4291-80b2-d1e657d505a5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.332289 Sep 16 13:56:32.448206 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 480/953] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:32 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:32.452163 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c257dc39-554e-4c0a-b8b5-8212f4c57814 req-9fd5d515-ccb4-460d-b74c-b57339c99d88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034254 Sep 16 13:56:32.454310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:32.454893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 474/954] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:32.455403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:32.463085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.463563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.463997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.464722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.465175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.465602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.573548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:32.574348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:32.581366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.581862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.582293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.583057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:32.583514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:32.583933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:32.617130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.626666 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b3522b2-d8e5-41ba-acaf-cb9cbe491abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.176951 Sep 16 13:56:32.627276 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 481/955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:32 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:32.734393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:32.743657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d55895d-5679-4bfb-a6f4-c5609d107a21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.175064 Sep 16 13:56:32.744366 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 475/956] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:32 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:33.139513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:33.140589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:33.141265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:33.141559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:33.149062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.149723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.150219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.151050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.151254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.151693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.151872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.152248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.152422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.153277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.153844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.154363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.160698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:33.397199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:33.402580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:33.410527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db6113f7-bda1-4fda-8ba2-b615960b2fd2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.273784 Sep 16 13:56:33.411496 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 476/957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:33 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:33.418279 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d24dae8-3779-4e29-acd7-a9fbf63655e6 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.283452 Sep 16 13:56:33.419759 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 482/958] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:33 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:33.453262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:33.453875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:33.460975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.461466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.461894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.462658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.463117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.463545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.481576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:33.482641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:33.493609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.494625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.495650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.496560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.497077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.497544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.680441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:33.696209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79cdd7f8-1141-4b03-988e-dfd5d182e927 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.246366 Sep 16 13:56:33.697494 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 477/959] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:33 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:33.706448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:33.707628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:33.719452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.720369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.721180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.722612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.723388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.724175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.731968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:33.740814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:33.742319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:33.743587 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-20f82a30-2115-46d6-8c5f-567cec1d6d4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.272218 Sep 16 13:56:33.744166 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 483/960] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:33 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:33.769190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:33.769957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:33.777241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.777729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.778162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:33.778907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:33.779360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:33.779787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.042589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:34.058848 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df3c632c-35d1-414f-af26-076dbea4a286 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.358943 Sep 16 13:56:34.063014 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 478/961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:33 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:34.064583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:34.083078 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7e9f32e-2507-4591-a5e1-1d044c9c0d0f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.316921 Sep 16 13:56:34.084870 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 484/962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:33 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:34.452467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:34.453384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:34.453976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:34.454203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:34.460765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.461256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.461695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.462435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.462900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.463063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.463315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.463456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.463832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.464559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.465019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.465451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.691263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:34.705583 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d256fcc6-436f-4c2a-830b-b348f30e3154 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.260451 Sep 16 13:56:34.718438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:34.719253 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 479/963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:34 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:34.722142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3a2f7622-d673-4884-b8be-9ff8206cf08c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.273644 Sep 16 13:56:34.723809 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 485/964] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:34 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:34.734237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:34.735328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:34.746315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.747294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.747974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.748968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.749688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.750598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.776446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:34.778203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:34.787078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.787963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.789133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:34.790219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:34.792221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:34.793180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.267331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:35.281686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02f09836-19cf-4be8-a170-f7e1ca998c2f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.552153 Sep 16 13:56:35.289258 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 480/965] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:34 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:35.313187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:35.313817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:35.315867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:35.321792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.322300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.323762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.323762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.324103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.324462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.402391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:35.411824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:35.413848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:35.415350 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-24f4bbbe-d186-4b44-8f33-258af36ee462 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.646556 Sep 16 13:56:35.415928 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 486/966] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:34 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:35.420870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:35.421802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:35.429145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.429915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.430598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.431501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.432132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.432743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.942448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:35.949991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:35.952357 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2171f30-8b62-494b-b378-9648dba74676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.661822 Sep 16 13:56:35.953053 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 481/967] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:35 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:35.959623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:35.961169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:35.965713 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f697775-a9dd-4a4e-a8b4-6e06be92de69 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1543 microversion: 2.1 time: 0.548145 Sep 16 13:56:35.966916 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 487/968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:35 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1543 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:35.971374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.972286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.973128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.974508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.975739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.976593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:35.977341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.977967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:35.988995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.989840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.990593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:35.991854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:35.992657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:35.993383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:36.327520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:36.333208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:36.341919 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-247063ef-382f-4a00-9fb3-a6bd041071cb tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.387217 Sep 16 13:56:36.343331 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 482/969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:35 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:36.348005 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-897e00af-c07a-4145-a0a6-22ea1a88f8af tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.378994 Sep 16 13:56:36.349221 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 488/970] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:35 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:36.359811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:36.360432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:36.368248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:36.368737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:36.369223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:36.370242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:36.370810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:36.371235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:36.449030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:36.449682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:36.456548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:36.457141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:36.457667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:36.458456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:36.458928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:36.459444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:36.642769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:36.656067 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e31aa830-ea6f-4e74-b8db-84b476079fcc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.307036 Sep 16 13:56:36.657594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 483/971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:36 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:36.702687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:36.711863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:36.713357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:36.714694 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4793bd3-187c-4880-aea0-40a4059efd0a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.271517 Sep 16 13:56:36.715270 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 489/972] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:36 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:36.977413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:36.978428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:36.986313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:36.987004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:36.987553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:36.988390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:36.989103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:36.989656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.006680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:37.008406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:37.017697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.018322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.018839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.019578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.020297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.020932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.246082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:37.256559 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df70dc89-7bea-4847-a01a-3a90a3adec3f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.283259 Sep 16 13:56:37.257393 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 484/973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:36 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:37.263704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8691d5e9-c3ec-4338-bbdb-8a82b98f5100 req-632bf3f8-9d92-4962-a385-b8b2e5e8a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074e9fe3-9449-49c8-9153-0999ee84f2a3", "name": "network-vif-plugged", "status": "completed", "tag": "f47e6241-6644-4a56-b0dd-ffda96bd59f2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:37.270196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:37.277778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:37.281073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8691d5e9-c3ec-4338-bbdb-8a82b98f5100 req-632bf3f8-9d92-4962-a385-b8b2e5e8a946 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.281937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8691d5e9-c3ec-4338-bbdb-8a82b98f5100 req-632bf3f8-9d92-4962-a385-b8b2e5e8a946 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.282751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8691d5e9-c3ec-4338-bbdb-8a82b98f5100 req-632bf3f8-9d92-4962-a385-b8b2e5e8a946 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.292235 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a3be9951-4a70-4a9c-9aae-0610a060380f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1542 microversion: 2.1 time: 0.289529 Sep 16 13:56:37.293568 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 490/974] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:37 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1542 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:37.314013 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8691d5e9-c3ec-4338-bbdb-8a82b98f5100 req-632bf3f8-9d92-4962-a385-b8b2e5e8a946 service nova] Creating event network-vif-plugged:f47e6241-6644-4a56-b0dd-ffda96bd59f2 for instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 on n-h2-858129-2 Sep 16 13:56:37.328165 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8691d5e9-c3ec-4338-bbdb-8a82b98f5100 req-632bf3f8-9d92-4962-a385-b8b2e5e8a946 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068496 Sep 16 13:56:37.336792 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 485/975] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:37.383501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:37.385017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:37.388317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:37.389868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:37.395458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.396344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.397003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.398605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.399455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.400194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.402911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.403927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.404838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.406322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.407206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.408012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.867629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:37.872116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:37.880532 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-457f4611-09dc-4794-9d7c-9fa141b3dbc5 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1395 microversion: 2.1 time: 0.502288 Sep 16 13:56:37.881142 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 486/976] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:37 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1395 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:37.882194 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8839d7b2-f788-47b1-8837-a6a2f76d1a8a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.504341 Sep 16 13:56:37.883865 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 491/977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:37 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:37.887225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:37.888773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:37.895413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.895940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:37.896488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.897100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.897664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:37.898425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.899078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.899753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.910467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.911502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.912365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:37.913760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:37.914700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:37.915457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.142315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:38.153356 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b66c3d2-19f5-45c6-a275-629e5c3090e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.271091 Sep 16 13:56:38.160546 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 487/978] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:37 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:38.175283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:38.200203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:38.206897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:38.210356 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-280ec4b5-40da-4da9-a32f-a4bc0865317e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.324421 Sep 16 13:56:38.211807 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 492/979] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:37 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:38.303285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:38.306665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:38.323236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.324139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.326019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.326913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.327946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.328719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.337505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:38.340328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:38.352338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.353544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.354807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.356549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.357664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.358321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.671448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:38.683614 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae950e77-50c3-49e8-947f-34d060a9b0bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.388197 Sep 16 13:56:38.684401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 488/980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:38 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:38.709418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:38.718334 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-856c763c-b407-4a13-b24a-68bccd865022 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1542 microversion: 2.1 time: 0.389367 Sep 16 13:56:38.718969 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 493/981] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:38 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1542 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:38.917357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:38.917989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:38.925261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.925765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.926316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.926580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:38.927119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.927626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.928209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:38.928351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.940302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.941147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.941956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:38.943265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:38.944113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:38.944867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.444158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:39.458041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:39.459766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-944eeacc-42f3-47c0-817e-3a72d62cf016 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1576 microversion: 2.1 time: 0.546950 Sep 16 13:56:39.461608 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 489/982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:38 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1576 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:39.472870 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-121f37db-a66a-4e3f-8883-990b1267a521 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.553995 Sep 16 13:56:39.486446 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 494/983] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:38 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:39.486446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:39.486446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:39.497339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.498107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.498827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.500364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.500567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:39.501277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:39.501690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.502484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.510290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.510943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.511406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.512164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.512635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.513066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.847763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:39.857330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:39.885487 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dd8d2640-fbc9-49d0-8b57-21d24e8b79bc tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.408847 Sep 16 13:56:39.887435 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 490/984] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:39 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:39.896543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:39.898441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:39.903852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:39.911814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.913205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.914504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.915037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:39.917872 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd92ef70-8a4d-46f8-a2c4-7ab78728f5bb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.439627 Sep 16 13:56:39.918062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.918798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.919553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.923603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 495/985] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:39 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:39.937296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:39.938747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:39.951376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.952257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.952903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:39.953950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:39.954731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:39.958115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.090720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca70098d-bc2a-4c89-b6cc-5a1b92ed6ee8 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201097 Sep 16 13:56:40.091878 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 491/986] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 13:56:39 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:40.102266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:40.103273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:40.120240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.121447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.122480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.124321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.125303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.126254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.368221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:40.378162 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06ffd189-2a5b-4e6d-b90e-816bb54542b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.452841 Sep 16 13:56:40.379196 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 496/987] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:39 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:40.441057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:40.453180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-447270d0-9339-49d9-897c-2c608b04c081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1542 microversion: 2.1 time: 0.359788 Sep 16 13:56:40.453950 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 492/988] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:40 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1542 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:40.504259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:40.505208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:40.515281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.516173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.517015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.518379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.519296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.520068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.749385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:40.761152 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5fb4eb6-95a7-42cf-a975-fac6f1960d3a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.261029 Sep 16 13:56:40.761954 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 497/989] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:40 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:40.915824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:40.917528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:40.932321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.933649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.934628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.936268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.937400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.938325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.976986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:40.978807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:40.993802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.995406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:40.996605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:40.998484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:40.999665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.001559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.221308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:41.225849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:41.238874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4d6be64-1a04-49f4-a0f3-da435d95663c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.330464 Sep 16 13:56:41.249294 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 493/990] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:40 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:41.250373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a526b21-b479-4b47-a733-3a9757f8c368", "name": "network-vif-unplugged", "status": "completed", "tag": "76355775-4b09-4831-b8c9-526859e22a89"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:41.263171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:41.272682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.273730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.274669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.275810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:41.277326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:41.278633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6cf72e00-3cd6-4af4-8af6-1daa260ed28c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.311846 Sep 16 13:56:41.279802 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 498/991] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:40 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:41.308805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] Creating event network-vif-unplugged:76355775-4b09-4831-b8c9-526859e22a89 for instance 0a526b21-b479-4b47-a733-3a9757f8c368 on n-h2-858129-2 Sep 16 13:56:41.318443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] Instance 0a526b21-b479-4b47-a733-3a9757f8c368 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:56:41.326088 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-380be7d6-85a8-4c25-a9b5-c607872c936e req-e3d89125-7d3e-485a-9901-b4ae96830271 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083452 Sep 16 13:56:41.329223 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 494/992] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:41.422595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:41.423716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:41.434868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.435604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.436384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.437699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.438547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.439298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.478967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:41.479873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:41.490218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.490891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.491346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.493736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.493736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.493736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.684532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:41.701688 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1b85aad6-a9b0-4f9b-9de4-c85caac0c50b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.285831 Sep 16 13:56:41.702822 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 499/993] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:41 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:41.712780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:41.713890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:41.723208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.724003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.724614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.725611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.726898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.727564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.734643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:41.752550 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5583a3c4-34de-4708-8add-b4bedec00ff4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1542 microversion: 2.1 time: 0.278657 Sep 16 13:56:41.760649 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 495/994] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:41 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1542 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:41.774328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6eb136a4-7e7a-4561-95f2-304fab3532c0 req-e915a002-a2d3-4125-b812-30cbad0e354f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5508ca6-96e8-447b-9bfd-6ce805d6418f", "tag": "ebcf9954-db11-4079-925a-2c4309e336c9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:41.786586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6eb136a4-7e7a-4561-95f2-304fab3532c0 req-e915a002-a2d3-4125-b812-30cbad0e354f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.787252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6eb136a4-7e7a-4561-95f2-304fab3532c0 req-e915a002-a2d3-4125-b812-30cbad0e354f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.787884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6eb136a4-7e7a-4561-95f2-304fab3532c0 req-e915a002-a2d3-4125-b812-30cbad0e354f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.803887 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6eb136a4-7e7a-4561-95f2-304fab3532c0 req-e915a002-a2d3-4125-b812-30cbad0e354f service nova] Creating event network-changed:ebcf9954-db11-4079-925a-2c4309e336c9 for instance e5508ca6-96e8-447b-9bfd-6ce805d6418f on n-h2-858129-2 Sep 16 13:56:41.809759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6eb136a4-7e7a-4561-95f2-304fab3532c0 req-e915a002-a2d3-4125-b812-30cbad0e354f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046657 Sep 16 13:56:41.810281 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 496/995] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:41.816078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:41.816734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:41.824173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.824677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.825118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:41.825869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:41.826346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:41.826819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.051575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:42.061443 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d7e2ba41-3394-4049-aaaa-7d7417ab5c2c tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1576 microversion: 2.1 time: 0.356684 Sep 16 13:56:42.061900 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 500/996] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:41 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1576 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:42.107963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:42.118053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cb6765c-ccc7-459c-abb1-deba31d50859 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.306460 Sep 16 13:56:42.118866 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 497/997] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:41 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:42.279822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:42.280457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:42.287399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.288784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.289226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.289980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.290449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.290887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.323230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:42.324629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:42.335262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.336512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.337316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.338651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.339496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.340297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.549140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:42.562703 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f62346d8-7109-46f8-8a27-b561b7d10655 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.286688 Sep 16 13:56:42.563521 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 501/998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:42 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:42.567241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:42.584109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:42.587968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:42.590303 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cacb728b-b561-4669-b653-a783e8046c20 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.273731 Sep 16 13:56:42.591473 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 498/999] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:42 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:42.742054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:42.742866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:42.751573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.752073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.752510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.753230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.753682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.754114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.792549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:42.793377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:42.800576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.801066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.801498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:42.802224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:42.802719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:42.803300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.016489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.032265 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3043b724-81fd-4626-a0b5-15be13528400 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.295310 Sep 16 13:56:43.033367 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 502/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:42 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:43.047031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.062690 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8541db10-fbc7-4c31-bf3b-d8f5565eefb7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1542 microversion: 2.1 time: 0.275824 Sep 16 13:56:43.063463 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 499/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:42 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1542 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:43.162054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:43.163986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:43.175030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:43.175889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:43.176664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.178159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:43.179297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:43.180040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.333423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.342196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00db0e69-8df6-4655-8f4c-2d344e6236e9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.188844 Sep 16 13:56:43.342836 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 503/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:43 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:43.602152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:43.602859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:43.609425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:43.609927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:43.610363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.611121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:43.611581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:43.612013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.637050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:43.637667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:43.645217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:43.645860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:43.646434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.647261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:43.648445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:43.649026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:43.847856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.858305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.860436 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6c50e3c-0078-4b95-9ae2-77a2a73d8586 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1319 microversion: 2.1 time: 0.262302 Sep 16 13:56:43.861384 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 500/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:43 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:43.870503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.872236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:43.873544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fbd0f307-eec1-4478-9b39-34721b69fabd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.241459 Sep 16 13:56:43.874250 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 504/1004] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:43 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:44.070205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:44.070869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:44.078150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.078672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.079113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.079833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.080296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.080718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.097413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:44.098344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:44.108874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.109622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.110380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.111696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.112587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.113356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.287864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:44.301502 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5382f963-dce4-4126-95b1-520a117551e6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.234434 Sep 16 13:56:44.306737 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 501/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:44 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:44.333809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:44.348197 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7940f64a-22d2-4f29-bd21-225bf4e4362b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1542 microversion: 2.1 time: 0.254525 Sep 16 13:56:44.349376 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 505/1006] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:44 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1542 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:44.367942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:44.368732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:44.376213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.376809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.377266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.377961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.378441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.379114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.886759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:44.887668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:44.896199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.897120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.898157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:44.899079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:44.899751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:44.900178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:45.011609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:45.022926 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c8ce6a2-1134-404f-9d84-d2748be4c904 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.659369 Sep 16 13:56:45.034543 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 502/1007] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:44 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:45.045638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:45.046354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:45.056167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:45.056654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:45.057326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:45.058061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:45.058549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:45.059051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:45.449606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:45.473617 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b4b6995-75a2-4645-a28e-c3546d254af5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1469 microversion: 2.1 time: 0.592003 Sep 16 13:56:45.490439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 506/1008] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:44 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:45.490439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:45.490439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:45.490439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:45.490439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:45.491974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:45.492332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:45.493105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:45.493593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:45.503154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:45.530606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:45.534306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:45.537105 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5cfe927-677b-4bbd-bc4c-ab01d9f31bab tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.500641 Sep 16 13:56:45.538879 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 503/1009] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:45 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:45.546557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:45.548740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:45.550351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:45.565564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:45.566737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:45.567682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:45.569000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:45.570607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:45.575843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.011034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:46.019345 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-387be807-654b-4760-a1f0-919334056134 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.541642 Sep 16 13:56:46.019958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 507/1010] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:45 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:46.024805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:46.030698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:46.031256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Searching by: {'reservation_id': 'r-8ctivwq1', 'deleted': False, 'project_id': 'da29b469d8554f0993b35628a9a05d89'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:56:46.037986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.037986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.039004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.039432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.039894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.040321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.075003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:46.086341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-884084d8-76f1-4de0-b37a-f194d4278ce0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1474 microversion: 2.1 time: 0.545428 Sep 16 13:56:46.087046 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 504/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:45 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1474 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:46.093156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:46.094136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:46.102546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.103578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.104007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.104802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.105271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.105703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.197733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:56:46.308005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:46.319930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.322077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.323299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.627830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:46.636723 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59954a68-b256-42a8-927c-6bc05e03793c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.548683 Sep 16 13:56:46.637423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 505/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:46 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:46.642457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-eb941c0b-18b2-4af9-ad6e-cb47d9da4c7c req-4fa283d2-3967-47fd-a337-58533352499f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d670bb-8f4c-42da-9277-256a3d31ecca", "name": "network-vif-unplugged", "status": "completed", "tag": "2a647267-4c40-4719-85cd-866bc9adb22d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:46.653116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb941c0b-18b2-4af9-ad6e-cb47d9da4c7c req-4fa283d2-3967-47fd-a337-58533352499f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.653732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb941c0b-18b2-4af9-ad6e-cb47d9da4c7c req-4fa283d2-3967-47fd-a337-58533352499f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.654249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb941c0b-18b2-4af9-ad6e-cb47d9da4c7c req-4fa283d2-3967-47fd-a337-58533352499f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.668051 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-eb941c0b-18b2-4af9-ad6e-cb47d9da4c7c req-4fa283d2-3967-47fd-a337-58533352499f service nova] Creating event network-vif-unplugged:2a647267-4c40-4719-85cd-866bc9adb22d for instance a0d670bb-8f4c-42da-9277-256a3d31ecca on n-h1-858129-2 Sep 16 13:56:46.673639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-eb941c0b-18b2-4af9-ad6e-cb47d9da4c7c req-4fa283d2-3967-47fd-a337-58533352499f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034887 Sep 16 13:56:46.674365 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 506/1013] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:46.680498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:46.681218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:46.687916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.688408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.688862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.689567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.690035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.690482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.744821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce77ad05-0959-4771-b3c9-00d4de119242 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-8ctivwq1" status: 200 len: 2931 microversion: 2.1 time: 0.723765 Sep 16 13:56:46.745723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 508/1014] 10.222.0.60 () {58 vars in 1197 bytes} [Fri Sep 16 13:56:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8ctivwq1 => generated 2931 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:46.770360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab715ec2-d1e4-4108-95aa-bb427d0d1590 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:46.787027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.server_groups [None req-ab715ec2-d1e4-4108-95aa-bb427d0d1590 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Querying cell 08ea4950-b373-4785-aced-301964963f98(cell1) for 2 instances {{(pid=128643) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 13:56:46.787971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab715ec2-d1e4-4108-95aa-bb427d0d1590 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.788977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab715ec2-d1e4-4108-95aa-bb427d0d1590 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.789414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab715ec2-d1e4-4108-95aa-bb427d0d1590 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.816336 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab715ec2-d1e4-4108-95aa-bb427d0d1590 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/4c6193b7-737c-4cb7-9549-4193f760d81f" status: 200 len: 270 microversion: 2.1 time: 0.049665 Sep 16 13:56:46.817479 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 509/1015] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:56:46 2022] GET /compute/v2.1/os-server-groups/4c6193b7-737c-4cb7-9549-4193f760d81f => generated 270 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:56:46.830461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:46.831444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:46.838960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.839372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.839887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:46.840700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:46.841233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:46.841746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.042176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:47.051677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:47.053206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:47.054835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7e8b13b-8ce8-4753-97bd-be9e70166313 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.378937 Sep 16 13:56:47.055403 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 507/1016] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:46 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:47.070664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:47.070664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:47.070664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.071372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.071372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.072039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.072759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.073196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.313907 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-db0cdf63-0f26-4ba8-8d97-eb43453bbbc5 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1620 microversion: 2.1 time: 0.488560 Sep 16 13:56:47.314694 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 510/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:46 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1620 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:47.320129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:47.320982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:47.329449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.330012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.330611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.331515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.332081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.332611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.454703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:47.465113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a197dad-e8f8-49d4-a2c0-ae5ab2b620b3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.408676 Sep 16 13:56:47.465882 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 508/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:47 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:47.472347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:47.473290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:47.481961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.482729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.483318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.484450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.485501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.486170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.542145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:47.563011 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-648d8d21-0212-484c-beaa-b84e315a1839 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1474 microversion: 2.1 time: 0.246387 Sep 16 13:56:47.564533 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 511/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:47 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1474 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:47.674665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:47.676246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:47.686785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.687414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.688020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.689213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:47.689899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:47.690519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:47.727965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8161cb02-4b33-4552-9ee9-133196f26b5f tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1620 microversion: 2.1 time: 0.260365 Sep 16 13:56:47.728996 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 509/1020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:47 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1620 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:47.873763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1903022886", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f6ba0e96-0970-4dbb-b9cc-a082824df96f"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:47.895134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:47.909360 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2404132c-76f9-45dd-b63e-ce13417d4017 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.243860 Sep 16 13:56:47.910304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 512/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:47 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:47.967604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:56:48.093543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:48.094458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:48.098849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:48.107606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.108557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.109359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.110715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.112052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.113063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.401913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:56:48.402619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:56:48.403359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:56:48.403885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:56:48.404489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:56:48.417559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.418198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.418883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.419760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.420363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.421057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.441902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:48.449300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:48.454015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:48.465628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:56:48.467902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:48.471373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:56:48.471918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:48.474218 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e0dd710-352d-4997-ab64-7bc87a499a1a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.388585 Sep 16 13:56:48.483711 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 513/1022] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:48 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:48.494658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-193704f1-2d24-458f-9c09-0edcf1c971a0 req-2767b441-6e6f-4776-ba62-4d3106e7f374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cdbfcc-18c8-4219-9fb2-c40f4517a561", "name": "network-vif-plugged", "status": "completed", "tag": "38c9b12a-5066-4ee6-baea-15e720a6984a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:48.512518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-193704f1-2d24-458f-9c09-0edcf1c971a0 req-2767b441-6e6f-4776-ba62-4d3106e7f374 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.513220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-193704f1-2d24-458f-9c09-0edcf1c971a0 req-2767b441-6e6f-4776-ba62-4d3106e7f374 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.513882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-193704f1-2d24-458f-9c09-0edcf1c971a0 req-2767b441-6e6f-4776-ba62-4d3106e7f374 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.522358 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29a8cca9-1493-4b5d-80b3-0b7da7691da2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657413 Sep 16 13:56:48.523681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 510/1023] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:56:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:56:48.528768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:48.529402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:48.536593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.537153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.537599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.537906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-193704f1-2d24-458f-9c09-0edcf1c971a0 req-2767b441-6e6f-4776-ba62-4d3106e7f374 service nova] Creating event network-vif-plugged:38c9b12a-5066-4ee6-baea-15e720a6984a for instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 on n-h2-858129-2 Sep 16 13:56:48.538946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.539407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.539847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.548321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-193704f1-2d24-458f-9c09-0edcf1c971a0 req-2767b441-6e6f-4776-ba62-4d3106e7f374 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062322 Sep 16 13:56:48.550216 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 514/1024] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:48.566583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ecd44edf-14fc-4c7a-9045-6145996da5e2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:48.567660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ecd44edf-14fc-4c7a-9045-6145996da5e2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:48.693393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ecd44edf-14fc-4c7a-9045-6145996da5e2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:48.704643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ecd44edf-14fc-4c7a-9045-6145996da5e2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1217 microversion: 2.1 time: 0.151848 Sep 16 13:56:48.714817 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 515/1025] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:48 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:48.723340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:48.724476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:48.736044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.736850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.737558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.738804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.739619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.740454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.848518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:48.860533 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3e4c6e7-cb12-4a8a-9147-90587e253da9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.335640 Sep 16 13:56:48.862140 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 511/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:48 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:48.887220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-81e3b42a-d7f2-4987-b7f4-5ea26b1a7e40 req-3001a6dc-eeec-4179-adb0-785d89011680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d670bb-8f4c-42da-9277-256a3d31ecca", "tag": "2a647267-4c40-4719-85cd-866bc9adb22d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:48.906502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81e3b42a-d7f2-4987-b7f4-5ea26b1a7e40 req-3001a6dc-eeec-4179-adb0-785d89011680 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.907819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81e3b42a-d7f2-4987-b7f4-5ea26b1a7e40 req-3001a6dc-eeec-4179-adb0-785d89011680 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.908951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81e3b42a-d7f2-4987-b7f4-5ea26b1a7e40 req-3001a6dc-eeec-4179-adb0-785d89011680 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.940904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-81e3b42a-d7f2-4987-b7f4-5ea26b1a7e40 req-3001a6dc-eeec-4179-adb0-785d89011680 service nova] Creating event network-changed:2a647267-4c40-4719-85cd-866bc9adb22d for instance a0d670bb-8f4c-42da-9277-256a3d31ecca on n-h1-858129-2 Sep 16 13:56:48.948481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-81e3b42a-d7f2-4987-b7f4-5ea26b1a7e40 req-3001a6dc-eeec-4179-adb0-785d89011680 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084172 Sep 16 13:56:48.949492 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 512/1027] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:48.955519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:48.956232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:48.963873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.964546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.964999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.966152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:48.966669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:48.967114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:48.987766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:49.050292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:49.093726 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81e4bdd8-021e-481b-9651-9a5bbed10aa8 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1474 microversion: 2.1 time: 0.376470 Sep 16 13:56:49.095977 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 516/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:48 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:49.197414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:49.207038 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d37023c0-8ba3-4c50-8d5f-70cdd44dbb1f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.255617 Sep 16 13:56:49.207614 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 513/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:48 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:49.515985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:49.517029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:49.529610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:49.530216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:49.531043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:49.532330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:49.533038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:49.533734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:49.741353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:49.743149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:49.752712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:49.753556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:49.755484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:49.758258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:49.759078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:49.759834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:49.767503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:49.795156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:49.797815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:49.799229 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-625c9ac1-9079-4e15-9453-cce64db58b9c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.290370 Sep 16 13:56:49.800050 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 517/1030] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:49 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:49.860964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:49.869885 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f50f21c8-0ed4-4014-9c10-3805d308d319 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1269 microversion: 2.1 time: 0.136092 Sep 16 13:56:49.871091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 514/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:49 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1269 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:49.901153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:49.902435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:49.916214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:49.916706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:49.917137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:49.917856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:49.918309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:49.918767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.092248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:50.100548 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abec8cbe-f95b-4237-86bd-620881eabf01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.206887 Sep 16 13:56:50.101182 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 518/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:49 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:50.122352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:50.128493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:50.137153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.137842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.138325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.139334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.139929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.140367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.248558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:50.249196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:50.257663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.258055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.258899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.259639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.260103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.260618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.433881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:50.457617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f24810a-25af-4255-803d-6a1e77421f6e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1474 microversion: 2.1 time: 0.342630 Sep 16 13:56:50.459033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 515/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:50 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:50.536420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:50.545799 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ff37e246-322b-4110-9837-84dc946704b9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.301680 Sep 16 13:56:50.546420 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 519/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:50 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:50.827632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:50.828356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:50.835968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.836495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.837030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.837750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.838242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.838702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.899963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:50.900896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:50.909794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.910656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.911249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:50.912162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:50.912772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:50.913984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.026867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.049913 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e1ba2f5-a233-4e0b-8a90-5f559d998338 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1277 microversion: 2.1 time: 0.155708 Sep 16 13:56:51.062638 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 520/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:50 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:51.065172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.077355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.079239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.080460 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-428498c6-3157-4bf3-8ed7-76fccaf4970b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.257023 Sep 16 13:56:51.090847 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 516/1036] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:50 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:51.127926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:51.129283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:51.140994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.141523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.141961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.142728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.143191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.143621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.324573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.333478 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62b59645-bcca-4d13-929b-a9eaa9408ef4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.209606 Sep 16 13:56:51.334376 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 521/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:51 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:51.481770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:51.482595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:51.489113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.489623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.490061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.490823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.491294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.492295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.579916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:51.582310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:51.597601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.598563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.599723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.601886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.603084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.603879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.714221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.729067 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7003df94-59d2-42f1-a941-098c21a0cb26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1471 microversion: 2.1 time: 0.251137 Sep 16 13:56:51.739729 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 517/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:51 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:51.777141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:51.778061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:51.791913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.793703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.794987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.797384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.798566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.798930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.853699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:51.871815 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba20e676-fd79-46d9-8279-af9b927cffd0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.302033 Sep 16 13:56:51.873127 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 522/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:51 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:51.939455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.940338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.941355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.942952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:51.943808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:51.945192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:51.993952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for project c67843449c98450aa14d5889893ceeb4. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:56:52.021785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for user ae208d89fa7549198ef91ef307464763 and project c67843449c98450aa14d5889893ceeb4. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:56:52.064762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:52.085080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:52.085887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:52.103158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.103999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.104653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.110740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.111652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.112421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.344984 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-721c6a15-ac98-458b-96d6-7af220658c98 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368/action" status: 202 len: 0 microversion: 2.1 time: 0.574540 Sep 16 13:56:52.347344 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 518/1040] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:56:51 2022] POST /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:56:52.360346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:52.361657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:52.374088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.374752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.376162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.377677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.378778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.379699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.446387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:52.463770 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abbf7d61-afd7-4ea2-a874-eb95d624e734 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.385788 Sep 16 13:56:52.479275 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 523/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:52 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:52.510648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:52.512303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:52.526482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.527691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.528459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.530042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.530903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.531910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.653031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:52.662277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:52.664878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:52.666853 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-145d83c4-7247-4f6b-90ee-eb439cb356f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.317933 Sep 16 13:56:52.668248 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 519/1042] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:52 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:52.686606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:52.687640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:52.697064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.698064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.700473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.701450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.704080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.705364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.901206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:52.912865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad761173-24ee-409f-a99c-7ef98aecaa11 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1470 microversion: 2.1 time: 0.431238 Sep 16 13:56:52.926777 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 524/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:52 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:52.926777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:52.926777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:52.928482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.938541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.938541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.938541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:52.938541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:52.939279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:52.971700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:53.018555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:53.034032 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c1d4ec8-5981-451d-851b-3dfc9b6eda6b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.363783 Sep 16 13:56:53.046435 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 520/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:52 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:53.199120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:53.215575 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b92ad5d5-163b-45e7-b0a3-0257c2522c0a tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.300596 Sep 16 13:56:53.229677 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 525/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:52 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:53.518248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:53.519411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:53.532098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.532986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.533750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.536845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.537713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.539020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.662498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0059d795-f1f1-4ac6-9eec-63830efed6e7 req-536de210-c93f-4e3e-a681-6469738a2daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796a1baf-9191-4ca2-8cec-9e192862f096", "tag": "8e788933-5986-4bfa-a679-8708c1a86579"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:53.682587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0059d795-f1f1-4ac6-9eec-63830efed6e7 req-536de210-c93f-4e3e-a681-6469738a2daf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.683084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0059d795-f1f1-4ac6-9eec-63830efed6e7 req-536de210-c93f-4e3e-a681-6469738a2daf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.683515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0059d795-f1f1-4ac6-9eec-63830efed6e7 req-536de210-c93f-4e3e-a681-6469738a2daf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.698196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0059d795-f1f1-4ac6-9eec-63830efed6e7 req-536de210-c93f-4e3e-a681-6469738a2daf service nova] Creating event network-changed:8e788933-5986-4bfa-a679-8708c1a86579 for instance 796a1baf-9191-4ca2-8cec-9e192862f096 on n-h1-858129-2 Sep 16 13:56:53.704187 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0059d795-f1f1-4ac6-9eec-63830efed6e7 req-536de210-c93f-4e3e-a681-6469738a2daf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053264 Sep 16 13:56:53.705660 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 526/1046] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:56:53.715799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:53.716528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:53.723632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.725044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.725872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.727214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.727913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.728929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.866253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:53.879300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e3bcf5a-ef96-4727-967a-b65475139509 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.368381 Sep 16 13:56:53.880080 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 521/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:53 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:53.962074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:53.963618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:53.976642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.977940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.982924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.983199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:53.983900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:53.984288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:53.984736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:53.998695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:54.002002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:54.004083 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a37b73b5-df22-4030-adbf-2d04f6aaeef9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.293909 Sep 16 13:56:54.005295 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 527/1048] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:53 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:54.073070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:54.074213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:54.084942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:54.086453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:54.087249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:54.088541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:54.089373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:54.090128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:54.156677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:54.165193 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1dde826-84c5-476d-824d-599f035da30d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1470 microversion: 2.1 time: 0.210549 Sep 16 13:56:54.166466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 522/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:53 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:54.264796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:54.265767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:54.276411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:54.277804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:54.278306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:54.279318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:54.280667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:54.281498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:54.297824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:54.306768 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-127cea22-3a94-4052-82d8-3a7e84751129 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1308 microversion: 2.1 time: 0.241438 Sep 16 13:56:54.307702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 528/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:54 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:54.487674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:54.497002 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c37188f-d78e-4d1e-8323-d59ec11c90bd tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.240968 Sep 16 13:56:54.497604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 523/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:54 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:54.903754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:54.904385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:54.911297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:54.911801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:54.912241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:54.912960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:54.913454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:54.913876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.050773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.052141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.064104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.065007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.065782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.067102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.067847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.068534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.068698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.079523 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e871a21b-634c-45f8-9d2b-9df112a4292b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.179471 Sep 16 13:56:55.080135 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 529/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:54 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:55.197895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.198566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.205972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.206491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.206953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.207680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.208143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.208671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.332856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.344091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.345629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.346937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6bba98e4-e4d7-4ce6-9c5a-8afe6fc0d855 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.303778 Sep 16 13:56:55.357396 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 524/1053] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:55 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:55.372372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.373509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.385804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.386758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.387725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.389049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.390449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.391061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.442284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.458890 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-10c4eebe-96c2-4427-b851-8e20221a8f76 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1470 microversion: 2.1 time: 0.264757 Sep 16 13:56:55.460763 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 530/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:55 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:55.523391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.524021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.531083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.531670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.532112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.532890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.533329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.534047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.594064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.604213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a7794306-5351-41e8-88e5-1c98f5a20f8a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1488 microversion: 2.1 time: 0.242573 Sep 16 13:56:55.605081 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 525/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:55 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1488 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:55.614332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.615480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.628964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.629920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.631553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.632609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.633493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.634522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.668601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:56:55.683999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:55.744859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:55.753679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7382801-11f0-4424-a566-22b81952ec8f tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.234185 Sep 16 13:56:55.754536 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 531/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:55 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:55.759293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:56:55.759830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.767804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.768344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.768823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.769527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.770009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.770453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.773427 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efe7c635-dc47-4001-807b-9eb985208de7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 204 len: 0 microversion: 2.1 time: 0.166082 Sep 16 13:56:55.774578 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 526/1057] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:56:55 2022] DELETE /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:56:55.787965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.790011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.798849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.799832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.800702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.805210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.805210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.805210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.882571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69d5e8cc-f8fd-4f53-b413-7ce3fc6b65d4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561/action" status: 202 len: 0 microversion: 2.1 time: 0.126451 Sep 16 13:56:55.886833 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 532/1058] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:56:55 2022] POST /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:56:55.899809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:55.901239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:55.913941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.915083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.916229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:55.917523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:55.919567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:55.920432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.071703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:56.080258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.091584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-168034c9-61b3-458f-a6e2-c3cae6a6bb3e tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1711 microversion: 2.1 time: 0.310703 Sep 16 13:56:56.092286 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 527/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:55 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1711 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:56.119527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:56.120888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:56.130326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.131053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.132167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.133296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.133805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.134243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.160306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.169754 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-849ad833-cf09-4715-bdea-ad0a2010c3f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1493 microversion: 2.1 time: 0.280941 Sep 16 13:56:56.170346 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 533/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:55 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1493 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:56.292285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.300775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d3ebde4-b637-4bc4-a098-fa2aa61c2e41 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.188439 Sep 16 13:56:56.301355 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 528/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:56 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:56.375917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:56.376529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:56.383714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.384123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.384563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.385267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.385725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.386146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.501713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:56.502680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:56.509922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.510619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.511204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.512015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.512677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.513258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.574180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.584964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.587465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.589021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3675f1f-c8b3-4b68-ae57-d4b7af85d07d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.217044 Sep 16 13:56:56.590083 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 534/1062] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:56 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:56.708138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.717523 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d93f7831-6185-436b-965b-a9a143415269 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1470 microversion: 2.1 time: 0.222810 Sep 16 13:56:56.718161 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 529/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:56 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:56.794057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:56.795233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:56.806934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.807815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.808632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.812607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:56.812607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:56.812607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:56.976096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:56.984425 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79823866-caa6-44d9-b87c-7d27e7dbd828 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.198267 Sep 16 13:56:56.985022 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 535/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:56 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:57.133030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:57.133776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:57.143189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.143769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.144249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.145021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.145527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.146088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.203664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:57.204906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:57.217612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.217612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.217946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.219301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.220164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.220950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.446222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:57.463878 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a7a8ef26-701c-4a59-a5c0-7d0489d57b2d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1711 microversion: 2.1 time: 0.334877 Sep 16 13:56:57.465470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 530/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:57 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1711 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:57.475114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:57.476784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:57.493459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.494984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.496222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.496421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:57.497902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.499262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.499893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.506090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7ec8c56-eef6-4b32-a156-9f3fce3def93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1493 microversion: 2.1 time: 0.309028 Sep 16 13:56:57.507618 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 536/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:57 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1493 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:57.630447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:57.632446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:57.646306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.648163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.648929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.650494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.651605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.652393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.821032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:57.834071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2370cfe-a756-48c0-8d8d-3fbb0a15a3f4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.366292 Sep 16 13:56:57.835169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 531/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:57 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:57.844197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:57.845364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:57.857252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.857941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.858756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.860025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:57.860961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:57.861710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:57.875702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:57.885755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:57.887343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:57.888758 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c36b3c57-1f76-4163-b618-1e6d4bdd3843 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.267095 Sep 16 13:56:57.889345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 537/1068] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:57 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:56:58.011062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:58.012086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:58.019702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.020437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.021155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.022070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.023377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.024016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.033997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:58.042745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b6e93d7-05c3-4a28-bd8d-f78284a210a7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1470 microversion: 2.1 time: 0.205847 Sep 16 13:56:58.043287 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 532/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:57 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:58.214987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:58.223935 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f4e09cb-f4de-41d6-be28-dca260979328 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.218366 Sep 16 13:56:58.224886 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 538/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:58 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:58.505866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:58.506542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:58.509879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:58.516005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.516555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.517059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.517862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.518604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.519179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.532514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:58.533396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:58.542453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.543266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.543909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.544748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.545336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.546011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.701023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:58.820052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:58.839997 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-222bcabe-eae8-46d9-bdac-93b873d8a9f4 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1711 microversion: 2.1 time: 0.337500 Sep 16 13:56:58.840754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:58.840879 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 533/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:58 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1711 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:58.855520 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4c286684-6de8-4e13-a143-54de2858edd9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1493 microversion: 2.1 time: 0.326809 Sep 16 13:56:58.856764 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 539/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:58 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1493 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:58.877640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:58.879112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:58.891963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.893047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.894144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.895584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.896542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.897381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.946948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:58.947963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:58.960408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.964535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.965194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:58.966037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:58.970987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:58.971597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.357727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:59.375810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-969de933-9da1-44a3-b455-255afe045901 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.510476 Sep 16 13:56:59.402070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 534/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:58 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:56:59.413832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:59.416103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:59.422266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.422949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.423695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.424453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.424918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.425347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.439602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:59.472216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:59.476521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:59.478927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d94e8eb-f488-4368-84c6-366e338db6eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.547422 Sep 16 13:56:59.480343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 540/1074] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:56:58 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:56:59.488444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:59.489861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:59.507049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.508567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.511499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.517108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.518336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.519231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.783529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:59.801318 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45491385-969d-46b4-9900-032aa1248dd0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1470 microversion: 2.1 time: 0.408706 Sep 16 13:56:59.803234 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 535/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:59 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1470 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:59.883569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:59.885848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:59.898588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.899516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.900227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.901042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.901520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.902224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.918463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:56:59.932872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:56:59.940444 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27e9e017-0b56-4af5-850a-da5e2581b3df tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.457389 Sep 16 13:56:59.942514 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 541/1076] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:59 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:56:59.953781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:56:59.954965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:56:59.974588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.975639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.977025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:56:59.978916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:56:59.980051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:56:59.980875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:00.792165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:00.802152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c50b875-f97b-45e4-ab88-fb6ba9dc8121 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1711 microversion: 2.1 time: 0.925525 Sep 16 13:57:00.802809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 536/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:59 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1711 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:00.816697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:00.818701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:00.834969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:00.836226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:00.837258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:00.838244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:00.838879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:00.839435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:00.885292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:00.894706 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62c563f6-8f70-47a3-9dea-1ef8a5a34f71 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 200 len: 1473 microversion: 2.1 time: 0.950577 Sep 16 13:57:00.896027 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 542/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:56:59 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 1473 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:00.902338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:00.903582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:00.912633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:00.913482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:00.914126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:00.915132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:00.915781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:00.916377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.342355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:01.359517 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b12799f-5e08-4e4c-a5c3-d5dd898a8902 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.555142 Sep 16 13:57:01.360755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 537/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:00 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:01.397691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:01.400133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:01.415421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.416007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.416765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.418095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.418669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.419149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.445569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:01.462262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:01.465644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:01.468410 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d749c17-edc1-474e-85fb-1b3d842bc89e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.570726 Sep 16 13:57:01.469708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 543/1080] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:00 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:01.477537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-303104487"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:01.480817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:01.489285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.490035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.490826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.492339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.493100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.493729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.696461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:01.716418 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efadb0d2-6040-42d5-a15e-bc7a0b460d88 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1536 microversion: 2.1 time: 0.353492 Sep 16 13:57:01.717773 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 538/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:01 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1536 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:01.725321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:01.727018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:01.734936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.735738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.736413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.740898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.741787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.742521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.812156 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c8702c6-fa90-4363-8c41-43b9f718c497 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561/action" status: 202 len: 0 microversion: 2.1 time: 0.340337 Sep 16 13:57:01.812787 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 544/1082] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:57:01 2022] POST /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 13:57:01.826866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd0b1f2d-d623-4788-8642-cc90ec25a403 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d4298b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:01.886328 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd0b1f2d-d623-4788-8642-cc90ec25a403 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.063787 Sep 16 13:57:01.888242 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 545/1083] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:01 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:01.904596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:01.905627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:01.915785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.916637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.917311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.918278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:01.918957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:01.919574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:01.977567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=5 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:02.083899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:02.107604 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36337e20-59f2-45ec-af91-5ca5423a085d tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1643 microversion: 2.1 time: 0.206586 Sep 16 13:57:02.130450 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 546/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:01 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1643 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:02.130450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-24ba2c2b-7347-4fd3-9c19-d95ec8486ecc req-b403a378-2ddc-4c39-9874-1e60e5bc47ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796a1baf-9191-4ca2-8cec-9e192862f096", "name": "network-vif-plugged", "status": "completed", "tag": "8e788933-5986-4bfa-a679-8708c1a86579"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:02.137996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-24ba2c2b-7347-4fd3-9c19-d95ec8486ecc req-b403a378-2ddc-4c39-9874-1e60e5bc47ef service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.138744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-24ba2c2b-7347-4fd3-9c19-d95ec8486ecc req-b403a378-2ddc-4c39-9874-1e60e5bc47ef service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.139330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-24ba2c2b-7347-4fd3-9c19-d95ec8486ecc req-b403a378-2ddc-4c39-9874-1e60e5bc47ef service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.153582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-24ba2c2b-7347-4fd3-9c19-d95ec8486ecc req-b403a378-2ddc-4c39-9874-1e60e5bc47ef service nova] Creating event network-vif-plugged:8e788933-5986-4bfa-a679-8708c1a86579 for instance 796a1baf-9191-4ca2-8cec-9e192862f096 on n-h1-858129-2 Sep 16 13:57:02.159960 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-24ba2c2b-7347-4fd3-9c19-d95ec8486ecc req-b403a378-2ddc-4c39-9874-1e60e5bc47ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040617 Sep 16 13:57:02.160718 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 547/1085] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:02.190673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:02.206009 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1c858f7-1390-4db7-a4db-b68870dd7ccf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.486462 Sep 16 13:57:02.207272 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 539/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:01 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:02.407960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:02.408705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:02.422436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.423136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.424134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.425447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.426165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.427007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.480181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cc4fdfbe-4c96-447d-81d1-3b1b72371248 req-f0ac45f8-d6bf-4109-a58a-129ba24fa7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68a841c-ac0a-44de-9d0e-7d1fdafdf730", "name": "network-vif-deleted", "tag": "04613bc1-5986-48d4-9629-aca916266b90"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:02.494255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cc4fdfbe-4c96-447d-81d1-3b1b72371248 req-f0ac45f8-d6bf-4109-a58a-129ba24fa7c5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.495265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cc4fdfbe-4c96-447d-81d1-3b1b72371248 req-f0ac45f8-d6bf-4109-a58a-129ba24fa7c5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.496378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cc4fdfbe-4c96-447d-81d1-3b1b72371248 req-f0ac45f8-d6bf-4109-a58a-129ba24fa7c5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.514641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cc4fdfbe-4c96-447d-81d1-3b1b72371248 req-f0ac45f8-d6bf-4109-a58a-129ba24fa7c5 service nova] Creating event network-vif-deleted:04613bc1-5986-48d4-9629-aca916266b90 for instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 on n-h1-858129-2 Sep 16 13:57:02.520516 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cc4fdfbe-4c96-447d-81d1-3b1b72371248 req-f0ac45f8-d6bf-4109-a58a-129ba24fa7c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048043 Sep 16 13:57:02.521431 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 540/1087] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:57:02.528620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:02.529339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:02.536520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.537014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.537458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.538226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.538764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.539203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.695667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:02.717752 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1b24642c-1cdc-4a03-ba3e-aa85aa2885b7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.314014 Sep 16 13:57:02.719013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 548/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:02 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:02.734751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:02.744454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:02.746357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:02.747631 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1538ed39-b70a-4a83-894b-9a01bf132d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.224889 Sep 16 13:57:02.748201 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 541/1089] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:02 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:02.766901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:02.768022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:02.776239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.776971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.777462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.778235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:02.778934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:02.779470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:02.910099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6513aea5-335b-4730-ba42-2eb9801009bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2afaf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:03.027378 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6513aea5-335b-4730-ba42-2eb9801009bb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.123586 Sep 16 13:57:03.028926 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 542/1090] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:02 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:03.055646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:03.071063 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7335e84b-b17f-4715-9d2f-1cfc2df4025e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1536 microversion: 2.1 time: 0.313969 Sep 16 13:57:03.078475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 549/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:02 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1536 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:03.161930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:03.163271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:03.174686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.175328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.175968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.176948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.177515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.178159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.247220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:03.248738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:03.256247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:03.260103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.261295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.261508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:03.262501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.263893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.264660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.265733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.275241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-07799516-67d9-4450-a190-af533cc19c5f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1347 microversion: 2.1 time: 0.120305 Sep 16 13:57:03.276233 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 543/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:03 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1347 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:03.493750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:03.514923 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd87d4ba-84ee-437e-aecf-75eeb0a9b32d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.273248 Sep 16 13:57:03.515913 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 550/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:03 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:03.760652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:03.762580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:03.774535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.775281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.776115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.777051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.777689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.778391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.780709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:03.781882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:03.791591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.792581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.793148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:03.794329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:03.795200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:03.795897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.123768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.126233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.136282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.137972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.139249 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-418838c5-a6a7-4a99-a2db-2d9e3a631a27 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.367988 Sep 16 13:57:04.139832 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 551/1094] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:03 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:04.142307 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b47c069-7dbf-4baa-9993-d8f15ef4cfea tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1317 microversion: 2.1 time: 0.387327 Sep 16 13:57:04.144091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 544/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:03 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:04.144871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83f266dc-1419-4eaa-a6eb-6ed8ba708c5b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d37b040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:04.171597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:04.173311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:04.201702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.202785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.205602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.208455 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83f266dc-1419-4eaa-a6eb-6ed8ba708c5b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.067248 Sep 16 13:57:04.209709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.211967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.215012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.219118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 552/1096] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:04 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:04.318436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:04.320152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:04.328521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.329237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.329814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.331333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.331952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.332537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.381689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.383241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.384107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.385143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lazy-loading 'fault' on Instance uuid e68a841c-ac0a-44de-9d0e-7d1fdafdf730 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:04.462067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ad00ee07c44e8e8ff54385234b0fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3640b77c194f6f8b0fb588bd07555c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.464141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.473179 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-638678d8-52c4-408e-b406-ffb3cc1436bb tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 200 len: 1352 microversion: 2.1 time: 0.159289 Sep 16 13:57:04.473778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 553/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:04 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 1352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:04.479969 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05ffe3a5-d345-4ce1-9760-2f6bcafc7b3e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1536 microversion: 2.1 time: 0.333842 Sep 16 13:57:04.480636 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 545/1098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:04 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1536 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:04.547312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:04.547998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:04.555835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.556318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.556751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.557460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:04.557913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:04.558330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:04.720619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:04.731649 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be762e98-3540-41a1-9794-d0f24d0819c3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.187473 Sep 16 13:57:04.732270 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 554/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:04 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:05.183362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.184131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.187581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.188446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.193853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.194657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.195409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.196609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.197383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.198099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.199495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.200289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.201010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.202201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.202963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.203665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.432720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:05.442979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:05.444164 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e5d48b4-835f-435f-884d-47cfa520c3e9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1466 microversion: 2.1 time: 0.265050 Sep 16 13:57:05.445698 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 546/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1466 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:05.453836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72070a47-433b-4dbd-ac55-a3f7f535878b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d245700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.458835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:05.461745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:05.464195 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c019b08d-35c9-4131-9939-a8b39d27e3dd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.280794 Sep 16 13:57:05.465511 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 555/1101] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:05.474603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.475624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.487283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.488081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.488818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.489898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.490693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.491495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.527505 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72070a47-433b-4dbd-ac55-a3f7f535878b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.080345 Sep 16 13:57:05.528305 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 547/1102] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:05.537029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.538791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.547483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.547974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.548407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.549130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.549591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.550013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.825355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-acf70413-b044-47d7-b0ed-42c3b41b7b19 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1617 microversion: 2.1 time: 0.356656 Sep 16 13:57:05.825956 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 556/1103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1617 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:05.830915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.831529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.837970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:05.838522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.839692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.840144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.840862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.841309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.841939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.851233 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30c8d0d4-28d0-4eb1-8dd0-3227c4bcc4b2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1536 microversion: 2.1 time: 0.321381 Sep 16 13:57:05.852074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 548/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1536 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:05.858183 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 HTTP/1.1 Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:57:05.859992 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:05.868413 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e68a841c-ac0a-44de-9d0e-7d1fdafdf730'} Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:05.870265 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:05.874154 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.876606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:05.876606 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8af8095f-39c6-4637-96ae-8bddd394603c tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 404 len: 111 microversion: 2.1 time: 0.034973 Sep 16 13:57:05.876606 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 557/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:05.877354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.877354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.886627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:05.886969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.887562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.888006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.888863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.889327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.889571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:05.889757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.902159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.903187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.904119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.905512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:05.906479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:05.907409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:05.936169 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 HTTP/1.1 Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:57:05.939447 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:05.941963 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '6db05562-05a5-4b02-9fa7-b13bac0c95e7'} Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:05.943372 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:05.945951 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:05.948742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:05.948742 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9159de0d-972c-4d14-9468-5193b924764f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 404 len: 111 microversion: 2.1 time: 0.067093 Sep 16 13:57:05.948742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 558/1106] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:05 2022] DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:57:05.952885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-998133192", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f6ba0e96-0970-4dbb-b9cc-a082824df96f"]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:06.019052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:57:06.141791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:06.156386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21efe51a-f2a9-4b6d-b7ef-8fee63a24ac4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.302198 Sep 16 13:57:06.157612 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 549/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:05 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:06.166514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:06.167615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:06.178147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.179082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.179845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.181169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.181991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.182754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.208964 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 HTTP/1.1 Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:57:06.213825 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:06.215443 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '6db05562-05a5-4b02-9fa7-b13bac0c95e7'} Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:06.216206 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:06.217412 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:06.218571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:06.218571 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8e1da60-a455-4d62-9915-836506842ce8 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 404 len: 111 microversion: 2.1 time: 0.057182 Sep 16 13:57:06.218571 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 550/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:06 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:06.228300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7cede89d-79bc-4692-8ce4-b48ded77f8bc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '.version_select at 0x7f724d264550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:06.251090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7cede89d-79bc-4692-8ce4-b48ded77f8bc tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-599284337" status: 202 len: 0 microversion: 2.1 time: 0.027407 Sep 16 13:57:06.251745 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 551/1109] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 13:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-599284337 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:57:06.328405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:57:06.329250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:57:06.329859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:57:06.330376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:57:06.330926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:57:06.341319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.341808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.342238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.343015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.343466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.343889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.363252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:57:06.369495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:57:06.372738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:06.388178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:57:06.390847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:57:06.455550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c493abbc-c3c2-4581-8c63-272243c83a93 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508602 Sep 16 13:57:06.462645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 559/1110] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:57:06.468818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5df0ebfc-5e5b-4c0d-89ff-032b150526f2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:06.469452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5df0ebfc-5e5b-4c0d-89ff-032b150526f2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:06.513596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:06.515062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:06.525493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.526312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.527072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.529059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.530848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.531926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.655247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5df0ebfc-5e5b-4c0d-89ff-032b150526f2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:06.670019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5df0ebfc-5e5b-4c0d-89ff-032b150526f2 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1216 microversion: 2.1 time: 0.204977 Sep 16 13:57:06.675379 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 552/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:06 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:06.688787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52e449a7-d584-41c3-baa9-5c4faf79c3d9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d264af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:06.778470 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52e449a7-d584-41c3-baa9-5c4faf79c3d9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.097900 Sep 16 13:57:06.780292 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 553/1112] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:06 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:06.894607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:06.895867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:06.936450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.937186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.938776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.940681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:06.941791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:06.942433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:06.948809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:06.965684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:06.967900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:06.969148 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de3846cb-1a13-449f-92df-16b376515126 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.468864 Sep 16 13:57:06.969740 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 560/1113] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:06 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:07.187359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.190749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:07.212451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.214494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.217049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.218856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.220366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.223626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.285892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:07.504993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:07.522433 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96901732-0566-4222-9df7-1fc36637ad6d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1536 microversion: 2.1 time: 0.635859 Sep 16 13:57:07.523429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 554/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:06 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1536 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:07.555305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5cad616e-9e14-48fc-a3e4-c1377fe16bf3 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.598296 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5cad616e-9e14-48fc-a3e4-c1377fe16bf3 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1828809638" status: 202 len: 0 microversion: 2.1 time: 0.046154 Sep 16 13:57:07.604871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 555/1115] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:57:07 2022] DELETE /compute/v2.1/flavors/1828809638 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:57:07.611845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dd700b8f-fd25-4d14-9360-a6bc92ca54c9 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.637219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dd700b8f-fd25-4d14-9360-a6bc92ca54c9 tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.030683 Sep 16 13:57:07.637821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 556/1116] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:07.650779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:07.650779 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6abc9b9b-a2c6-4893-a89d-6804cf43dcd9 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.470967 Sep 16 13:57:07.650779 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 561/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:07.659345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4620285c-447b-4923-b2da-af4f3b76812e tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.685478 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4620285c-447b-4923-b2da-af4f3b76812e tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/364251384" status: 202 len: 0 microversion: 2.1 time: 0.029237 Sep 16 13:57:07.687164 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 562/1118] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 13:57:07 2022] DELETE /compute/v2.1/flavors/364251384 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:57:07.697253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb647991-ae9a-46d3-9848-6862c327104b tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.705289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.706013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:07.718457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.719096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb647991-ae9a-46d3-9848-6862c327104b tempest-ServersWithSpecificFlavorTestJSON-272045454 tempest-ServersWithSpecificFlavorTestJSON-272045454-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027627 Sep 16 13:57:07.719467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.720244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.729892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.733596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 557/1119] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:07.734480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.735119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.751129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.751813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:07.759140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.759729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.761427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.762433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.763524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.764165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.783941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 HTTP/1.1 Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:57:07.785689 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.787118 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e68a841c-ac0a-44de-9d0e-7d1fdafdf730'} Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:07.787867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.789914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.791164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:07.791164 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b719dad7-a16b-4538-a1b7-370946e0b5b1 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 404 len: 111 microversion: 2.1 time: 0.047202 Sep 16 13:57:07.791164 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 558/1120] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:07 2022] DELETE /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:57:07.798893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.799838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: e68a841c-ac0a-44de-9d0e-7d1fdafdf730] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:07.809816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.810843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.811507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.813556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.814267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.814896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.830698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:07.832458 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 HTTP/1.1 Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:57:07.835081 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.837332 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e68a841c-ac0a-44de-9d0e-7d1fdafdf730'} Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:07.838217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. Sep 16 13:57:07.839684 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.841847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance e68a841c-ac0a-44de-9d0e-7d1fdafdf730 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:07.842750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9edd828-f01d-432b-a486-41702d8793b7 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730" status: 404 len: 111 microversion: 2.1 time: 0.048040 Sep 16 13:57:07.847435 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 559/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/servers/e68a841c-ac0a-44de-9d0e-7d1fdafdf730 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:07.849930 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a736f7ae-ade5-45c9-9b3b-a9b2389d8dfe tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1268 microversion: 2.1 time: 0.149917 Sep 16 13:57:07.851325 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 563/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:07.852360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c48a7b96-9044-4a6d-a34a-f9e294b942fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d264700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.867270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.867782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:07.874622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.875428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.876061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.877013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.877668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.878282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.896679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 HTTP/1.1 Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:57:07.898492 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.900101 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '6db05562-05a5-4b02-9fa7-b13bac0c95e7'} Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:07.900923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.902246 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.903471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:07.903471 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-548caa4f-d3bd-4a94-878e-2a3d5568345f tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 404 len: 111 microversion: 2.1 time: 0.045719 Sep 16 13:57:07.903471 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 564/1123] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:07 2022] DELETE /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:07.909474 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c48a7b96-9044-4a6d-a34a-f9e294b942fa tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.060783 Sep 16 13:57:07.909826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:07.910159 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 560/1124] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:07.910384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] [instance: 6db05562-05a5-4b02-9fa7-b13bac0c95e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:07.916840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.917339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.917780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.918535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:07.918988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:07.919408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:07.934908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] HTTP exception thrown: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Request method failure captured: Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 HTTP/1.1 Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-j8JUBfZRNdIR4w1EZUISp2hikCiuQArHDbxBS_l1ErCyz0JxeW7MAkvTCod2HaXplodK60DiC9IVeSvx_NZ7zJr2xep1yalN5_CpY00FY_C6DCQxNXtGUHfJBQxINzDKxEWMRSa7qaK8Ps6gO118ZHAgHQ6Nngsl-ipRuFRw7hcY Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:57:07.936484 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b3640b77c194f6f8b0fb588bd07555c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b3640b77c194f6f8b0fb588bd07555c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b3640b77c194f6f8b0fb588bd07555c"}]}] Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 3b3640b77c194f6f8b0fb588bd07555c Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414 Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 93ad00ee07c44e8e8ff54385234b0fb8 Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1016963414-project Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.937819 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '6db05562-05a5-4b02-9fa7-b13bac0c95e7'} Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:07.938590 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. Sep 16 13:57:07.939768 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:07.940824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] Returning 404 to user: Instance 6db05562-05a5-4b02-9fa7-b13bac0c95e7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:07.940824 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-441a365f-3f9b-4a6b-aa81-df59f92ee792 tempest-ServersWithSpecificFlavorTestJSON-1016963414 tempest-ServersWithSpecificFlavorTestJSON-1016963414-project] 10.222.0.60 "GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7" status: 404 len: 111 microversion: 2.1 time: 0.032446 Sep 16 13:57:07.940824 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 565/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:07 2022] GET /compute/v2.1/servers/6db05562-05a5-4b02-9fa7-b13bac0c95e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:57:08.017743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:08.018757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:08.027419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:08.027926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:08.028367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:08.029103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:08.029564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:08.029990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:08.547833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:08.548578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:08.556586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:08.557001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:08.557444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:08.558173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:08.558668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:08.559099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:08.839731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:08.848773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:08.850296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:08.851642 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49d876c3-4049-4444-9e6a-250d3a4f3106 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.837970 Sep 16 13:57:08.867289 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 561/1126] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:08 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:08.872713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:08.873659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:08.880434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:08.880939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:08.881381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:08.882166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:08.882688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:08.883588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.060995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:09.077767 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8774e920-a81a-46d8-8822-cae2562fd173 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1529 microversion: 2.1 time: 0.533852 Sep 16 13:57:09.078534 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 566/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:08 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1529 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:09.083511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:09.084315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:09.098320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:09.099669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:09.100274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.101543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:09.102128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:09.102613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.220288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:09.231813 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a0248c38-bfc5-46e3-91c7-78d77efe7b7c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1274 microversion: 2.1 time: 0.151994 Sep 16 13:57:09.232739 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 567/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:09 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:09.239306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-613864fa-5fc2-40cb-b7f9-4c5ee1a5ebda tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d8cd1f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:09.293207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:09.314733 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-613864fa-5fc2-40cb-b7f9-4c5ee1a5ebda tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.080509 Sep 16 13:57:09.318468 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 568/1129] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:09 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:09.323932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-459141c2-d6d5-42de-b0b5-ab86c69f2761 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1472 microversion: 2.1 time: 0.454973 Sep 16 13:57:09.325038 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 562/1130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:08 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:09.329386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:09.331010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:09.338968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:09.340051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:09.340847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.341851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:09.342364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:09.342932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.651279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:09.661697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e695de21-ef8f-46e7-adf0-c139b33e78d7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1529 microversion: 2.1 time: 0.344498 Sep 16 13:57:09.662317 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 569/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:09 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1529 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:09.685617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d598e25-2790-4c9f-a27c-ff15da90287f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:09.689143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:09.694571 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2d598e25-2790-4c9f-a27c-ff15da90287f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] HTTP exception thrown: Flavor 123b7628-1548-488b-a042-8ea034288f3f could not be found. Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d598e25-2790-4c9f-a27c-ff15da90287f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Request method failure captured: Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/flavors/123b7628-1548-488b-a042-8ea034288f3f HTTP/1.1 Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-RuSe-kUE0-PmAf9TWC3xFFVvwxgcAnQAhAS7pyr_Nw2m103ZDvpnKzILbjUk3TtYoo9Bxk-qrGh84Mh0M160Q8Cq2WitprNWE7IDzRTrM6EaUw60GLB2V9b7n1XXDVjGMNyo3sI4vnplfeV2VDr2oT9WqM_1d33s4iKDGMQt3sNQ Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2214fc02f7664f268a03557dc8c5201b Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MigrationsAdminTest-691844227 Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:57:09.701995 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2214fc02f7664f268a03557dc8c5201b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2214fc02f7664f268a03557dc8c5201b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2214fc02f7664f268a03557dc8c5201b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2214fc02f7664f268a03557dc8c5201b"}]}] Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MigrationsAdminTest-691844227 Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2214fc02f7664f268a03557dc8c5201b Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MigrationsAdminTest-691844227 Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MigrationsAdminTest-691844227-project-admin Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c519716c82b84ec5b2e31c3f5b1622dc Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MigrationsAdminTest-691844227-project-admin Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: exception: Flavor 123b7628-1548-488b-a042-8ea034288f3f could not be found. Sep 16 13:57:09.705207 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '123b7628-1548-488b-a042-8ea034288f3f'} Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 123b7628-1548-488b-a042-8ea034288f3f could not be found. Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:09.707190 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 123b7628-1548-488b-a042-8ea034288f3f could not be found. Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 123b7628-1548-488b-a042-8ea034288f3f could not be found. Sep 16 13:57:09.710643 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:09.715008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d598e25-2790-4c9f-a27c-ff15da90287f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Returning 404 to user: Flavor 123b7628-1548-488b-a042-8ea034288f3f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:09.715008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d598e25-2790-4c9f-a27c-ff15da90287f tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/123b7628-1548-488b-a042-8ea034288f3f" status: 404 len: 109 microversion: 2.1 time: 0.023149 Sep 16 13:57:09.715008 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 563/1132] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:09 2022] DELETE /compute/v2.1/flavors/123b7628-1548-488b-a042-8ea034288f3f => generated 109 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:57:09.886395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:09.887453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-579706339", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:09.889867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:09.904557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:09.905772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:09.906652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.907580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:09.908324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:09.909413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:09.956380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:57:10.592484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:10.615442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:10.621174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:10.625253 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-947d3d15-04a0-425c-8372-1354f1899982 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1568 microversion: 2.25 time: 0.744722 Sep 16 13:57:10.626973 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 564/1133] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:09 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1568 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:10.637092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:10.638266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:10.650866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:10.652104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:10.653165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:10.661550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:10.663008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:10.664548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:10.805036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:57:10.808578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:57:10.809871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:57:10.810776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:57:10.819091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:57:10.857646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:10.860993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:10.863704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:10.868411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:10.869913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:10.871912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:10.921857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:57:10.936427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Getting quotas for user ae208d89fa7549198ef91ef307464763 and project c67843449c98450aa14d5889893ceeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:57:10.985640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:57:10.990452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:57:11.118012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:11.154774 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e9428e5e-e5e0-42d6-8802-545c9e0fd100 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274030 Sep 16 13:57:11.155797 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 570/1134] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:57:11.166735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-161dffac-2630-4a8b-9ea9-f827a71df7d0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d429a60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:11.168030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44032164-8e9f-46a6-877c-1cf7fa4959bb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.538367 Sep 16 13:57:11.173161 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 565/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:10 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:11.201249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:11.211776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:11.251152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:11.252678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:11.255682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:11.257882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:11.260112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:11.261278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:11.274010 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-161dffac-2630-4a8b-9ea9-f827a71df7d0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.114334 Sep 16 13:57:11.285138 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 571/1136] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:11 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:11.294446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d281a665-cbce-44e4-b828-b35420931d7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:11.300557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d281a665-cbce-44e4-b828-b35420931d7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:11.423344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d281a665-cbce-44e4-b828-b35420931d7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:11.436576 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d281a665-cbce-44e4-b828-b35420931d7e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1212 microversion: 2.1 time: 0.147151 Sep 16 13:57:11.438156 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 572/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:11 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:11.683814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:11.684930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:11.693974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:11.694977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:11.695597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:11.697487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:11.698428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:11.699027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:12.556425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:12.568741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9da9f8e-8a38-44fc-afac-453d17204656 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1490 microversion: 2.1 time: 1.393236 Sep 16 13:57:12.569359 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 566/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:11 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1490 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:12.575481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9a125a4b-afaf-4317-878e-bd8a5e82268e req-98e79734-548e-45e9-84ab-b275c44eb439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a526b21-b479-4b47-a733-3a9757f8c368", "name": "network-vif-plugged", "status": "completed", "tag": "76355775-4b09-4831-b8c9-526859e22a89"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:12.587583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9a125a4b-afaf-4317-878e-bd8a5e82268e req-98e79734-548e-45e9-84ab-b275c44eb439 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:12.588377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9a125a4b-afaf-4317-878e-bd8a5e82268e req-98e79734-548e-45e9-84ab-b275c44eb439 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:12.588967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9a125a4b-afaf-4317-878e-bd8a5e82268e req-98e79734-548e-45e9-84ab-b275c44eb439 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:12.607299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9a125a4b-afaf-4317-878e-bd8a5e82268e req-98e79734-548e-45e9-84ab-b275c44eb439 service nova] Creating event network-vif-plugged:76355775-4b09-4831-b8c9-526859e22a89 for instance 0a526b21-b479-4b47-a733-3a9757f8c368 on n-h2-858129-2 Sep 16 13:57:12.612936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9a125a4b-afaf-4317-878e-bd8a5e82268e req-98e79734-548e-45e9-84ab-b275c44eb439 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041332 Sep 16 13:57:12.613557 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 567/1139] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:12.620698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:12.621800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:12.628583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:12.629085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:12.629524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:12.630245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:12.630727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:12.631152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.203809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:13.231429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:13.235292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:13.239907 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62441c97-fd83-4822-bb36-8430a32743eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1543 microversion: 2.25 time: 1.560371 Sep 16 13:57:13.242589 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 573/1140] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:11 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1543 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:13.270583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ca08434-7ecd-4627-9fc9-8ae815cf4d0f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3cd940>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:13.414005 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ca08434-7ecd-4627-9fc9-8ae815cf4d0f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.169187 Sep 16 13:57:13.415618 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 574/1141] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:13 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:13.426087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:13.427948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:13.441479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.442818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.443911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.446529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.447926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.449026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.464050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:13.489487 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85981f3e-b8f0-43c8-a2ad-d0d49f6546e8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.874565 Sep 16 13:57:13.491939 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 568/1142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:12 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:13.504924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f2569db-aa0c-49f7-a052-fb18976af8fb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '.version_select at 0x7f724d23bb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:13.520138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f2569db-aa0c-49f7-a052-fb18976af8fb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.523251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f2569db-aa0c-49f7-a052-fb18976af8fb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.525936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f2569db-aa0c-49f7-a052-fb18976af8fb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.550822 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f2569db-aa0c-49f7-a052-fb18976af8fb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.055058 Sep 16 13:57:13.558390 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 569/1143] 10.222.0.60 () {60 vars in 1184 bytes} [Fri Sep 16 13:57:13 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:13.584465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:13.586150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:13.604640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.605408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.606128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.607877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.609967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.610851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.667449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:13.677684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93471f23-7e2c-46cc-b8b1-2b859cc5eb96 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1264 microversion: 2.1 time: 0.259935 Sep 16 13:57:13.678546 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 575/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:13 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:13.710773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:13.711935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:13.730148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.731154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.731746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:13.733425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:13.734817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:13.735648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:14.455402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:14.473987 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a84f37b1-de8c-4ffe-9e67-0c60f3a5bdb0 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1478 microversion: 2.1 time: 0.793090 Sep 16 13:57:14.497778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 576/1145] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:13 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1478 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:14.507631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:14.532468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7f1e63c-0eff-4b8c-a340-74868150dfb0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d394670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:14.623776 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e81fb6d-58a4-4c48-8e44-9c23275e7dbb tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 2036 microversion: 2.25 time: 1.047843 Sep 16 13:57:14.630657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 570/1146] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:13 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 2036 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:14.643162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:14.644113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:14.661812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:14.663356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:14.664179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:14.666776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:14.671063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:14.671912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:14.704134 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7f1e63c-0eff-4b8c-a340-74868150dfb0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.204302 Sep 16 13:57:14.711603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 577/1147] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:14 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:14.732124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d29814a-20f9-48a9-bf1c-3b0564dbe605 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Action: 'create', calling method: .version_select at 0x7f724d4213a0>, body: {"keypair": {"name": "tempest-keypair-967937511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYJqFc8hr2LPTR0Qdd9jHYyeE4vpYYjDkh9RzGVU7rrnfYypONSgXlfH35OIjEsUI1bczHmMkmTQ2phXzAFhs1zxqY+gUxI8K8SYqSYeid+XSritTVDt3zAZrgUiTzSag=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:14.826087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9d29814a-20f9-48a9-bf1c-3b0564dbe605 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:57:14.849099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9d29814a-20f9-48a9-bf1c-3b0564dbe605 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for user 916231d4d6114380b4e48d428d6dd843 and project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:57:14.926934 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d29814a-20f9-48a9-bf1c-3b0564dbe605 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.213187 Sep 16 13:57:14.931395 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 578/1148] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 13:57:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 13:57:14.940538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:14.944541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:14.964096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:14.965120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:14.965754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:14.966857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:14.969995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:14.970781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:15.496998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:15.525123 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-068db2de-ca6a-406e-ae02-8b3b7cf27ca1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1272 microversion: 2.1 time: 0.591038 Sep 16 13:57:15.526341 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 579/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:14 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1272 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:15.538277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:15.540451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:15.558869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:15.561520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:15.562436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:15.563997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:15.566467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:15.567455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:15.837868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:15.852087 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6036dc5b-c5eb-4f6a-b5e7-cee761f05c76 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 1.219470 Sep 16 13:57:15.878647 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 571/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:14 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:15.887049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94f2b976-665c-4286-840e-fc8f376c30c0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2649d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:16.008386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94f2b976-665c-4286-840e-fc8f376c30c0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.126282 Sep 16 13:57:16.030917 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 572/1151] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:15 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:16.037361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c587abc3-02f4-4398-a3e9-3ff49306c405 req-f21a4be4-aaae-4117-975b-db184a18ca90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b287762e-66e3-4d88-90dd-22dac4222156", "tag": "61cda1da-977a-4f37-83d1-96e34f33bbc3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:16.049006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c587abc3-02f4-4398-a3e9-3ff49306c405 req-f21a4be4-aaae-4117-975b-db184a18ca90 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:16.049513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c587abc3-02f4-4398-a3e9-3ff49306c405 req-f21a4be4-aaae-4117-975b-db184a18ca90 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:16.049961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c587abc3-02f4-4398-a3e9-3ff49306c405 req-f21a4be4-aaae-4117-975b-db184a18ca90 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:16.077273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c587abc3-02f4-4398-a3e9-3ff49306c405 req-f21a4be4-aaae-4117-975b-db184a18ca90 service nova] Creating event network-changed:61cda1da-977a-4f37-83d1-96e34f33bbc3 for instance b287762e-66e3-4d88-90dd-22dac4222156 on n-h1-858129-2 Sep 16 13:57:16.092794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c587abc3-02f4-4398-a3e9-3ff49306c405 req-f21a4be4-aaae-4117-975b-db184a18ca90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059752 Sep 16 13:57:16.094762 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 573/1152] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:16.402545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:16.419393 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a1b5d79f-7e97-4940-80a5-c69026ce767c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1478 microversion: 2.1 time: 0.890488 Sep 16 13:57:16.425688 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 580/1153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:15 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1478 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:16.509306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-345833ae-0908-4b88-bc18-f27c6f401648 req-9a3363b9-1802-47d6-bbfe-db0f53d8d01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cdbfcc-18c8-4219-9fb2-c40f4517a561", "name": "network-vif-plugged", "status": "completed", "tag": "38c9b12a-5066-4ee6-baea-15e720a6984a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:16.536349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-345833ae-0908-4b88-bc18-f27c6f401648 req-9a3363b9-1802-47d6-bbfe-db0f53d8d01f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:16.539121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-345833ae-0908-4b88-bc18-f27c6f401648 req-9a3363b9-1802-47d6-bbfe-db0f53d8d01f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:16.540318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-345833ae-0908-4b88-bc18-f27c6f401648 req-9a3363b9-1802-47d6-bbfe-db0f53d8d01f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:16.557060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:16.582672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:16.586573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:16.609101 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-345833ae-0908-4b88-bc18-f27c6f401648 req-9a3363b9-1802-47d6-bbfe-db0f53d8d01f service nova] Creating event network-vif-plugged:38c9b12a-5066-4ee6-baea-15e720a6984a for instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 on n-h2-858129-2 Sep 16 13:57:16.614958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:16.617355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:16.621519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:16.627884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:16.630454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:16.631279 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-345833ae-0908-4b88-bc18-f27c6f401648 req-9a3363b9-1802-47d6-bbfe-db0f53d8d01f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131206 Sep 16 13:57:16.633420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:16.635140 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 574/1154] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:16.884847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:16.893069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:16.894637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:16.911062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:16.918475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:16.923549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:16.926393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:16.931192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:16.932426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:16.933545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:16.955776 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-301f177a-e06d-474f-bca9-392c99139437 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1282 microversion: 2.1 time: 0.385115 Sep 16 13:57:16.959422 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 581/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:16 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1282 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:17.043563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb764421-96f4-4ea0-8a80-35bf0af5243d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3b2670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:17.145369 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb764421-96f4-4ea0-8a80-35bf0af5243d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.114501 Sep 16 13:57:17.150907 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 582/1156] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:17 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:17.228851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:17.243850 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-210b83ff-87a1-4de6-a69d-94a14cce4c86 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.358721 Sep 16 13:57:17.245484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 575/1157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:16 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:17.464838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:17.465632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:17.477686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:17.478346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:17.479162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:17.480003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:17.480561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:17.481143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:17.675127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:17.685812 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb9ff809-5448-43ca-a310-df8e5bf54deb tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1478 microversion: 2.1 time: 0.224467 Sep 16 13:57:17.686557 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 583/1158] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:17 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1478 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:18.141317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:18.143467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:18.175292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae0ebf39-6689-4d42-ad25-d064e3225d93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3b2820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:18.191266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.193098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.194194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.196363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.197507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.199151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.284365 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae0ebf39-6689-4d42-ad25-d064e3225d93 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.122462 Sep 16 13:57:18.284977 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 584/1159] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:18 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:18.300941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:18.302295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:18.311280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.312443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.312443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.313227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.313699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.314136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.476635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:18.499007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4c6247e-78a6-4e0c-b492-84fb51d18d33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1282 microversion: 2.1 time: 0.506106 Sep 16 13:57:18.499678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 576/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:17 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1282 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:18.717825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-20a62c25-1ab8-4712-b99a-dce4a78b45e7 req-f24c5072-1a61-4c0d-a82a-63d95db3250f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "name": "network-vif-unplugged", "status": "completed", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:18.745477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-20a62c25-1ab8-4712-b99a-dce4a78b45e7 req-f24c5072-1a61-4c0d-a82a-63d95db3250f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.746531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-20a62c25-1ab8-4712-b99a-dce4a78b45e7 req-f24c5072-1a61-4c0d-a82a-63d95db3250f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.747596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-20a62c25-1ab8-4712-b99a-dce4a78b45e7 req-f24c5072-1a61-4c0d-a82a-63d95db3250f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.772174 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-20a62c25-1ab8-4712-b99a-dce4a78b45e7 req-f24c5072-1a61-4c0d-a82a-63d95db3250f service nova] Creating event network-vif-unplugged:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:57:18.785557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-20a62c25-1ab8-4712-b99a-dce4a78b45e7 req-f24c5072-1a61-4c0d-a82a-63d95db3250f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075771 Sep 16 13:57:18.790040 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 577/1161] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:57:18.801690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:18.804653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:18.806267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:18.820773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.821993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.823174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.824267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:18.825056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:18.825771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:18.827844 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c6b5725e-f813-4966-af99-82717dbc5169 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.540574 Sep 16 13:57:18.829601 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 585/1162] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:18 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:18.946508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-975010300", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "72957846-66c4-4f63-b24e-6ce8e865631e"}], "security_groups": [{"name": "tempest-securitygroup--1224615111"}], "key_name": "tempest-keypair-967937511", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:19.322810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:19.333846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-770cbd21-6d09-4ca9-91de-efbaa0c73358 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1478 microversion: 2.1 time: 0.541486 Sep 16 13:57:19.334789 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 578/1163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:18 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1478 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:19.340427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be2fe879-c28a-4cff-a93a-d479d4445676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d325550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:19.381602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] validate_networks() for [('72957846-66c4-4f63-b24e-6ce8e865631e', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:57:19.413342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be2fe879-c28a-4cff-a93a-d479d4445676 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.076470 Sep 16 13:57:19.414429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 579/1164] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:19 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:19.522548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:19.523866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:19.531161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:19.531666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:19.532313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:19.533251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:19.533765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:19.534198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:19.860486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:19.878525 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d64c59c-5af1-4ab7-bb8f-e38fb431f815 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1282 microversion: 2.1 time: 0.360074 Sep 16 13:57:19.879831 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 580/1165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:19 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1282 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:19.886275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:19.887702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:19.896912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:19.899849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:19.900706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:19.901948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:19.902830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:19.903804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:20.903463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:21.032789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:21.046175 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68ac75f6-cc34-4086-b8f8-83d49a506c1a tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 1.164015 Sep 16 13:57:21.049379 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 581/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:19 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:21.061899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:21.062728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:21.077549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:21.080657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:21.081114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:21.081909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:21.082382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:21.082838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:21.567483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:21.592246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-255592d7-d120-459d-993c-6c5800608e66 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1478 microversion: 2.1 time: 0.541158 Sep 16 13:57:21.595124 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 582/1167] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:21 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1478 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:21.608927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-924ff47a-b135-4850-a43f-25e2c624772b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3e58b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:21.657548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:57:21.658529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:57:21.659775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:57:21.660862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:57:21.661915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:57:21.693875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:21.696334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:21.711838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:21.717881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:21.718511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:21.718966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:21.737012 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-924ff47a-b135-4850-a43f-25e2c624772b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.139648 Sep 16 13:57:21.738323 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 583/1168] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:21 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:21.756540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:57:21.759991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:21.761363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:21.764178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for user 916231d4d6114380b4e48d428d6dd843 and project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:57:21.783981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:21.785095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:21.788566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:21.790070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:21.792193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:57:21.798649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:57:21.799198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:21.800360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:21.908580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a29d11b5-d994-468b-b4e4-ca2de67f37ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.966308 Sep 16 13:57:21.911055 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 586/1169] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:57:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 16 13:57:21.929213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fbe12a8c-317a-437f-bd46-f722bea59487 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:21.932793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fbe12a8c-317a-437f-bd46-f722bea59487 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:21.997818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:22.019246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76c0ac5b-024b-485b-91fe-a865ffd97f2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1270 microversion: 2.1 time: 0.278674 Sep 16 13:57:22.036385 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 584/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:21 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1270 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:22.096037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbe12a8c-317a-437f-bd46-f722bea59487 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:22.105116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:22.106653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:22.118487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbe12a8c-317a-437f-bd46-f722bea59487 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:22.119527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:22.121316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:22.122340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:22.123011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbe12a8c-317a-437f-bd46-f722bea59487 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:22.124360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:22.125483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:22.126576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:22.127182 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fbe12a8c-317a-437f-bd46-f722bea59487 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1284 microversion: 2.25 time: 0.207810 Sep 16 13:57:22.127800 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 587/1171] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:21 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:22.645088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:22.645406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:22.646328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:22.667919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:22.668416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4302b187-7829-4bec-8c1e-a67245a8fc1f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.579042 Sep 16 13:57:22.672533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:22.675134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:22.678866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:22.690457 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 585/1172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:22 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:22.699590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:22.712115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:22.717304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:22.765334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f076c2a9-d2c0-4b7c-ad21-bf2f4e8e1df8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d24de50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:22.927186 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f076c2a9-d2c0-4b7c-ad21-bf2f4e8e1df8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.157871 Sep 16 13:57:22.928626 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 586/1173] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:22 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:23.068231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:23.073840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:23.111276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:23.118744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:23.122337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:23.124610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:23.127365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:23.131340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:23.725395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:23.760404 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-caed6077-27a5-4515-9242-9bf3c7ed7c97 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1478 microversion: 2.1 time: 1.120141 Sep 16 13:57:23.762723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 588/1174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:22 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1478 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:23.776107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:23.778668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:23.779693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:23.789039 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5a0f2eb7-7cbb-43aa-b753-81a9e3c7933f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.729581 Sep 16 13:57:23.794170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:23.795028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:23.796144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:23.798691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:23.799594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:23.802169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:23.812989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 587/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:23 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:23.836824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:23.840120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:23.869020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:23.886560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:23.887897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:23.889519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:23.893192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:23.909564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:24.159670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:24.178084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:24.180006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:24.184734 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b042be59-4aab-4530-b331-9ce3c0ee5ee2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1280 microversion: 2.25 time: 0.418395 Sep 16 13:57:24.185349 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 589/1176] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:23 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1280 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:24.196619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-12e058b1-fc00-4fad-9544-7829959365a6 req-341d846a-594c-4c92-ae50-307806a387a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b287762e-66e3-4d88-90dd-22dac4222156", "name": "network-vif-plugged", "status": "completed", "tag": "61cda1da-977a-4f37-83d1-96e34f33bbc3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:24.222763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-12e058b1-fc00-4fad-9544-7829959365a6 req-341d846a-594c-4c92-ae50-307806a387a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:24.225527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-12e058b1-fc00-4fad-9544-7829959365a6 req-341d846a-594c-4c92-ae50-307806a387a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:24.228023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-12e058b1-fc00-4fad-9544-7829959365a6 req-341d846a-594c-4c92-ae50-307806a387a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:24.260912 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-12e058b1-fc00-4fad-9544-7829959365a6 req-341d846a-594c-4c92-ae50-307806a387a4 service nova] Creating event network-vif-plugged:61cda1da-977a-4f37-83d1-96e34f33bbc3 for instance b287762e-66e3-4d88-90dd-22dac4222156 on n-h1-858129-2 Sep 16 13:57:24.268498 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-12e058b1-fc00-4fad-9544-7829959365a6 req-341d846a-594c-4c92-ae50-307806a387a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081876 Sep 16 13:57:24.270571 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 590/1177] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:24.276931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fde25a8e-443c-4aa8-9003-52e14c7b2009 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d56c430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:24.400963 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fde25a8e-443c-4aa8-9003-52e14c7b2009 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.128891 Sep 16 13:57:24.401946 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 591/1178] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:24 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:24.644710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:24.660792 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-abe35dce-0f8a-46a7-80b7-039775d11988 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.842041 Sep 16 13:57:24.661419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 588/1179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:23 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:24.805772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:24.807367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:24.815862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:24.816824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:24.836105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:24.839238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:24.840566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:24.842511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:24.843520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:24.844476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:24.845617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:24.848276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:24.849263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:24.852886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:24.857351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:24.857918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:24.915448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:25.189755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:25.215159 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bbcfc23e-234f-4a8b-9b71-e3530021fb09 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.402318 Sep 16 13:57:25.221401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 589/1180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:24 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:25.241844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:25.248249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:25.249025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:25.256530 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3c027529-4f9a-4351-9c6b-c6b1aed0e808 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1463 microversion: 2.1 time: 0.455364 Sep 16 13:57:25.261516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.262337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.263023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.265027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.273482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.274380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.274918 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 592/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:24 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1463 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:25.307908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:25.310800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:25.335855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.337450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.340189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.341665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.348254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.353187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.571154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:25.573766 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b9396f3-8029-4c9f-bde2-eae0e58b1bd1 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 0 microversion: 2.1 time: 0.267986 Sep 16 13:57:25.577682 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 593/1182] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:57:25 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:57:25.591897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:25.593918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:25.597036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-418c31aa-f699-416c-9bc7-a8a841b562a9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d9f1ee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:25.599774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ab41974-3b4f-4fd5-bd7b-77b3b69ffc02 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1280 microversion: 2.25 time: 0.354062 Sep 16 13:57:25.602138 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 590/1183] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:25 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1280 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:25.619475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e46c8c17-4922-4818-b498-766c56e6abd1 req-d2d35b93-71b6-4ef5-9d4b-4d8a9e37d0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:25.643430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e46c8c17-4922-4818-b498-766c56e6abd1 req-d2d35b93-71b6-4ef5-9d4b-4d8a9e37d0b1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.643937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e46c8c17-4922-4818-b498-766c56e6abd1 req-d2d35b93-71b6-4ef5-9d4b-4d8a9e37d0b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.644569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e46c8c17-4922-4818-b498-766c56e6abd1 req-d2d35b93-71b6-4ef5-9d4b-4d8a9e37d0b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.663729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e46c8c17-4922-4818-b498-766c56e6abd1 req-d2d35b93-71b6-4ef5-9d4b-4d8a9e37d0b1 service nova] Creating event network-changed:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h2-858129-2 Sep 16 13:57:25.672774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e46c8c17-4922-4818-b498-766c56e6abd1 req-d2d35b93-71b6-4ef5-9d4b-4d8a9e37d0b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068451 Sep 16 13:57:25.674612 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 591/1184] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:25.690049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:25.690898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:25.698733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.700745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.701494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.702534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.703284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.704329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.760759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.761537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.762671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.763857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lazy-loading 'fault' on Instance uuid ad55c464-a245-4276-880c-b5bbd0bce53e {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:25.775426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-418c31aa-f699-416c-9bc7-a8a841b562a9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.192644 Sep 16 13:57:25.779874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 594/1185] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:25 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:25.802104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:25.810196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:25.843905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.845261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.846771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.848467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.849688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.850869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.947789 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94e50c74-b80d-4949-ba07-036424407faf tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1597 microversion: 2.1 time: 0.267429 Sep 16 13:57:25.963420 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 592/1186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:25 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1597 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:25.971988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:25.975560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:25.983076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.984143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.984825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:25.985967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:25.986835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:25.987504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:26.143173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:26.156004 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6bf5d1b4-f6a2-49ee-a365-f85f695b2ff7 tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action" status: 202 len: 0 microversion: 2.1 time: 0.187832 Sep 16 13:57:26.161315 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 593/1187] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:57:25 2022] POST /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 13:57:26.172609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:26.173260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:26.187675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:26.188184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:26.188702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:26.189444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:26.189842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:26.190281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:26.573655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:26.625009 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e80b0f0-5313-4f97-9c43-a45fa240fb14 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1316 microversion: 2.1 time: 0.841551 Sep 16 13:57:26.635900 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 595/1188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:25 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1316 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:26.670429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:26.676387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:26.718557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:26.728400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:26.729083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:26.736804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:26.738255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:26.747896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:26.832892 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8917fbbe-747e-4a1a-936d-1e0b6401091a tempest-ServersAdminTestJSON-1896121463 tempest-ServersAdminTestJSON-1896121463-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1614 microversion: 2.1 time: 0.669970 Sep 16 13:57:26.840432 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 594/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:26 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1614 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:26.860917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fa220c04-b0aa-4393-85bc-8f769c8f9d2c req-ba6588b8-7337-4a6e-afb4-ee9ca6e70058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "name": "network-vif-plugged", "status": "completed", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:26.898141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa220c04-b0aa-4393-85bc-8f769c8f9d2c req-ba6588b8-7337-4a6e-afb4-ee9ca6e70058 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:26.900025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa220c04-b0aa-4393-85bc-8f769c8f9d2c req-ba6588b8-7337-4a6e-afb4-ee9ca6e70058 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:26.902993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa220c04-b0aa-4393-85bc-8f769c8f9d2c req-ba6588b8-7337-4a6e-afb4-ee9ca6e70058 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:26.959267 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fa220c04-b0aa-4393-85bc-8f769c8f9d2c req-ba6588b8-7337-4a6e-afb4-ee9ca6e70058 service nova] Creating event network-vif-plugged:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:57:26.980832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fa220c04-b0aa-4393-85bc-8f769c8f9d2c req-ba6588b8-7337-4a6e-afb4-ee9ca6e70058 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135880 Sep 16 13:57:27.005968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 595/1190] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:27.118802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:27.119690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:27.138390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.139294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.139996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.141023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.141882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.143730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.392682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:27.414123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:27.416039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:27.417911 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7705b38-de4a-4d16-ab53-96a223db7e1b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1336 microversion: 2.25 time: 0.404011 Sep 16 13:57:27.418895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:27.419832 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 596/1191] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:27 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1336 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:27.427282 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ac153a3-3ca4-4e04-946c-bef6af6c9803 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.789747 Sep 16 13:57:27.431238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf3236c9-74c2-4e4c-bfa6-691bf70a87ed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d271e50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:27.444778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 596/1192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:26 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:27.452806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:27.453856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:27.462384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.463309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.463937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.466083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.466848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.467448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.498430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:57:27.533648 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf3236c9-74c2-4e4c-bfa6-691bf70a87ed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.112396 Sep 16 13:57:27.534482 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 597/1193] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:27 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:27.649941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:27.651934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:27.656535 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93668d03-7dfe-44dc-acd5-3477d3b5f7f3 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 204 len: 0 microversion: 2.1 time: 0.195226 Sep 16 13:57:27.659790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 597/1194] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:27 2022] DELETE /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:57:27.674185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.675190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.676129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.677771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.678255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.689986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:27.691258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:27.694230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.701714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.702439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.703434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:27.704405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:27.705055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:27.706905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:28.027044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:28.037070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aee326cc-bc74-4cad-ab40-19f33606d904 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1466 microversion: 2.1 time: 0.391683 Sep 16 13:57:28.058476 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 598/1195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:27 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1466 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:28.086851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:28.112544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:28.175741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:28.176062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:28.180847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:28.181814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:28.188180 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e1b260f-3920-48ae-a855-a49531b0548c tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1470 microversion: 2.1 time: 0.503947 Sep 16 13:57:28.191689 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 598/1196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:27 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1470 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:28.195671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:28.198665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:28.201338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:28.444861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:28.445779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:28.465108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:28.479515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:28.483029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:28.488715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:28.489226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:28.489677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:28.730586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:28.786324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:28.814181 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2fa87589-cc94-48ee-94bc-2d65dd9ae1c6 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1617 microversion: 2.1 time: 0.744715 Sep 16 13:57:28.818428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:28.826054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca9d103c-d875-4e44-8119-c00bbe89d17a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1344 microversion: 2.25 time: 0.380938 Sep 16 13:57:28.826537 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 599/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:28 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1617 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:28.830284 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 599/1198] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:28 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1344 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:28.850191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:28.857346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:28.864982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8053357f-06d2-4721-855c-33d693f7103a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d339a60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:28.888155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:28.889870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:28.892884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:28.901316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:28.904006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:28.906321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:29.029525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8053357f-06d2-4721-855c-33d693f7103a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.196962 Sep 16 13:57:29.033520 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 600/1199] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:28 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:29.095712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2047245490", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f6ba0e96-0970-4dbb-b9cc-a082824df96f"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:29.241222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:57:29.316065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:29.329071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e3215a3-d7d2-4075-a1c7-0c2c233c6594 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.500948 Sep 16 13:57:29.332754 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 600/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:28 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:29.344131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:29.345974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:29.355400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:29.357727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:29.358534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:29.359542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:29.360241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:29.361734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:29.837816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:29.854074 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c80eeb24-ae5d-4cbf-80e9-12f751f285fc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1470 microversion: 2.1 time: 0.519805 Sep 16 13:57:29.854742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 601/1201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:29 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:29.879059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:29.879792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:29.887777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:29.889304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:29.890045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:29.891093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:29.891839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:29.892540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:30.124283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:30.137840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:30.144638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:30.146049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9ccc255-b846-4ce3-9c7b-9ba85755caf7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1342 microversion: 2.25 time: 0.271309 Sep 16 13:57:30.151796 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 602/1202] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:29 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1342 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:30.167695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:57:30.168829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:57:30.169489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:57:30.170070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:57:30.170681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:57:30.174391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-addbc18e-7543-4b66-8a1a-b9ccd1a8e994 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d24de50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:30.182204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=27 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:30.196433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:30.198960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:30.199617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:30.201565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:30.202231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:30.202900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:30.226815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:57:30.234269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Getting quotas for user 25fcb9106443488ebf540ea787256548 and project da29b469d8554f0993b35628a9a05d89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:57:30.251710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:57:30.262370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:57:30.304851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-addbc18e-7543-4b66-8a1a-b9ccd1a8e994 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.147913 Sep 16 13:57:30.304851 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 603/1203] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:30 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:30.338211 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec122934-d98f-4124-bd2c-a331bbee0e3c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250304 Sep 16 13:57:30.358121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ec5bb06-d51f-4b5d-b90a-948ef2c87e19 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:30.359126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ec5bb06-d51f-4b5d-b90a-948ef2c87e19 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:30.362186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 601/1204] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:57:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:57:30.378811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:30.382674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:30.400263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:30.401564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:30.401564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:30.402033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:30.407251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:30.408086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:30.477615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ec5bb06-d51f-4b5d-b90a-948ef2c87e19 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:30.489234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ec5bb06-d51f-4b5d-b90a-948ef2c87e19 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1217 microversion: 2.1 time: 0.141893 Sep 16 13:57:30.505319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 604/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:30 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:30.728715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:30.740333 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d002d9fe-b52a-4f84-ba2a-a47f73ceec28 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.376892 Sep 16 13:57:30.767257 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 602/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:30 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:30.881246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:30.881982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:30.894891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:30.895389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:30.897840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:30.901591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:30.906942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:30.908051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:31.184326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:31.185225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:31.206841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:31.208721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:31.209569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:31.214972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:31.216187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:31.218273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:31.249601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:31.319213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec0462c1-cc23-47a5-94ba-90fe706e809d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1470 microversion: 2.1 time: 0.441441 Sep 16 13:57:31.327880 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 605/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:30 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:31.345459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b5d0abc-f9d3-4566-91da-a6f941a0b0b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d212d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:31.601865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:31.612336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:31.614188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:31.615428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a941dab-66a1-495c-bff9-59ef5a3ad4da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.435416 Sep 16 13:57:31.616378 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 603/1208] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:31 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:31.621855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:31.622786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:31.630430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:31.631259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:31.632597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:31.633315 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b5d0abc-f9d3-4566-91da-a6f941a0b0b0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.303503 Sep 16 13:57:31.633932 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 606/1209] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:31 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:31.634640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:31.635349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:31.635960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:31.730163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:31.748137 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1a75fde-b834-43f2-9383-bc779757a972 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1221 microversion: 2.1 time: 0.130251 Sep 16 13:57:31.750868 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 604/1210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:31 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:31.787033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:31.789273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:31.802161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:31.803155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:31.804531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:31.806785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:31.809181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:31.811280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.349276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:32.352041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:32.375027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:32.375836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:32.376456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.377387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:32.378204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:32.379470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.404337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:32.412687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb5b8a47-9fce-496f-8394-ea374822f209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.635694 Sep 16 13:57:32.416856 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 607/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:31 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:32.668063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:32.668947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:32.684642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:32.685862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:32.686656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.687613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:32.688405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:32.689018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.702948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:32.714343 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3efbb01a-d9e2-4343-b972-8e9e6570935e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1470 microversion: 2.1 time: 0.369628 Sep 16 13:57:32.715872 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 605/1212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:32 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:32.720904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ac0d3943-a2f5-4a1f-97b5-60a45cac1999 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d339790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:32.783019 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ac0d3943-a2f5-4a1f-97b5-60a45cac1999 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.065616 Sep 16 13:57:32.793634 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 606/1213] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:32 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:32.799327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:32.800299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:32.807563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:32.808708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:32.809364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.810348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:32.811041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:32.811651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:32.927864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:32.952893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:32.953807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:32.960992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:32.964943 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05d4f8fe-7aef-4dd2-93e5-888b645b3f50 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.299476 Sep 16 13:57:32.965644 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 608/1214] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:32 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:32.972014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-88c1e6a6-01f6-405f-ad39-51111cc554aa tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1221 microversion: 2.1 time: 0.176489 Sep 16 13:57:32.973315 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 607/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:32 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:33.274710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-76ecd97a-6e1c-49aa-9108-861ebcbc862a req-d847e7b4-862c-48c4-aa75-39d4da447a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a45620b-7d81-415b-8d59-3cda88cd19b5", "tag": "95690f41-ab10-4f0f-9aa7-7e1c74615840"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:33.295736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-76ecd97a-6e1c-49aa-9108-861ebcbc862a req-d847e7b4-862c-48c4-aa75-39d4da447a39 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:33.296499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-76ecd97a-6e1c-49aa-9108-861ebcbc862a req-d847e7b4-862c-48c4-aa75-39d4da447a39 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:33.297553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-76ecd97a-6e1c-49aa-9108-861ebcbc862a req-d847e7b4-862c-48c4-aa75-39d4da447a39 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:33.325676 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-76ecd97a-6e1c-49aa-9108-861ebcbc862a req-d847e7b4-862c-48c4-aa75-39d4da447a39 service nova] Creating event network-changed:95690f41-ab10-4f0f-9aa7-7e1c74615840 for instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 on n-h1-858129-2 Sep 16 13:57:33.340795 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-76ecd97a-6e1c-49aa-9108-861ebcbc862a req-d847e7b4-862c-48c4-aa75-39d4da447a39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372219 Sep 16 13:57:33.343119 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 609/1216] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:33.444074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:33.445312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:33.455310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:33.456203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:33.457038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:33.458747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:33.459495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:33.460964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:33.744686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:33.777601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:33.798829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:33.833938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:33.834711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:33.835388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-864f6b50-84ec-4ece-a334-f17845feeb2d tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.393511 Sep 16 13:57:33.840082 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 608/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:33 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:33.854119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31653824-85d5-4d4a-91d8-e489ba17ecac tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3571f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:33.854697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:33.862713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:33.863226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:33.863676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:34.038931 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31653824-85d5-4d4a-91d8-e489ba17ecac tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.197017 Sep 16 13:57:34.049240 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 609/1218] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:33 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:34.057977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:34.060464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:34.092151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:34.093551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:34.094214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:34.095247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:34.096005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:34.096646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:34.229376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:34.243085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:34.246669 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-beaa96df-c18a-429e-9335-016695ae6fb8 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1213 microversion: 2.1 time: 0.195521 Sep 16 13:57:34.262900 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 610/1219] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:34 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:34.268745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:34.269884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:34.280223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:34.283074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:34.285317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:34.286392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:34.289945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:34.290850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:34.313765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:34.324470 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf794613-b2d3-48f3-8894-81848772af84 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1470 microversion: 2.1 time: 0.587625 Sep 16 13:57:34.335486 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 610/1220] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:33 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1470 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:34.490578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:34.507535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:34.507535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:34.507535 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c755b060-40a9-4e20-a851-28ccfc4931a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.240371 Sep 16 13:57:34.518853 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 611/1221] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:34 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:34.872596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:34.878658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:34.913583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:34.914925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:34.915730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:34.917041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:34.920339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:34.923382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.061045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b831424-3012-44ec-a1cb-559150c1fe34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3574c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:35.167717 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b831424-3012-44ec-a1cb-559150c1fe34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.113880 Sep 16 13:57:35.171717 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 612/1222] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:35 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:35.272152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:35.273024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:35.298161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.302239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.307129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.308152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.309711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.314521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.523752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:35.569134 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2cc60ce5-3f1b-407f-bf46-f94e4dc5323c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1269 microversion: 2.1 time: 0.302631 Sep 16 13:57:35.570298 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 613/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:35 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1269 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:35.581214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:35.582797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:35.597065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.598048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.599611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.602357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.603182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.604403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.754603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:35.761077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:35.783464 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4edd6245-1788-4a92-80b3-f333a55e856b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1428 microversion: 2.1 time: 0.211186 Sep 16 13:57:35.787185 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 614/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:35 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1428 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:35.808027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:35.809608 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-60d3fb8e-392c-4f29-963e-23e19be621e6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.948947 Sep 16 13:57:35.812454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 611/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:34 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:35.821681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-48fb142a-34a1-470f-ad0b-9d0fed9411fd req-39182593-1e1d-458b-aab4-7f59bd5ac3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf45248f-cf76-486d-96ef-2e4b7cbf8d62", "name": "network-vif-deleted", "tag": "7f09331d-e342-4d47-ad44-0085c26d3267"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:35.825982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:35.845418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48fb142a-34a1-470f-ad0b-9d0fed9411fd req-39182593-1e1d-458b-aab4-7f59bd5ac3cf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.846300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48fb142a-34a1-470f-ad0b-9d0fed9411fd req-39182593-1e1d-458b-aab4-7f59bd5ac3cf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.847386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48fb142a-34a1-470f-ad0b-9d0fed9411fd req-39182593-1e1d-458b-aab4-7f59bd5ac3cf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.874674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.875467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.875967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.876968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:35.877834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:35.879131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:35.881350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-48fb142a-34a1-470f-ad0b-9d0fed9411fd req-39182593-1e1d-458b-aab4-7f59bd5ac3cf service nova] Creating event network-vif-deleted:7f09331d-e342-4d47-ad44-0085c26d3267 for instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 on n-h2-858129-2 Sep 16 13:57:35.893230 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-48fb142a-34a1-470f-ad0b-9d0fed9411fd req-39182593-1e1d-458b-aab4-7f59bd5ac3cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077913 Sep 16 13:57:35.902215 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 612/1226] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:36.192544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44880a13-13b6-4fe0-8a9e-4b8bcc81120c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d1c6790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:36.326099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44880a13-13b6-4fe0-8a9e-4b8bcc81120c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.142885 Sep 16 13:57:36.337441 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 613/1227] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:36 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:36.431639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:36.455277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:36.458844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:36.467743 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-350b0745-f6f8-46e5-ab23-661285c93e94 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.677807 Sep 16 13:57:36.482966 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 615/1228] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:35 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:36.602658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:36.603529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:36.619963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:36.628637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:36.631460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:36.635473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:36.638737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:36.640884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:36.653518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5891b70-1da0-4fef-91ba-da8832831d5c tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-298606420", "ram": 512, "vcpus": 1, "disk": 10, "id": 1111491262, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:36.690810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5891b70-1da0-4fef-91ba-da8832831d5c tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.351776 Sep 16 13:57:36.706941 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 614/1229] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:57:36 2022] POST /compute/v2.1/flavors => generated 415 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:36.714711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-26788123-a8a8-4861-bafb-2aa767d4c0d5 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:36.764685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:36.780799 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-26788123-a8a8-4861-bafb-2aa767d4c0d5 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072623 Sep 16 13:57:36.789833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 615/1230] 10.222.0.60 () {60 vars in 1224 bytes} [Fri Sep 16 13:57:36 2022] POST /compute/v2.1/flavors/1111491262/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:36.794233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:36.811021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69048c3e-d826-4cb7-aa6a-7a20403f8a94 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1275 microversion: 2.1 time: 0.211178 Sep 16 13:57:36.830591 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 616/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:36 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:36.837596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:36.838841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:36.847621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:36.848588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:36.849765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:36.852616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:36.853387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:36.853983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:36.903870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:36.904717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:36.905313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:36.905977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid bf45248f-cf76-486d-96ef-2e4b7cbf8d62 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:36.973774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:36.987673 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-440ca16d-7c01-4362-8e43-396f5acf50ed tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1304 microversion: 2.1 time: 0.155506 Sep 16 13:57:36.992303 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 617/1232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:36 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:37.015678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.016295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:37.024189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.024682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.025111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.025822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.026269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.026809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.235972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-705bffbf-0fac-40c6-9cab-e32bcdbe26fa tempest-FlavorsExtraSpecsTestJSON-852494080 tempest-FlavorsExtraSpecsTestJSON-852494080-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.282560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:37.294259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a725a634-87ae-4a15-b346-f4c6197b3aa4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.282611 Sep 16 13:57:37.295508 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 618/1233] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:37 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:37.303074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d902ff66-24ec-466c-af73-68b5cd39fc09 req-08a34008-a5f5-4bc8-9dce-af7d45dea0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "name": "network-vif-plugged", "status": "completed", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:37.318698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-705bffbf-0fac-40c6-9cab-e32bcdbe26fa tempest-FlavorsExtraSpecsTestJSON-852494080 tempest-FlavorsExtraSpecsTestJSON-852494080-project] 10.222.0.60 "GET /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.523096 Sep 16 13:57:37.329842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d902ff66-24ec-466c-af73-68b5cd39fc09 req-08a34008-a5f5-4bc8-9dce-af7d45dea0d9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.330481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d902ff66-24ec-466c-af73-68b5cd39fc09 req-08a34008-a5f5-4bc8-9dce-af7d45dea0d9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.332181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d902ff66-24ec-466c-af73-68b5cd39fc09 req-08a34008-a5f5-4bc8-9dce-af7d45dea0d9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.339896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 616/1234] 10.222.0.60 () {58 vars in 1203 bytes} [Fri Sep 16 13:57:36 2022] GET /compute/v2.1/flavors/1111491262/os-extra_specs => generated 66 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:37.366191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55561a9f-a54e-40f4-b512-ce60c5261618 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:37.367892 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d902ff66-24ec-466c-af73-68b5cd39fc09 req-08a34008-a5f5-4bc8-9dce-af7d45dea0d9 service nova] Creating event network-vif-plugged:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h2-858129-2 Sep 16 13:57:37.378359 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d902ff66-24ec-466c-af73-68b5cd39fc09 req-08a34008-a5f5-4bc8-9dce-af7d45dea0d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080837 Sep 16 13:57:37.379600 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 619/1235] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:37.388078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-17dfb7ae-cc84-42ea-b6f3-99a8150fdbf8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724e35cf70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.495864 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55561a9f-a54e-40f4-b512-ce60c5261618 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.150522 Sep 16 13:57:37.506164 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 617/1236] 10.222.0.60 () {60 vars in 1224 bytes} [Fri Sep 16 13:57:37 2022] POST /compute/v2.1/flavors/1111491262/os-extra_specs => generated 66 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:37.516752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.518342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:37.533106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.534111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.535115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.537057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.538818 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-17dfb7ae-cc84-42ea-b6f3-99a8150fdbf8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.154673 Sep 16 13:57:37.539423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.539952 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 620/1237] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:37 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:37.540879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.576048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6ecab93-5f7a-4d61-bac1-145b5672f052 tempest-FlavorsExtraSpecsTestJSON-852494080 tempest-FlavorsExtraSpecsTestJSON-852494080-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.649721 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6ecab93-5f7a-4d61-bac1-145b5672f052 tempest-FlavorsExtraSpecsTestJSON-852494080 tempest-FlavorsExtraSpecsTestJSON-852494080-project] 10.222.0.60 "GET /compute/v2.1/flavors/1111491262/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.095019 Sep 16 13:57:37.652232 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 621/1238] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 13:57:37 2022] GET /compute/v2.1/flavors/1111491262/os-extra_specs/hw:numa_nodes => generated 22 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:37.671308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7926757-0f3a-4d33-b21d-3341bca8d422 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:37.780421 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7926757-0f3a-4d33-b21d-3341bca8d422 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117762 Sep 16 13:57:37.781882 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 622/1239] 10.222.0.60 () {60 vars in 1224 bytes} [Fri Sep 16 13:57:37 2022] POST /compute/v2.1/flavors/1111491262/os-extra_specs => generated 66 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 13:57:37.808467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82498e96-94b4-41ee-9f2b-0a1ffbcbfb58 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.842073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82498e96-94b4-41ee-9f2b-0a1ffbcbfb58 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050946 Sep 16 13:57:37.843939 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 623/1240] 10.222.0.60 () {58 vars in 1203 bytes} [Fri Sep 16 13:57:37 2022] GET /compute/v2.1/flavors/1111491262/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 13:57:37.862950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:37.864490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:37.879113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.880141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.881248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.883021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:37.883926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:37.884812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:37.967244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:37.978874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:37.981168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:37.982725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc92c4f2-3287-44ab-9725-2f484f594e33 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.474233 Sep 16 13:57:37.983531 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 618/1241] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:37 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:37.988850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2277bc3-8983-4146-abfd-36b644748271 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:38.042361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2277bc3-8983-4146-abfd-36b644748271 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1111491262/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.057189 Sep 16 13:57:38.049084 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 619/1242] 10.222.0.60 () {60 vars in 1265 bytes} [Fri Sep 16 13:57:37 2022] PUT /compute/v2.1/flavors/1111491262/os-extra_specs/hw:numa_nodes => generated 22 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:38.055764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.056906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:38.064943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:38.065916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:38.066670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:38.067964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:38.069211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:38.070761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:38.071651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:38.086117 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf25b7e7-d051-401d-b874-372a0e916a4b tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1275 microversion: 2.1 time: 0.235551 Sep 16 13:57:38.087729 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 624/1243] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:37 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:38.107089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bb6b6e6-6f3a-4a3a-99d2-688dab44f307 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.136377 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5bb6b6e6-6f3a-4a3a-99d2-688dab44f307 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045777 Sep 16 13:57:38.137370 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 625/1244] 10.222.0.60 () {58 vars in 1203 bytes} [Fri Sep 16 13:57:38 2022] GET /compute/v2.1/flavors/1111491262/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:38.148520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-869a662b-8892-4387-891b-2a01b31f0bb3 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.149681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:38.150539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:38.152148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:38.153289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid bf45248f-cf76-486d-96ef-2e4b7cbf8d62 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:38.205234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:38.218535 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-869a662b-8892-4387-891b-2a01b31f0bb3 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1111491262/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.074416 Sep 16 13:57:38.219143 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 626/1245] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 13:57:38 2022] DELETE /compute/v2.1/flavors/1111491262/os-extra_specs/hw:numa_nodes => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:57:38.229852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d6539e70-4611-40f4-9a0c-8bce015f544b tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.269513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:38.295998 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e35d9a74-acc6-4284-b5b6-3aaf43f4746d tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 200 len: 1304 microversion: 2.1 time: 0.244461 Sep 16 13:57:38.300843 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 620/1246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:38 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:38.306138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d6539e70-4611-40f4-9a0c-8bce015f544b tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1111491262/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.080602 Sep 16 13:57:38.311921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 627/1247] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 13:57:38 2022] DELETE /compute/v2.1/flavors/1111491262/os-extra_specs/hw:cpu_policy => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 13:57:38.321759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.322055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:38.329829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0958b2a3-b09f-4f6e-9216-82d005fb8e7a tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.338995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:38.342080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:38.342366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:38.345198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:38.345900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:38.352037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0958b2a3-b09f-4f6e-9216-82d005fb8e7a tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1111491262/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027931 Sep 16 13:57:38.362627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 1203 bytes} [Fri Sep 16 13:57:38 2022] GET /compute/v2.1/flavors/1111491262/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:57:38.363260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:38.383170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-403b3b54-03c9-47b7-a798-16e6602bb8c6 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.433500 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-403b3b54-03c9-47b7-a798-16e6602bb8c6 tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1111491262" status: 202 len: 0 microversion: 2.1 time: 0.065284 Sep 16 13:57:38.438471 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 629/1249] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 13:57:38 2022] DELETE /compute/v2.1/flavors/1111491262 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:57:38.448700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-448318f8-e830-4b23-ac2f-b68521be907d tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.480919 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-448318f8-e830-4b23-ac2f-b68521be907d tempest-FlavorsExtraSpecsTestJSON-1509328866 tempest-FlavorsExtraSpecsTestJSON-1509328866-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039785 Sep 16 13:57:38.481843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 630/1250] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:57:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:38.558676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4c419f5-b9c4-4996-abf2-94caa9bac2b5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d38cd30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:38.628180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:38.646768 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4c419f5-b9c4-4996-abf2-94caa9bac2b5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.093858 Sep 16 13:57:38.650185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c90da72f-325a-490a-bc91-ef7f4bbde81b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.336113 Sep 16 13:57:38.656692 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 621/1251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:38 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:38.659325 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 631/1252] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:38 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:39.043063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:39.048093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:39.070504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.097972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.099903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.106723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.110507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.116037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.119603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:39.120224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:39.133347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.135862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.137034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.139680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.140299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.141122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.142741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:39.553861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:39.573025 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60f0d69b-133a-4d9a-b37f-4e9db28adb4c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.459221 Sep 16 13:57:39.574002 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 632/1253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:39 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:39.582128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:39.582824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: bf45248f-cf76-486d-96ef-2e4b7cbf8d62] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:39.610010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.614883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.615478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.616348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.617680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.618170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.655896 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] HTTP exception thrown: Instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 could not be found. Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Request method failure captured: Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 HTTP/1.1 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAKxitu5HddqDjS2UXG6k4V4baTlWnxTiEUTJklsQRPyFkrZ1VcQSB3QCzrlEe9lqSuy7VE-I2ZTWS3zW_Hc7XWVOvXY6SIoCYPjfd9XcLlDUZ9kL9UHBKvEIdQ42OLB_RXaVP6ld4I6O9EWTnRFB6ShMAKLj-pJaNdiritEaynnK8 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0be8e21f9d2d436285f91238eb580125 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:57:39.657847 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0be8e21f9d2d436285f91238eb580125", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0be8e21f9d2d436285f91238eb580125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0be8e21f9d2d436285f91238eb580125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0be8e21f9d2d436285f91238eb580125"}]}] Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0be8e21f9d2d436285f91238eb580125 Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdminTestJSON-1740110922-project Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f7b24d82070f42f59776a115147e9678 Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdminTestJSON-1740110922-project Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 could not be found. Sep 16 13:57:39.661355 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'bf45248f-cf76-486d-96ef-2e4b7cbf8d62'} Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 could not be found. Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:39.665736 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 could not be found. Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 could not be found. Sep 16 13:57:39.670490 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:39.675830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Returning 404 to user: Instance bf45248f-cf76-486d-96ef-2e4b7cbf8d62 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:39.675830 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-988aabb2-f83f-4285-8d3b-a2f5bbd4d866 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62" status: 404 len: 111 microversion: 2.1 time: 0.086936 Sep 16 13:57:39.675830 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 633/1254] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:39 2022] GET /compute/v2.1/servers/bf45248f-cf76-486d-96ef-2e4b7cbf8d62 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:39.682897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b981c12-ae76-409b-8b95-2ef1c24fe9fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d357670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:39.748871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b981c12-ae76-409b-8b95-2ef1c24fe9fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.083215 Sep 16 13:57:39.750465 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 634/1255] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:39 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:39.754822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:39.756070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:39.757402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:39.771391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.772196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.773423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.774351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.775054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.775881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.785645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:39.798525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:39.805897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89e69d22-d562-4042-8175-e8c2a33bab64 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.773617 Sep 16 13:57:39.826530 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 622/1256] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:39 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:39.849797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:57:39.851853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:39.857691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:39.880083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.881635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.883487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:39.886493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:39.887806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:39.894027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:40.037228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e57e4bf1-4b2c-47b9-86da-981d49c2f133 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 204 len: 0 microversion: 2.1 time: 0.283563 Sep 16 13:57:40.038643 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 635/1257] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:39 2022] DELETE /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:57:40.047910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:40.049148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:40.058617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:40.059667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:40.060302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:40.087482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:40.087482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:40.096554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:40.212735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:40.245802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=5 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:40.385485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:40.429280 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ccb45029-1f45-41fb-ad05-1c9ac72f593b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1312 microversion: 2.1 time: 0.600698 Sep 16 13:57:40.443008 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 623/1258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:39 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:40.580077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:40.590128 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9e427aad-9d3a-4728-ab2c-a01161f99d9b tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1468 microversion: 2.1 time: 0.547367 Sep 16 13:57:40.603397 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 636/1259] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:40 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1468 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:40.614660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:40.621239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:40.628886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:40.648567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:40.650382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:40.651681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:40.653644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:40.655180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:40.656355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:40.767586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd0a8f11-9590-4fc3-9e63-58c7e879e8cb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d56c820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:40.958741 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd0a8f11-9590-4fc3-9e63-58c7e879e8cb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.197229 Sep 16 13:57:40.970541 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 637/1260] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:40 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:40.983339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:40.987284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:41.001092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.002339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.003481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:41.005564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.007275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.007845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:41.010739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:41.020722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f0585dc-771d-41c5-bc7f-436f7d0ec1db tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.418774 Sep 16 13:57:41.023765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 624/1261] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:40 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:41.387680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:41.401989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:41.404244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:41.405425 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-10cbff17-f8fb-4d4a-b102-a8544305c5d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.434203 Sep 16 13:57:41.406132 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 638/1262] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:40 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:41.471704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:41.480768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:41.514573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.515465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.517194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:41.519760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.521166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.523241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:41.608046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-288e309b-85ff-4189-9ed2-557f3196dee9 req-703c877c-c20d-4aaf-9d8a-f68bf2cb93d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c33ea9e-f16a-4ca1-afbe-29878cacf2f0", "tag": "1ed0a192-ed63-40eb-bc95-a2bb26cffe55"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:41.635513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-288e309b-85ff-4189-9ed2-557f3196dee9 req-703c877c-c20d-4aaf-9d8a-f68bf2cb93d3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.636045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-288e309b-85ff-4189-9ed2-557f3196dee9 req-703c877c-c20d-4aaf-9d8a-f68bf2cb93d3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.636552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-288e309b-85ff-4189-9ed2-557f3196dee9 req-703c877c-c20d-4aaf-9d8a-f68bf2cb93d3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:41.664120 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-288e309b-85ff-4189-9ed2-557f3196dee9 req-703c877c-c20d-4aaf-9d8a-f68bf2cb93d3 service nova] Creating event network-changed:1ed0a192-ed63-40eb-bc95-a2bb26cffe55 for instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 on n-h2-858129-2 Sep 16 13:57:41.689312 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-288e309b-85ff-4189-9ed2-557f3196dee9 req-703c877c-c20d-4aaf-9d8a-f68bf2cb93d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086017 Sep 16 13:57:41.691452 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 639/1263] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:41.714630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:41.718341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:41.739183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.745059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.746052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:41.751221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:41.752240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:41.753001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.029984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:42.055823 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-73ca932d-e524-4d5f-9129-dddc22c62659 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1462 microversion: 2.1 time: 0.599581 Sep 16 13:57:42.056448 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 625/1264] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:41 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1462 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:42.072346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89210460-ef87-4a29-92cb-4ec341922e94 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2641f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:42.209653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:42.251073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e397d57-71a7-444d-ad02-d136b045bcb7 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1468 microversion: 2.1 time: 0.557165 Sep 16 13:57:42.266501 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89210460-ef87-4a29-92cb-4ec341922e94 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.193162 Sep 16 13:57:42.266770 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 640/1265] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:41 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1468 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:42.266875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 626/1266] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:42 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:42.289852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:42.294391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:42.295037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:42.299489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:42.319670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.320381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.320872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.326493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.328401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.329808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.331558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.332834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.334326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.336470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.337105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.337736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.401816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:42.763935 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1510640-2924-4230-950e-42e29bd8d64d tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1613 microversion: 2.1 time: 0.503455 Sep 16 13:57:42.776063 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 627/1267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:42 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1613 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:42.794662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:42.796020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:42.809095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.809871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.810553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.811755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.812423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.813018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.852849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:42.882800 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd83e7ec-f94b-447e-b9a3-9925acb2ffb9 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.609544 Sep 16 13:57:42.883855 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 641/1268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:42 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:42.895944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:42.897142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:42.909871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.910786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.911624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:42.913669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:42.914860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:42.915877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:43.052937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c519716c82b84ec5b2e31c3f5b1622dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214fc02f7664f268a03557dc8c5201b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:43.054866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] flavor_id is None. Assuming migration. {{(pid=128643) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 16 13:57:43.057554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128643) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 13:57:43.285089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:43.318577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:43.333822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:43.336524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82a9e17a-bf03-475e-96f2-3e88f69a03f6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.558823 Sep 16 13:57:43.337565 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 628/1269] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:42 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:43.362000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b45caa7-b541-4f2a-9be5-aea0f9bba746 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d212d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:43.460741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b45caa7-b541-4f2a-9be5-aea0f9bba746 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.113784 Sep 16 13:57:43.461839 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 629/1270] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:43 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:43.476777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:43.495994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:43.536091 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6430665b-16f5-4a41-ac4d-22534ed7ea5c tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570/action" status: 202 len: 0 microversion: 2.1 time: 0.644212 Sep 16 13:57:43.540155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 642/1271] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:57:42 2022] POST /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:57:43.547763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:43.548384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:43.560657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:43.561740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:43.562509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:43.564768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:43.565273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:43.565713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:43.566490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:43.566967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:43.567839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:43.577490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:43.580499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:43.586091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:43.953649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:43.970823 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fe23029-167f-408a-9d27-598552f0b88c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.422977 Sep 16 13:57:43.972151 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 643/1272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:43 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:43.980816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:43.986209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:44.004786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:44.010695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:44.011536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:44.012513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:44.013348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:44.017517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:44.034964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:44.056297 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25f67e25-cbb9-4786-be85-50ceabd52094 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1468 microversion: 2.1 time: 0.591670 Sep 16 13:57:44.057219 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 630/1273] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:43 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1468 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:44.385796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:44.390157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:44.405213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:44.406120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:44.407154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:44.408449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:44.409302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:44.410515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:44.434389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:44.456389 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-096e7e7c-e582-4ace-b8cb-5409e83e00ee tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.482759 Sep 16 13:57:44.475123 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 644/1274] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:43 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:44.490269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-12cf4475-282f-49ec-8b00-f59d29f555b3 req-c2e841b9-26db-4f05-b86f-11e2b0b7d3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9273f24-7349-4e30-ae09-0cffb2856d33", "name": "network-vif-deleted", "tag": "804a3871-b28d-4c94-9928-649d033a5921"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:44.507671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-12cf4475-282f-49ec-8b00-f59d29f555b3 req-c2e841b9-26db-4f05-b86f-11e2b0b7d3e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:44.510663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-12cf4475-282f-49ec-8b00-f59d29f555b3 req-c2e841b9-26db-4f05-b86f-11e2b0b7d3e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:44.512231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-12cf4475-282f-49ec-8b00-f59d29f555b3 req-c2e841b9-26db-4f05-b86f-11e2b0b7d3e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:44.542030 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-12cf4475-282f-49ec-8b00-f59d29f555b3 req-c2e841b9-26db-4f05-b86f-11e2b0b7d3e2 service nova] Creating event network-vif-deleted:804a3871-b28d-4c94-9928-649d033a5921 for instance b9273f24-7349-4e30-ae09-0cffb2856d33 on n-h1-858129-2 Sep 16 13:57:44.556589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-12cf4475-282f-49ec-8b00-f59d29f555b3 req-c2e841b9-26db-4f05-b86f-11e2b0b7d3e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079569 Sep 16 13:57:44.557828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 645/1275] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:44.564517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0cc3fe93-617b-43dc-8941-3ef6f29a1949 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724e492d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:44.671924 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0cc3fe93-617b-43dc-8941-3ef6f29a1949 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.112477 Sep 16 13:57:44.684655 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 646/1276] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:44 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:44.902946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:44.925752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:44.945193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:44.948914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b9ff19a-b49f-43c1-8ab3-53a7f9ca574e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.575103 Sep 16 13:57:44.968276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 631/1277] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:44 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:45.022206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:45.023026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:45.033022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.033535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.033981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.034768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.035606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.036310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.088025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d8a2bd99-cb2b-4455-a7df-3b9c23add84c req-8a43bd55-966f-42fc-8081-c5cf4574e2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45620b-7d81-415b-8d59-3cda88cd19b5", "name": "network-vif-plugged", "status": "completed", "tag": "95690f41-ab10-4f0f-9aa7-7e1c74615840"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:45.104604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d8a2bd99-cb2b-4455-a7df-3b9c23add84c req-8a43bd55-966f-42fc-8081-c5cf4574e2ac service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.106957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d8a2bd99-cb2b-4455-a7df-3b9c23add84c req-8a43bd55-966f-42fc-8081-c5cf4574e2ac service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.109362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d8a2bd99-cb2b-4455-a7df-3b9c23add84c req-8a43bd55-966f-42fc-8081-c5cf4574e2ac service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.134468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d8a2bd99-cb2b-4455-a7df-3b9c23add84c req-8a43bd55-966f-42fc-8081-c5cf4574e2ac service nova] Creating event network-vif-plugged:95690f41-ab10-4f0f-9aa7-7e1c74615840 for instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 on n-h1-858129-2 Sep 16 13:57:45.149423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d8a2bd99-cb2b-4455-a7df-3b9c23add84c req-8a43bd55-966f-42fc-8081-c5cf4574e2ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064692 Sep 16 13:57:45.151235 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 632/1278] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:57:45.162787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:45.166345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:45.181194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.182186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.182838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.184135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.188870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.190366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.265493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.266209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.267138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.268523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid b9273f24-7349-4e30-ae09-0cffb2856d33 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:45.485899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:45.513337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9dd30404-30f5-4434-bcda-fcce8ecebbc4 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1303 microversion: 2.1 time: 0.351748 Sep 16 13:57:45.514033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 633/1279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:45 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1303 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:45.521724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:45.531129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:45.584824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.589519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.595663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.597667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:45.599900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:45.601331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:45.640889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:45.659035 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf034145-aa74-4475-b90f-07ea2a43db21 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.634478 Sep 16 13:57:45.661340 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 647/1280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:45 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:45.689746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f628416b-6fdf-4542-840d-2b20bc68c331 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d429a60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:45.836350 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f628416b-6fdf-4542-840d-2b20bc68c331 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.149295 Sep 16 13:57:45.838698 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 648/1281] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:45 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:45.987507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:45.989689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:45.990070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:46.005484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.007450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.007938 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-836e6ded-064b-4f49-90a7-19bd53c3fd35 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.489466 Sep 16 13:57:46.008644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.010148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.011506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.012434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.028302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 634/1282] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:45 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:46.372801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:46.395758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:46.400624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:46.403776 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-695ba1e8-fc5f-4d1c-95d5-118f0050b0c5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.424879 Sep 16 13:57:46.405219 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 649/1283] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:45 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:57:46.546712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:46.552333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:46.571150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.578490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.583954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.585666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.587163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.588189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.669583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.671246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.673001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.674347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid b9273f24-7349-4e30-ae09-0cffb2856d33 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:46.730530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:46.739893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:46.769368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.769731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:46.770268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.774489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.776279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:46.787093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:46.788450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:46.797339 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6ec7dd6-c129-4cb9-ac1b-b32ecb05c30e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 200 len: 1303 microversion: 2.1 time: 0.259973 Sep 16 13:57:46.799510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 635/1284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:46 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:46.862661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad5d323d-e836-4b2f-aee1-a71b0d6bfb50 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d200c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:46.953966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ad5d323d-e836-4b2f-aee1-a71b0d6bfb50 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.097135 Sep 16 13:57:46.956859 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 636/1285] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:46 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:47.050740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:47.063076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:47.101103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:47.104858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:47.106627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:47.109571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:47.113361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:47.116131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:47.120380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:47.144161 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b126cdf8-dc9d-4edb-8b39-b4a55e022b84 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.421377 Sep 16 13:57:47.159434 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 650/1286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:46 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:47.487301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:47.488463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:47.537743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:47.565611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:47.567172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:47.571243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:47.572973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:47.577750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:47.579026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:47.583736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b543b2f-34f7-449a-bf48-3e2c58774ce0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.546647 Sep 16 13:57:47.588478 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 637/1287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:47 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:47.921620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0dc04650-3091-4aac-970b-e6aff4532733 tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1498465027", "id": 1012455683, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:47.964901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:47.979927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:47.981561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:47.982784 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d34958a-b029-433b-9125-f9784fac4cdb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1410 microversion: 2.25 time: 0.526900 Sep 16 13:57:47.998659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0dc04650-3091-4aac-970b-e6aff4532733 tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.407856 Sep 16 13:57:47.998983 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 651/1288] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:47 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1410 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:48.011005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 638/1289] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:57:47 2022] POST /compute/v2.1/flavors => generated 449 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:57:48.015609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:48.016511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: b9273f24-7349-4e30-ae09-0cffb2856d33] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:48.020718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4175144a-5ec3-4277-9e6c-2bf0479bfdd0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2af040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:48.027251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.027774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.028217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.033529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.034351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.035695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.061161 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] HTTP exception thrown: Instance b9273f24-7349-4e30-ae09-0cffb2856d33 could not be found. Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Request method failure captured: Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 HTTP/1.1 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAKxitu5HddqDjS2UXG6k4V4baTlWnxTiEUTJklsQRPyFkrZ1VcQSB3QCzrlEe9lqSuy7VE-I2ZTWS3zW_Hc7XWVOvXY6SIoCYPjfd9XcLlDUZ9kL9UHBKvEIdQ42OLB_RXaVP6ld4I6O9EWTnRFB6ShMAKLj-pJaNdiritEaynnK8 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0be8e21f9d2d436285f91238eb580125 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:57:48.126812 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0be8e21f9d2d436285f91238eb580125", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0be8e21f9d2d436285f91238eb580125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0be8e21f9d2d436285f91238eb580125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0be8e21f9d2d436285f91238eb580125"}]}] Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0be8e21f9d2d436285f91238eb580125 Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdminTestJSON-1740110922-project Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f7b24d82070f42f59776a115147e9678 Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdminTestJSON-1740110922-project Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b9273f24-7349-4e30-ae09-0cffb2856d33 could not be found. Sep 16 13:57:48.129489 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b9273f24-7349-4e30-ae09-0cffb2856d33'} Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9273f24-7349-4e30-ae09-0cffb2856d33 could not be found. Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:48.130955 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9273f24-7349-4e30-ae09-0cffb2856d33 could not be found. Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9273f24-7349-4e30-ae09-0cffb2856d33 could not be found. Sep 16 13:57:48.133790 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:57:48.139395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Returning 404 to user: Instance b9273f24-7349-4e30-ae09-0cffb2856d33 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:48.144920 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b75790f4-eded-4816-86cb-b88e26c5b351 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33" status: 404 len: 111 microversion: 2.1 time: 0.140891 Sep 16 13:57:48.151869 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 652/1290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:47 2022] GET /compute/v2.1/servers/b9273f24-7349-4e30-ae09-0cffb2856d33 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:48.156365 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4175144a-5ec3-4277-9e6c-2bf0479bfdd0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1413 microversion: 2.1 time: 0.129350 Sep 16 13:57:48.182817 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 639/1291] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:48 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:48.202451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:48.202964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:48.221338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.221338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.222002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.222699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.222886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.224233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.298912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:57:48.629314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05f6579b-dce8-42e0-8b98-31d7aa766fcf tempest-FlavorsV255TestJSON-564732385 tempest-FlavorsV255TestJSON-564732385-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:48.684990 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05f6579b-dce8-42e0-8b98-31d7aa766fcf tempest-FlavorsV255TestJSON-564732385 tempest-FlavorsV255TestJSON-564732385-project] 10.222.0.60 "GET /compute/v2.1/flavors/1012455683" status: 200 len: 449 microversion: 2.55 time: 0.530912 Sep 16 13:57:48.691004 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 653/1292] 10.222.0.60 () {60 vars in 1199 bytes} [Fri Sep 16 13:57:48 2022] GET /compute/v2.1/flavors/1012455683 => generated 449 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:57:48.739529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:48.740662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:48.770932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6bcada06-76dd-4183-a47d-e343c55bc0ff tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 204 len: 0 microversion: 2.1 time: 0.586101 Sep 16 13:57:48.772008 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 640/1293] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:48 2022] DELETE /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:57:48.806346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.807457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.808261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.809552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.816275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:48.817851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.820299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.824904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:48.854887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.882550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.883320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:48.884643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:48.885474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:48.886242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:49.273514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:49.288421 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c8b2634-5eab-43b6-bd69-6d9a2b811081 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.595479 Sep 16 13:57:49.289635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 654/1294] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:48 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:49.312497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad0e01fe-b3e6-4467-8c4a-9fcccc2188f2 tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:49.370588 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad0e01fe-b3e6-4467-8c4a-9fcccc2188f2 tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1012455683" status: 200 len: 450 microversion: 2.55 time: 0.078916 Sep 16 13:57:49.384909 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 655/1295] 10.222.0.60 () {62 vars in 1219 bytes} [Fri Sep 16 13:57:49 2022] PUT /compute/v2.1/flavors/1012455683 => generated 450 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:57:49.395988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:49.400202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:49.402376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:49.427825 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2158a02c-a240-4ec6-bf00-f221e58af3f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.639655 Sep 16 13:57:49.429577 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 641/1296] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:48 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:49.448417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:49.450481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:49.471415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:49.472965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:49.474724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:49.475615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:49.477354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:49.478326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:49.490712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:49.710938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:49.711831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:49.712507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:49.713583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:49.714058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:49.714768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:49.756587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:49.772451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:49.776246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:49.778730 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d21745b-b676-4e6b-be48-e8783802c12c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1605 microversion: 2.25 time: 0.346709 Sep 16 13:57:49.795005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 642/1297] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:57:49 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1605 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:49.829859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c77febe-842f-4004-8754-6dc5a21fd00a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2120d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:49.945880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:49.962354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4486d859-f100-46c1-8320-422498ac11bf tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1469 microversion: 2.1 time: 0.574394 Sep 16 13:57:49.963714 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 656/1298] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:49 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1469 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:49.966842 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c77febe-842f-4004-8754-6dc5a21fd00a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1422 microversion: 2.1 time: 0.169313 Sep 16 13:57:49.968594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 643/1299] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:49 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1422 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:49.979157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:49.979663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6bf94f38-44ba-420a-9c6d-31f2ca53b11e tempest-FlavorsV255TestJSON-564732385 tempest-FlavorsV255TestJSON-564732385-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:49.980738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:50.003477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:50.004299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:50.005084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:50.006650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:50.010334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:50.011278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:50.027980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6bf94f38-44ba-420a-9c6d-31f2ca53b11e tempest-FlavorsV255TestJSON-564732385 tempest-FlavorsV255TestJSON-564732385-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.062896 Sep 16 13:57:50.039124 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 657/1300] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:57:49 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:50.053074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc9cded9-67f9-474b-a1f3-a74303695395 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3089d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:50.162171 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc9cded9-67f9-474b-a1f3-a74303695395 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 200 len: 1422 microversion: 2.1 time: 0.119787 Sep 16 13:57:50.165095 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 658/1301] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:57:50 2022] GET /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:50.177701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a72cc59c-1c81-4b05-8f37-86e40a5a7bdc tempest-FlavorsV255TestJSON-564732385 tempest-FlavorsV255TestJSON-564732385-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:50.182669 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d19e2dbc-e4e0-4122-95b6-961cec04db68 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.206826 Sep 16 13:57:50.183719 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 644/1302] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 13:57:49 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:57:50.193291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77b9542e-b7b7-4388-91bb-b8d1b9e93c2b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d212700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:50.233459 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a72cc59c-1c81-4b05-8f37-86e40a5a7bdc tempest-FlavorsV255TestJSON-564732385 tempest-FlavorsV255TestJSON-564732385-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.065227 Sep 16 13:57:50.251774 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 659/1303] 10.222.0.60 () {60 vars in 1166 bytes} [Fri Sep 16 13:57:50 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:50.301195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27706664-8cd4-482f-8138-494145d1963d tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:50.376430 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27706664-8cd4-482f-8138-494145d1963d tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1012455683" status: 202 len: 0 microversion: 2.55 time: 0.093022 Sep 16 13:57:50.383944 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 660/1304] 10.222.0.60 () {60 vars in 1202 bytes} [Fri Sep 16 13:57:50 2022] DELETE /compute/v2.1/flavors/1012455683 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 13:57:50.394340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:50.395604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:50.429761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:50.433365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:50.437283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:50.448460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:50.451710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:50.455649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:50.988808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:51.010964 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f54b0dbe-67e4-4aec-a29c-67f4ea8a7740 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.624556 Sep 16 13:57:51.012663 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 661/1305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:50 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:51.030446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-99ec4d72-fee1-4467-a8f4-69c35650c8ee tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:51.068426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-99ec4d72-fee1-4467-a8f4-69c35650c8ee tempest-FlavorsV255TestJSON-467243333 tempest-FlavorsV255TestJSON-467243333-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.053395 Sep 16 13:57:51.070018 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 662/1306] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 13:57:51 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:57:51.079074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:51.079669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:51.092091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:51.092091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:51.092757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:51.095659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:51.095659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:51.095894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:51.461119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77b9542e-b7b7-4388-91bb-b8d1b9e93c2b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 204 len: 0 microversion: 2.1 time: 1.263787 Sep 16 13:57:51.479583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 645/1307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:50 2022] DELETE /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 0 bytes in 1287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:57:51.524207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:51.528917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:51.573234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:51.574603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:51.575682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:51.578009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:51.583051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:51.584297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:51.589483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:51.609667 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79562139-3de6-4002-a801-999ec198a2ef tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.537521 Sep 16 13:57:51.638930 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 663/1308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:51 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:51.657933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:51.659686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:51.687527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:51.691185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:51.694779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:51.698284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:51.699493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:51.700592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:51.769156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:57:51.994170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eae4319e-b1e4-405f-b13d-0f0c65c13377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 204 len: 0 microversion: 2.1 time: 0.353003 Sep 16 13:57:51.995235 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 664/1309] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:51 2022] DELETE /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:57:52.051104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:52.051961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:52.057880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:52.062380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:52.063150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:52.064415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:52.065945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:52.066710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:52.067290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:52.076195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:52.678363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:52.691767 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15410e44-8df5-4dbd-9f3f-e3d81d0abd56 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.645285 Sep 16 13:57:52.696050 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 665/1310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:52 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:52.707785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1704348973", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:52.738334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:52.760423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c5c126f-2b18-42a9-a669-e008b11d016e tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1469 microversion: 2.1 time: 1.273183 Sep 16 13:57:52.777362 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 646/1311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:51 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1469 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:52.813263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:52.814065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:52.850874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:52.852784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:52.853856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:52.855379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:52.856465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:52.856675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] validate_networks() for [('b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:57:52.857691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:53.518031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:53.529492 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f86c1a26-8528-4f49-9d68-273e78b27147 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.750510 Sep 16 13:57:53.531218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 647/1312] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:52 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:53.537786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c13b6cb-2418-479f-85aa-085acb1cdb9c"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:53.542560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:53.554539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:53.555670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:53.556916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:53.558562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:53.559410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:53.560246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.191946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:57:54.193172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:57:54.195293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:57:54.196561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:57:54.197629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:57:54.207463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30c64e31-76aa-4e92-aa37-b4fa9a308666 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "POST /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674350 Sep 16 13:57:54.209313 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 648/1313] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 13:57:53 2022] POST /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:54.215826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-adfe9adf-1e31-4724-a7c1-b00829147912 req-4f098baa-05df-4018-b94c-8ee92a3ad291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad55c464-a245-4276-880c-b5bbd0bce53e", "name": "network-vif-deleted", "tag": "031df40d-8042-4765-ba47-dd1974f71ef4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:54.230183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-adfe9adf-1e31-4724-a7c1-b00829147912 req-4f098baa-05df-4018-b94c-8ee92a3ad291 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.231141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-adfe9adf-1e31-4724-a7c1-b00829147912 req-4f098baa-05df-4018-b94c-8ee92a3ad291 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.231790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-adfe9adf-1e31-4724-a7c1-b00829147912 req-4f098baa-05df-4018-b94c-8ee92a3ad291 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.238885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.239843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.240648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.245274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.248691 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-adfe9adf-1e31-4724-a7c1-b00829147912 req-4f098baa-05df-4018-b94c-8ee92a3ad291 service nova] Creating event network-vif-deleted:031df40d-8042-4765-ba47-dd1974f71ef4 for instance ad55c464-a245-4276-880c-b5bbd0bce53e on n-h2-858129-2 Sep 16 13:57:54.249586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.250485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.256664 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-adfe9adf-1e31-4724-a7c1-b00829147912 req-4f098baa-05df-4018-b94c-8ee92a3ad291 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045549 Sep 16 13:57:54.257964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 649/1314] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:54.264423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5c4f1e90-0692-4cee-9857-b74c34ce0cda req-ccfa8f0b-8e60-4d29-a454-9677dbd7cd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c33ea9e-f16a-4ca1-afbe-29878cacf2f0", "name": "network-vif-plugged", "status": "completed", "tag": "1ed0a192-ed63-40eb-bc95-a2bb26cffe55"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:54.278824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5c4f1e90-0692-4cee-9857-b74c34ce0cda req-ccfa8f0b-8e60-4d29-a454-9677dbd7cd50 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.279721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5c4f1e90-0692-4cee-9857-b74c34ce0cda req-ccfa8f0b-8e60-4d29-a454-9677dbd7cd50 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.280331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5c4f1e90-0692-4cee-9857-b74c34ce0cda req-ccfa8f0b-8e60-4d29-a454-9677dbd7cd50 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.316158 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5c4f1e90-0692-4cee-9857-b74c34ce0cda req-ccfa8f0b-8e60-4d29-a454-9677dbd7cd50 service nova] Creating event network-vif-plugged:1ed0a192-ed63-40eb-bc95-a2bb26cffe55 for instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 on n-h2-858129-2 Sep 16 13:57:54.322671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5c4f1e90-0692-4cee-9857-b74c34ce0cda req-ccfa8f0b-8e60-4d29-a454-9677dbd7cd50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062998 Sep 16 13:57:54.324010 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 650/1315] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:54.337800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:54.340843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:54.354383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:57:54.357589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.359465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.360097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.362997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.363485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.363927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.389059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for user f410179d3cca47dbb7ea031494bd1b07 and project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:57:54.475095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:57:54.483952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:57:54.613095 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-159d4cb4-6166-46d1-9c9f-a7887ceedee6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911911 Sep 16 13:57:54.615483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 666/1316] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:57:54.627410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:54.629324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:54.660414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.662165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.669986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.671314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.672718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.673392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.787531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.791329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.794340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.799558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid ad55c464-a245-4276-880c-b5bbd0bce53e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:54.908446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:54.911523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:54.934600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8079a81-2ce0-4782-9916-a493eaa56453 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1304 microversion: 2.1 time: 0.312737 Sep 16 13:57:54.935776 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 667/1317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:54 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1304 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:54.940774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a0a16d96-0a0d-4e84-8751-c7292ec41e9c req-86dd7ad9-9f65-437e-93fd-b809095630a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a45620b-7d81-415b-8d59-3cda88cd19b5", "tag": "95690f41-ab10-4f0f-9aa7-7e1c74615840"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:54.953727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a0a16d96-0a0d-4e84-8751-c7292ec41e9c req-86dd7ad9-9f65-437e-93fd-b809095630a6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:54.954685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a0a16d96-0a0d-4e84-8751-c7292ec41e9c req-86dd7ad9-9f65-437e-93fd-b809095630a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:54.955355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a0a16d96-0a0d-4e84-8751-c7292ec41e9c req-86dd7ad9-9f65-437e-93fd-b809095630a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:54.967868 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b478ddc-cab3-467d-838d-21d23d859944 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.641936 Sep 16 13:57:54.969552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 651/1318] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:54 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:54.973099 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a0a16d96-0a0d-4e84-8751-c7292ec41e9c req-86dd7ad9-9f65-437e-93fd-b809095630a6 service nova] Creating event network-changed:95690f41-ab10-4f0f-9aa7-7e1c74615840 for instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 on n-h1-858129-2 Sep 16 13:57:54.991136 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a0a16d96-0a0d-4e84-8751-c7292ec41e9c req-86dd7ad9-9f65-437e-93fd-b809095630a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050852 Sep 16 13:57:54.992895 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 668/1319] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:54.996061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:55.000365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:55.011134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19b4528f-f59a-46c3-9a74-93234270e61a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:55.011879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19b4528f-f59a-46c3-9a74-93234270e61a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:55.030980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:55.031687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:55.032672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:55.040269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:55.041588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:55.043008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:55.302879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19b4528f-f59a-46c3-9a74-93234270e61a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:55.330646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19b4528f-f59a-46c3-9a74-93234270e61a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1208 microversion: 2.1 time: 0.331660 Sep 16 13:57:55.347338 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 669/1320] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:54 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1208 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:55.780954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:55.799807 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e60c98f9-62f9-40f9-a487-5ff9a6711da0 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.823587 Sep 16 13:57:55.824039 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 652/1321] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:54 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:56.007345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:56.009545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:56.010188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:56.013544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:56.028643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.029159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.029889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.032429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.035162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.035910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.071306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.074115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.076714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.081936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.084393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.089635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.265693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.266843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.270106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.271143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid ad55c464-a245-4276-880c-b5bbd0bce53e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:56.357301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:56.372814 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc3005af-b7a7-4226-aeeb-00b95968c0bc tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1304 microversion: 2.1 time: 0.391145 Sep 16 13:57:56.380744 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 670/1322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:55 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1304 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:56.386656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:56.386879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:56.391069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:56.419996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.421067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.421067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.421900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.422423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.423042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.425728 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62a2a07a-6e07-41ec-a32b-1e89df384a70 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1471 microversion: 2.1 time: 0.416660 Sep 16 13:57:56.459134 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 653/1323] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:56 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:56.582352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:56.595892 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b3e94e54-e923-406d-8985-b32ecfb8f377 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1260 microversion: 2.1 time: 0.215174 Sep 16 13:57:56.596563 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 671/1324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:56 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:56.834708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:56.836082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:56.839623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:RELEASE=5,nova_api:SELECT=88,nova_api:SAVEPOINT=4,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:57:56.857755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.858913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.859773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:56.864864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:56.866762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:56.870805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:57.204226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:57.218097 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19e8e1f5-2d71-4824-9648-a60427d4871c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1317 microversion: 2.1 time: 0.387317 Sep 16 13:57:57.219168 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 654/1325] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:56 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:57.406098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:57.406858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:57.421474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:57.421989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:57.422462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:57.423217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:57.423689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:57.424122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:57.484284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:57.484935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:57.502677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:57.503231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:57.503864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:57.504751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lazy-loading 'fault' on Instance uuid ad55c464-a245-4276-880c-b5bbd0bce53e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:57:57.510027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:57.510963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:57.511430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:57.519333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:57.519931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:57.520449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:57.642091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b24d82070f42f59776a115147e9678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8e21f9d2d436285f91238eb580125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:57.673297 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1b03733-d060-49f3-a56b-0b84eb40d930 tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 200 len: 1304 microversion: 2.1 time: 0.268710 Sep 16 13:57:57.675386 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 672/1326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:57 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:57.995954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:58.010920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d4ee6ac-8d75-451b-9067-e40c53fab8b7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.532560 Sep 16 13:57:58.014185 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 655/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:57 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:58.040544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.041531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:58.052141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.057241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.057699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.058493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.058958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.062915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.145882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Calling method '.version_select at 0x7f724d23ddc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.149051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.153505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.154439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.174357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.175403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.176206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.189088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.190103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.190800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.203386 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a6a5fb4c-0125-4dd7-b078-b21839cdb5d0 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.521756 Sep 16 13:57:58.215828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:58.220655 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 673/1328] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:57:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:58.225535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29510b11-8b9f-4212-8e9b-63afdc20b1c9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1266 microversion: 2.1 time: 0.209877 Sep 16 13:57:58.231744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6d37c45e-3618-40f3-8b30-3bff1249ff21 req-79fbd76b-0048-4c8b-8aab-3e2a955e2685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cdbfcc-18c8-4219-9fb2-c40f4517a561", "name": "network-vif-deleted", "tag": "38c9b12a-5066-4ee6-baea-15e720a6984a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:57:58.232827 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 656/1329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:58.262999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6d37c45e-3618-40f3-8b30-3bff1249ff21 req-79fbd76b-0048-4c8b-8aab-3e2a955e2685 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.263481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6d37c45e-3618-40f3-8b30-3bff1249ff21 req-79fbd76b-0048-4c8b-8aab-3e2a955e2685 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.263918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6d37c45e-3618-40f3-8b30-3bff1249ff21 req-79fbd76b-0048-4c8b-8aab-3e2a955e2685 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.289263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6d37c45e-3618-40f3-8b30-3bff1249ff21 req-79fbd76b-0048-4c8b-8aab-3e2a955e2685 service nova] Creating event network-vif-deleted:38c9b12a-5066-4ee6-baea-15e720a6984a for instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 on n-h2-858129-2 Sep 16 13:57:58.296381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6d37c45e-3618-40f3-8b30-3bff1249ff21 req-79fbd76b-0048-4c8b-8aab-3e2a955e2685 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068075 Sep 16 13:57:58.300154 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 674/1330] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:58.312080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.312821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:58.332586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.333095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.333545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.335504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.349913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.351274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.532235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f83c91cc-a703-4600-85e8-3d8ee85d1743 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Calling method '.version_select at 0x7f724d325940>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.539186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f83c91cc-a703-4600-85e8-3d8ee85d1743 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f7941c55030a4da5af54d4b2966b2ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d83217b36694154a360f37166e8f827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f83c91cc-a703-4600-85e8-3d8ee85d1743 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Request method failure captured: Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/n-h1-858129-2/search HTTP/1.1 Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIDkN535125ttQPXOVtJ4DDE0I3RioJ88vC9PzjEsRLx3rqdVGtgIJhOdhYUW-WnaVxNICi_eZVQWUDPa-Y36XrdycKQWZlNxat7i4PfQ38VQfyJ33fbJYpuhS6lAnbqCStSz-qsZO2E6us7VscwV8_p-zkt5vO0GQPs3JzHOmuFckQ Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 8d83217b36694154a360f37166e8f827 Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-406323581 Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:57:58.541338 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8d83217b36694154a360f37166e8f827", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8d83217b36694154a360f37166e8f827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8d83217b36694154a360f37166e8f827"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8d83217b36694154a360f37166e8f827"}]}] Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-406323581 Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 8d83217b36694154a360f37166e8f827 Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-406323581 Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-406323581-project Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f7941c55030a4da5af54d4b2966b2ec5 Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-406323581-project Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 16 13:57:58.543239 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'n-h1-858129-2'} Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:57:58.544459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 16 13:57:58.545784 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.548285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f83c91cc-a703-4600-85e8-3d8ee85d1743 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:58.548439 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f83c91cc-a703-4600-85e8-3d8ee85d1743 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h1-858129-2/search" status: 403 len: 117 microversion: 2.1 time: 0.314256 Sep 16 13:57:58.555191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 657/1331] 10.222.0.60 () {58 vars in 1209 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/os-hypervisors/n-h1-858129-2/search => generated 117 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:58.561193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Calling method '.version_select at 0x7f724d197160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.570449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.574365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.575007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.584326 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Request method failure captured: Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIDlHp7LfrY1v_u-0kqGlpvMesCdAzfN3cB8pTJ0ooPvLj2oB18Y-DYHob3XzaY3sgr3RMBQpjXmLCT75pOCqiBA55ISD4CelJyBzUKiQrLPTed9bdAxzq_aPpkIQw81vPHa9WMxhOMODwJhg1O79nM8O1yfYt4PtIkQXqMhD5GqqI8 Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c76da1e1a4eb43488adbb3f633f9966c Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-366689109 Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:57:58.586539 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c76da1e1a4eb43488adbb3f633f9966c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c76da1e1a4eb43488adbb3f633f9966c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c76da1e1a4eb43488adbb3f633f9966c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c76da1e1a4eb43488adbb3f633f9966c"}]}] Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-366689109 Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c76da1e1a4eb43488adbb3f633f9966c Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-366689109 Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 085d2d69393a43928d5b798cd3e6e4ec Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 13:57:58.588101 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.588986 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:58.590791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-591348ac-6000-4e2a-93c8-5cefa983e8c6 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.031502 Sep 16 13:57:58.596635 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 658/1332] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:58.602037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Calling method '.version_select at 0x7f724d2d0160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.604932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.605302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.605775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.631787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.632700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.633519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.651218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.652872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.653490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.661939 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-294f6297-45d1-4ce4-a2ff-922145fc7bc4 tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064101 Sep 16 13:57:58.669579 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 659/1333] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:57:58.677824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-510c9bbd-4074-484b-a6bf-877a65d7be17 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Calling method '.version_select at 0x7f724d271160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.681734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-510c9bbd-4074-484b-a6bf-877a65d7be17 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f7941c55030a4da5af54d4b2966b2ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d83217b36694154a360f37166e8f827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-510c9bbd-4074-484b-a6bf-877a65d7be17 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Request method failure captured: Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIDkN535125ttQPXOVtJ4DDE0I3RioJ88vC9PzjEsRLx3rqdVGtgIJhOdhYUW-WnaVxNICi_eZVQWUDPa-Y36XrdycKQWZlNxat7i4PfQ38VQfyJ33fbJYpuhS6lAnbqCStSz-qsZO2E6us7VscwV8_p-zkt5vO0GQPs3JzHOmuFckQ Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 8d83217b36694154a360f37166e8f827 Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-406323581 Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:57:58.684249 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8d83217b36694154a360f37166e8f827", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8d83217b36694154a360f37166e8f827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8d83217b36694154a360f37166e8f827"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8d83217b36694154a360f37166e8f827"}]}] Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-406323581 Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 8d83217b36694154a360f37166e8f827 Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-406323581 Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-406323581-project Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f7941c55030a4da5af54d4b2966b2ec5 Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-406323581-project Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 16 13:57:58.686020 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1'} Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:57:58.687027 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 16 13:57:58.688538 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.691666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-510c9bbd-4074-484b-a6bf-877a65d7be17 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:58.692527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-510c9bbd-4074-484b-a6bf-877a65d7be17 tempest-HypervisorAdminNegativeUnderV252Test-406323581 tempest-HypervisorAdminNegativeUnderV252Test-406323581-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021631 Sep 16 13:57:58.693161 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 660/1334] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:58.704983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Calling method '.version_select at 0x7f724d197d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.707738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.708500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.709130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.718531 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] HTTP exception thrown: No hypervisor matching 'a5f78f59-7909-4f05-b683-d90463120f7e' could be found. Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Request method failure captured: Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-hypervisors/a5f78f59-7909-4f05-b683-d90463120f7e/servers HTTP/1.1 Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIDlHp7LfrY1v_u-0kqGlpvMesCdAzfN3cB8pTJ0ooPvLj2oB18Y-DYHob3XzaY3sgr3RMBQpjXmLCT75pOCqiBA55ISD4CelJyBzUKiQrLPTed9bdAxzq_aPpkIQw81vPHa9WMxhOMODwJhg1O79nM8O1yfYt4PtIkQXqMhD5GqqI8 Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c76da1e1a4eb43488adbb3f633f9966c Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-366689109 Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 13:57:58.720598 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c76da1e1a4eb43488adbb3f633f9966c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c76da1e1a4eb43488adbb3f633f9966c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c76da1e1a4eb43488adbb3f633f9966c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c76da1e1a4eb43488adbb3f633f9966c"}]}] Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-366689109 Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c76da1e1a4eb43488adbb3f633f9966c Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-366689109 Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 085d2d69393a43928d5b798cd3e6e4ec Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: exception: No hypervisor matching 'a5f78f59-7909-4f05-b683-d90463120f7e' could be found. Sep 16 13:57:58.722086 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a5f78f59-7909-4f05-b683-d90463120f7e'} Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a5f78f59-7909-4f05-b683-d90463120f7e' could be found. Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.723115 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.724530 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.724530 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.724530 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:58.724530 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:58.724530 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a5f78f59-7909-4f05-b683-d90463120f7e' could be found. Sep 16 13:57:58.724530 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.726866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] Returning 404 to user: No hypervisor matching 'a5f78f59-7909-4f05-b683-d90463120f7e' could be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:58.727975 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42d66dee-8125-4e83-8a70-13da8ddccaaa tempest-HypervisorAdminNegativeUnderV252Test-366689109 tempest-HypervisorAdminNegativeUnderV252Test-366689109-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/a5f78f59-7909-4f05-b683-d90463120f7e/servers" status: 404 len: 123 microversion: 2.1 time: 0.028970 Sep 16 13:57:58.728880 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 661/1335] 10.222.0.60 () {58 vars in 1281 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/os-hypervisors/a5f78f59-7909-4f05-b683-d90463120f7e/servers => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:58.733990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.735171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] [instance: ad55c464-a245-4276-880c-b5bbd0bce53e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:58.743392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.743912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.744353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.746002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.746779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.748060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.766493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] HTTP exception thrown: Instance ad55c464-a245-4276-880c-b5bbd0bce53e could not be found. Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Request method failure captured: Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e HTTP/1.1 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIAKxitu5HddqDjS2UXG6k4V4baTlWnxTiEUTJklsQRPyFkrZ1VcQSB3QCzrlEe9lqSuy7VE-I2ZTWS3zW_Hc7XWVOvXY6SIoCYPjfd9XcLlDUZ9kL9UHBKvEIdQ42OLB_RXaVP6ld4I6O9EWTnRFB6ShMAKLj-pJaNdiritEaynnK8 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0be8e21f9d2d436285f91238eb580125 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:57:58.768088 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0be8e21f9d2d436285f91238eb580125", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0be8e21f9d2d436285f91238eb580125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0be8e21f9d2d436285f91238eb580125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0be8e21f9d2d436285f91238eb580125"}]}] Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0be8e21f9d2d436285f91238eb580125 Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminTestJSON-1740110922 Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminTestJSON-1740110922-project Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f7b24d82070f42f59776a115147e9678 Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminTestJSON-1740110922-project Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ad55c464-a245-4276-880c-b5bbd0bce53e could not be found. Sep 16 13:57:58.769785 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ad55c464-a245-4276-880c-b5bbd0bce53e'} Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad55c464-a245-4276-880c-b5bbd0bce53e could not be found. Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:57:58.770800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad55c464-a245-4276-880c-b5bbd0bce53e could not be found. Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad55c464-a245-4276-880c-b5bbd0bce53e could not be found. Sep 16 13:57:58.772732 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:57:58.775052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] Returning 404 to user: Instance ad55c464-a245-4276-880c-b5bbd0bce53e could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:57:58.775052 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89541749-cc03-4222-9a24-e25d019601fe tempest-ServersAdminTestJSON-1740110922 tempest-ServersAdminTestJSON-1740110922-project] 10.222.0.60 "GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e" status: 404 len: 111 microversion: 2.1 time: 0.039511 Sep 16 13:57:58.776233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:58.776668 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 662/1336] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/servers/ad55c464-a245-4276-880c-b5bbd0bce53e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:57:58.806367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae511a77-6145-47f5-95fc-2b9d5d05ba80 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1467 microversion: 2.1 time: 0.504709 Sep 16 13:57:58.811139 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 675/1337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:58.833612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:58.834243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:58.841458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.842306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.842985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:58.843931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:58.844608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:58.845241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.035360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:59.035813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:59.044774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.045692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.046546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.049245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.050586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.051233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.319953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdbb9a79-2dc9-4a02-9435-4de66e046013 tempest-ServersOnMultiNodesTest-1930767640 tempest-ServersOnMultiNodesTest-1930767640-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1618 microversion: 2.1 time: 0.490429 Sep 16 13:57:59.320563 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 663/1338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:58 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1618 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:57:59.322492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:59.333310 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86e8ffc2-350e-498d-bd7c-2db4266e6c02 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.301984 Sep 16 13:57:59.351428 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 676/1339] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:59 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:57:59.357657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:59.358171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:59.364983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.365488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.365935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.367262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.367727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.368416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.387872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:59.388542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:59.395678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.396495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.399155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.400186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.400839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.403456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.428410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:57:59.619694 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-66dbe4fd-88c3-49cd-8ee6-7538eabd4f3e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 204 len: 0 microversion: 2.1 time: 0.266851 Sep 16 13:57:59.624881 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 677/1340] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:57:59 2022] DELETE /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:57:59.638766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:57:59.639786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:57:59.665743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.666256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.666740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.667492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:57:59.667968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:57:59.668410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:57:59.956891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:57:59.975428 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2feb0cab-e516-4721-9d66-e77ef29dc1b8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.635119 Sep 16 13:57:59.990936 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 664/1341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:59 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:00.104215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:00.145948 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5991b9f4-1b94-4cad-90aa-f6c5948ee71f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1473 microversion: 2.1 time: 0.517627 Sep 16 13:58:00.158136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 678/1342] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:57:59 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1473 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:00.374188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:00.375443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:00.394310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:00.395805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:00.397214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:00.399937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:00.401630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:00.403181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:00.416387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:01.002043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:01.003465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:01.013884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:01.014857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:01.015555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:01.016700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:01.017528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:01.018439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:01.417890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:01.443490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39a4b55d-9f24-43e7-b2b1-41b7db11f0b3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 1.082297 Sep 16 13:58:01.457497 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 665/1343] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:00 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:01.467831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:01.473223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:01.485954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:01.486605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:01.486920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:01.488825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:01.489391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:01.489754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:01.651444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:01.704863 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e2d11c7d-84d2-4255-9df1-f4ce6a61a14c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.704713 Sep 16 13:58:01.737418 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 679/1344] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:00 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:02.031154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:02.054791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67df37b0-7c8b-486c-91f5-bf6b3f753e74 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1473 microversion: 2.1 time: 0.595408 Sep 16 13:58:02.056748 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 666/1345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:01 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1473 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:02.472428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8f044d65-8594-45fe-a0e5-18d39022d92a req-2edd6ba4-3832-4ed5-abbc-25223ead6a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfdc316-c9c9-4fad-ac55-a87d2e79a296", "tag": "dc326c93-e39b-42ec-a562-fd0897d9e657"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:02.480699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:02.493067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:02.499112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8f044d65-8594-45fe-a0e5-18d39022d92a req-2edd6ba4-3832-4ed5-abbc-25223ead6a36 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:02.502324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8f044d65-8594-45fe-a0e5-18d39022d92a req-2edd6ba4-3832-4ed5-abbc-25223ead6a36 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:02.505704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8f044d65-8594-45fe-a0e5-18d39022d92a req-2edd6ba4-3832-4ed5-abbc-25223ead6a36 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:02.528493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:02.533214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:02.534667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:02.535964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:02.541432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:02.542355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:02.542924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8f044d65-8594-45fe-a0e5-18d39022d92a req-2edd6ba4-3832-4ed5-abbc-25223ead6a36 service nova] Creating event network-changed:dc326c93-e39b-42ec-a562-fd0897d9e657 for instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 on n-h1-858129-2 Sep 16 13:58:02.557948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8f044d65-8594-45fe-a0e5-18d39022d92a req-2edd6ba4-3832-4ed5-abbc-25223ead6a36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090502 Sep 16 13:58:02.558610 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 667/1346] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:02.769900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:02.770950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:02.787325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:02.787820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:02.794169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:02.799617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:02.800385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:02.800831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:03.253635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:03.320442 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0651384b-2852-4a14-a3e2-9fcff2a9717e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.822791 Sep 16 13:58:03.334448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 680/1347] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:02 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:03.339526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:03.341098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:03.371944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:03.373209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:03.374225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:03.375732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:03.377317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:03.378426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:03.724836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:03.758911 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9e2c473c-7266-4ed4-abdb-19336c906849 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1302 microversion: 2.1 time: 0.430373 Sep 16 13:58:03.769754 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 681/1348] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:03 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1302 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:03.773604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5608eef5-3460-4448-802e-dc14f6f3ac61 req-bf6e38e5-cea1-41d9-bf2e-3ba947bc2646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c33ea9e-f16a-4ca1-afbe-29878cacf2f0", "name": "network-vif-deleted", "tag": "1ed0a192-ed63-40eb-bc95-a2bb26cffe55"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:03.811649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5608eef5-3460-4448-802e-dc14f6f3ac61 req-bf6e38e5-cea1-41d9-bf2e-3ba947bc2646 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:03.816235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5608eef5-3460-4448-802e-dc14f6f3ac61 req-bf6e38e5-cea1-41d9-bf2e-3ba947bc2646 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:03.819320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5608eef5-3460-4448-802e-dc14f6f3ac61 req-bf6e38e5-cea1-41d9-bf2e-3ba947bc2646 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:03.874786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:03.887023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5608eef5-3460-4448-802e-dc14f6f3ac61 req-bf6e38e5-cea1-41d9-bf2e-3ba947bc2646 service nova] Creating event network-vif-deleted:1ed0a192-ed63-40eb-bc95-a2bb26cffe55 for instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 on n-h2-858129-2 Sep 16 13:58:03.916830 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5608eef5-3460-4448-802e-dc14f6f3ac61 req-bf6e38e5-cea1-41d9-bf2e-3ba947bc2646 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153978 Sep 16 13:58:03.918949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 682/1349] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:03.951815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:03.993189 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c5c9fe0-0e0e-4ebe-a79f-44150400f9c8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 1.226765 Sep 16 13:58:03.996416 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 668/1350] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:02 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:04.346132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:04.353829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:04.355325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:04.366759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:04.367526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:04.368158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:04.369094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:04.370312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:04.370991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:04.741021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:04.751476 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e9f086ea-7dba-4d1c-b143-36eb5b441358 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.406556 Sep 16 13:58:04.766482 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 683/1351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:04 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:04.797930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:04.798802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:04.815327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:04.816108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:04.817390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:04.818720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:04.819522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:04.820223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:04.889680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:04.890578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:04.891596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:04.892642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:04.969330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:04.978661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-32a5e1b8-531e-4970-b88e-3d25a3b9d1d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 200 len: 1307 microversion: 2.1 time: 0.189390 Sep 16 13:58:04.979267 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 669/1352] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:04 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 1307 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:05.021990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:05.023037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:05.032346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:05.033204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:05.034258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:05.046941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:05.047335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:05.047779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:05.220057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:05.230146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d893f2e-11ca-463c-92ba-6222ff3ac9d5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.213561 Sep 16 13:58:05.230793 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 684/1353] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:05 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:05.250428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-739843657", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:05.324605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:58:05.325037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:58:05.325533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:58:05.325941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:58:05.326362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:58:05.337397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:05.337397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:05.337740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:05.338456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:05.338933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:05.339366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:05.359776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Getting quotas for project 8de194b4db22463e837f94115b86ed36. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:58:05.367932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Getting quotas for user 62b0ebd1924f4dc2a4101755e7ce63df and project 8de194b4db22463e837f94115b86ed36. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:58:05.382845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:58:05.385301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:58:05.443340 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a2613bb-4afe-4ab3-81ed-43878e4a20b0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.379911 Sep 16 13:58:05.455519 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 670/1354] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 16 13:58:05.461435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bfac66d0-5a7a-43cf-826c-3cca494df2fb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:05.462308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bfac66d0-5a7a-43cf-826c-3cca494df2fb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:05.464374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:05.534512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfac66d0-5a7a-43cf-826c-3cca494df2fb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:05.548926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfac66d0-5a7a-43cf-826c-3cca494df2fb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:05.552230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfac66d0-5a7a-43cf-826c-3cca494df2fb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:05.564446 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bfac66d0-5a7a-43cf-826c-3cca494df2fb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1452 microversion: 2.91 time: 0.107101 Sep 16 13:58:05.565631 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 685/1355] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:05 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:05.799989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:05.803674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:05.817565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:05.818064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:05.818545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:05.819315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:05.819785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:05.820340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.004956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:06.005940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:06.015936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.016453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.017081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.018008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.018514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.018949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.035530 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 could not be found. Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 HTTP/1.1 Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:06.038042 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 could not be found. Sep 16 13:58:06.039784 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7c33ea9e-f16a-4ca1-afbe-29878cacf2f0'} Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 could not be found. Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:06.044062 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 could not be found. Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 could not be found. Sep 16 13:58:06.045627 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:06.047054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance 7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:06.047054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-94206369-fc45-4c2f-87cd-f519a828d868 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0" status: 404 len: 111 microversion: 2.1 time: 0.038934 Sep 16 13:58:06.047054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 686/1356] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:05 2022] GET /compute/v2.1/servers/7c33ea9e-f16a-4ca1-afbe-29878cacf2f0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:58:06.053300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:06.053735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:06.062123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.062949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.063468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.064406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.064874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.065832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.066978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:06.084602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-33c29a02-3510-4828-831e-e5ee7f78113f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.291916 Sep 16 13:58:06.087169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 671/1357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:05 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:06.104575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:06.222201 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-661bb288-562f-4fe8-854a-ceb54f9cccec tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 204 len: 0 microversion: 2.1 time: 0.177013 Sep 16 13:58:06.222781 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 687/1358] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:06 2022] DELETE /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:06.232172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:06.233022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:06.240006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.240936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.242141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.243189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.243899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.244534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.264784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:06.266177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:06.279327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.280472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.281231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.282768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.283836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.284594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.495600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:06.515107 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75439bbd-a991-483a-8983-ec1feb5db7cb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1472 microversion: 2.1 time: 0.286765 Sep 16 13:58:06.517507 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 672/1359] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:06 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:06.551875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:06.567643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-991e9d92-8061-41ce-a471-ff94ee17d337 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.310634 Sep 16 13:58:06.568832 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 688/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:06 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:06.619956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:06.621427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:06.637597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.638609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.641234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.643468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:06.644283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:06.645478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:06.748894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef0e6bdb-a62d-4adb-bf8b-201e69acdb71 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '.version_select at 0x7f724d245dc0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:06.863615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef0e6bdb-a62d-4adb-bf8b-201e69acdb71 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92" status: 200 len: 371 microversion: 2.1 time: 0.344020 Sep 16 13:58:06.864561 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 673/1361] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 13:58:06 2022] GET /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92 => generated 371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:06.865636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:06.881654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:06.885401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:06.889216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Action: 'update', calling method: .version_select at 0x7f724d0f6dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:06.896805 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a2b8ba2-1cce-4016-8b6f-4c9353c01377 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1504 microversion: 2.91 time: 0.288304 Sep 16 13:58:06.899331 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 689/1362] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:06 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:07.010121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.010640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.011200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.012089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.012636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.013117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.075126 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b53350ee-5ab4-4076-ae34-cd0a2a54f10c tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92" status: 200 len: 328 microversion: 2.1 time: 0.195319 Sep 16 13:58:07.076532 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 674/1363] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:58:06 2022] PUT /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92 => generated 328 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:07.089914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9eeac268-6968-4e78-a1f0-1b4291a0b3f0 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.106713 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9eeac268-6968-4e78-a1f0-1b4291a0b3f0 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92" status: 202 len: 0 microversion: 2.1 time: 0.021820 Sep 16 13:58:07.107322 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 690/1364] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 13:58:07 2022] DELETE /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:58:07.117868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-988d3f29-405a-4771-9da3-365256ec3acb tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '.version_select at 0x7f724d14ea60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.128393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.129517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:07.140798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.141687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.142321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.143514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.144247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.144958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.204587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-988d3f29-405a-4771-9da3-365256ec3acb tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92" status: 200 len: 371 microversion: 2.1 time: 0.091722 Sep 16 13:58:07.205583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 675/1365] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 13:58:07 2022] GET /compute/v2.1/os-quota-sets/79dfd4611557455ca0794176732e7c92 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:07.352730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:07.367414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e3f1402-93e1-4b67-a13b-654644c378f0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.246644 Sep 16 13:58:07.368738 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 691/1366] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:07 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:07.393656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-130ca7e2-5bc8-4256-8dbd-f2ad1d975fbc tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '.version_select at 0x7f724dd46f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.556173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.558396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:07.571173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.572596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.573668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.575286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.576412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.577200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.697250 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-130ca7e2-5bc8-4256-8dbd-f2ad1d975fbc tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75/defaults" status: 200 len: 371 microversion: 2.1 time: 0.313773 Sep 16 13:58:07.698331 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 676/1367] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 13:58:07 2022] GET /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75/defaults => generated 371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:07.707927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.710383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:07.728640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.729614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.730806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.732175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.733032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.733796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.826319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:07.836239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86039028-514e-438f-bd71-17c39b3dd99f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1472 microversion: 2.1 time: 0.289540 Sep 16 13:58:07.843025 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 692/1368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:07 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1472 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:07.959514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:07.960779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:07.969851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.971018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.972033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.973439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:07.974055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:07.975048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:07.985212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:08.002395 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-23306fc4-8b17-40d8-9d86-0f3665285623 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.301856 Sep 16 13:58:08.011026 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 677/1369] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:07 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:08.013266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Action: 'update', calling method: .version_select at 0x7f724d325940>, body: {"quota_set": {"ram": "5120"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:08.083304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:08.093338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:08.094999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:08.098245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:08.101842 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11dc05c6-2a39-4c7a-ab9d-9b6fe935688c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1510 microversion: 2.91 time: 0.152807 Sep 16 13:58:08.102700 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 693/1370] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:07 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:08.186947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.187673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.187854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.188612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.189067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.189492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.247979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40068406-e4b5-416f-9e9e-be20434944e4 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510" status: 200 len: 328 microversion: 2.1 time: 0.242069 Sep 16 13:58:08.248840 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 678/1371] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 13:58:08 2022] PUT /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510 => generated 328 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:08.262137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '.version_select at 0x7f724d23d790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:08.357769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.358433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.358988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.359969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.360544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.361083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.390318 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f7500c9-0bf9-4625-88a8-f6e3810d2515 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510/detail" status: 200 len: 916 microversion: 2.1 time: 0.131872 Sep 16 13:58:08.391197 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 694/1372] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 13:58:08 2022] GET /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510/detail => generated 916 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:08.411011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:08.412254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:08.424115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.425083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.426149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.427720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.428566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.429840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.596783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Action: 'update', calling method: .version_select at 0x7f724d3cd310>, body: {"quota_set": {"ram": "2048"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:08.672772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.673273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.673710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.674488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.675466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.675466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.724365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.724861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.725337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.726142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.726721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.727159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.751528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:08.764109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9acbbec6-e1d6-48a8-ac4b-7371c3611812 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.361570 Sep 16 13:58:08.764722 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 679/1373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:08 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:08.802006 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-985c59e1-a21a-4326-a1bb-fc43a108d703 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510?user_id=959a40cde2ac46cf87e1963d9c3510fb" status: 200 len: 328 microversion: 2.1 time: 0.209069 Sep 16 13:58:08.802892 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 695/1374] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 13:58:08 2022] PUT /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510?user_id=959a40cde2ac46cf87e1963d9c3510fb => generated 328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:08.816113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a99940ab-c9fa-48f6-a3fa-2230ba25bbc3 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '.version_select at 0x7f724d200f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:08.865916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:08.867023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:08.878818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.879654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.880367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.881656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:08.882718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:08.883434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:08.928751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a99940ab-c9fa-48f6-a3fa-2230ba25bbc3 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510?user_id=959a40cde2ac46cf87e1963d9c3510fb" status: 200 len: 370 microversion: 2.1 time: 0.116667 Sep 16 13:58:08.929843 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 680/1375] 10.222.0.60 () {58 vars in 1323 bytes} [Fri Sep 16 13:58:08 2022] GET /compute/v2.1/os-quota-sets/152bf71c7adb4559ab8f45eaf334d510?user_id=959a40cde2ac46cf87e1963d9c3510fb => generated 370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:09.049110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:09.050710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:09.086598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:09.090347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:09.091284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:09.094351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:09.095231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:09.099693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:09.452313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:09.479373 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9cc64958-42db-4e8b-bcc6-72b259d64da5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1472 microversion: 2.1 time: 0.621153 Sep 16 13:58:09.480670 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 696/1376] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:08 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1472 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:09.489727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:09.502100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:09.525323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:09.526185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:09.535594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:09.536891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:09.537737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:09.538642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:09.669798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:09.684453 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-176be8a4-66bd-4048-8755-84d6656f70d8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.642816 Sep 16 13:58:09.686188 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 681/1377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:09 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:09.696510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89b1821e-bf82-45e6-a869-45ab36c5cd04 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Calling method '.version_select at 0x7f724d1971f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:09.765852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:09.787702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:09.791266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:09.802839 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e1378e1-a57d-411c-a2fa-4b9fd40f7530 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1510 microversion: 2.91 time: 0.320349 Sep 16 13:58:09.837667 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 697/1378] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:09 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:09.869822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:09.873642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:09.890487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:09.891683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:09.892723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:09.894295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:09.895438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:09.899211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.134106 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89b1821e-bf82-45e6-a869-45ab36c5cd04 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75/defaults" status: 200 len: 371 microversion: 2.1 time: 0.443940 Sep 16 13:58:10.137936 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 682/1379] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 13:58:09 2022] GET /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75/defaults => generated 371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:10.155222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8d7496de-dafe-42e8-a7ad-7205debdb3bd req-58f715d8-9de4-4604-9d03-7ca8fbc9c6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b287762e-66e3-4d88-90dd-22dac4222156", "name": "network-vif-deleted", "tag": "61cda1da-977a-4f37-83d1-96e34f33bbc3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:10.195806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:10.223825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d7496de-dafe-42e8-a7ad-7205debdb3bd req-58f715d8-9de4-4604-9d03-7ca8fbc9c6c8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.224883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d7496de-dafe-42e8-a7ad-7205debdb3bd req-58f715d8-9de4-4604-9d03-7ca8fbc9c6c8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.226311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d7496de-dafe-42e8-a7ad-7205debdb3bd req-58f715d8-9de4-4604-9d03-7ca8fbc9c6c8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.239754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:10.260457 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8d7496de-dafe-42e8-a7ad-7205debdb3bd req-58f715d8-9de4-4604-9d03-7ca8fbc9c6c8 service nova] Creating event network-vif-deleted:61cda1da-977a-4f37-83d1-96e34f33bbc3 for instance b287762e-66e3-4d88-90dd-22dac4222156 on n-h1-858129-2 Sep 16 13:58:10.272988 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8d7496de-dafe-42e8-a7ad-7205debdb3bd req-58f715d8-9de4-4604-9d03-7ca8fbc9c6c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130683 Sep 16 13:58:10.279742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 683/1380] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:10.281592 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-24cc2838-73e8-4152-b02e-aa0229e88fe9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.442221 Sep 16 13:58:10.282374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 698/1381] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:09 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:10.291681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Action: 'update', calling method: .version_select at 0x7f724d1a9f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:10.411100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.411942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.413622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.415065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.415930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.416713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.536484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:10.537514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:10.555982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.556805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.557508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.558773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.559816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.560292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.633237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.634612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.635607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.636784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid b287762e-66e3-4d88-90dd-22dac4222156 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:10.821416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b53e2db-d9f5-4959-9c17-4b32778a67d7 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75" status: 200 len: 329 microversion: 2.1 time: 0.540877 Sep 16 13:58:10.822156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 684/1382] 10.222.0.60 () {60 vars in 1263 bytes} [Fri Sep 16 13:58:10 2022] PUT /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75 => generated 329 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:10.828226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:10.828974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:10.837359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:10.844378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.850193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.852842 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d46de464-58d4-4abb-8fc5-e6437a82ec07 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 200 len: 1306 microversion: 2.1 time: 0.335140 Sep 16 13:58:10.853536 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 699/1383] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:10 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 1306 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:10.870641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.870641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.870641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.870641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.871339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Action: 'update', calling method: .version_select at 0x7f724d35eee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:10.984795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.986196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.987178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:10.988886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:10.989746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:10.990267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.103276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:11.121193 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c6e3c6e-f05b-490e-8df0-de3a1774ed58 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.297935 Sep 16 13:58:11.125893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 685/1384] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:10 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:11.152203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:11.153348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:11.160658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.161466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:11.162088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.163133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.163799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:11.164401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.466186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:11.486438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:11.489599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:11.503010 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-057c64df-83a6-4f37-ba41-885418162d68 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1510 microversion: 2.91 time: 0.361096 Sep 16 13:58:11.504102 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 686/1385] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:11 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:11.514858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:11.515882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:11.524264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.525056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:11.525780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.526902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.527691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:11.528403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.545756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=14,nova_api:UPDATE=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:11.617522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-04df732b-951a-4204-b6e4-082cd315b490 tempest-QuotasAdminTestJSON-633539140 tempest-QuotasAdminTestJSON-633539140-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75" status: 200 len: 329 microversion: 2.1 time: 0.761910 Sep 16 13:58:11.618395 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 700/1386] 10.222.0.60 () {60 vars in 1263 bytes} [Fri Sep 16 13:58:10 2022] PUT /compute/v2.1/os-quota-sets/48e6a15e5ec3442f99c4c2fdc88cdd75 => generated 329 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:11.896690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:11.897712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: b287762e-66e3-4d88-90dd-22dac4222156] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:11.908645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.909437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:11.909955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.910826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.911247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:11.911681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:11.927377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:11.945208 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-faf9c288-2aef-4659-9e9d-3997fba9f717 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.438691 Sep 16 13:58:11.946706 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 687/1387] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:11 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:11.965643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance b287762e-66e3-4d88-90dd-22dac4222156 could not be found. Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 HTTP/1.1 Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:11.967458 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b287762e-66e3-4d88-90dd-22dac4222156 could not be found. Sep 16 13:58:11.969057 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b287762e-66e3-4d88-90dd-22dac4222156'} Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b287762e-66e3-4d88-90dd-22dac4222156 could not be found. Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:11.969860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b287762e-66e3-4d88-90dd-22dac4222156 could not be found. Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b287762e-66e3-4d88-90dd-22dac4222156 could not be found. Sep 16 13:58:11.972931 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:11.975268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance b287762e-66e3-4d88-90dd-22dac4222156 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:11.975268 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df14a0f7-b5b9-4417-92bd-4caf3930ca23 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156" status: 404 len: 111 microversion: 2.1 time: 0.076511 Sep 16 13:58:11.975268 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 701/1388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:11 2022] GET /compute/v2.1/servers/b287762e-66e3-4d88-90dd-22dac4222156 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:58:11.985091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:11.986012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:11.999114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:11.999992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.000931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.002044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.002920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.003725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.046902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:12.113005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:12.158094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:12.159086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:12.166056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe6725b6-d900-476c-86d9-4a20db01b474 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 204 len: 0 microversion: 2.1 time: 0.189107 Sep 16 13:58:12.167759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.168332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.168875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.169816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.170359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.171029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.172208 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 688/1389] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:11 2022] DELETE /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:12.180637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:12.188403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:12.189525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:12.199796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.200571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.201633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.203420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.204597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.205669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.517483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:12.526300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:12.533825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50cb9fb0-ed50-4a00-a048-69f008957c86 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.382926 Sep 16 13:58:12.535066 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 702/1390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:12 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:12.543143 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a25ed1a5-aea6-4a82-933e-2612f4176540 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1472 microversion: 2.1 time: 0.362790 Sep 16 13:58:12.544692 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 689/1391] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:12 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:12.578800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:12.579427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:12.586175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.586881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.587330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.588054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.588514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.588938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.686165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:12.703789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:12.706879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:12.716056 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b959c94c-3f34-40d8-a169-79bf797b4928 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1510 microversion: 2.91 time: 0.144292 Sep 16 13:58:12.717064 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 703/1392] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:12 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:12.974458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:12.976275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:12.987153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.987896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.988906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:12.990291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:12.991884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:12.992533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:13.283738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:13.299233 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0b7a342-2090-425d-9a9f-176f49398132 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.329167 Sep 16 13:58:13.315445 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 690/1393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:12 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:13.575921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:13.576555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:13.584259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:13.585443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:13.587907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:13.588417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:13.588846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:13.596854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:13.597321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:13.598024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:13.598976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:13.599654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:13.600258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:13.602932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:13.604102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:13.605053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.117105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:14.128807 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dbbaa606-6d9d-4cda-a057-f1c164307d1d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1472 microversion: 2.1 time: 0.549130 Sep 16 13:58:14.128807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 691/1394] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:13 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:14.137710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:14.138629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:14.140268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:14.168664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.171431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.175460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.177105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.178106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.178936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.185219 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4dbc1065-b9b6-4ca5-a9dc-0b1f491f2ccf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.613426 Sep 16 13:58:14.186273 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 704/1395] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:13 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:14.342069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:14.347376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:14.348924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:14.363122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:14.367905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:14.378843 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7cffeb8a-9c7c-4c1d-86de-86d935e3d81e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1531 microversion: 2.91 time: 0.250606 Sep 16 13:58:14.381019 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 692/1396] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:14 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1531 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:14.391409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.393464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.401149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.405835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.407100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.409405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.750083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:14.768498 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e89c51c-dbd5-436a-b95c-6e526d252209 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.428932 Sep 16 13:58:14.770077 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 705/1397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:14 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:14.851739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:14.852773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:14.864422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.865485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.866815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.868278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.869324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.870394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:14.973045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0591ebd5-6ad1-4cee-8e17-c7bcf8d15c0e req-e431e404-0c12-430e-aac0-b0a5faef918c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfdc316-c9c9-4fad-ac55-a87d2e79a296", "name": "network-vif-plugged", "status": "completed", "tag": "dc326c93-e39b-42ec-a562-fd0897d9e657"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:14.990354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0591ebd5-6ad1-4cee-8e17-c7bcf8d15c0e req-e431e404-0c12-430e-aac0-b0a5faef918c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:14.991608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0591ebd5-6ad1-4cee-8e17-c7bcf8d15c0e req-e431e404-0c12-430e-aac0-b0a5faef918c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:14.992161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0591ebd5-6ad1-4cee-8e17-c7bcf8d15c0e req-e431e404-0c12-430e-aac0-b0a5faef918c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.013550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0591ebd5-6ad1-4cee-8e17-c7bcf8d15c0e req-e431e404-0c12-430e-aac0-b0a5faef918c service nova] Creating event network-vif-plugged:dc326c93-e39b-42ec-a562-fd0897d9e657 for instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 on n-h1-858129-2 Sep 16 13:58:15.026153 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0591ebd5-6ad1-4cee-8e17-c7bcf8d15c0e req-e431e404-0c12-430e-aac0-b0a5faef918c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253419 Sep 16 13:58:15.027448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 706/1398] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:15.059519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lazy-loading 'services' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:15.079459 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8bb1fcba-9d80-434c-af06-82debb02d6ad tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1936 microversion: 2.91 time: 0.650204 Sep 16 13:58:15.080391 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 693/1399] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:14 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1936 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:15.109260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:15.109963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:15.117571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.118062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.118428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.119232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.119697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.120122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.159090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:15.160106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:15.168750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.169509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.170085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.171439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.172133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.173081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.269018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lazy-loading 'services' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:15.313548 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e09fbaaa-3d99-4de3-b143-75d60921dfd2 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1936 microversion: 2.91 time: 0.208562 Sep 16 13:58:15.314313 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 707/1400] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:15 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1936 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:15.325353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:15.326953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:15.340013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.341276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.342297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.343908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.345009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.346303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.449507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:15.460993 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fbdaef68-3f0e-4fde-bdfd-bc05ef2f8ef4 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1472 microversion: 2.1 time: 0.307002 Sep 16 13:58:15.462322 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 694/1401] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:15 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:15.469459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:15.476563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.479071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.480141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.482136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.482905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.483555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.523784 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-132e6d99-0e78-4d15-bbf3-c2623a2b773b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.059955 Sep 16 13:58:15.524758 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 695/1402] 10.222.0.60 () {60 vars in 1217 bytes} [Fri Sep 16 13:58:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:58:15.545179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:15.547015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:15.573470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.574365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.575188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.578229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.579083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.579837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.627549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lazy-loading 'flavor' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:15.708476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:15.723714 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-08ed153e-3ff2-46d5-895e-29304321db96 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.407303 Sep 16 13:58:15.725178 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 708/1403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:15 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:15.821515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:15.822748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:15.836284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.837359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.838093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:15.839338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:15.840115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:15.841021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.155965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94da256f-eccb-4f4c-a91f-7efc5c9609e2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action" status: 202 len: 0 microversion: 2.91 time: 0.619116 Sep 16 13:58:16.157077 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 696/1404] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:58:15 2022] POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:16.176017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:16.177147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:16.182187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:16.191953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:16.192715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:16.193435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.195123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:16.196235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:16.197192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.216329 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e38618e2-33b3-4b65-bc40-5def28e1d14f tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.403503 Sep 16 13:58:16.217368 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 709/1405] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:15 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:16.425789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:16.442305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:16.446993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:16.462618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d0cf154-59a3-4e7d-b44d-2a24d4a6257f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.298154 Sep 16 13:58:16.464347 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 697/1406] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:16 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:16.514315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:16.519573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:16.539395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:16.545281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:16.546122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.548905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:16.550047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:16.551011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.668858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6a4fbf37-9f49-4063-acff-9b025de57c13"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:16.671993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:16.679859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:16.680803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:16.681586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.682571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:16.683206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:16.683790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:16.905045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] HTTP exception thrown: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Request method failure captured: Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments/8c13b6cb-2418-479f-85aa-085acb1cdb9c HTTP/1.1 Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 74 Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIBUjf7VhhawZ89V36QQY0Q-6bGl7dSnAHMQQ6FMV04gVaWRCZ2Y7TKiBZHw8vxO7HFOsqkcfjR12y6fKxELciIBx5-tw67nwiAI_1LCsGkn7gGpUSNrAjRHbz98en37EXD58BZ9MiXNWfxX0yIyjq-rNDmlMk-9ADZFmDdNxFs12w4 Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 876b857a096a44258e26d72bfecc20aa Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesAdminNegativeTest-690905129 Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:58:16.913779 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_876b857a096a44258e26d72bfecc20aa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/876b857a096a44258e26d72bfecc20aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/876b857a096a44258e26d72bfecc20aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/876b857a096a44258e26d72bfecc20aa"}]}] Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesAdminNegativeTest-690905129 Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 876b857a096a44258e26d72bfecc20aa Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-690905129 Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesAdminNegativeTest-690905129-project-admin Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 52b0ad2dadf5485abc36aff0734841c5 Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesAdminNegativeTest-690905129-project-admin Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: {"volumeAttachment": {"volumeId": "6a4fbf37-9f49-4063-acff-9b025de57c13"}} Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:16.916321 n-d-858129-2 devstack@n-api.service[128643]: exception: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': '80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98', 'id': '8c13b6cb-2418-479f-85aa-085acb1cdb9c', 'body': {'volumeAttachment': {'volumeId': '6a4fbf37-9f49-4063-acff-9b025de57c13'}}} Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 13:58:16.918011 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. (HTTP 404) (Request-ID: req-2122537e-483d-41c8-b586-edf57ba669e8) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 13:58:16.920103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:16.923355 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. Sep 16 13:58:16.925863 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:16.934440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Returning 400 to user: Volume 6a4fbf37-9f49-4063-acff-9b025de57c13 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:16.934440 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59d6c0f2-0883-49f0-b12c-20f19a3fa36b tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments/8c13b6cb-2418-479f-85aa-085acb1cdb9c" status: 400 len: 107 microversion: 2.1 time: 0.712890 Sep 16 13:58:16.934440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 710/1407] 10.222.0.60 () {60 vars in 1433 bytes} [Fri Sep 16 13:58:16 2022] PUT /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments/8c13b6cb-2418-479f-85aa-085acb1cdb9c => generated 107 bytes in 715 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:58:16.966704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:16.986492 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd00530e-6f21-4639-bd16-2706ff00b54d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1472 microversion: 2.1 time: 0.480953 Sep 16 13:58:17.004575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 698/1408] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:16 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:17.021716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1452490548", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:17.036911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:17.038864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:17.056218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.058130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.059160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.062308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.063179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.067186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.090985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:58:17.091644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:58:17.092311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:58:17.092955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:58:17.093534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:58:17.106020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.106665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.107378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.108254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.109000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.109513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.132409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Getting quotas for project f47f8f2caf1b4ed9a6ef73aeb333211d. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:58:17.138934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Getting quotas for user 8396f4bf519b416cad9381985fb5e9d8 and project f47f8f2caf1b4ed9a6ef73aeb333211d. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:58:17.154381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:58:17.156866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:58:17.223110 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-509be01a-2922-4914-8821-47de681feb89 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.288446 Sep 16 13:58:17.224153 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 711/1409] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 13:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 13:58:17.231548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:17.232390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:17.244198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.245920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.247434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.251470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.252858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.254063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.305820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:17.319961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-abc07bde-0ce6-4702-b316-541ffc531824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1308 microversion: 2.1 time: 0.313051 Sep 16 13:58:17.324026 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 699/1410] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:17 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:17.335448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42fac8c7-0239-4481-9a0f-7ea33ee1ff77 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:17.341433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-42fac8c7-0239-4481-9a0f-7ea33ee1ff77 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:17.551761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42fac8c7-0239-4481-9a0f-7ea33ee1ff77 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:17.582005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42fac8c7-0239-4481-9a0f-7ea33ee1ff77 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:17.584042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42fac8c7-0239-4481-9a0f-7ea33ee1ff77 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:17.590748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42fac8c7-0239-4481-9a0f-7ea33ee1ff77 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "PUT /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1359 microversion: 2.75 time: 0.264425 Sep 16 13:58:17.591621 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 700/1411] 10.222.0.60 () {62 vars in 1297 bytes} [Fri Sep 16 13:58:17 2022] PUT /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:17.598051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:17.599229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:17.606847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lazy-loading 'services' on Instance uuid 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:17.619965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.620606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.621783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.624971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.625552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.630375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.939684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-adc4809d-cd4b-41f4-b68a-c194fb806971 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments/8c13b6cb-2418-479f-85aa-085acb1cdb9c" status: 202 len: 0 microversion: 2.1 time: 0.711694 Sep 16 13:58:17.943809 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 712/1412] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 13:58:17 2022] DELETE /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments/8c13b6cb-2418-479f-85aa-085acb1cdb9c => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:58:17.957565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:17.962798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:17.964852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:17.971299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41c46139-4c38-4f47-a96a-fa2ee590adb5 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.378233 Sep 16 13:58:17.978172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.978713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.979407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:17.980528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:17.981198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:17.981948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.000688 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 701/1413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:17 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:18.012285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-98e998fb-ac93-4b26-a6a9-0560d327965a req-4cd5941c-0ea3-49c1-b592-048c3c8200ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796a1baf-9191-4ca2-8cec-9e192862f096", "name": "network-vif-deleted", "tag": "8e788933-5986-4bfa-a679-8708c1a86579"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:18.024559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=14,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:18.041901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-98e998fb-ac93-4b26-a6a9-0560d327965a req-4cd5941c-0ea3-49c1-b592-048c3c8200ab service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.042421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-98e998fb-ac93-4b26-a6a9-0560d327965a req-4cd5941c-0ea3-49c1-b592-048c3c8200ab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.043622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-98e998fb-ac93-4b26-a6a9-0560d327965a req-4cd5941c-0ea3-49c1-b592-048c3c8200ab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.063277 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-98e998fb-ac93-4b26-a6a9-0560d327965a req-4cd5941c-0ea3-49c1-b592-048c3c8200ab service nova] Creating event network-vif-deleted:8e788933-5986-4bfa-a679-8708c1a86579 for instance 796a1baf-9191-4ca2-8cec-9e192862f096 on n-h1-858129-2 Sep 16 13:58:18.069700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-98e998fb-ac93-4b26-a6a9-0560d327965a req-4cd5941c-0ea3-49c1-b592-048c3c8200ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066840 Sep 16 13:58:18.070494 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 702/1414] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:18.078828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2af857e2-e596-44a5-bf59-1349995ef48a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:18.079948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2af857e2-e596-44a5-bf59-1349995ef48a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:18.171681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.205996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.206268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2af857e2-e596-44a5-bf59-1349995ef48a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.209171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.219423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2af857e2-e596-44a5-bf59-1349995ef48a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.221476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2af857e2-e596-44a5-bf59-1349995ef48a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.229391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2af857e2-e596-44a5-bf59-1349995ef48a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1359 microversion: 2.75 time: 0.156298 Sep 16 13:58:18.230733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 703/1415] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:18 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:18.237824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:18.240574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:18.259924 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8628d6aa-ff8e-4b5c-83b9-355e91b5b904 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.310937 Sep 16 13:58:18.262483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 713/1416] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:17 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:18.279530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.283341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.284420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.285456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.285917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:18.286828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:18.287518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.288173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.308233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.308502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.308962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.309666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.331666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.332476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.384818 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac84bbce-16a6-4125-8bbb-a10a790325c4 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152125 Sep 16 13:58:18.391538 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 704/1417] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:18 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:18.406641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:18.407557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.408049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.408499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:18.408690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.409644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 796a1baf-9191-4ca2-8cec-9e192862f096 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:18.425341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.428086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.429615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.431133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.436030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.450848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.484858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.497037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-682bd7c1-df87-482c-80f5-6d5cb5f49197 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1307 microversion: 2.1 time: 0.232777 Sep 16 13:58:18.498231 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 714/1418] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:18 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:18.652017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:18.660805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1521a9b-59e9-436d-9219-1d89581ab54e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1488 microversion: 2.1 time: 0.267226 Sep 16 13:58:18.661421 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 705/1419] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:18 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1488 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:18.685493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-604fc2af-8d6f-45ca-887a-120994a1433b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:18.692066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-604fc2af-8d6f-45ca-887a-120994a1433b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.692563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-604fc2af-8d6f-45ca-887a-120994a1433b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.692995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-604fc2af-8d6f-45ca-887a-120994a1433b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.759967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-604fc2af-8d6f-45ca-887a-120994a1433b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Going to try to stop instance {{(pid=128643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 13:58:18.812734 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-604fc2af-8d6f-45ca-887a-120994a1433b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296/action" status: 202 len: 0 microversion: 2.1 time: 0.130784 Sep 16 13:58:18.813590 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 715/1420] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:58:18 2022] POST /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:58:18.827291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:18.828345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:18.840890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.841714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.842460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.843710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:18.844475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:18.845237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:18.872571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:19.006302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:19.007718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:19.011707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.015468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.016272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.016892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.018453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.019114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.019696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.029045 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efc783a6-dbe7-4947-8565-0dfc2339f5b4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.209261 Sep 16 13:58:19.030141 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 706/1421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:18 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:19.222541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.232007 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4939e6e9-2a67-4623-a10f-caf9e0db01bc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.230299 Sep 16 13:58:19.232697 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 716/1422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:19 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:19.295432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:19.296391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:19.298762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:19.300238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:19.309012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.309896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.310659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.310820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.311995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.312140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.312552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.312821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.313413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.313604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.313988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.314542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.422631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.432928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.434562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.440707 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3dd58017-edb4-42c5-8a2b-f14cdc1ddb0d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.148151 Sep 16 13:58:19.441617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 717/1423] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:19 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:19.447110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:19.449633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:19.456922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.459253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.459934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.460504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.461349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.462233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.462677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.471182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:19.477121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.479851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.487562 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-934da35e-5aa9-4e97-8df1-2b93b3b16ab0 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1355 microversion: 2.75 time: 0.196412 Sep 16 13:58:19.488370 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 707/1424] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:19 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1355 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:19.509464 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-233bd83f-a350-437e-a643-1457f42a84a7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066883 Sep 16 13:58:19.510157 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 718/1425] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:19 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:19.540572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:19.541732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:19.554530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.555394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.556186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.557457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.558285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.559081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.601939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:19.602540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:19.603100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:19.603633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 796a1baf-9191-4ca2-8cec-9e192862f096 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:19.661969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:19.673926 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-714c197b-a95b-4400-9e1b-69132ef10529 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 200 len: 1307 microversion: 2.1 time: 0.141850 Sep 16 13:58:19.674937 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 708/1426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:19 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:20.058007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.058866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.066315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.066838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.067274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.068037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.068493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.068921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.280237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.281935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.296011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.297218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.298836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.300384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.302750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.303282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.307437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.327419 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-298e23bf-999a-4dd0-8a0f-984220a7a6be tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.273525 Sep 16 13:58:20.346438 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 719/1427] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:20 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:20.496771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.499472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.500910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.511451 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93100240-4759-418c-8d65-44a8ec8f537b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1476 microversion: 2.1 time: 0.241775 Sep 16 13:58:20.512682 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 709/1428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:20 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:20.518030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.525461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.526458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.527845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.528847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.529878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.533117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.534230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.555829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.556414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.556871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.557657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.562057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.562535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.661197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.671618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.673206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.694372 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5abbc73-bac1-49b8-91ae-951b832501a0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.208767 Sep 16 13:58:20.697619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 720/1429] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:20 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:20.702918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.705310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.725577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.726650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.727096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.727864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.728332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.728760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.743645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.765950 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d8018a6-5424-423f-9013-fc2e27101ff1 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067071 Sep 16 13:58:20.766966 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 721/1430] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:20 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:20.773610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.774322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 796a1baf-9191-4ca2-8cec-9e192862f096] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.775226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.778614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:20.794307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.794730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.795471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.796600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.798014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.798699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.812216 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4607b75a-f131-4521-a7b4-acac0717273e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1411 microversion: 2.75 time: 0.290798 Sep 16 13:58:20.813146 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 710/1431] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:20 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1411 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:20.856591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance 796a1baf-9191-4ca2-8cec-9e192862f096 could not be found. Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 HTTP/1.1 Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:20.869428 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 796a1baf-9191-4ca2-8cec-9e192862f096 could not be found. Sep 16 13:58:20.872354 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '796a1baf-9191-4ca2-8cec-9e192862f096'} Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796a1baf-9191-4ca2-8cec-9e192862f096 could not be found. Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:20.874506 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796a1baf-9191-4ca2-8cec-9e192862f096 could not be found. Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796a1baf-9191-4ca2-8cec-9e192862f096 could not be found. Sep 16 13:58:20.881340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:20.883903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance 796a1baf-9191-4ca2-8cec-9e192862f096 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:20.885009 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d7f16ce7-90b7-4c2a-af42-730c5604862f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096" status: 404 len: 111 microversion: 2.1 time: 0.113549 Sep 16 13:58:20.886396 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 722/1432] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:20 2022] GET /compute/v2.1/servers/796a1baf-9191-4ca2-8cec-9e192862f096 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:58:20.899622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:20.899622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:20.923095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.924367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.925612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.927420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:20.928580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:20.930134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:20.995781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:21.170287 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53aa3140-efd3-4b7e-8ff5-e600c93880d1 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 204 len: 0 microversion: 2.1 time: 0.277298 Sep 16 13:58:21.175249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 711/1433] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:20 2022] DELETE /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:21.187868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:21.188986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:21.203182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.203967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.204539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.205527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.214579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.217916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.271787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:21.379864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:21.382151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:21.404530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.405194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.406046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.407058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.407681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.408311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.433791 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e16c0d51-9d58-4c5e-8be9-795b419bdeab tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 204 len: 0 microversion: 2.1 time: 0.256145 Sep 16 13:58:21.435341 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 723/1434] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:21 2022] DELETE /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:21.442181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "name": "network-vif-unplugged", "status": "completed", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:21.455255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.456043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.456851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.496444 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] Creating event network-vif-unplugged:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h1-858129-2 Sep 16 13:58:21.505754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:58:21.539177 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4366500d-2e6f-48ee-b141-8b4303f7b811 req-f40bbbcd-dd05-4187-acc3-71a26f404d3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101223 Sep 16 13:58:21.543654 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 724/1435] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:21.560890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:21.562704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:21.581149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.581767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.585991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.588214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.588930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.589721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.693146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:21.702828 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25495843-e505-4d0a-843c-0cc19935b665 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.336235 Sep 16 13:58:21.717858 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 712/1436] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:21 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:21.725522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:21.727850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:21.736503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.738060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.738570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.739345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.739827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.742665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.939383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:21.954851 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0abf5fd1-0ec4-4f39-b556-3989e158561f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1475 microversion: 2.1 time: 0.409328 Sep 16 13:58:21.955818 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 725/1437] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:21 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:21.964949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:21.965704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:21.983577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.984902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.985563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.986264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:21.986814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:21.987494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:21.998188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.007497 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-517a684c-352e-46c9-bb6d-ff548f9b6c47 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1475 microversion: 2.1 time: 0.287117 Sep 16 13:58:22.019792 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 713/1438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:21 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1475 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:22.031014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:22.033357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:22.040352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:22.040860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:22.041304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:22.042035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:22.042526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:22.042957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:22.076162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.079495 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cc4cc2a2-9fa6-48ea-8f5f-4348b2fa4c0f tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058641 Sep 16 13:58:22.080407 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 714/1439] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:22 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:22.085963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:22.087405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:22.092438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.094106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:22.094678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.094921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:22.095262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:22.095986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:22.096545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:22.096964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:22.102493 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb1343fe-ea15-4c8f-9505-fb219e6bdf20 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.144888 Sep 16 13:58:22.103571 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 726/1440] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:21 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:22.196218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.205605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.207104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:22.213489 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d50d903c-feee-43a3-811e-fd9f6c249e99 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1419 microversion: 2.75 time: 0.132026 Sep 16 13:58:22.214101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 715/1441] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:22 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1419 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:22.731631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:22.732780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:22.764280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:22.767174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:22.767890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:22.770873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:22.773907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:22.774826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.003037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:23.004189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:23.029717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.030381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.030929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.032575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.033592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.034251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.044685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.074090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9e49b4e-aaa3-438c-aaae-03f9802a393e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.348723 Sep 16 13:58:23.075223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 727/1442] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:22 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:23.095497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:23.096656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:23.107425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:23.126916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.126916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.134019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.136575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.138314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.139622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.483139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.501968 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ef22ec1-ff29-4b00-85a4-681a3bc2c331 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1475 microversion: 2.1 time: 0.506008 Sep 16 13:58:23.503540 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 716/1443] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:22 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1475 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:23.518089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:23.522540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:23.544075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.545771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.549780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.551818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.553007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.554748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.633804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3dc81334-c65f-4d4e-a22d-142a2ea8df90 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125382 Sep 16 13:58:23.636254 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 717/1444] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:23 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:23.642327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.650275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:23.652155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:23.657580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1263cd87-f991-4c71-b373-0694e2554a17 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1475 microversion: 2.1 time: 0.580172 Sep 16 13:58:23.658591 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 728/1445] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:23 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:23.664146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:23.664770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:23.665929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.667097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.668344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.670222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.671815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.672844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.692702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.693201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.693644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.694456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.694902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.695329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.883104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.897916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.900153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.901821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.909972 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c140d624-58b2-4d12-8bd2-c12932687827 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.271395 Sep 16 13:58:23.910886 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 718/1446] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:23 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:23.919518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:23.923358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.924872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:23.933141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:23.934218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:23.934985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:23.942815 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2cba3437-041c-4d00-8092-f50e65176226 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1417 microversion: 2.75 time: 0.282494 Sep 16 13:58:23.943232 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 729/1447] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:23 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1417 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:23.952399 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] Creating event network-changed:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h1-858129-2 Sep 16 13:58:23.959158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:58:23.994340 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c20572f9-55d4-4e7b-b3fb-7216c1949e36 req-82d718bc-af87-4033-9b9b-9ffc9eda3a06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078106 Sep 16 13:58:23.996018 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 719/1448] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:24.125068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:24.125947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:24.138121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:24.138121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:24.138121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:24.138121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:24.140240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:24.140514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:24.557540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:24.558461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:24.574436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:24.574947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:24.575397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:24.576138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:24.578201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:24.578201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:24.827218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:24.838623 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb7c7951-cad8-4c78-af37-2da948dc1139 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1433 microversion: 2.1 time: 0.286449 Sep 16 13:58:24.863377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 720/1449] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:24 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1433 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:24.870192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:24.875846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:24.892581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:24.894003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:24.896174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:24.897262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:24.899895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:24.900610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:24.962197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:25.002472 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e5468df-c7a3-45e4-bfb7-c9862850fd17 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137371 Sep 16 13:58:25.011410 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 721/1450] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:24 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:25.018376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:25.027140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:25.045854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.046495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.047300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.058802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.059648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.060118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.182696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.209453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bad6968-aa98-4348-99d0-9905f3b5a0fe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 1.088176 Sep 16 13:58:25.210529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 730/1451] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:24 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:25.246093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:25.250051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:25.272530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.272909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.273450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.274197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.274701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.275254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.491188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.500502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:25.501225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.503973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.510849 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce9465c6-2859-4348-bb61-579dca3ae84e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.289143 Sep 16 13:58:25.511452 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 731/1452] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:25 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:25.516810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:25.517421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:25.525292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.526570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.527195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.528526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.529158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.529746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.574805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.595225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6e429ad-b903-4a2e-a069-0e32a29dc159 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1475 microversion: 2.1 time: 0.581424 Sep 16 13:58:25.596886 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 722/1453] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:25 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1475 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:25.606160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-39f92290-3a50-4d51-be2e-8403d63bec8d req-e5b56628-6b6a-4e15-ae0c-106c320fc780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343a95db-843b-4fb8-85a3-9440a605b38e", "name": "network-vif-deleted", "tag": "e8225a0e-7ec1-44b5-812c-bba0be636c1b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:25.607660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.620330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.622176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:25.625721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-39f92290-3a50-4d51-be2e-8403d63bec8d req-e5b56628-6b6a-4e15-ae0c-106c320fc780 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.626621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-39f92290-3a50-4d51-be2e-8403d63bec8d req-e5b56628-6b6a-4e15-ae0c-106c320fc780 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.627392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-39f92290-3a50-4d51-be2e-8403d63bec8d req-e5b56628-6b6a-4e15-ae0c-106c320fc780 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.628845 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6a3813de-1a2b-4adb-8d17-986a0069ed26 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1417 microversion: 2.75 time: 0.115797 Sep 16 13:58:25.629581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 732/1454] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:25 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1417 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:25.651347 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-39f92290-3a50-4d51-be2e-8403d63bec8d req-e5b56628-6b6a-4e15-ae0c-106c320fc780 service nova] Creating event network-vif-deleted:e8225a0e-7ec1-44b5-812c-bba0be636c1b for instance 343a95db-843b-4fb8-85a3-9440a605b38e on n-h1-858129-2 Sep 16 13:58:25.660556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-39f92290-3a50-4d51-be2e-8403d63bec8d req-e5b56628-6b6a-4e15-ae0c-106c320fc780 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061387 Sep 16 13:58:25.661840 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 723/1455] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:25.875976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:25.876989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:25.887188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.887949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.888549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.889434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.897911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.898859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.991700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:25.992570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:25.993365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:25.994207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 074e9fe3-9449-49c8-9153-0999ee84f2a3 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:26.020656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:26.023809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:26.032747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.033292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.033744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.034555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.035301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.035895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.125387 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09c2a30c-1d66-4771-a22e-551df8df520c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109348 Sep 16 13:58:26.129085 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 724/1456] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 13:58:26 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 13:58:26.155335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1d7e81c9-f4da-44fb-92ac-82aa372ce409 req-1f82f3fb-d8d3-491a-8434-94f7412f5386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074e9fe3-9449-49c8-9153-0999ee84f2a3", "name": "network-vif-deleted", "tag": "f47e6241-6644-4a56-b0dd-ffda96bd59f2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:26.172276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:26.186292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1d7e81c9-f4da-44fb-92ac-82aa372ce409 req-1f82f3fb-d8d3-491a-8434-94f7412f5386 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.186839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1d7e81c9-f4da-44fb-92ac-82aa372ce409 req-1f82f3fb-d8d3-491a-8434-94f7412f5386 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.189548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1d7e81c9-f4da-44fb-92ac-82aa372ce409 req-1f82f3fb-d8d3-491a-8434-94f7412f5386 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.193539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:26.205868 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8d2d96a-1300-486e-a84c-8040994944f5 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 200 len: 1309 microversion: 2.1 time: 0.333674 Sep 16 13:58:26.214494 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 733/1457] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:25 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:26.221902 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1d7e81c9-f4da-44fb-92ac-82aa372ce409 req-1f82f3fb-d8d3-491a-8434-94f7412f5386 service nova] Creating event network-vif-deleted:f47e6241-6644-4a56-b0dd-ffda96bd59f2 for instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 on n-h2-858129-2 Sep 16 13:58:26.233274 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1d7e81c9-f4da-44fb-92ac-82aa372ce409 req-1f82f3fb-d8d3-491a-8434-94f7412f5386 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102509 Sep 16 13:58:26.234584 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 725/1458] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:26.253769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:26.255226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:26.271452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.272805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.273974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.276549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.278106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.279234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.368120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-201817872", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f5ded7ba-8171-497d-ae0f-60a8d6711993"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:26.432848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] validate_networks() for [('f5ded7ba-8171-497d-ae0f-60a8d6711993', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:58:26.667500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:26.676657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56063e50-03c9-4999-81a5-d1e4d7a3ea01 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.431783 Sep 16 13:58:26.677605 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 734/1459] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:26 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:26.684707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:26.685737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:26.695860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.696677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.697413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.698306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.698918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.699404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.832607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:26.842095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:26.843810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:26.849601 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7fbb37c-b440-4a69-ac01-712b3527a65e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.169445 Sep 16 13:58:26.859082 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 735/1460] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:26 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:26.859082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:26.859082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:26.862672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.863251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.863682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:26.864474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:26.864930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:26.865347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.119781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=11 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:27.144475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:27.148519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=56 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:27.156962 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5cc2946e-d51a-4a6f-9e81-637d4a041351 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1475 microversion: 2.1 time: 0.305565 Sep 16 13:58:27.157934 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 736/1461] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:26 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1475 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:27.163198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:27.164156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:27.181130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.181610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.182045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.182894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.183340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.183757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.325521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:27.341742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:27.345734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:27.358821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d82f685-9ebf-431c-9e1b-66d82e34541a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1417 microversion: 2.75 time: 0.199394 Sep 16 13:58:27.375145 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 737/1462] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:27 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1417 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:27.403000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:27.404098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 074e9fe3-9449-49c8-9153-0999ee84f2a3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:27.426791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.431294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.431938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.435062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.435849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.436296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.448988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:58:27.449727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:58:27.449896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:58:27.450290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:58:27.451180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:58:27.457452 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 could not be found. Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 HTTP/1.1 Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:27.460437 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 could not be found. Sep 16 13:58:27.462199 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '074e9fe3-9449-49c8-9153-0999ee84f2a3'} Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 could not be found. Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:27.463211 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 could not be found. Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 could not be found. Sep 16 13:58:27.464947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:27.467181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance 074e9fe3-9449-49c8-9153-0999ee84f2a3 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:27.467538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.468100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.468592 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7476883d-ef8f-4658-a419-fabe134c274c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3" status: 404 len: 111 microversion: 2.1 time: 0.091918 Sep 16 13:58:27.468729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.469456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.470164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.470906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.471397 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 738/1463] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:27 2022] GET /compute/v2.1/servers/074e9fe3-9449-49c8-9153-0999ee84f2a3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:58:27.478602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:27.479226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:27.485817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.486267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.486774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.487530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.488206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.488812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.500718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Getting quotas for project eb701055c61a4eb29a1d36c197c42b70. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:58:27.507565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Getting quotas for user b476e900905a4f238a64e2ffd34e1159 and project eb701055c61a4eb29a1d36c197c42b70. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:58:27.528274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:58:27.531448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:58:27.536519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.537016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.537454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.537946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 343a95db-843b-4fb8-85a3-9440a605b38e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:27.589225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab7754c6-ea3d-496f-8e4a-0c01f3040daa tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225914 Sep 16 13:58:27.589901 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 726/1464] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:58:27.602642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a2a0ba59-33e9-4f88-a0db-5578c7ef203c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:27.603416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a2a0ba59-33e9-4f88-a0db-5578c7ef203c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:27.616996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:27.626181 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fdfc1fdd-f9e8-4f64-8d39-580de1dd6215 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1309 microversion: 2.1 time: 0.152481 Sep 16 13:58:27.627511 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 739/1465] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:27 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:27.705183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:27.705905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:27.719311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a2a0ba59-33e9-4f88-a0db-5578c7ef203c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:27.727703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.728411 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a2a0ba59-33e9-4f88-a0db-5578c7ef203c tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1217 microversion: 2.1 time: 0.130183 Sep 16 13:58:27.728702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.730456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.730640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 727/1466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:27 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:27.730880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.731739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.732532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.893218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:27.893843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:27.902008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.902541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.902985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:27.903708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:27.904125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:27.904518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.046242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.064721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.065842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.067399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.083705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dad3cdc7-d87c-450b-a689-db2bd43b13ee tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.193933 Sep 16 13:58:28.085833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 728/1467] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:27 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:28.086130 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e75e73f2-90a1-47b2-9416-6fea7ead6132 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.384413 Sep 16 13:58:28.087066 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 740/1468] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:27 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:28.181783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:28.182503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:28.192123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.193029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.193815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.195085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.195928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.196740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.381373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.393858 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f1a4cf4-7579-48dc-91e3-1db886d72c95 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1473 microversion: 2.1 time: 0.215608 Sep 16 13:58:28.395101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 729/1469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:28 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:28.411495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:28.412340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:28.432906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.433878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.434554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.435638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.436347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.436880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.517750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.540538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.543490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.550283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23945c86-e5df-418a-8fb2-b8106cbed95e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1438 microversion: 2.75 time: 0.144966 Sep 16 13:58:28.550936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 741/1470] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:28 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1438 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:28.579105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:28.582063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:28.589573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.590064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.590527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.591257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.591711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.592130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.672999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:28.673618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:28.680780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.681674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.682054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.682871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.683303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.683709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.697115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:58:28.697699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:58:28.698294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:58:28.698975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:58:28.699638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:58:28.723956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.724476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.724985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.726422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 343a95db-843b-4fb8-85a3-9440a605b38e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:28.787104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.796310 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d6755567-cf9f-4519-adee-d68da723470f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1309 microversion: 2.1 time: 0.127250 Sep 16 13:58:28.797220 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 742/1471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:28 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:28.800729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:28.808089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.808894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.809508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.811007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.811007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.811387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.816934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:28.818071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:28.827659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.828159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.828591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.829324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:28.829780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:28.830195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:28.889761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.913052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.916985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.922500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:28.930866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf8d4ebd-f899-4e6b-bee9-4c7a25e928b3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "POST /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb/action" status: 202 len: 1495 microversion: 2.75 time: 0.355371 Sep 16 13:58:28.936488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:28.946077 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a86714f-b991-4c07-8c56-16e9313ff5c5 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1269 microversion: 2.1 time: 0.134457 Sep 16 13:58:28.947211 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 730/1472] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:58:28 2022] POST /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb/action => generated 1495 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 13:58:28.947755 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 743/1473] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:28 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:28.992676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:28.993341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:29.001356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.001931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.002193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.002954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.003408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.004877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.097733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.108406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.109934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.114465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:29.115282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:29.118762 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0496423-6fc4-42f3-a829-0f80e94c0f2e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.129935 Sep 16 13:58:29.119885 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 731/1474] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:28 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:29.124204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.124693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.125283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.126523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.127619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.128394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.131534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:29.133090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:29.142338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.143107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.143841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.145138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.145858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.146448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.260241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.273056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.276174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.283728 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da9f0f1f-13e6-41cb-8b16-2ad9704d0af7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.158707 Sep 16 13:58:29.285100 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 732/1475] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:29 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:29.334743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.343360 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11f75c21-debf-4bbe-abbb-d9bf616b5001 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.233619 Sep 16 13:58:29.343981 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 744/1476] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:29 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:29.419717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:29.420365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:29.427314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.427822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.428267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.429111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.429634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.430170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.611557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.625530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c526a63-fa88-4f43-a914-fd313119c7b1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1473 microversion: 2.1 time: 0.209691 Sep 16 13:58:29.626474 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 733/1477] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:29 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1473 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:29.824137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:29.824992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:29.831636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.832137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.832576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.833296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.833751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.834179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.871276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:29.871706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:29.872149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:29.872603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 343a95db-843b-4fb8-85a3-9440a605b38e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:29.966777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:29.976506 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-340d4efc-caaa-4bd4-bf3f-a1c13e0ff519 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1309 microversion: 2.1 time: 0.155886 Sep 16 13:58:29.977123 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 745/1478] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:29 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:29.994870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:29.995506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:30.002628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.003138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.003706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.004450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.004915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.005349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.083860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.098259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cec6dfda-865a-4e51-bafd-104f31bd1fb3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1275 microversion: 2.1 time: 0.107533 Sep 16 13:58:30.099429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 734/1479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:29 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:30.153941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:30.155533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:30.164548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.165352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.165936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.167055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.167659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.168399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.281977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.298056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.301229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.310818 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86274ec1-cd61-4047-b35a-2a378816af44 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.162821 Sep 16 13:58:30.320428 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 746/1480] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:30 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:30.332105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:30.333447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:30.346212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.347337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.348172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.349017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.349661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.350247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.375049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:30.376201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:30.391731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.392619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.393401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.395023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.395882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.396634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.508044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.519209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.521593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.531600 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ddb3ed22-b91a-4184-82dc-ae70f15b4a98 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.208583 Sep 16 13:58:30.532524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 735/1481] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:30 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:30.666537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:30.668664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:30.680611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.681951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.682841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.684238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:30.685235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:30.685927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:30.804572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:30.820709 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7e626de-0284-461a-a49a-e6e46a0d7e00 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.453122 Sep 16 13:58:30.839558 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 747/1482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:30 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:31.008504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:31.011120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:31.027691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.029691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.030875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.032521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.033805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.034846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.108697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.109595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.110678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.111268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 343a95db-843b-4fb8-85a3-9440a605b38e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:31.243762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.258874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.263875 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9df1f7e0-ce57-446c-92e2-01a54b74603c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 200 len: 1309 microversion: 2.1 time: 0.264001 Sep 16 13:58:31.281084 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 748/1483] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:30 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:31.283286 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-20296ceb-082d-4832-96ba-399c1f814a24 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1473 microversion: 2.1 time: 0.616498 Sep 16 13:58:31.300330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 736/1484] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:30 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1473 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:31.307287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:31.310315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:31.324197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.325558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.326738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.329153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.330338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.331656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.360042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:31.360924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:31.414881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.415877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.416666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.430692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.431768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.432543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.681656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.702077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.707426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.719098 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af0dbbc5-96b2-4d28-b8d4-68c7d440c100 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.364393 Sep 16 13:58:31.721007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 737/1485] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:31 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:31.755079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:31.759412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:31.790664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.793025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.795253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.797014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.801254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.801999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:31.949752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.956916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:31.970057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90fb5146-506c-4a0f-9834-36cbf9d6f62d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.679613 Sep 16 13:58:31.971186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 749/1486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:31 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:31.982178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:31.983506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:31.990188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:31.995061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:31.997630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:31.998834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:31.999835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.001355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.002179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.002688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:32.002955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.004702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:32.030535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef25c576-9d68-4030-991c-1ab62d2e60e0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.307414 Sep 16 13:58:32.031156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 738/1487] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:31 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:32.310285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.311422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 343a95db-843b-4fb8-85a3-9440a605b38e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:32.321830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.322447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.322979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.323839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.324387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.324892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.339134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:32.349671 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1ab59d8-c47d-446c-8054-a3af653b4e87 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.376974 Sep 16 13:58:32.350531 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 750/1488] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:31 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:32.358921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.360442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:32.364601 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance 343a95db-843b-4fb8-85a3-9440a605b38e could not be found. Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e HTTP/1.1 Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:58:32.368099 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 343a95db-843b-4fb8-85a3-9440a605b38e could not be found. Sep 16 13:58:32.370964 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '343a95db-843b-4fb8-85a3-9440a605b38e'} Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343a95db-843b-4fb8-85a3-9440a605b38e could not be found. Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:32.373760 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343a95db-843b-4fb8-85a3-9440a605b38e could not be found. Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343a95db-843b-4fb8-85a3-9440a605b38e could not be found. Sep 16 13:58:32.378468 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:32.383591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance 343a95db-843b-4fb8-85a3-9440a605b38e could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:32.383591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-307fa89f-5b49-4c8d-8013-16ec6b209bcb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e" status: 404 len: 111 microversion: 2.1 time: 0.066052 Sep 16 13:58:32.384086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.384086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.384086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.384086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.384951 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 739/1489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:32 2022] GET /compute/v2.1/servers/343a95db-843b-4fb8-85a3-9440a605b38e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:58:32.385168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.385168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.390963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e673233-feb7-42b4-8ac3-70613093f64d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.435777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e673233-feb7-42b4-8ac3-70613093f64d tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/4c6193b7-737c-4cb7-9549-4193f760d81f" status: 204 len: 0 microversion: 2.1 time: 0.054093 Sep 16 13:58:32.436630 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 740/1490] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 13:58:32 2022] DELETE /compute/v2.1/os-server-groups/4c6193b7-737c-4cb7-9549-4193f760d81f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:32.447224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.447737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:32.454730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.455153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.455614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.456338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.456793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.457219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.486394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:32.580442 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4098734-e90e-48f7-9a66-b2a58d1f2699 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 204 len: 0 microversion: 2.1 time: 0.138700 Sep 16 13:58:32.582884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 741/1491] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:32 2022] DELETE /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 13:58:32.600715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.601694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:32.609387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.610219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.610788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.611982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.612884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.613872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.644618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:32.752202 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44e7ad24-605b-4951-bf07-6c323b131632 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 204 len: 0 microversion: 2.1 time: 0.160674 Sep 16 13:58:32.754502 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 742/1492] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:32 2022] DELETE /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:32.763862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.764580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:32.771604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.772093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.772676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.773416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.773871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.774337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.820871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:32.830501 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fcaa9fa0-c949-4526-b67e-0eecb7b19dd2 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1470 microversion: 2.1 time: 0.478714 Sep 16 13:58:32.831200 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 751/1493] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:32 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1470 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:32.836749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:32.837746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:32.844934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.845809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.846383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.847248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:32.847819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:32.849007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:32.981711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:32.996852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:32.998997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.008685 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd13eb24-a3db-4df6-a758-74c66393f8ec tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.175699 Sep 16 13:58:33.009865 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 752/1494] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:32 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:33.016096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:33.016965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:33.025187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.025894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.026579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.027591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.028394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.029007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.197308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.215754 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0410277b-0fbf-44a5-b740-1cd30b18b7ff tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1475 microversion: 2.1 time: 0.455748 Sep 16 13:58:33.227015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 743/1495] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:32 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:33.227491 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc9f94e1-6a25-4d46-af7a-16881d343450 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "POST /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570/action" status: 202 len: 0 microversion: 2.1 time: 0.214793 Sep 16 13:58:33.228593 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 753/1496] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:58:33 2022] POST /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:58:33.240590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:33.241897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:33.247871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:33.249445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.249944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.250312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:33.250555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.251117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.251581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.252056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.263589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.264336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.264921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.265816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.266478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.267235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.438298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.454513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.457705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.467763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3c9ea975-7b16-4ba7-935e-82fc2ebda51c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.231323 Sep 16 13:58:33.468871 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 754/1497] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:33 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:33.479564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "name": "network-vif-plugged", "status": "completed", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:33.496475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.497122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.497406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.515223 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] Creating event network-vif-plugged:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h1-858129-2 Sep 16 13:58:33.527948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:58:33.543155 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f21b4c1c-cc8d-459c-88a9-9623a8c95cc1 req-8517327f-3358-40c5-9091-f9afc1caf282 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071732 Sep 16 13:58:33.543949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 755/1498] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:33.550172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:33.550940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:33.558468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.559195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.559635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.560372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.560835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.561287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.629345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.640905 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a4e0a10-4a96-43f4-af17-5b00f4a97019 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.405485 Sep 16 13:58:33.641680 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 744/1499] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:33 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:33.649863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:33.650820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:33.658549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.659329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.659976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.660918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:33.661830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:33.662526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:33.899175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.912628 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc0945f3-d59f-4806-97d2-7ce1f9172d63 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.367092 Sep 16 13:58:33.913684 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 756/1500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:33 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:33.982256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:33.994443 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e471e96-0ab6-43b0-b300-10266f8b0a92 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.349414 Sep 16 13:58:33.995447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 745/1501] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:33 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:34.004583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9d3a17cf-e803-44f7-a4d8-913da3a6f428 req-d66f640e-7db6-44e1-b49c-052a0f887824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e674e04-fc08-4814-973e-4bd630ea35cc", "tag": "4d864e37-e655-4bc0-9a95-aa1b6340d75f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:34.017568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9d3a17cf-e803-44f7-a4d8-913da3a6f428 req-d66f640e-7db6-44e1-b49c-052a0f887824 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.018028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9d3a17cf-e803-44f7-a4d8-913da3a6f428 req-d66f640e-7db6-44e1-b49c-052a0f887824 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.018511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9d3a17cf-e803-44f7-a4d8-913da3a6f428 req-d66f640e-7db6-44e1-b49c-052a0f887824 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.031311 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9d3a17cf-e803-44f7-a4d8-913da3a6f428 req-d66f640e-7db6-44e1-b49c-052a0f887824 service nova] Creating event network-changed:4d864e37-e655-4bc0-9a95-aa1b6340d75f for instance 1e674e04-fc08-4814-973e-4bd630ea35cc on n-h2-858129-2 Sep 16 13:58:34.036934 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9d3a17cf-e803-44f7-a4d8-913da3a6f428 req-d66f640e-7db6-44e1-b49c-052a0f887824 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121566 Sep 16 13:58:34.037703 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 757/1502] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:34.041069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:34.041697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:34.048550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.049057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.049494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.050221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.050715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.051148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.136441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.147516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.149296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.155122 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f082e0b-0b56-4023-b60e-177389bd70cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.119413 Sep 16 13:58:34.155741 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 746/1503] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:34 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:34.242996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:34.243844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:34.251211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.251721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.252193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.253171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.253767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.254215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.516813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:34.517501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:34.525269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.526128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.526604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.527346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.528150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.528779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.634288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.645244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.646807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.653397 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6531a76c-130f-434a-be5b-b1acc38942f1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.141739 Sep 16 13:58:34.654033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 747/1504] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:34 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:34.657558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.672870 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0e60b0d-89aa-43a0-968d-c5ae30d533e7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1475 microversion: 2.1 time: 0.434793 Sep 16 13:58:34.686439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 758/1505] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:34 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:34.686747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:34.686747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:34.698479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.699394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.700215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.701551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.702438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.703241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.856874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:34.865626 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-22361208-5d90-4358-9dac-0f04c5a3eb4d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.190308 Sep 16 13:58:34.866778 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 748/1506] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:34 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:34.941264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:34.941885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:34.949030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.949515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.949948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:34.950685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:34.951136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:34.951560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.018349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:35.019174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:35.026110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.026646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.027124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.028003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.028629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.029070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.166609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.177634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61a9a63b-9f7b-4847-90e3-010091523a33 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.240246 Sep 16 13:58:35.179340 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 759/1507] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:34 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:35.201339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:35.201962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:35.208732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.209552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.210014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.210984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.211443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.211870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.235348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.249655 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3d7af31-6963-4bcf-bb6f-f88af8d5672c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.234898 Sep 16 13:58:35.250666 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 749/1508] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:35 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:35.311164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.322380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.324549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.331111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d35ce27a-ff77-4796-a4d6-58b7e93886ca tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.133716 Sep 16 13:58:35.331891 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 760/1509] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:35 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:35.681725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:35.682333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:35.690019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.690929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.691487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.692391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.693105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.693747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.717459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:35.718386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:35.722811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:35.729384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.730018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.730603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.731432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.732084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.732680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.778026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.788724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.790438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:35.798128 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7286584-5420-41ac-bbd1-71906c007058 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.120341 Sep 16 13:58:35.798969 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 750/1510] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:35 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:35.898951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:35.900137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:35.909484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.910076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.910646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:35.911764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:35.912389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:35.913581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.024383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.038949 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eee8f750-21c8-4570-a150-c2eb8aa0b08c tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1475 microversion: 2.1 time: 0.326400 Sep 16 13:58:36.040353 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 761/1511] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:35 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1475 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:36.188780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.205241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-621f5552-c561-4442-9c1f-56ebfb068a9b tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.314724 Sep 16 13:58:36.207026 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 751/1512] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:35 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:36.227545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:36.228440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:36.235013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.235820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.236660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.238328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.239107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.239750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.285135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:36.286097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:36.304739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.305330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.305875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.306656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.307122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.307718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.601578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.620176 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81bd0cbd-fc9e-4cdf-b005-0e157d232f13 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.400182 Sep 16 13:58:36.634232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.643287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 762/1513] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:36 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:36.649098 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7dd7e38c-bffe-43db-b400-d81a33b458fb tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.371197 Sep 16 13:58:36.649708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 752/1514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:36 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:36.665859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:36.669884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:36.680424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.681187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.682593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.683511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.684098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.685408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.758858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f5d4caf8-8eda-4b6a-86d4-71a31efb332f req-d30f95e0-3eb1-4061-9b29-84abf1631ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956d23ad-d927-4fbe-ba93-40e436b3284c", "name": "network-vif-deleted", "tag": "781106b3-9349-4ccb-9d64-9bae8c575ddc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:36.770815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f5d4caf8-8eda-4b6a-86d4-71a31efb332f req-d30f95e0-3eb1-4061-9b29-84abf1631ddc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.771623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f5d4caf8-8eda-4b6a-86d4-71a31efb332f req-d30f95e0-3eb1-4061-9b29-84abf1631ddc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.772314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f5d4caf8-8eda-4b6a-86d4-71a31efb332f req-d30f95e0-3eb1-4061-9b29-84abf1631ddc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.785859 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f5d4caf8-8eda-4b6a-86d4-71a31efb332f req-d30f95e0-3eb1-4061-9b29-84abf1631ddc service nova] Creating event network-vif-deleted:781106b3-9349-4ccb-9d64-9bae8c575ddc for instance 956d23ad-d927-4fbe-ba93-40e436b3284c on n-h1-858129-2 Sep 16 13:58:36.793925 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f5d4caf8-8eda-4b6a-86d4-71a31efb332f req-d30f95e0-3eb1-4061-9b29-84abf1631ddc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039314 Sep 16 13:58:36.795533 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 753/1515] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:36.814314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.844950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.850031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:36.851609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:36.854125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:36.864874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.867346 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c0ca383-b2a1-4810-a274-6fe2ecd045d2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.222779 Sep 16 13:58:36.867931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.868595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.869018 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 763/1516] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:36 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:36.870231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:36.870957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:36.872323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:36.920931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:36.993468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:37.016073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:37.019686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:37.035192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44fb5bc6-058a-4eea-91c4-4985e4620ca4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.194004 Sep 16 13:58:37.038974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 754/1517] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:36 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:37.071812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:37.072953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:37.088148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.090449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.092371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.094036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.095395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.096145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.156917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.157907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.158938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.159883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 956d23ad-d927-4fbe-ba93-40e436b3284c {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:37.225123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:37.238934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:37.239658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:37.249344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.249949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.250532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.251354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.251891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.252461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.258896 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23358c09-4a34-4622-a4db-37bc2cfdc2d7 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1309 microversion: 2.1 time: 0.194249 Sep 16 13:58:37.267539 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 764/1518] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:37 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:37.416282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7395b3f4-b94c-4c76-8009-de8ac4f74229 req-a2b71c5d-bdaa-49e0-8cfc-8e982f660da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d86e2c-0f16-4456-95aa-b7157dd71e84", "name": "network-vif-deleted", "tag": "5a5c4d29-5f39-418a-8e4c-c849bfda0612"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:37.427196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7395b3f4-b94c-4c76-8009-de8ac4f74229 req-a2b71c5d-bdaa-49e0-8cfc-8e982f660da7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.427683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7395b3f4-b94c-4c76-8009-de8ac4f74229 req-a2b71c5d-bdaa-49e0-8cfc-8e982f660da7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.428121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7395b3f4-b94c-4c76-8009-de8ac4f74229 req-a2b71c5d-bdaa-49e0-8cfc-8e982f660da7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.444075 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7395b3f4-b94c-4c76-8009-de8ac4f74229 req-a2b71c5d-bdaa-49e0-8cfc-8e982f660da7 service nova] Creating event network-vif-deleted:5a5c4d29-5f39-418a-8e4c-c849bfda0612 for instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 on n-h1-858129-2 Sep 16 13:58:37.445720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:37.455130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a01808c4-069b-45c4-bb03-2ec483499280 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.225390 Sep 16 13:58:37.455714 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7395b3f4-b94c-4c76-8009-de8ac4f74229 req-a2b71c5d-bdaa-49e0-8cfc-8e982f660da7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044006 Sep 16 13:58:37.455845 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 755/1519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:37 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:37.456327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 765/1520] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:37.680085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:37.681540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:37.689498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:37.692981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.693674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.694377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.696414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.697217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.697977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.698241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:37.700112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:37.721300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.722278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.723350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.725214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:37.727553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:37.729636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:37.740998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:37.744828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=76 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:37.999712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.007864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.011121 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-113065b8-bd6b-4335-bff3-3d7cb3c08744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.338253 Sep 16 13:58:38.011853 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 756/1521] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:37 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:38.018663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:38.019710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:38.023460 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-caf4d138-10f0-4a3e-a236-d4a47ca7392b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.335298 Sep 16 13:58:38.024622 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 766/1522] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:37 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:38.030326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.030873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.031298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.032022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.032468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.033078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.067806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:38.068959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:38.079441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.080093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.080846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.081837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.082317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.082799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.107379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.122332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.125588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.135254 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-628b938c-4bb9-4104-b56d-6159ea02285c tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.121644 Sep 16 13:58:38.136304 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 757/1523] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:38 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:38.162007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.171488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.173091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.178979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f5cf519-65de-447d-989a-8672b8bd6181 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.118606 Sep 16 13:58:38.179593 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 767/1524] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:38 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:38.309819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:38.310474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:38.317024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.317523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.317966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.318729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.319192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.319629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.355227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.355714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.356158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.356618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 956d23ad-d927-4fbe-ba93-40e436b3284c {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:38.403310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.412680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9be76b2d-6f0d-4f57-95d9-04c92bfa3898 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 200 len: 1309 microversion: 2.1 time: 0.107316 Sep 16 13:58:38.413891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 758/1525] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:38 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:38.498613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:38.499659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:38.507923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.508443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.508933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.509805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:38.510317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:38.510846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:38.685118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:38.693347 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b37e21f0-66da-4657-af30-efd5069a8c55 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.200324 Sep 16 13:58:38.693949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 768/1526] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:38 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:39.041858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.042742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.047742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.048533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.054751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.055453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.056235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.056752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.057313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.057464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.057931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.058296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.058804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.059102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.059753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.060254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.400119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.420638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb715def-4b12-4dad-b447-e3743b2a5b9a tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.376825 Sep 16 13:58:39.421527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 769/1527] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:39.426703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.427406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.435281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.436175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.436860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.437832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.438562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.439218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.505497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.520915 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5aac4ee1-793b-417c-876d-8d2dab9fa1cf tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.486674 Sep 16 13:58:39.543082 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 759/1528] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:39.555589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.556987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.564840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.565936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:39.570292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.571836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.572628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.573927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.575250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.576045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.579757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.581720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.588941 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9e4d0792-4897-48ab-9e82-0bc0de5e1757 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.166216 Sep 16 13:58:39.590245 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 770/1529] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:39.595912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.596979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 956d23ad-d927-4fbe-ba93-40e436b3284c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.605269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.606095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.606795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.608075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.608865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.609616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.641697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance 956d23ad-d927-4fbe-ba93-40e436b3284c could not be found. Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c HTTP/1.1 Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:39.645000 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 956d23ad-d927-4fbe-ba93-40e436b3284c could not be found. Sep 16 13:58:39.648469 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '956d23ad-d927-4fbe-ba93-40e436b3284c'} Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956d23ad-d927-4fbe-ba93-40e436b3284c could not be found. Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:39.650085 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956d23ad-d927-4fbe-ba93-40e436b3284c could not be found. Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956d23ad-d927-4fbe-ba93-40e436b3284c could not be found. Sep 16 13:58:39.652763 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:39.655147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance 956d23ad-d927-4fbe-ba93-40e436b3284c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:39.656093 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61a46020-ab27-430a-8ee6-c014d92bc240 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c" status: 404 len: 111 microversion: 2.1 time: 0.064499 Sep 16 13:58:39.656864 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 771/1530] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/956d23ad-d927-4fbe-ba93-40e436b3284c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:58:39.668952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.669872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.677535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.678357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.679071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.680125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.680834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.681430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.746751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.747603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.748163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.749074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid 49d86e2c-0f16-4456-95aa-b7157dd71e84 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:39.764805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.782077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.785231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.793200 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-614eb4ba-5f17-4a75-8606-f2b956c6320b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.248421 Sep 16 13:58:39.794005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 760/1531] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:39.809824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:39.811061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:39.820963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.821738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.822348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.823330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:39.824005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:39.824715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:39.834488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:39.849926 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30f8d0fb-3b79-4e13-abf2-0034eb2d7208 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 200 len: 1309 microversion: 2.1 time: 0.187014 Sep 16 13:58:39.851504 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 772/1532] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:40.085695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.100127 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-84144d91-794e-45ee-8a8d-60b79d7f67c0 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.304143 Sep 16 13:58:40.101686 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 761/1533] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:39 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:40.446246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:40.447150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:40.462106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.462963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.463759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.464967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.465731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.466476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.567013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:40.568106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:40.579877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.580837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.581641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.583388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.584174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.585758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.708878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.723228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-88807534-8095-40ce-9943-95a12bbc30bf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.281266 Sep 16 13:58:40.724635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 773/1534] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:40 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:40.735356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:40.736842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:40.749733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.750816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.751708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.753128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.754088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.754990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.842593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.856886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-639c3e39-9a37-436e-995a-9020f96cab9f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.295002 Sep 16 13:58:40.858461 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 762/1535] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:40 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:40.864272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.865334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:40.866848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:40.879632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.880492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.880951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.881201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.882855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.883058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.883464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.883901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.889382 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-77cbfbe4-d0c6-43af-862c-cd7cc5060a4f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.162022 Sep 16 13:58:40.903394 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 774/1536] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:40 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:40.917979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:40.918974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: 49d86e2c-0f16-4456-95aa-b7157dd71e84] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:40.926139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.926935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.927550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.928489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:40.929661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:40.930290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:40.948735 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 could not be found. Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 HTTP/1.1 Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:40.950687 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 could not be found. Sep 16 13:58:40.952364 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '49d86e2c-0f16-4456-95aa-b7157dd71e84'} Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 could not be found. Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:40.953295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 could not be found. Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 could not be found. Sep 16 13:58:40.954838 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:40.957564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance 49d86e2c-0f16-4456-95aa-b7157dd71e84 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:40.958758 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4a48e294-3040-45fa-882a-1126b91a9edb tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84" status: 404 len: 111 microversion: 2.1 time: 0.053988 Sep 16 13:58:40.960385 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 775/1537] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:40 2022] GET /compute/v2.1/servers/49d86e2c-0f16-4456-95aa-b7157dd71e84 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:58:40.970695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-10199abd-70d5-4755-9271-740936152310 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:40.985963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.998982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:40.999764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:41.008419 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a82dbd26-c93e-4cce-b8e4-38b3b99f7d3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.148379 Sep 16 13:58:41.008990 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 763/1538] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:40 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:41.009501 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-10199abd-70d5-4755-9271-740936152310 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/460842ce-b822-44a7-975f-a2f21d9cbe29" status: 204 len: 0 microversion: 2.1 time: 0.043939 Sep 16 13:58:41.010188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 776/1539] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 13:58:40 2022] DELETE /compute/v2.1/os-server-groups/460842ce-b822-44a7-975f-a2f21d9cbe29 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 13:58:41.018764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:41.019455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:41.030627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.031238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.031756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.032598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.033140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.033656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.070722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:41.129032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:41.130523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:41.143511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.145550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.148080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.150162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.151240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.153214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.173638 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1107d7a3-eacd-4db2-873f-6ecd5ab9af8f tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 204 len: 0 microversion: 2.1 time: 0.158308 Sep 16 13:58:41.175746 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 764/1540] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:41 2022] DELETE /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:41.189251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:41.190878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:41.200883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.201798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.202501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.203557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.204246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.205241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.431988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:41.442059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45fb20c7-7ae5-4066-95a6-a335dd0c8f2e tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.320919 Sep 16 13:58:41.442917 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 777/1541] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:41 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:41.446644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:41.456770 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13054b84-acf3-424b-bf24-aa339d23f324 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1472 microversion: 2.1 time: 0.274987 Sep 16 13:58:41.457596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 765/1542] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:41 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:41.769305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:41.770652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:41.782966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.783883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.784696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.785984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.786825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.787598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.884074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:41.885097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:41.892494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.893254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.893791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.894659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:41.895204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:41.895715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:41.975888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:41.989192 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37090a25-f087-46ff-9ecf-ad131ee71ea0 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.226799 Sep 16 13:58:41.990368 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 778/1543] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:41 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:42.000247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:42.001380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:42.013187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.014071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.014927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.016264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.017137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.017962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.096888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.107683 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d22a0e4b-d6cc-41f9-b1ca-03375521cc5f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.228864 Sep 16 13:58:42.108569 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 766/1544] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:41 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:42.115556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:42.116624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:42.118069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.127360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.128524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.129248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.130515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.131311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.132577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.136116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.139213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.148518 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca4d65ed-deb9-49b0-9094-b98157583ab1 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.155138 Sep 16 13:58:42.149560 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 779/1545] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:41 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:42.243337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.259161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.262145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.271609 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5d9678f4-bc86-4e29-bb0e-1cd0b66e2017 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.161424 Sep 16 13:58:42.272848 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 767/1546] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:42 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:42.471007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:42.471634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:42.478977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.479466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.479888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.480588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.481033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.481449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.483240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:42.483952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:42.491398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.491864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.492457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.493320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.493847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.494340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.831403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.838569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.840790 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e43a483-64d3-47df-9ba3-e01d87419a38 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.373442 Sep 16 13:58:42.841402 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 780/1547] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:42 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:42.852503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:42.852834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a340078-ff20-4a98-90ec-dba182f83364 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1472 microversion: 2.1 time: 0.374516 Sep 16 13:58:42.853481 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 768/1548] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:42 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:42.863039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.864693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Searching by: {'deleted': False, 'project_id': '454a349170e442479ba080adf1ae35b9'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:58:42.875606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.876484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.877319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.879080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.879948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.880734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.914891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:58:42.948539 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27e03271-f5a1-466e-8531-b65469c2f94d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.101698 Sep 16 13:58:42.949174 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 781/1549] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 13:58:42 2022] GET /compute/v2.1/servers => generated 333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:42.963058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:42.968304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:42.969216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Searching by: {'deleted': False, 'project_id': '454a349170e442479ba080adf1ae35b9'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 13:58:42.975223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.976256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.976700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.977446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:42.977902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:42.978333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:42.998123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:43.025075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 13:58:43.026181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.026943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:43.040377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.041211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.042096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.043354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.043948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.044619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.097900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.111047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.112323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.113352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.465844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.475612 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e98dd8d-2fc8-476c-afc1-d13c2ee49b23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.455057 Sep 16 13:58:43.484081 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 782/1550] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:43.484081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.484081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:43.486182 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dfc36194-a8a3-4e63-b0b9-23a12dbc547d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.527633 Sep 16 13:58:43.487620 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 769/1551] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 13:58:42 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:43.493557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "name": "network-vif-unplugged", "status": "completed", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:43.508012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.508413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.508531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.508880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.509072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.509847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.511538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.512631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.513922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.528745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] Creating event network-vif-unplugged:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h2-858129-2 Sep 16 13:58:43.535197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:58:43.566563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c9d43a44-e3cc-4848-a125-0aee8576da4b req-77cf846a-2c1b-46f7-b48a-044780aabdd5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077240 Sep 16 13:58:43.568759 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 770/1552] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:43.577953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.578831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:43.588818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.589340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.589867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.590642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.591136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.591626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.677758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.693155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.695843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.702972 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf643906-ff27-4409-b81d-61346565959e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.132005 Sep 16 13:58:43.703615 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 771/1553] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:43.719927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.720555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:43.728233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.728729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.729425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.730386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.730896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.731340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.772924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.781989 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cdd34468-d00f-4244-a8c5-0c0c0cdddb6c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.304137 Sep 16 13:58:43.782625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 783/1554] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:43.788518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b83764b-c3d2-4543-9f80-344b866287c0 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.800694 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b83764b-c3d2-4543-9f80-344b866287c0 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016568 Sep 16 13:58:43.801774 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 784/1555] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:43.825765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.843229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.846624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:43.856732 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-613c11bb-3ee8-4458-a8a4-4ff884151161 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.151744 Sep 16 13:58:43.857910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 772/1556] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:43.880340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.881384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:43.900679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.901746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:43.902083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.903128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.904892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.905993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.906328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:43.907195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.925917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.926806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.927435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.928274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:43.929396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:43.929930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:43.939640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:44.462674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:44.470601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:44.479008 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-410e1524-c0d6-4172-86ab-b983ff11f2eb tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.603081 Sep 16 13:58:44.480770 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 785/1557] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:44.487929 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-83f571a0-0b54-459f-948f-37de3a263f68 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1472 microversion: 2.1 time: 0.597047 Sep 16 13:58:44.502437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:44.502437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:44.503382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.504222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 773/1558] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:43 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:44.504421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.505464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.513871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.513871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.513871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.541360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:44.543857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:44.556933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.558666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.559796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.561362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.562598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.563675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.620934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:44.783597 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a558e6d-2f19-46be-9f1a-12eb9b299409 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 204 len: 0 microversion: 2.1 time: 0.300771 Sep 16 13:58:44.789172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 786/1559] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:44 2022] DELETE /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:44.790565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d10c6360-327e-4835-a8d6-5a4d9658d4b3 req-47e279b9-4e43-4eaf-933b-3cc481e79424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba0e96-0970-4dbb-b9cc-a082824df96f", "name": "network-vif-deleted", "tag": "bf14938d-0606-4211-bad3-6350e8faa4a7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:44.801587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d10c6360-327e-4835-a8d6-5a4d9658d4b3 req-47e279b9-4e43-4eaf-933b-3cc481e79424 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.802081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d10c6360-327e-4835-a8d6-5a4d9658d4b3 req-47e279b9-4e43-4eaf-933b-3cc481e79424 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.802763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d10c6360-327e-4835-a8d6-5a4d9658d4b3 req-47e279b9-4e43-4eaf-933b-3cc481e79424 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.822634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d10c6360-327e-4835-a8d6-5a4d9658d4b3 req-47e279b9-4e43-4eaf-933b-3cc481e79424 service nova] Creating event network-vif-deleted:bf14938d-0606-4211-bad3-6350e8faa4a7 for instance f6ba0e96-0970-4dbb-b9cc-a082824df96f on n-h2-858129-2 Sep 16 13:58:44.828512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d10c6360-327e-4835-a8d6-5a4d9658d4b3 req-47e279b9-4e43-4eaf-933b-3cc481e79424 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042217 Sep 16 13:58:44.832383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 787/1560] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:44.838599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:44.839209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:44.847170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.847975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.848411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.849334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.849804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.850231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.919368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:44.934353 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-038217a9-c9a9-46a3-a8dd-ea858df3a0c9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.418185 Sep 16 13:58:44.935307 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 774/1561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:44 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:44.947950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:44.949694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:44.962270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.964671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.966425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:44.968151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:44.969096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:44.970021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.020531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.039975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.041565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.048152 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83e9393e-50a4-4b2a-9d23-c1b0a9ba242a tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.214345 Sep 16 13:58:45.049043 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 788/1562] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:44 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:45.054969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:45.055846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:45.071134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.071924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.073294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.074620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.075259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.075845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.426863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.440832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-077704fe-5a1e-44af-bd6a-a188e029ea78 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1701 microversion: 2.1 time: 0.503422 Sep 16 13:58:45.442207 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 775/1563] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:44 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1701 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:45.468152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:45.468809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:45.476315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.477015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.477871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.478008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.478482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.479535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.503613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.515468 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e65be6b-c8ae-4b2b-9aac-0bf204b45c17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.464497 Sep 16 13:58:45.516735 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 789/1564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:45 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:45.536702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:45.538592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:45.549978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.551018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.551867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.553250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.554558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.555077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.583801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.593784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.595361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.601863 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e2e90d0-f09c-48ee-a3d1-779955811006 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.137696 Sep 16 13:58:45.602495 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 776/1565] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:45 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:45.610674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:45.611454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:45.619272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.619793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.620212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.620934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.621397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.621833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.658649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.659233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.659710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.660344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid f6ba0e96-0970-4dbb-b9cc-a082824df96f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:45.789999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.800788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a76054b-dd19-45b8-a3d5-80dcdd478162 tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1306 microversion: 2.1 time: 0.197147 Sep 16 13:58:45.801400 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 777/1566] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:45 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1306 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:45.806817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-91cf8ecb-c3d5-4fa6-9c71-bd49daafedaf req-c95447a5-726b-4d12-9e50-df4064dffb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e674e04-fc08-4814-973e-4bd630ea35cc", "name": "network-vif-plugged", "status": "completed", "tag": "4d864e37-e655-4bc0-9a95-aa1b6340d75f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:45.817781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-91cf8ecb-c3d5-4fa6-9c71-bd49daafedaf req-c95447a5-726b-4d12-9e50-df4064dffb4a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.818737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-91cf8ecb-c3d5-4fa6-9c71-bd49daafedaf req-c95447a5-726b-4d12-9e50-df4064dffb4a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.819433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-91cf8ecb-c3d5-4fa6-9c71-bd49daafedaf req-c95447a5-726b-4d12-9e50-df4064dffb4a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.831903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-91cf8ecb-c3d5-4fa6-9c71-bd49daafedaf req-c95447a5-726b-4d12-9e50-df4064dffb4a service nova] Creating event network-vif-plugged:4d864e37-e655-4bc0-9a95-aa1b6340d75f for instance 1e674e04-fc08-4814-973e-4bd630ea35cc on n-h2-858129-2 Sep 16 13:58:45.837330 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-91cf8ecb-c3d5-4fa6-9c71-bd49daafedaf req-c95447a5-726b-4d12-9e50-df4064dffb4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034690 Sep 16 13:58:45.838019 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 778/1567] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:45.934880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:45.945583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:45.946071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:45.946544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:45.961371 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] Creating event network-changed:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h2-858129-2 Sep 16 13:58:45.968903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:45.972421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 13:58:45.985669 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-bc9d151b-f161-4d54-b8cc-7fe875f5e22d req-3376b4a5-3f00-4654-b808-9c3183305bf1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055020 Sep 16 13:58:45.987401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 779/1568] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:45.989364 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a54996bb-b43e-448f-a6c6-1cae850aa7b6 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.459470 Sep 16 13:58:45.991687 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 790/1569] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:45 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:45.999451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:46.000814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:46.012851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.013703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.014465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.015671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.016478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.017262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.106271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:46.107265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:46.117821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.118753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.119540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.120844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.121691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.122473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.241904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:46.246010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:46.255525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:46.256436 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d786847d-02d6-473b-8e89-b6badcfa2a04 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.267732 Sep 16 13:58:46.257747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:46.262920 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 780/1570] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:45 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:46.266881 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-944a9dc7-259a-490e-a86a-91ed387cdee7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.168699 Sep 16 13:58:46.270696 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 791/1571] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:46 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:46.482708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:46.483861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:46.497018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.497900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.499161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.500502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.501348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.502093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.546297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:46.547417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:46.563502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.567375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.567916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.570686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.572860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.573461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.953869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:46.962267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:46.969951 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4501ffe6-8bb9-4b6c-b73b-d82bf11ae35f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.432338 Sep 16 13:58:46.971842 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 792/1572] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:46 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:46.974105 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0923a1df-38e6-4d95-9bb4-18170da98206 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1701 microversion: 2.1 time: 0.495963 Sep 16 13:58:46.974847 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 781/1573] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:46 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1701 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:46.981541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:46.982720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:46.991056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:46.991713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:46.994318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.995237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.996044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.997326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.998346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:46.999098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:46.999376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:46.999594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.000032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.000757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.001218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.001642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.042043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.042383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.043488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.044325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid f6ba0e96-0970-4dbb-b9cc-a082824df96f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:47.504526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.516513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.519223 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cbc2d3aa-cf24-4a8f-8619-b57c051e300e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1306 microversion: 2.1 time: 0.541672 Sep 16 13:58:47.520510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 782/1574] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:46 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1306 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:47.530928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:47.533046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:47.545669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.547143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.548403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.550506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.551841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.553250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.575337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.581920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.592402 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90261400-57d6-48cd-9e99-5e31ee8b4aba tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.618588 Sep 16 13:58:47.600345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 793/1575] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:46 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:47.607394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:47.607885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:47.627396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.628481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.629398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.630875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.631917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.632839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.766844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.785824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.790833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.803745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:47.807492 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a438906d-54a1-45ed-847e-9f2661d65918 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.210435 Sep 16 13:58:47.811747 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 794/1576] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:47 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:47.822730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:47.823961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:47.841970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.843584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.844325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.845597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:47.846390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:47.847149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:47.884630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:47.894298 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47802c04-fbd0-4b5a-940a-a0012a151c20 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.371543 Sep 16 13:58:47.895138 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 783/1577] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:47 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:47.997960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:47.999782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:48.013119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.013986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.014843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.016113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.016893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.017733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.052765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.066926 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-559e0816-7562-4724-9eed-8e9e20e318a4 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.252914 Sep 16 13:58:48.071245 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 795/1578] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:47 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:48.078603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:48.079701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:48.089454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.090872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.091626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.092772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.093250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.093792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.296644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.305745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc51f675-55b6-487e-b527-83bb14dfefd8 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.315073 Sep 16 13:58:48.322367 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 784/1579] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:47 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:48.341550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.353577 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca524129-7ad6-4c15-b35b-c7a8a11e6714 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1701 microversion: 2.1 time: 0.280110 Sep 16 13:58:48.354296 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 796/1580] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:48 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1701 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:48.570218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:48.571446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:48.580378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.581224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.581771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.582683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.583310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.583858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.627604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.628289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.628831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.629406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lazy-loading 'fault' on Instance uuid f6ba0e96-0970-4dbb-b9cc-a082824df96f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:48.634308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:48.654606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:48.655728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:48.667583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.668487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.669311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.670633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.671463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.672235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.691268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25fcb9106443488ebf540ea787256548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da29b469d8554f0993b35628a9a05d89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.728915 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75ba9a83-59ba-4129-8bc6-473a55d5c44e tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 200 len: 1306 microversion: 2.1 time: 0.161100 Sep 16 13:58:48.743855 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 785/1581] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:48 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 1306 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:48.792584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6ed515c2-aaf8-437d-ace2-a6ef8004834f req-958e4325-b46a-419e-bc9a-0f794e713a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5508ca6-96e8-447b-9bfd-6ce805d6418f", "name": "network-vif-deleted", "tag": "ebcf9954-db11-4079-925a-2c4309e336c9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:48.801690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.817936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.818231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6ed515c2-aaf8-437d-ace2-a6ef8004834f req-958e4325-b46a-419e-bc9a-0f794e713a39 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.819069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6ed515c2-aaf8-437d-ace2-a6ef8004834f req-958e4325-b46a-419e-bc9a-0f794e713a39 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.820356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6ed515c2-aaf8-437d-ace2-a6ef8004834f req-958e4325-b46a-419e-bc9a-0f794e713a39 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.827654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:48.836462 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb2857ad-ea3b-4223-97da-1b2363f2af74 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.188220 Sep 16 13:58:48.837776 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 797/1582] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:48 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:48.843715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:48.844858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:48.848337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6ed515c2-aaf8-437d-ace2-a6ef8004834f req-958e4325-b46a-419e-bc9a-0f794e713a39 service nova] Creating event network-vif-deleted:ebcf9954-db11-4079-925a-2c4309e336c9 for instance e5508ca6-96e8-447b-9bfd-6ce805d6418f on n-h2-858129-2 Sep 16 13:58:48.855513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.856804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.857285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.858752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.859237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.859676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.870705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6ed515c2-aaf8-437d-ace2-a6ef8004834f req-958e4325-b46a-419e-bc9a-0f794e713a39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093745 Sep 16 13:58:48.872743 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 786/1583] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:48.943709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:48.945766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:48.955541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.961749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.962584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:48.964058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:48.964893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:48.965534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.087204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.136782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.140122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.167240 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8dfce975-7010-4ab4-9958-6bd3184d2994 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.327703 Sep 16 13:58:49.168922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 798/1584] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:48 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:49.179142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:49.180473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:49.192212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.193612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.195348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.197030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.198228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.199304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.335279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.344376 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e5542e9-96d7-40ce-910e-703ff7ba04c7 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1317 microversion: 2.1 time: 0.407987 Sep 16 13:58:49.359869 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 787/1585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:48 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:49.365487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:49.366770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:49.373987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.374635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.375322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.376308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.376889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.377555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.432667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.445205 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43a1c533-cb30-4412-9fd6-58d6eb71ee0b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.273953 Sep 16 13:58:49.447025 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 799/1586] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:49 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:49.472096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:49.478264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:49.494794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.495620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.496259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.497522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.498201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.499233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.558920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.559566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.560027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.560480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lazy-loading 'fault' on Instance uuid e5508ca6-96e8-447b-9bfd-6ce805d6418f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:49.683223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.689066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:49.702965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-768e7e3b-702e-4918-8f08-d1e396f71e7d tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1359 microversion: 2.1 time: 0.254378 Sep 16 13:58:49.711181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 800/1587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:49 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:49.774527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:49.775381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] [instance: f6ba0e96-0970-4dbb-b9cc-a082824df96f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:49.787497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.788372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.789242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.790784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.791986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.792191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.804374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:49.819932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2232fb48-13df-4e1d-9b3e-68c4c6373526 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.458061 Sep 16 13:58:49.824132 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 788/1588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:49 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:49.848457 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] HTTP exception thrown: Instance f6ba0e96-0970-4dbb-b9cc-a082824df96f could not be found. Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Request method failure captured: Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f HTTP/1.1 Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIAcHPHI-Rokf1QWZfq6GTOJa-CuYhVvOqKHEsDMWJ0TxyflnXye7oqhDPOuu2sHHdrmztq4Zsuuvx7TaRuaGocwRtEe73f_XBZcqT9tuM7eNdwy6isL_Vzr5VqwcBk2TMvumQ04woxteU4OUhZ2fI2VMz2CI7_UsqZcMNtVKl6NMJM Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:49.852530 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da29b469d8554f0993b35628a9a05d89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da29b469d8554f0993b35628a9a05d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da29b469d8554f0993b35628a9a05d89"}]}] Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: da29b469d8554f0993b35628a9a05d89 Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-815015414 Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 25fcb9106443488ebf540ea787256548 Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersOnMultiNodesTest-815015414-project Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f6ba0e96-0970-4dbb-b9cc-a082824df96f could not be found. Sep 16 13:58:49.855254 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f6ba0e96-0970-4dbb-b9cc-a082824df96f'} Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ba0e96-0970-4dbb-b9cc-a082824df96f could not be found. Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:49.856770 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ba0e96-0970-4dbb-b9cc-a082824df96f could not be found. Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ba0e96-0970-4dbb-b9cc-a082824df96f could not be found. Sep 16 13:58:49.861245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:49.868054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] Returning 404 to user: Instance f6ba0e96-0970-4dbb-b9cc-a082824df96f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:49.868054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b600c87-a784-4af6-9803-b035e264fdcd tempest-ServersOnMultiNodesTest-815015414 tempest-ServersOnMultiNodesTest-815015414-project] 10.222.0.60 "GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f" status: 404 len: 111 microversion: 2.1 time: 0.087774 Sep 16 13:58:49.868054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 801/1589] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:49 2022] GET /compute/v2.1/servers/f6ba0e96-0970-4dbb-b9cc-a082824df96f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:58:49.892801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:49.893661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:49.901319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.901826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.902571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:49.903351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:49.904036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:49.904488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.050757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.064789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.067866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.077865 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-072054ec-8c46-4694-bd53-5885bd333d0a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.188847 Sep 16 13:58:50.079972 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 789/1590] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:49 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:50.223944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:50.224669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:50.232934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.233831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.234462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.235557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.236512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.237525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.378120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:50.379504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:50.382694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.393617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.395363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.396462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.397949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.398723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.401719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.402692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.403187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.418283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-449f3ff2-c60e-490e-b61d-b291495c24b2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.192929 Sep 16 13:58:50.423333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 802/1591] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:50 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:50.492843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:50.494341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:50.504760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.506260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.506985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.507932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.508926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.509541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.722377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.746722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3ca8f90-d2ce-40b7-9562-a3a3e1608ae3 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1507 microversion: 2.1 time: 0.382500 Sep 16 13:58:50.752929 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 790/1592] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:50 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:50.769619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:50.774213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:50.787642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.789025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.789481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.790325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.791376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.791978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.795605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.820938 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b10a678c-5512-4a96-8dcc-038c1a620ebb tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.335833 Sep 16 13:58:50.826952 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 803/1593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:50 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:50.845705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:50.847922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:50.856935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.857885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.858343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.859319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.859938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.860644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.871699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:50.872282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:50.873917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:50.874446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lazy-loading 'fault' on Instance uuid e5508ca6-96e8-447b-9bfd-6ce805d6418f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:50.963127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:50.988574 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2e8eb55-6f0c-420c-b683-80e06bce7fc2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1359 microversion: 2.1 time: 0.233324 Sep 16 13:58:51.002452 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 791/1594] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:50 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:51.099220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.113958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:51.114641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:51.122935 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c49dbb7-323d-4207-9374-63f0b8529d34 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1498 microversion: 2.1 time: 0.281181 Sep 16 13:58:51.124016 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 804/1595] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:50 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:51.126209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:51.126735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:51.127394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:51.128298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:51.128759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:51.129352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:51.232811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.246210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.248751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.256368 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6dfd71c4-4001-4db1-87d2-20132148f0e6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.148576 Sep 16 13:58:51.257602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 792/1596] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:51 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:51.471543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:51.472467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:51.479438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:51.480110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:51.480556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:51.481274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:51.481961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:51.482598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:51.559390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.570117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.571936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:51.578706 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-566a1330-1e46-4f5d-9c9c-ba7a4949181e tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.113424 Sep 16 13:58:51.579366 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 805/1597] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:51 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:51.880586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:51.882914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:51.890294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:51.891190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:51.891840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:51.892645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:51.893100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:51.893774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.021637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:52.023541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:52.035302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.036181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.037413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.039023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.040331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.041445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.066572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:52.085480 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45b1683a-473c-4728-ab35-58a4b8836d9e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.205877 Sep 16 13:58:52.086864 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 793/1598] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:51 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:52.103919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.104411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.104848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.105308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lazy-loading 'fault' on Instance uuid e5508ca6-96e8-447b-9bfd-6ce805d6418f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:52.151157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:52.152802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:52.159999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:52.164563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.165943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.166714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.170161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.171497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.172373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.181696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:52.197253 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e93e36ff-ecfe-43a4-b201-073d42aad987 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1359 microversion: 2.1 time: 0.183040 Sep 16 13:58:52.199262 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 806/1599] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:52 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:52.295976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:52.309488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:52.327522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.328657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.329677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.331281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.332379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.333386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.474166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:52.485529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:52.487128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:52.493972 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ef48d19-7c5e-45bf-8160-a016e3384b96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.211416 Sep 16 13:58:52.503849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 807/1600] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:52 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:52.520688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:52.528301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "77cded40-5485-41c3-a492-cbd2f22b30ca"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:52.529764 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4de075a8-6bbb-472d-8d72-2047e874c81a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 200 len: 1475 microversion: 2.1 time: 0.384798 Sep 16 13:58:52.530793 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 794/1601] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:52 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 1475 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:52.531910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:52.540554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.541355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.542302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.543574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.544312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.544796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.573156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-686531006"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:52.576139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:52.586535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.587310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.588093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.589323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.590149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.591184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.783680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] HTTP exception thrown: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Request method failure captured: Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc/os-volume_attachments/087804fe-f181-4150-9af4-346bca3a1755 HTTP/1.1 Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 74 Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIBUjf7VhhawZ89V36QQY0Q-6bGl7dSnAHMQQ6FMV04gVaWRCZ2Y7TKiBZHw8vxO7HFOsqkcfjR12y6fKxELciIBx5-tw67nwiAI_1LCsGkn7gGpUSNrAjRHbz98en37EXD58BZ9MiXNWfxX0yIyjq-rNDmlMk-9ADZFmDdNxFs12w4 Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 876b857a096a44258e26d72bfecc20aa Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesAdminNegativeTest-690905129 Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:58:52.788438 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_876b857a096a44258e26d72bfecc20aa", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/876b857a096a44258e26d72bfecc20aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/876b857a096a44258e26d72bfecc20aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/876b857a096a44258e26d72bfecc20aa"}]}] Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesAdminNegativeTest-690905129 Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 876b857a096a44258e26d72bfecc20aa Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-690905129 Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesAdminNegativeTest-690905129-project-admin Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 52b0ad2dadf5485abc36aff0734841c5 Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesAdminNegativeTest-690905129-project-admin Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: {"volumeAttachment": {"volumeId": "77cded40-5485-41c3-a492-cbd2f22b30ca"}} Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:52.789953 n-d-858129-2 devstack@n-api.service[128643]: exception: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': '1e674e04-fc08-4814-973e-4bd630ea35cc', 'id': '087804fe-f181-4150-9af4-346bca3a1755', 'body': {'volumeAttachment': {'volumeId': '77cded40-5485-41c3-a492-cbd2f22b30ca'}}} Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 13:58:52.790891 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. (HTTP 404) (Request-ID: req-e9b37dad-8731-4241-aefb-ba8cfb709ff2) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 13:58:52.792142 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:52.793809 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. Sep 16 13:58:52.795422 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:52.797071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] Returning 404 to user: Volume 087804fe-f181-4150-9af4-346bca3a1755 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:52.797071 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2ea8da0-0ba6-4e1d-8dd8-1a86391cb601 tempest-VolumesAdminNegativeTest-690905129 tempest-VolumesAdminNegativeTest-690905129-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc/os-volume_attachments/087804fe-f181-4150-9af4-346bca3a1755" status: 404 len: 109 microversion: 2.1 time: 0.270963 Sep 16 13:58:52.797071 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 808/1602] 10.222.0.60 () {60 vars in 1433 bytes} [Fri Sep 16 13:58:52 2022] PUT /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc/os-volume_attachments/087804fe-f181-4150-9af4-346bca3a1755 => generated 109 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 13:58:52.816191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:52.817682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:52.829359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.830784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.831836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.835842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:52.836982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:52.837942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:52.891815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:52.909252 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-895868ce-c2a1-4a2e-a75a-390373d9ec48 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296/action" status: 202 len: 0 microversion: 2.1 time: 0.341371 Sep 16 13:58:52.911548 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 795/1603] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 13:58:52 2022] POST /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 13:58:52.959717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71e50264-0fae-4ac4-9769-2d9463154c46 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3250d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:52.986339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:53.026052 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71e50264-0fae-4ac4-9769-2d9463154c46 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.088752 Sep 16 13:58:53.027364 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 796/1604] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:52 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:53.055551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.072337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.076559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.089963 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6f2bf353-f6d9-4389-a508-ba9aa4fde212 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.291610 Sep 16 13:58:53.096997 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 809/1605] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:52 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:53.117356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:53.122589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:53.123843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:53.134333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.137673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.138195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.138994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.139675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.140101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.239655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:53.239655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:53.254669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.255732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.257603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.259818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.260380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.261084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.345927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.360262 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8630938b-de50-4f91-a1be-373c8fd3ce2c tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.243448 Sep 16 13:58:53.363248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.363560 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 797/1606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:53 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:53.364641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.366459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.367555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lazy-loading 'fault' on Instance uuid e5508ca6-96e8-447b-9bfd-6ce805d6418f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:53.434169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.443016 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fedb62e-eb7d-482e-9b9a-1a3a40907c3b tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1359 microversion: 2.1 time: 0.223623 Sep 16 13:58:53.443610 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 810/1607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:53 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:53.525939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:53.526777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:53.534199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.534834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.535556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.536404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:53.536956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:53.537508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:53.627383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.650677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.653954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:53.665685 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e754ba2a-e4c2-4948-9410-2e24de763031 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.143494 Sep 16 13:58:53.671963 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 798/1608] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:53 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:54.048121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e54b174-0cdf-456c-9daf-27aecbcd309c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d24ddc0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.066984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Action: 'update', calling method: .version_select at 0x7f724cfc1280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:54.070907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.071389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.071829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.080022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.080511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.080945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.102835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] HTTP exception thrown: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Request method failure captured: Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8 HTTP/1.1 Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 56 Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIEdJeR00od3CKQgW4JvCnA2GfF0qzjVImESaq-JgqUrGJRmGwbvywVHReQ9tWj9pySxn1qsZFAzjbrqhBImTfdeUdCqgv6oxoLY9fgWPYYirGID_7m0T9bv2Z1yLgHcvJzjIAAgax-i25SSJ2SECEtQRmrdM5hYHiNma4VzgWrkIQg Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 20b731af9c1b4aed8f576891e71ec0db Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:58:54.110259 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b731af9c1b4aed8f576891e71ec0db", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b731af9c1b4aed8f576891e71ec0db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b731af9c1b4aed8f576891e71ec0db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b731af9c1b4aed8f576891e71ec0db"}]}] Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 20b731af9c1b4aed8f576891e71ec0db Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f93b53d16509442d8e1965c0242eb98e Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:58:54.111846 n-d-858129-2 devstack@n-api.service[128643]: exception: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '76bcad00-9328-4f03-83b7-6eb723c3e8d8', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.112771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:54.114127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:54.115503 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:54.115503 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.115503 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.116407 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e54b174-0cdf-456c-9daf-27aecbcd309c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.068591 Sep 16 13:58:54.117360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Returning 404 to user: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:54.119381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-884bd8bb-d959-4087-875b-1661acd840b1 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8" status: 404 len: 110 microversion: 2.53 time: 0.238096 Sep 16 13:58:54.123162 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 811/1610] 10.222.0.60 () {62 vars in 1309 bytes} [Fri Sep 16 13:58:53 2022] PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8 => generated 110 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:58:54.123673 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 799/1610] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:54.145209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Action: 'update', calling method: .version_select at 0x7f724cfc1700>, body: {"status": "disabled"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:54.149024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.149591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.150127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.156299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.156886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.157384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.161431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.162341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:54.166242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] HTTP exception thrown: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Request method failure captured: Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8 HTTP/1.1 Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 22 Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIEdJeR00od3CKQgW4JvCnA2GfF0qzjVImESaq-JgqUrGJRmGwbvywVHReQ9tWj9pySxn1qsZFAzjbrqhBImTfdeUdCqgv6oxoLY9fgWPYYirGID_7m0T9bv2Z1yLgHcvJzjIAAgax-i25SSJ2SECEtQRmrdM5hYHiNma4VzgWrkIQg Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 20b731af9c1b4aed8f576891e71ec0db Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:58:54.168251 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b731af9c1b4aed8f576891e71ec0db", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b731af9c1b4aed8f576891e71ec0db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b731af9c1b4aed8f576891e71ec0db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b731af9c1b4aed8f576891e71ec0db"}]}] Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 20b731af9c1b4aed8f576891e71ec0db Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f93b53d16509442d8e1965c0242eb98e Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: {"status": "disabled"} Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: exception: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.171609 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '76bcad00-9328-4f03-83b7-6eb723c3e8d8', 'body': {'status': 'disabled'}} Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.176600 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:54.180043 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:54.183094 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.183094 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.183094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Returning 404 to user: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:54.183094 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dadc0fb0-3935-4b9f-817a-f7736059f913 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8" status: 404 len: 110 microversion: 2.53 time: 0.029257 Sep 16 13:58:54.183094 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 812/1611] 10.222.0.60 () {62 vars in 1309 bytes} [Fri Sep 16 13:58:54 2022] PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:58:54.183844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.183844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.183844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.183844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.184479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.184479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.189998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Action: 'update', calling method: .version_select at 0x7f724cff39d0>, body: {"status": "enabled"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:54.196560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.197205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.197761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.219016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.219505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.219942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.227065 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] HTTP exception thrown: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Request method failure captured: Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8 HTTP/1.1 Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 21 Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIEdJeR00od3CKQgW4JvCnA2GfF0qzjVImESaq-JgqUrGJRmGwbvywVHReQ9tWj9pySxn1qsZFAzjbrqhBImTfdeUdCqgv6oxoLY9fgWPYYirGID_7m0T9bv2Z1yLgHcvJzjIAAgax-i25SSJ2SECEtQRmrdM5hYHiNma4VzgWrkIQg Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 20b731af9c1b4aed8f576891e71ec0db Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 13:58:54.228646 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_20b731af9c1b4aed8f576891e71ec0db", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b731af9c1b4aed8f576891e71ec0db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/20b731af9c1b4aed8f576891e71ec0db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/20b731af9c1b4aed8f576891e71ec0db"}]}] Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 20b731af9c1b4aed8f576891e71ec0db Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767 Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f93b53d16509442d8e1965c0242eb98e Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: {"status": "enabled"} Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: exception: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.230375 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '76bcad00-9328-4f03-83b7-6eb723c3e8d8', 'body': {'status': 'enabled'}} Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.231458 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:54.233007 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:54.234605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. Sep 16 13:58:54.234605 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:54.236827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Returning 404 to user: Service 76bcad00-9328-4f03-83b7-6eb723c3e8d8 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:54.237950 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b68c337-79d5-4261-a74f-3cb531b295d7 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8" status: 404 len: 110 microversion: 2.53 time: 0.053596 Sep 16 13:58:54.244178 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 813/1612] 10.222.0.60 () {62 vars in 1309 bytes} [Fri Sep 16 13:58:54 2022] PUT /compute/v2.1/os-services/76bcad00-9328-4f03-83b7-6eb723c3e8d8 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 13:58:54.249829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.253706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.254187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.255387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.256220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.256989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.257649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.269874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.286626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-20ee81a9-4f2d-4717-b538-6fa8c5c750aa tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041176 Sep 16 13:58:54.288133 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 814/1613] 10.222.0.60 () {60 vars in 1178 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:54.290313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.294380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.306377 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dea94c0c-bfa2-4f26-abc4-67c47fedd3cd tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.157798 Sep 16 13:58:54.307574 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 800/1614] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:54.309017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.315878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.316740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.317521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.319015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.319885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.320660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.366894 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5db9db1-c9ec-4760-87af-f054365b09dd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068084 Sep 16 13:58:54.368035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 815/1615] 10.222.0.60 () {60 vars in 1211 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:54.390226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.390958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:54.391590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.395355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.395839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.396277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.397858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.398622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.399319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.399774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.400374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.400916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.402038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.402653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.403185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.432720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-306699dc-fc20-44d1-8640-e9a3e0f6d04e tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045842 Sep 16 13:58:54.441798 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 801/1616] 10.222.0.60 () {60 vars in 1178 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:58:54.457281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.462647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.463474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.463918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.464857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.465607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.466218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.496219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d85b711-ab32-4c76-ae25-114054ea4cbd tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-858129-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.049142 Sep 16 13:58:54.496845 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 802/1617] 10.222.0.60 () {60 vars in 1235 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services?host=n-d-858129-2&binary=xxx => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:54.502109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.503327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:54.511153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.511647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.512077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.513167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.513632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.514069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.554790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.555287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.555724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.556181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lazy-loading 'fault' on Instance uuid e5508ca6-96e8-447b-9bfd-6ce805d6418f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:58:54.656233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114d1f26bd44cae99ecd59f1ccfd683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454a349170e442479ba080adf1ae35b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.665855 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e2f5091-35cc-4898-a45e-483fdfaa4bd3 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 200 len: 1359 microversion: 2.1 time: 0.167598 Sep 16 13:58:54.666497 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 803/1618] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:54.676856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.680391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.680982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.681404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.682345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.682827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.683249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.691442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.691739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:54.704279 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e15c476b-ae41-48f9-94e6-50a4407950fc tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1469 microversion: 2.1 time: 0.318689 Sep 16 13:58:54.713751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4bd46370-9877-46ac-b159-22016a7ff3dc tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045974 Sep 16 13:58:54.726596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 804/1619] 10.222.0.60 () {60 vars in 1178 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:54.726920 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 816/1620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:54.727110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.727110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:54.727521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.727904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.728340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.729052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.729507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.729928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.764410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:54.768449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.768933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.769383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.770131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:54.770616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:54.771053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:54.814372 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41b9a318-eefa-4e8a-9088-93bf006d5743 tempest-ServicesAdminNegativeV253TestJSON-32878767 tempest-ServicesAdminNegativeV253TestJSON-32878767-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.070374 Sep 16 13:58:54.815155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 817/1621] 10.222.0.60 () {60 vars in 1239 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:54.946971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.972577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.975912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:54.986283 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e4883b6-76b1-4016-927a-cbba6fa9a8af tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.270236 Sep 16 13:58:54.988022 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 805/1622] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:55.011547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c85caa0-8347-40e0-ae38-1c91fea6d9fc tempest-ServicesAdminNegativeV253TestJSON-1892636626 tempest-ServicesAdminNegativeV253TestJSON-1892636626-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:55.018929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c85caa0-8347-40e0-ae38-1c91fea6d9fc tempest-ServicesAdminNegativeV253TestJSON-1892636626 tempest-ServicesAdminNegativeV253TestJSON-1892636626-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'eb30ed597df043d0b80ef78e5f00474a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e8949a021ce4c6d9dc1cabce2224ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c85caa0-8347-40e0-ae38-1c91fea6d9fc tempest-ServicesAdminNegativeV253TestJSON-1892636626 tempest-ServicesAdminNegativeV253TestJSON-1892636626-project] Request method failure captured: Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIEc7u-5mqUYagd25kwcLPh8tTDneDz6ucYLFAnD7RtAk-sZR1HNfbUNcwYCjmpRF2QEG7hgOsztLFR5UGxVHZnEqnqFMmJZf1ZP03ypfebd85FXrUuvLqsd97aAfZ2fou0AlfB277lImbg9To9zME6vW5FaKUr72br09evRd_wLdV8 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.53 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 5e8949a021ce4c6d9dc1cabce2224ecf Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1892636626 Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:58:55.022940 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5e8949a021ce4c6d9dc1cabce2224ecf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e8949a021ce4c6d9dc1cabce2224ecf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5e8949a021ce4c6d9dc1cabce2224ecf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5e8949a021ce4c6d9dc1cabce2224ecf"}]}] Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1892636626 Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 5e8949a021ce4c6d9dc1cabce2224ecf Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1892636626 Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1892636626-project Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: eb30ed597df043d0b80ef78e5f00474a Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1892636626-project Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 13:58:55.025829 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 13:58:55.027910 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 13:58:55.032425 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.036626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c85caa0-8347-40e0-ae38-1c91fea6d9fc tempest-ServicesAdminNegativeV253TestJSON-1892636626 tempest-ServicesAdminNegativeV253TestJSON-1892636626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:55.036626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c85caa0-8347-40e0-ae38-1c91fea6d9fc tempest-ServicesAdminNegativeV253TestJSON-1892636626 tempest-ServicesAdminNegativeV253TestJSON-1892636626-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.200016 Sep 16 13:58:55.036626 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 818/1623] 10.222.0.60 () {60 vars in 1178 bytes} [Fri Sep 16 13:58:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:58:55.152911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2c2f199-ea82-4ff8-b70d-c64984f11b46 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2b5430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:55.274821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2c2f199-ea82-4ff8-b70d-c64984f11b46 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.132683 Sep 16 13:58:55.276782 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 806/1624] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:55 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:55.338873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:55.345766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:55.366852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:55.373969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:55.375308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:55.376866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:55.378031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:55.383019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:55.551227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:55.568001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:55.570022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:55.575770 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7553847c-8b4c-4082-a1c6-1967a25f46dc tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.244648 Sep 16 13:58:55.576681 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 819/1625] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:55 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:55.689427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:55.690069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] [instance: e5508ca6-96e8-447b-9bfd-6ce805d6418f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:55.706291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:55.707417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:55.707860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:55.708620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:55.709080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:55.710156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:55.743065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:55.743706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:55.749036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] HTTP exception thrown: Instance e5508ca6-96e8-447b-9bfd-6ce805d6418f could not be found. Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Request method failure captured: Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f HTTP/1.1 Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIBvGPoHYynKESl4egUzMKy07pG_P_pe_P5Ve_k3r0Y4cNeU1A5nFmsCF-lPh1B-pQ8MlIi2UCHZ1hVjHNpQomfTU3PrKoTd-O-Bu_o9ylkLrPww9PJO9Dtw1wZ6T8a91PbplVuoOxg7CT2uyWmwkIpaLr2Dmv66VxK5ckZz6Jx2l9M Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 454a349170e442479ba080adf1ae35b9 Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-1419306533 Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:58:55.750780 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_454a349170e442479ba080adf1ae35b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/454a349170e442479ba080adf1ae35b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/454a349170e442479ba080adf1ae35b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/454a349170e442479ba080adf1ae35b9"}]}] Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-1419306533 Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 454a349170e442479ba080adf1ae35b9 Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-1419306533 Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-1419306533-project Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1114d1f26bd44cae99ecd59f1ccfd683 Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-1419306533-project Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e5508ca6-96e8-447b-9bfd-6ce805d6418f could not be found. Sep 16 13:58:55.753438 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e5508ca6-96e8-447b-9bfd-6ce805d6418f'} Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5508ca6-96e8-447b-9bfd-6ce805d6418f could not be found. Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:58:55.754620 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5508ca6-96e8-447b-9bfd-6ce805d6418f could not be found. Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5508ca6-96e8-447b-9bfd-6ce805d6418f could not be found. Sep 16 13:58:55.758597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:58:55.762049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Returning 404 to user: Instance e5508ca6-96e8-447b-9bfd-6ce805d6418f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:58:55.762049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7884ddff-d434-4631-a2c7-93c488d87ab2 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f" status: 404 len: 111 microversion: 2.1 time: 0.067101 Sep 16 13:58:55.762535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:55.762535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:55.762535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:55.762535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:55.763366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:55.763366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:55.774819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 807/1626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:55 2022] GET /compute/v2.1/servers/e5508ca6-96e8-447b-9bfd-6ce805d6418f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:58:55.780487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85779b96-c98f-4483-8b11-1402639b1ea7 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] Calling method '.version_select at 0x7f724d2af550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:55.845192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85779b96-c98f-4483-8b11-1402639b1ea7 tempest-ServersTestJSON-1419306533 tempest-ServersTestJSON-1419306533-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097487598" status: 202 len: 0 microversion: 2.1 time: 0.069019 Sep 16 13:58:55.846091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 808/1627] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 13:58:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097487598 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:58:56.019996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:56.020635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:56.045037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.045540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.045984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.060889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.061436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.061890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.296068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.324636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.326351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.338632 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4d3da66-0088-4361-b2e6-d0da5ac85079 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.325490 Sep 16 13:58:56.339544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 809/1628] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:56 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:56.345867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9cfa829-8cd6-4684-969c-2434697026d6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d24d5e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:56.351970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.402595 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce15e190-0888-42f0-8d00-342c64e9ea23 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1462 microversion: 2.1 time: 0.663753 Sep 16 13:58:56.425466 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 820/1629] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:55 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1462 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:56.475153 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9cfa829-8cd6-4684-969c-2434697026d6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.134133 Sep 16 13:58:56.475875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 810/1630] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:56 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:56.481874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:56.484394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:56.503232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.503983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.505311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.507295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.508155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.509166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.578820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:56.737398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:56.738991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:56.747691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.748952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.749836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.751678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.752550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.753210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.757367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-684e875a-3976-4c48-9e80-b5b4f7cfa199 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 204 len: 0 microversion: 2.1 time: 0.278298 Sep 16 13:58:56.762154 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 811/1631] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:56 2022] DELETE /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:56.775088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:56.777015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:56.789924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.791449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.792113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.793601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.794988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.795354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.906698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.923775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.925352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:56.935316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7143d76b-206f-4dc7-a15f-517dd3a5e968 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.173256 Sep 16 13:58:56.935932 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 812/1632] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:56 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:56.955241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:56.955896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:56.965672 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-066e6254-dac5-4429-9c60-30274fc6de98 tempest-MigrationsAdminTest-691844227 tempest-MigrationsAdminTest-691844227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1613 microversion: 2.1 time: 0.518674 Sep 16 13:58:56.967325 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 821/1633] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:56 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1613 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:56.974461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.975385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.976066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:56.976810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:56.977274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:56.977702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.014046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:57.015235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:57.027591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.028772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.029584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.031031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.031870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.032801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.093069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:58:57.113738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:57.312261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:57.329960 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3bce0440-8ebd-46c0-9ae1-39a1417f6a15 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1513 microversion: 2.1 time: 0.392490 Sep 16 13:58:57.347425 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 813/1634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:56 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:57.376406 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60f3427b-cc27-435b-a09c-d5068e337651 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 204 len: 0 microversion: 2.1 time: 0.371352 Sep 16 13:58:57.384145 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 822/1635] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:58:57 2022] DELETE /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:58:57.391790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:57.392376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:57.400167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.400660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.401089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.402163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.402990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.406059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.413569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:57.418918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:57.456939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.462875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.463993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.465502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.471124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.472528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.628005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:57.647019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:57.649317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:57.669467 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c272a7d1-5eb6-4373-a967-feb667e749c3 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.269400 Sep 16 13:58:57.670054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 823/1636] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:57 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:57.679739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfbc7261-5f09-41d3-8ca6-f20a741cfb8f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cfd4280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:57.753205 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfbc7261-5f09-41d3-8ca6-f20a741cfb8f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.081274 Sep 16 13:58:57.754318 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 824/1637] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:57 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:57.774647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-66f76e86-bee1-4c48-b65b-0a60ad005e09 req-0217d2cb-b1fd-4ca3-94c0-c4e22e45f042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfdc316-c9c9-4fad-ac55-a87d2e79a296", "name": "network-vif-plugged", "status": "completed", "tag": "dc326c93-e39b-42ec-a562-fd0897d9e657"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:57.796732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-66f76e86-bee1-4c48-b65b-0a60ad005e09 req-0217d2cb-b1fd-4ca3-94c0-c4e22e45f042 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:57.797630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-66f76e86-bee1-4c48-b65b-0a60ad005e09 req-0217d2cb-b1fd-4ca3-94c0-c4e22e45f042 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:57.798544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-66f76e86-bee1-4c48-b65b-0a60ad005e09 req-0217d2cb-b1fd-4ca3-94c0-c4e22e45f042 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:57.836879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-66f76e86-bee1-4c48-b65b-0a60ad005e09 req-0217d2cb-b1fd-4ca3-94c0-c4e22e45f042 service nova] Creating event network-vif-plugged:dc326c93-e39b-42ec-a562-fd0897d9e657 for instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 on n-h1-858129-2 Sep 16 13:58:57.852022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-66f76e86-bee1-4c48-b65b-0a60ad005e09 req-0217d2cb-b1fd-4ca3-94c0-c4e22e45f042 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094740 Sep 16 13:58:57.855998 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 825/1638] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:58:57.967199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:57.993586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:57.998753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:58.021921 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-324ec927-dbc0-4193-a16f-7f3834f72e60 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1468 microversion: 2.1 time: 0.636297 Sep 16 13:58:58.024809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 814/1639] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:57 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1468 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:58.027806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:58.028994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:58.030009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:58.032772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:58.034229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:58.036386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:58.187487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.209907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.212996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.223277 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-484ecb25-e81a-4433-9949-94fe38223de7 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.252955 Sep 16 13:58:58.225209 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 826/1640] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:57 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:58.374455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:58.375719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:58.385499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:58.386262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:58.386939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:58.388228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:58.388800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:58.389333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:58.712284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:58.713861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:58.730538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:58.731409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:58.732002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:58.732932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:58.733467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:58.733935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:58.789120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.801361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b790d9c6-67f4-4fa8-ad11-f237f3ef1969 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1513 microversion: 2.1 time: 0.432059 Sep 16 13:58:58.801971 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 815/1641] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:58 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1513 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:58:58.810840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf01e681-ded7-4de7-9d90-36e548d72f2f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d325af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:58.857104 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf01e681-ded7-4de7-9d90-36e548d72f2f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.053951 Sep 16 13:58:58.857700 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 816/1642] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:58 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:58.877539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.888111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.890090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:58.898615 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39dd0c97-fa02-41d8-8aea-4045a07b8d76 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.193947 Sep 16 13:58:58.900887 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 827/1643] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:58 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:59.056162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:59.058213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:59.074795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.076062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.077546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.079240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.080514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.081684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.261372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:59.263942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:59.275106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.276093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.276868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.278234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.279143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.279860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.458990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:59.473112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:59.475487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:59.484028 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae6a07bb-d30b-43b5-9794-8a290a14b41f tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.232940 Sep 16 13:58:59.485665 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 828/1644] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:58:59 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:58:59.532619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:58:59.553709 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa77abcd-015e-47b0-a15a-f38dec407d7b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1468 microversion: 2.1 time: 0.505438 Sep 16 13:58:59.566961 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 817/1645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:59 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:58:59.848720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:58:59.849764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:58:59.861188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:58:59.871685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7e7a77fe-4d24-47b4-8fdf-e7d7c8e9f0d4 req-b72768f0-11ed-417b-a4f5-8c42f5a52de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "name": "network-vif-plugged", "status": "completed", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:58:59.873277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.874240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.875143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.876908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.877848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.878747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.888529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7e7a77fe-4d24-47b4-8fdf-e7d7c8e9f0d4 req-b72768f0-11ed-417b-a4f5-8c42f5a52de0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:58:59.889011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7e7a77fe-4d24-47b4-8fdf-e7d7c8e9f0d4 req-b72768f0-11ed-417b-a4f5-8c42f5a52de0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:58:59.892183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7e7a77fe-4d24-47b4-8fdf-e7d7c8e9f0d4 req-b72768f0-11ed-417b-a4f5-8c42f5a52de0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:58:59.918298 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7e7a77fe-4d24-47b4-8fdf-e7d7c8e9f0d4 req-b72768f0-11ed-417b-a4f5-8c42f5a52de0 service nova] Creating event network-vif-plugged:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h2-858129-2 Sep 16 13:58:59.932757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7e7a77fe-4d24-47b4-8fdf-e7d7c8e9f0d4 req-b72768f0-11ed-417b-a4f5-8c42f5a52de0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064917 Sep 16 13:58:59.939908 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 818/1646] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 13:58:59.949361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6852338b-eb48-407a-a9a7-0d5d3b9a201e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d3250d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:00.025966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6852338b-eb48-407a-a9a7-0d5d3b9a201e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.083956 Sep 16 13:59:00.027085 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 819/1647] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:58:59 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:00.045554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:00.046444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:00.061852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:00.062362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:00.062827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:00.063576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:00.064129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:00.064575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:00.210822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.211023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.220262 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b39b052d-e76e-4711-a1a9-b225a2c333df tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1513 microversion: 2.1 time: 0.378789 Sep 16 13:59:00.225118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 829/1648] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:58:59 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1513 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:00.227871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.229806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.238880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c7729d2-fa8f-44f5-a385-ac3ea913578a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.210444 Sep 16 13:59:00.240909 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 820/1649] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:00 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:00.529444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:00.530224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:00.537769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:00.538225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:00.538775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:00.539583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:00.540375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:00.540755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:00.594609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:00.595346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:00.606034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:00.606654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:00.607433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:00.608725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:00.609435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:00.610073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:00.686756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.702211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.703762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:00.729676 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f97ecdd-b30f-4056-9057-33d6e4a366a2 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.203850 Sep 16 13:59:00.743137 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 830/1650] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:00 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:59:01.050071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d9b712d-888f-4a35-9cb4-bc4c09519689 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cf784c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:01.139514 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d9b712d-888f-4a35-9cb4-bc4c09519689 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.093305 Sep 16 13:59:01.140121 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 831/1651] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:59:01 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:59:01.247831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:01.248726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:01.262918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:01.269938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:01.270528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:01.271940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:01.272652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:01.273099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:01.378890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:01.397563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-508d344b-edf0-4d43-9df3-02719a9d1755 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1468 microversion: 2.1 time: 0.806282 Sep 16 13:59:01.411293 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 821/1652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:00 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1468 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:01.455181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:01.460196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:01.478792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:01.484895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:01.487705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:01.488790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:01.491385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:01.492099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:01.737456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:01.762561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:01.778162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:01.801798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b281a3b-d4fc-4e34-ba11-1aa110652ac0 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.387337 Sep 16 13:59:01.804667 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 822/1653] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:01 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:01.822066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:01.827696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:01.855071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:01.856041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:01.858590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:01.860033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:01.864179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:01.865168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:02.088327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:02.123353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:02.126296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:02.148583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:02.155363 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e02a026d-52cd-4b59-8785-07dc464c4025 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1447 microversion: 2.75 time: 0.346596 Sep 16 13:59:02.157202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 823/1654] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:01 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1447 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:02.169536 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59d54173-cd8e-48e9-97d0-df2def57a30a tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1513 microversion: 2.1 time: 0.925615 Sep 16 13:59:02.171444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3cbf92fb-ba5f-44b2-a0dd-2a36fa6d8ad5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d23bd30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:02.187388 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 832/1655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:01 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1513 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:02.276910 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3cbf92fb-ba5f-44b2-a0dd-2a36fa6d8ad5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1413 microversion: 2.1 time: 0.112638 Sep 16 13:59:02.297733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 824/1656] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:59:02 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 13:59:02.446117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:02.452912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:02.476268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:02.477790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:02.478684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:02.481925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:02.483129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:02.484121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:02.656744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-729650114", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:02.818655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:59:03.323020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:03.353248 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fc5a76d3-5fb2-4e1e-9ffc-56a1db6c6662 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 200 len: 1468 microversion: 2.1 time: 0.915067 Sep 16 13:59:03.362446 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 825/1657] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:02 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 1468 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:03.390731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:03.398246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:03.441973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:03.443449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:03.447283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:03.448696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:03.453056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:03.457367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:03.697199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:59:03.698095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:59:03.698296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:59:03.698689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:59:03.699760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:59:03.753864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:03.754362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:03.754837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:03.756181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:03.756633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:03.757112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:03.867512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:03.893928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Getting quotas for project ca6193d04a0941c1b92374922423efa6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:59:03.919565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Getting quotas for user 8708cac0c47b45c583fa86bde33134b8 and project ca6193d04a0941c1b92374922423efa6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:59:03.951620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:59:03.955494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:59:03.955940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:03.987038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:04.074029 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5dfb192-b1f4-4970-9adb-e24d43a070a0 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737916 Sep 16 13:59:04.074616 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 833/1658] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 13:59:04.075705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9bdfb4c-1d80-416b-9f77-893c3d02b02b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.696024 Sep 16 13:59:04.088071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:04.090688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:04.122190 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 826/1659] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:03 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:04.124404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:04.137742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:04.138210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:04.139439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:04.139915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:04.140351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:04.180996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:04.186756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:04.233257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:04.234257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:04.243327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:04.250862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:04.254766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:04.259975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:04.301699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:04.440085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:04.482050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:04.485434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:04.532303 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a526d637-dd19-4840-821b-299e06d80bee tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1465 microversion: 2.75 time: 0.447599 Sep 16 13:59:04.534144 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 834/1660] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:04 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1465 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:04.565701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e2f8480-e11a-4f6b-9a05-42d0eee6708e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cfc1dc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:04.693554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:04.698765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:04.704384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:04.713327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lazy-loading 'fault' on Instance uuid 1e674e04-fc08-4814-973e-4bd630ea35cc {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:04.730088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:04.889168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:04.931693 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef5db3aa-99f8-4214-a277-03c6dd73efea tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 200 len: 1307 microversion: 2.1 time: 0.802095 Sep 16 13:59:04.943137 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 827/1661] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:04 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 1307 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:04.963998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-96dd890b-5e8c-4a65-888c-6f53e9ab32c7 req-32b59998-4e5a-46c7-a709-d058600782a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e674e04-fc08-4814-973e-4bd630ea35cc", "name": "network-vif-deleted", "tag": "4d864e37-e655-4bc0-9a95-aa1b6340d75f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:05.006695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-96dd890b-5e8c-4a65-888c-6f53e9ab32c7 req-32b59998-4e5a-46c7-a709-d058600782a2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:05.008139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-96dd890b-5e8c-4a65-888c-6f53e9ab32c7 req-32b59998-4e5a-46c7-a709-d058600782a2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:05.009780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-96dd890b-5e8c-4a65-888c-6f53e9ab32c7 req-32b59998-4e5a-46c7-a709-d058600782a2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:05.079036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-96dd890b-5e8c-4a65-888c-6f53e9ab32c7 req-32b59998-4e5a-46c7-a709-d058600782a2 service nova] Creating event network-vif-deleted:4d864e37-e655-4bc0-9a95-aa1b6340d75f for instance 1e674e04-fc08-4814-973e-4bd630ea35cc on n-h2-858129-2 Sep 16 13:59:05.095932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-96dd890b-5e8c-4a65-888c-6f53e9ab32c7 req-32b59998-4e5a-46c7-a709-d058600782a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157836 Sep 16 13:59:05.106030 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 828/1662] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:05.132544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09db5622-0dc6-49c4-8893-a23acc349918 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:05.140703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09db5622-0dc6-49c4-8893-a23acc349918 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:05.445525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09db5622-0dc6-49c4-8893-a23acc349918 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:05.513752 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09db5622-0dc6-49c4-8893-a23acc349918 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1213 microversion: 2.1 time: 0.403387 Sep 16 13:59:05.515011 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 829/1663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:05 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1213 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:05.559301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9c743a83-174d-40bc-aeb7-a0ca526d6929 req-2e6897ea-8c48-4962-bf8f-1725ce3f96f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b04cd4-0e3c-4ffc-8b11-ad2b99dee570", "name": "network-vif-deleted", "tag": "15fdea86-c8b4-4d8d-86d8-46ac8b4531e7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:05.623071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c743a83-174d-40bc-aeb7-a0ca526d6929 req-2e6897ea-8c48-4962-bf8f-1725ce3f96f2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:05.623687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c743a83-174d-40bc-aeb7-a0ca526d6929 req-2e6897ea-8c48-4962-bf8f-1725ce3f96f2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:05.626596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c743a83-174d-40bc-aeb7-a0ca526d6929 req-2e6897ea-8c48-4962-bf8f-1725ce3f96f2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:05.668005 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9c743a83-174d-40bc-aeb7-a0ca526d6929 req-2e6897ea-8c48-4962-bf8f-1725ce3f96f2 service nova] Creating event network-vif-deleted:15fdea86-c8b4-4d8d-86d8-46ac8b4531e7 for instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 on n-h2-858129-2 Sep 16 13:59:05.681446 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9c743a83-174d-40bc-aeb7-a0ca526d6929 req-2e6897ea-8c48-4962-bf8f-1725ce3f96f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162989 Sep 16 13:59:05.684519 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 830/1664] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:05.702274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:05.704007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:05.716859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:05.717755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:05.718559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:05.721703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:05.725485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:05.726796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:05.776889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] HTTP exception thrown: Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 could not be found. Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Request method failure captured: Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 HTTP/1.1 Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-Ogxv9FYZmWGaDauUznTsbp_Nh9B63VxyqBkShgc8OMxb118aRRV3fBdHtvzalU_dm0YdZ5lcjM8kws8B-4wja2q9ru5ZsOMmw2byvldKpmf1AK17aiG4ZsZFauR5fTnY3V6j0oCtcjObywtMzkCkmdbJfNm4Jg65G1-YPo8I39Ow Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:59:05.781405 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c67843449c98450aa14d5889893ceeb4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}] Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ae208d89fa7549198ef91ef307464763 Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 could not be found. Sep 16 13:59:05.784111 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '07b04cd4-0e3c-4ffc-8b11-ad2b99dee570'} Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 could not be found. Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:05.785142 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 could not be found. Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 could not be found. Sep 16 13:59:05.788332 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:05.794352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Returning 404 to user: Instance 07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:05.797710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6e9ef17-af99-4339-8134-c12eb8397e92 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570" status: 404 len: 111 microversion: 2.1 time: 0.111323 Sep 16 13:59:05.798612 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 831/1665] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:05 2022] GET /compute/v2.1/servers/07b04cd4-0e3c-4ffc-8b11-ad2b99dee570 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:05.817237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:05.820923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:05.870266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:05.900938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:05.901813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:05.922289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:05.926698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:05.928627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:05.930082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:06.281046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:06.315413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:06.332022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:06.361719 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-051f851d-31a9-4734-9b9a-c78e3ee3d74c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.559948 Sep 16 13:59:06.370499 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 832/1666] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:05 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:06.447486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:06.448652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:06.479991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:06.483708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:06.485115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:06.491120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:06.492422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:06.495869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:06.767860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:06.814680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:06.823036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:06.859891 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ace4039-21c0-46de-961b-7ea5acba2714 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1453 microversion: 2.75 time: 0.426976 Sep 16 13:59:06.867458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 833/1667] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:06 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1453 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:06.921955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:06.930999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:06.959507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:06.962848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:06.963751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:06.971505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:06.972583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:06.977215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:07.112482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:07.578812 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ac0b741-fabe-4ce9-bb52-69bc6cf40c36 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 204 len: 0 microversion: 2.1 time: 0.704979 Sep 16 13:59:07.582032 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 834/1668] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:59:06 2022] DELETE /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:07.632063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:07.635849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 1e674e04-fc08-4814-973e-4bd630ea35cc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:07.669237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:07.670982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:07.671707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:07.672683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:07.673350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:07.674156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:07.723353 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] HTTP exception thrown: Instance 1e674e04-fc08-4814-973e-4bd630ea35cc could not be found. Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Request method failure captured: Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc HTTP/1.1 Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIBARLk-fZLaZxVqr7qWYBoQ0U3a2k2qyE4B-6vrWM8xmVYfx8NDFafyOAsXhnsJvGWg_kXnSNyatsuZ4LgeKKYxZn7XL9Gja_O-180EiudpP0k5JHplgJU_YleUFM9bLMcvHDj0POSmH_X4ggxMkS0lQLp-ubM51XrEhJ54nSxg8eI Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: eb701055c61a4eb29a1d36c197c42b70 Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesAdminNegativeTest-583442906 Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:59:07.727675 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb701055c61a4eb29a1d36c197c42b70", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb701055c61a4eb29a1d36c197c42b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb701055c61a4eb29a1d36c197c42b70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb701055c61a4eb29a1d36c197c42b70"}]}] Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesAdminNegativeTest-583442906 Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: eb701055c61a4eb29a1d36c197c42b70 Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-583442906 Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesAdminNegativeTest-583442906-project Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b476e900905a4f238a64e2ffd34e1159 Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesAdminNegativeTest-583442906-project Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 1e674e04-fc08-4814-973e-4bd630ea35cc could not be found. Sep 16 13:59:07.729558 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1e674e04-fc08-4814-973e-4bd630ea35cc'} Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e674e04-fc08-4814-973e-4bd630ea35cc could not be found. Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:07.730593 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e674e04-fc08-4814-973e-4bd630ea35cc could not be found. Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e674e04-fc08-4814-973e-4bd630ea35cc could not be found. Sep 16 13:59:07.732504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:07.733997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Returning 404 to user: Instance 1e674e04-fc08-4814-973e-4bd630ea35cc could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:07.733997 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c114915-ea3c-4d9f-98a1-ef71cea69973 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc" status: 404 len: 111 microversion: 2.1 time: 0.143489 Sep 16 13:59:07.733997 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 835/1669] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:07 2022] GET /compute/v2.1/servers/1e674e04-fc08-4814-973e-4bd630ea35cc => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:07.762936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:07.763888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:07.782259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:07.783681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:07.787111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:07.788239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:07.789177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:07.793730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:08.208853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:08.234598 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67996978-72b2-4db2-8e5c-126f90d27695 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1265 microversion: 2.1 time: 0.500186 Sep 16 13:59:08.243171 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 836/1670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:07 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1265 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:08.255482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:08.258005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:08.278279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:08.285609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:08.305354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:08.307129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:08.309769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:08.310584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:08.509561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:08.548504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:08.550605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:08.566869 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e42bca72-6984-47dd-8550-424d709578f6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.320082 Sep 16 13:59:08.570745 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 837/1671] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:08 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:08.607978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:08.618037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:08.670938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:08.674713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:08.676711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:08.680728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:08.689286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:08.693835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:09.087434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:09.099836 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0aefceb7-eded-441b-92a9-de5e0781b872 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1535 microversion: 2.1 time: 0.526438 Sep 16 13:59:09.101202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 838/1672] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:08 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1535 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:09.108205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:09.109327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:09.120641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:09.121764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:09.124373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:09.126618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:09.128719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:09.129520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:09.322795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:09.342386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:09.349381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:09.367508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e945f8c-c8fc-4eff-8f43-5644cd36bb1d tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1453 microversion: 2.75 time: 0.264128 Sep 16 13:59:09.370252 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 839/1673] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:09 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1453 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:09.386972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:09.387634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:09.409091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:09.409929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:09.414549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:09.417635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:09.418375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:09.419218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:10.060016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid 1a45620b-7d81-415b-8d59-3cda88cd19b5 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:10.110227 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-103d4ee7-9ce7-49be-9ed9-3e4c5433464e tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 2342 microversion: 2.25 time: 0.737827 Sep 16 13:59:10.120238 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 840/1674] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:09 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 2342 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:10.131092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:10.140739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:10.167945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:10.168972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:10.169784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:10.170871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:10.177550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:10.187226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:10.350179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:10.367745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a247081b-e9ae-422a-9a0d-f1a7184955ad tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1283 microversion: 2.1 time: 0.245840 Sep 16 13:59:10.379559 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 841/1675] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:10 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1283 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:10.395168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:10.399284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:10.427472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:10.429281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:10.430757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:10.432932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:10.435001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:10.438966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:10.613049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:10.631599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:10.631599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:10.652198 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6abfe4db-9fbe-46c9-98af-a499b6a77328 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.270474 Sep 16 13:59:10.666951 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 842/1676] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:10 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:10.685154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:10.685818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:10.703292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:10.703292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:10.703292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:10.703292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:10.704142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:10.704142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:11.209617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:11.227355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe00dbac-98cf-4f89-bf3a-908d81e10ec6 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1535 microversion: 2.1 time: 0.559084 Sep 16 13:59:11.243195 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 843/1677] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:10 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1535 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:11.261824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:11.271150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:11.282025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:11.284880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:11.306119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:11.307279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:11.310285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:11.383219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-776f0a62-1ec1-4c28-b545-925c231684c0 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.138390 Sep 16 13:59:11.387535 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 844/1678] 10.222.0.60 () {60 vars in 1217 bytes} [Fri Sep 16 13:59:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:59:11.401624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:11.402512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:11.421003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:11.423574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:11.424111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:11.428388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:11.429053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:11.430703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:12.536859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:12.536859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:12.536859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:12.537953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:12.537953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e0f580d-920c-4c94-a038-f2d2644bb0e6 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1438 microversion: 2.75 time: 1.143237 Sep 16 13:59:12.564930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 845/1679] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:11 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1438 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:12.578124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:12.580048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:12.641064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:12.642759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:12.643074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:12.647375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:12.647907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:12.650715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:13.008994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:13.068052 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-50242f00-63d6-4826-982d-fd058ae97211 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1271 microversion: 2.1 time: 0.495199 Sep 16 13:59:13.070772 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 846/1680] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:12 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1271 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:13.113796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:13.115658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:13.197589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:13.203326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:13.206385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:13.216450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:13.224458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:13.231482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:13.821393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=14 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:13.843282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:13.896423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:13.907799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:13.936135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:13.962737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d692339-0165-4ce6-ac0c-45b941c70bce tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.879137 Sep 16 13:59:13.963630 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 847/1681] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:13 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:13.993398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:13.994059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:14.048222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:14.049550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:14.050025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:14.056315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:14.066590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:14.066590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:14.237132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:14.241313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:14.241869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:14.245598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lazy-loading 'fault' on Instance uuid 0a526b21-b479-4b47-a733-3a9757f8c368 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:14.470985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:14.522951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:14.526121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:14.536893 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a9f2f63-95d8-41fb-84b6-e4ac627944c7 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 200 len: 1369 microversion: 2.1 time: 0.568441 Sep 16 13:59:14.537581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 848/1682] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:13 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 1369 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:15.472550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:15.750174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:15.778066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:15.816928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:15.819610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:15.828254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:15.836009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:15.836911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:15.837735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:21.336182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:25.795467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:26.011355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=24 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:28.412404 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e2f8480-e11a-4f6b-9a05-42d0eee6708e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1422 microversion: 2.1 time: 23.869501 Sep 16 13:59:28.424948 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 835/1683] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:59:04 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1422 bytes in 23879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:28.435050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ddf8c64c-2805-41db-9cca-bd6078aea7b8 req-737a454b-ffdb-49b2-b36d-181e797a3524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a526b21-b479-4b47-a733-3a9757f8c368", "name": "network-vif-deleted", "tag": "76355775-4b09-4831-b8c9-526859e22a89"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:28.482228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:59:28.486500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:59:28.489294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:59:28.489961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:59:28.491696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:59:28.497911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ddf8c64c-2805-41db-9cca-bd6078aea7b8 req-737a454b-ffdb-49b2-b36d-181e797a3524 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:28.499552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ddf8c64c-2805-41db-9cca-bd6078aea7b8 req-737a454b-ffdb-49b2-b36d-181e797a3524 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:28.500534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ddf8c64c-2805-41db-9cca-bd6078aea7b8 req-737a454b-ffdb-49b2-b36d-181e797a3524 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:28.528233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ddf8c64c-2805-41db-9cca-bd6078aea7b8 req-737a454b-ffdb-49b2-b36d-181e797a3524 service nova] Creating event network-vif-deleted:76355775-4b09-4831-b8c9-526859e22a89 for instance 0a526b21-b479-4b47-a733-3a9757f8c368 on n-h2-858129-2 Sep 16 13:59:28.549512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ddf8c64c-2805-41db-9cca-bd6078aea7b8 req-737a454b-ffdb-49b2-b36d-181e797a3524 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127491 Sep 16 13:59:28.556856 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 836/1684] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:28.581006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:28.583007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:28.603035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:28.606937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:28.609026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:28.611522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:28.612582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:28.614438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:28.677421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:28.692999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:28.693575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:28.694463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:28.695686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:28.696505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:28.697352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.077579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:29.115830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:29.141933 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7861e0f6-95fc-48bb-962d-7dab36146679 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1313 microversion: 2.1 time: 0.582843 Sep 16 13:59:29.152806 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 837/1685] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:28 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:29.153396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:29.154747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:29.177811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4fa9915a-035b-48ca-826e-43011d4420f4 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb/action" status: 202 len: 1942 microversion: 2.75 time: 14.637980 Sep 16 13:59:29.178963 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 849/1686] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:59:14 2022] POST /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb/action => generated 1942 bytes in 14641 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 13:59:29.181082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.181833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.182508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.183889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.185630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.188442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.200407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:29.203844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 0a526b21-b479-4b47-a733-3a9757f8c368] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:29.217864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.218906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.219780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.221098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.221989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.223847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.257758 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] HTTP exception thrown: Instance 0a526b21-b479-4b47-a733-3a9757f8c368 could not be found. Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Request method failure captured: Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 HTTP/1.1 Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH-Ogxv9FYZmWGaDauUznTsbp_Nh9B63VxyqBkShgc8OMxb118aRRV3fBdHtvzalU_dm0YdZ5lcjM8kws8B-4wja2q9ru5ZsOMmw2byvldKpmf1AK17aiG4ZsZFauR5fTnY3V6j0oCtcjObywtMzkCkmdbJfNm4Jg65G1-YPo8I39Ow Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:59:29.261425 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c67843449c98450aa14d5889893ceeb4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}] Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ae208d89fa7549198ef91ef307464763 Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0a526b21-b479-4b47-a733-3a9757f8c368 could not be found. Sep 16 13:59:29.264510 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0a526b21-b479-4b47-a733-3a9757f8c368'} Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a526b21-b479-4b47-a733-3a9757f8c368 could not be found. Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:29.266060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a526b21-b479-4b47-a733-3a9757f8c368 could not be found. Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a526b21-b479-4b47-a733-3a9757f8c368 could not be found. Sep 16 13:59:29.268601 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:29.274041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Returning 404 to user: Instance 0a526b21-b479-4b47-a733-3a9757f8c368 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:29.283192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c06390ef-8810-4361-b546-b0a32b22bda3 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368" status: 404 len: 111 microversion: 2.1 time: 0.096236 Sep 16 13:59:29.289183 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 850/1687] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:29 2022] GET /compute/v2.1/servers/0a526b21-b479-4b47-a733-3a9757f8c368 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:29.295926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2a24bea2-0054-4391-91b7-0b34ce3c0fb7 req-036cea0d-90c3-4f45-b756-7a8060cfd525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527c6ec8-295b-48c5-896f-7fb23a732824", "tag": "08c84441-58ce-43af-ae94-913153efd718"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:29.318920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2a24bea2-0054-4391-91b7-0b34ce3c0fb7 req-036cea0d-90c3-4f45-b756-7a8060cfd525 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.319776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2a24bea2-0054-4391-91b7-0b34ce3c0fb7 req-036cea0d-90c3-4f45-b756-7a8060cfd525 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.320555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2a24bea2-0054-4391-91b7-0b34ce3c0fb7 req-036cea0d-90c3-4f45-b756-7a8060cfd525 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.353605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2a24bea2-0054-4391-91b7-0b34ce3c0fb7 req-036cea0d-90c3-4f45-b756-7a8060cfd525 service nova] Creating event network-changed:08c84441-58ce-43af-ae94-913153efd718 for instance 527c6ec8-295b-48c5-896f-7fb23a732824 on n-h2-858129-2 Sep 16 13:59:29.379443 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2a24bea2-0054-4391-91b7-0b34ce3c0fb7 req-036cea0d-90c3-4f45-b756-7a8060cfd525 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090616 Sep 16 13:59:29.380591 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 851/1688] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:29.397174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:29.422483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:29.424195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:29.442748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c195d0cb-66a2-47fd-a72b-8a5a76514da7 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.297077 Sep 16 13:59:29.447242 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 838/1689] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:29 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:29.457573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:29.471938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:29.489043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.492611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.493062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.497009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.497499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.497932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.594106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:29.868525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d28b0e57-0ee7-4ace-984c-49460eb8a772 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 204 len: 0 microversion: 2.1 time: 0.416894 Sep 16 13:59:29.872358 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 839/1690] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:59:29 2022] DELETE /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:29.891961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-784843d4-4ff4-4c17-94b9-e56171d3f596 req-82daa0d2-a6db-4e1e-a22d-9c1072334ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527c6ec8-295b-48c5-896f-7fb23a732824", "name": "network-vif-plugged", "status": "completed", "tag": "08c84441-58ce-43af-ae94-913153efd718"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:29.930964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-784843d4-4ff4-4c17-94b9-e56171d3f596 req-82daa0d2-a6db-4e1e-a22d-9c1072334ec8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:29.934162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-784843d4-4ff4-4c17-94b9-e56171d3f596 req-82daa0d2-a6db-4e1e-a22d-9c1072334ec8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:29.935158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-784843d4-4ff4-4c17-94b9-e56171d3f596 req-82daa0d2-a6db-4e1e-a22d-9c1072334ec8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:29.972498 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-784843d4-4ff4-4c17-94b9-e56171d3f596 req-82daa0d2-a6db-4e1e-a22d-9c1072334ec8 service nova] Creating event network-vif-plugged:08c84441-58ce-43af-ae94-913153efd718 for instance 527c6ec8-295b-48c5-896f-7fb23a732824 on n-h2-858129-2 Sep 16 13:59:29.979697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-784843d4-4ff4-4c17-94b9-e56171d3f596 req-82daa0d2-a6db-4e1e-a22d-9c1072334ec8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103319 Sep 16 13:59:29.981022 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 840/1691] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:29.986813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29545ee3-c994-476d-8ab8-b20e2ae1c3ed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d045d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:30.084192 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29545ee3-c994-476d-8ab8-b20e2ae1c3ed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 200 len: 1422 microversion: 2.1 time: 0.101306 Sep 16 13:59:30.085001 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 841/1692] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 13:59:29 2022] GET /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 1422 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:30.090807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:30.092045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:30.100149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:30.100392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e990daeb-a942-429f-8f31-7b057fa32453", "device": "/dev/xvdb"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:30.101400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:30.102007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:30.103095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:30.103736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:30.104343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:30.105326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:30.120797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:30.121310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:30.122027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:30.122806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:30.123274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:30.131791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:30.289284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:30.313050 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dbf715d9-3e06-4606-a791-d38562c81a46 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1929 microversion: 2.75 time: 0.226360 Sep 16 13:59:30.313635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 842/1693] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:30 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1929 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:30.321441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd2245c3-ad73-4092-8832-43535f2b55f1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '.version_select at 0x7f724cf8fb80>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:30.353983 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd2245c3-ad73-4092-8832-43535f2b55f1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060106077" status: 202 len: 0 microversion: 2.1 time: 0.036098 Sep 16 13:59:30.355608 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 843/1694] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 13:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060106077 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:59:30.369410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:30.370601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:30.382480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:30.383364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:30.384158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:30.385449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:30.386304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:30.387189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:30.805351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:30.826156 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a9a4b93-56c3-437b-8f9a-4cd7a22d6c71 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1684 microversion: 2.1 time: 0.464245 Sep 16 13:59:30.827440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 844/1695] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:30 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1684 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:30.838194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55f0f3b9-407c-4c0f-9160-88fc79d3effe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cff31f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:31.886129 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-347bdf47-605a-462c-af19-3626ac9665ce tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "POST /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.494130 Sep 16 13:59:31.901452 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 852/1696] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Sep 16 13:59:29 2022] POST /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments => generated 194 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:59:31.929175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:31.943229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:32.001957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.007927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.008844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.011366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.021174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.026438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.285461 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55f0f3b9-407c-4c0f-9160-88fc79d3effe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 204 len: 0 microversion: 2.1 time: 1.455610 Sep 16 13:59:32.291797 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 845/1697] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:30 2022] DELETE /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 0 bytes in 1459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:32.307486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:32.312650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:32.344038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.345410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.353669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.355533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.372643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.376365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.481614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:32.494547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0cdc2c1a-c800-4ac0-ae46-d47b3b0f9c3d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1313 microversion: 2.1 time: 0.590513 Sep 16 13:59:32.495518 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 853/1698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:31 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1313 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:32.503032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:32.504669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:32.514980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.515942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.516776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.517910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.518787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.520450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.717112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:32.757146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:32.782310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:32.786894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:32.807655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-100530ca-82e9-4716-8fd6-360b23a5b6fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1535 microversion: 2.91 time: 0.516984 Sep 16 13:59:32.818146 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 846/1699] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:32 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1535 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:32.851700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:32.853187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:32.859452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a01ed46-25b9-4ad5-b2ba-a02d18b01f72 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1929 microversion: 2.75 time: 0.361578 Sep 16 13:59:32.860359 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 854/1700] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:32 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1929 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:32.870303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:32.871159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:32.892508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.893407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.894779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.896092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.896786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.897261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.897671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.898065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.898815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:32.905865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:32.906919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:32.907583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:33.070394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:33.382972 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98832bc8-76ca-4ebc-9325-52c0ae51604e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 204 len: 0 microversion: 2.1 time: 0.514540 Sep 16 13:59:33.386765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 855/1701] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:59:32 2022] DELETE /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:33.407621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:33.407621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:33.434459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:33.438392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:33.439606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:33.443199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:33.445478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:33.447111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:33.543818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:33.876223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:33.898737 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b2f3183-caba-4bb7-aeb5-7344252de4be tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1684 microversion: 2.1 time: 1.078588 Sep 16 13:59:33.912258 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18f7e453-00ec-429c-8276-840acbfa8118 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 204 len: 0 microversion: 2.1 time: 0.507066 Sep 16 13:59:33.912258 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 856/1702] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:59:33 2022] DELETE /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:33.917612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 847/1703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:32 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1684 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:33.925587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:33.929451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:33.935955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2fa1be8f-6189-4f35-a3f8-9f6188653111 req-6c8b02e9-1643-41ea-9b59-6dbf92461319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfdc316-c9c9-4fad-ac55-a87d2e79a296", "name": "network-vif-unplugged", "status": "completed", "tag": "dc326c93-e39b-42ec-a562-fd0897d9e657"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:33.950373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:33.951302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:33.952057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:33.952980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:33.953611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:33.954217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:33.979876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2fa1be8f-6189-4f35-a3f8-9f6188653111 req-6c8b02e9-1643-41ea-9b59-6dbf92461319 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:33.982044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2fa1be8f-6189-4f35-a3f8-9f6188653111 req-6c8b02e9-1643-41ea-9b59-6dbf92461319 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:33.984654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2fa1be8f-6189-4f35-a3f8-9f6188653111 req-6c8b02e9-1643-41ea-9b59-6dbf92461319 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:34.039379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2fa1be8f-6189-4f35-a3f8-9f6188653111 req-6c8b02e9-1643-41ea-9b59-6dbf92461319 service nova] Creating event network-vif-unplugged:dc326c93-e39b-42ec-a562-fd0897d9e657 for instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 on n-h1-858129-2 Sep 16 13:59:34.055475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2fa1be8f-6189-4f35-a3f8-9f6188653111 req-6c8b02e9-1643-41ea-9b59-6dbf92461319 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137590 Sep 16 13:59:34.058645 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 857/1704] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:34.079502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-34508097", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:34.178062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] validate_networks() for [('b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 13:59:35.386366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:35.407013 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3eb884e7-99b6-48e7-a460-d36962e4c6c9 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1462 microversion: 2.1 time: 1.476437 Sep 16 13:59:35.408085 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 848/1705] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:33 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1462 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:35.414177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:35.414827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:35.434651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:35.435164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:35.435839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:35.436783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:35.437453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:35.438061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:35.763861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:35.783943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:35.788509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:35.798841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b7bf8f6-740c-4a44-bc3f-701ad72ee79f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1478 microversion: 2.91 time: 0.389265 Sep 16 13:59:35.801372 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 849/1706] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:35 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1478 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:35.810420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:35.811282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:35.819324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:35.820092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:35.820735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:35.821649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:35.822283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:35.822913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:36.696280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 13:59:36.697753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 13:59:36.698327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 13:59:36.699093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 13:59:36.700004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 13:59:36.784671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:36.786279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:36.788609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:36.792417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:36.795003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:36.801034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:36.863577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:36.904474 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d7794bea-48bd-447d-b45f-8aec9a961e8b tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1466 microversion: 2.1 time: 1.101195 Sep 16 13:59:36.906672 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 850/1707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:35 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1466 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:36.927436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:36.930207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:36.941149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 13:59:36.961727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:36.965588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:36.967105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:36.969271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for user f410179d3cca47dbb7ea031494bd1b07 and project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 13:59:36.973784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:36.975263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:36.976960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.004725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 13:59:37.010390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 13:59:37.177238 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1ea3fa82-1d38-42f8-8868-74ab2e32a96f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.111387 Sep 16 13:59:37.185899 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 858/1708] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 13:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 13:59:37.196506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:37.217956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:37.254339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:37.277388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:37.278203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:37.278885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.279827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:37.286505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:37.287777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.337065 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4690e3d-2bda-4480-a5de-305b5d3c23b5 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1929 microversion: 2.75 time: 0.427952 Sep 16 13:59:37.337687 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 851/1709] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:36 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1929 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:37.362168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9e700571-85b9-46b5-a855-ea323e5706c6 req-90884cf6-d077-4000-a5b4-cb9b6b1bafc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98", "name": "network-vif-deleted", "tag": "e79f32ee-c133-461d-98f9-33ec125ea86c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:37.401838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:37.405146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:37.405882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.406899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lazy-loading 'fault' on Instance uuid 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:37.408632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9e700571-85b9-46b5-a855-ea323e5706c6 req-90884cf6-d077-4000-a5b4-cb9b6b1bafc4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:37.409504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9e700571-85b9-46b5-a855-ea323e5706c6 req-90884cf6-d077-4000-a5b4-cb9b6b1bafc4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:37.415465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9e700571-85b9-46b5-a855-ea323e5706c6 req-90884cf6-d077-4000-a5b4-cb9b6b1bafc4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.457239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9e700571-85b9-46b5-a855-ea323e5706c6 req-90884cf6-d077-4000-a5b4-cb9b6b1bafc4 service nova] Creating event network-vif-deleted:e79f32ee-c133-461d-98f9-33ec125ea86c for instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 on n-h1-858129-2 Sep 16 13:59:37.470199 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9e700571-85b9-46b5-a855-ea323e5706c6 req-90884cf6-d077-4000-a5b4-cb9b6b1bafc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119945 Sep 16 13:59:37.490776 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 852/1710] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:37.622366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b476e900905a4f238a64e2ffd34e1159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb701055c61a4eb29a1d36c197c42b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:37.638178 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-304a96d5-3011-4705-82e1-3006df823c8d tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 200 len: 1332 microversion: 2.1 time: 0.454510 Sep 16 13:59:37.639145 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 859/1711] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:37 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 1332 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:37.677130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:37.713122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:37.730486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:37.730486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:37.731017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.731634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:37.732102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:37.732539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:37.942900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:37.968009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858129-2". {{(pid=128642) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 13:59:38.028618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Calling method '.version_select at 0x7f724cf92280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:38.076432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:38.077061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:38.077524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:38.160688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:38.166001 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9b85988e-9363-4c95-9bda-3dfa6d231d4e tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action" status: 202 len: 0 microversion: 2.91 time: 0.500809 Sep 16 13:59:38.167397 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 860/1712] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:59:37 2022] POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:38.178773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66e29d8c-ac71-48c2-9c70-e2620bc5c0a1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:38.179262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:38.179729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:38.180575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66e29d8c-ac71-48c2-9c70-e2620bc5c0a1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:38.283995 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0ac1706-90d9-4836-853f-e9e8c64a1e59 tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/ca6193d04a0941c1b92374922423efa6?start=2022-09-15T13%3A59%3A35.427780&end=2022-09-17T13%3A59%3A35.427780" status: 200 len: 694 microversion: 2.1 time: 0.788998 Sep 16 13:59:38.304168 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 853/1713] 10.222.0.60 () {58 vars in 1412 bytes} [Fri Sep 16 13:59:37 2022] GET /compute/v2.1/os-simple-tenant-usage/ca6193d04a0941c1b92374922423efa6?start=2022-09-15T13%3A59%3A35.427780&end=2022-09-17T13%3A59%3A35.427780 => generated 694 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:38.319850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:38.324178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:38.364773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:38.366858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:38.370017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:38.370865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:38.371613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:38.372062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:38.616868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66e29d8c-ac71-48c2-9c70-e2620bc5c0a1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:38.628255 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66e29d8c-ac71-48c2-9c70-e2620bc5c0a1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1206 microversion: 2.1 time: 0.458405 Sep 16 13:59:38.628870 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 861/1714] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:38 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1206 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:38.662025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:38.663128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:38.679572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:38.689876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:38.690706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:38.691685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:38.692586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:38.693217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.010981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:39.051251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:39.059984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:39.126097 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e907d55-6386-4635-8688-2e39cfccf364 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1486 microversion: 2.91 time: 0.488344 Sep 16 13:59:39.150445 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 862/1715] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:38 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:39.169545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '.version_select at 0x7f724d325280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:39.277836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.281912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.285956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.382432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.388559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.393048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.427515 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-885b43c4-5ce8-4055-a8ff-2b73504c3a16 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/ca6193d04a0941c1b92374922423efa6?start=2022-09-15T13%3A59%3A35.427780&end=2022-09-17T13%3A59%3A35.427780" status: 200 len: 642 microversion: 2.1 time: 0.274123 Sep 16 13:59:39.437331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:39.440910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 863/1716] 10.222.0.60 () {58 vars in 1412 bytes} [Fri Sep 16 13:59:39 2022] GET /compute/v2.1/os-simple-tenant-usage/ca6193d04a0941c1b92374922423efa6?start=2022-09-15T13%3A59%3A35.427780&end=2022-09-17T13%3A59%3A35.427780 => generated 642 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:39.446983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:39.447992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:39.457440 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9d9f8b2-5bea-43b3-b171-5109aab08e15 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1466 microversion: 2.1 time: 1.151789 Sep 16 13:59:39.458048 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 854/1717] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:38 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1466 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:39.458712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.459238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.462983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.464497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.465159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.465929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.514136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:39.527705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] [instance: 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:39.588372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.589327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.590058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.599428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.602498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.608827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.718978 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] HTTP exception thrown: Instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 could not be found. Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Request method failure captured: Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 HTTP/1.1 Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIBARLk-fZLaZxVqr7qWYBoQ0U3a2k2qyE4B-6vrWM8xmVYfx8NDFafyOAsXhnsJvGWg_kXnSNyatsuZ4LgeKKYxZn7XL9Gja_O-180EiudpP0k5JHplgJU_YleUFM9bLMcvHDj0POSmH_X4ggxMkS0lQLp-ubM51XrEhJ54nSxg8eI Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: eb701055c61a4eb29a1d36c197c42b70 Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesAdminNegativeTest-583442906 Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:59:39.720860 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eb701055c61a4eb29a1d36c197c42b70", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb701055c61a4eb29a1d36c197c42b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eb701055c61a4eb29a1d36c197c42b70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eb701055c61a4eb29a1d36c197c42b70"}]}] Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesAdminNegativeTest-583442906 Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: eb701055c61a4eb29a1d36c197c42b70 Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-583442906 Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesAdminNegativeTest-583442906-project Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b476e900905a4f238a64e2ffd34e1159 Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesAdminNegativeTest-583442906-project Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 could not be found. Sep 16 13:59:39.723067 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98'} Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 could not be found. Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:39.723919 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 could not be found. Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 could not be found. Sep 16 13:59:39.725729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:39.727669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Returning 404 to user: Instance 80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:39.727669 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a99009de-544a-472a-ab09-5cf25185ab64 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98" status: 404 len: 111 microversion: 2.1 time: 0.257439 Sep 16 13:59:39.727669 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 855/1718] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:39 2022] GET /compute/v2.1/servers/80ff5f3b-f1d5-440b-ba30-c27c7b3e5f98 => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:39.730744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Calling method '.version_select at 0x7f724cf8f790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:39.795082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.797565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.801340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.839677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:39.882561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.890668 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2eb7a153-b0db-4cb2-85e7-a9b79c24891a tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1929 microversion: 2.75 time: 0.447805 Sep 16 13:59:39.891461 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 864/1719] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:39 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1929 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:39.911626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.912462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.920689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:39.921318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:39.941420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.942280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.943066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:39.945346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:39.946012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:39.948144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.201592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:40.214753 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71619c75-0248-497a-beb9-d885f8741fed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1258 microversion: 2.1 time: 0.306381 Sep 16 13:59:40.221214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 865/1720] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:39 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1258 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:40.226435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a6c0d18-dcd5-48ed-910d-d5c6fde2d999 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] Calling method '.version_select at 0x7f724d81e310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:40.318660 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-63938b53-4c41-4f72-8d69-0a976ea5c40d tempest-TenantUsagesTestJSON-576466398 tempest-TenantUsagesTestJSON-576466398-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T13%3A59%3A35.427780&end=2022-09-17T13%3A59%3A35.427780&detailed=1" status: 200 len: 17745 microversion: 2.1 time: 0.582078 Sep 16 13:59:40.319329 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a6c0d18-dcd5-48ed-910d-d5c6fde2d999 tempest-VolumesAdminNegativeTest-583442906 tempest-VolumesAdminNegativeTest-583442906-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021153059" status: 202 len: 0 microversion: 2.1 time: 0.095457 Sep 16 13:59:40.319842 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 856/1721] 10.222.0.60 () {58 vars in 1335 bytes} [Fri Sep 16 13:59:39 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T13%3A59%3A35.427780&end=2022-09-17T13%3A59%3A35.427780&detailed=1 => generated 17745 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 13:59:40.344217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-94c02ffb-46dd-48ae-bf5f-ffa2f14cd51e req-c1c8a4a5-1cbb-418b-afb0-d79bbc61e2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfdc316-c9c9-4fad-ac55-a87d2e79a296", "name": "network-vif-deleted", "tag": "dc326c93-e39b-42ec-a562-fd0897d9e657"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:40.361048 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 866/1722] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 13:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021153059 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 13:59:40.373528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:40.375712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:40.392018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-94c02ffb-46dd-48ae-bf5f-ffa2f14cd51e req-c1c8a4a5-1cbb-418b-afb0-d79bbc61e2f0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.392894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-94c02ffb-46dd-48ae-bf5f-ffa2f14cd51e req-c1c8a4a5-1cbb-418b-afb0-d79bbc61e2f0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.394217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-94c02ffb-46dd-48ae-bf5f-ffa2f14cd51e req-c1c8a4a5-1cbb-418b-afb0-d79bbc61e2f0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.407385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.412492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.413558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.415484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.417827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.421036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.454438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:40.462965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-94c02ffb-46dd-48ae-bf5f-ffa2f14cd51e req-c1c8a4a5-1cbb-418b-afb0-d79bbc61e2f0 service nova] Creating event network-vif-deleted:dc326c93-e39b-42ec-a562-fd0897d9e657 for instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 on n-h1-858129-2 Sep 16 13:59:40.519909 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-94c02ffb-46dd-48ae-bf5f-ffa2f14cd51e req-c1c8a4a5-1cbb-418b-afb0-d79bbc61e2f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196609 Sep 16 13:59:40.521030 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 857/1723] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:40.543257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:40.545085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:40.582138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.583343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.584402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.586203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.588169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.589286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.708335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:40.713536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:40.748032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:40.749536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:40.775498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0cf6054b-ce04-4c0c-bae9-05743ce3ac3f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1486 microversion: 2.91 time: 0.412962 Sep 16 13:59:40.778795 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 867/1724] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:40 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1486 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:40.785975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:40.799270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:40.822100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.831279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.831737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:40.832502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:40.832971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:40.833409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.041662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e23eb221-6df5-4c46-8948-23e22a1ef3ef tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "DELETE /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 204 len: 0 microversion: 2.1 time: 0.517717 Sep 16 13:59:41.043345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 858/1725] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:59:40 2022] DELETE /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:41.059876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:41.067025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:41.096448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.097730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.098871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.103706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.107351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.108143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.441339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:41.460002 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1916d4a5-83a6-4dbd-8e89-4627bd4817cf tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 200 len: 1424 microversion: 2.1 time: 0.679654 Sep 16 13:59:41.461263 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 868/1726] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:40 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 1424 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:41.466715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:41.471987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:41.494724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.495538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.503235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.504747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.505235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.505683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.645676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:41.754228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4a0e408-ddc0-46ec-bcfe-b2e1846ff50d tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1929 microversion: 2.75 time: 0.708469 Sep 16 13:59:41.777682 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 859/1727] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:41 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1929 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:41.790391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:41.792940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:41.800804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.801686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.802533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.803580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.804352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.805742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.934057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:41.946345 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91012403-7f40-48c6-8010-27fa0f0a76ce tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1276 microversion: 2.1 time: 0.166550 Sep 16 13:59:41.953271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 860/1728] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:41 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:41.958686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:41.963391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:41.980771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.981982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.983480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:41.989171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:41.990101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:41.990791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.188337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:42.250112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:42.275475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:42.303424 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11fbf8a7-9fbf-431b-b7bc-c838dd8fae96 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1488 microversion: 2.91 time: 0.348550 Sep 16 13:59:42.304302 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 861/1729] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:41 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1488 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:42.320937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:42.337914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-472ab351-3680-4a32-81c6-57ba769e1901 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1468 microversion: 2.1 time: 0.875230 Sep 16 13:59:42.361352 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 869/1730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:41 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1468 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:42.512272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:42.515444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 9a74a7af-9736-478c-8d65-a331a8aec11d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:42.528453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.531231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.532445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.535053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.536353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.537444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.569530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f46646d5-70bf-4281-a273-d3d23e68381b req-c1881e91-d943-4314-9831-d5870a0b9ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a74a7af-9736-478c-8d65-a331a8aec11d", "name": "network-vif-deleted", "tag": "63d31d28-e16d-4175-8c59-5ef3ebed49bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:42.584573 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] HTTP exception thrown: Instance 9a74a7af-9736-478c-8d65-a331a8aec11d could not be found. Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Request method failure captured: Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d HTTP/1.1 Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-Ogxv9FYZmWGaDauUznTsbp_Nh9B63VxyqBkShgc8OMxb118aRRV3fBdHtvzalU_dm0YdZ5lcjM8kws8B-4wja2q9ru5ZsOMmw2byvldKpmf1AK17aiG4ZsZFauR5fTnY3V6j0oCtcjObywtMzkCkmdbJfNm4Jg65G1-YPo8I39Ow Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:59:42.598748 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c67843449c98450aa14d5889893ceeb4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}] Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ae208d89fa7549198ef91ef307464763 Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 9a74a7af-9736-478c-8d65-a331a8aec11d could not be found. Sep 16 13:59:42.601460 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9a74a7af-9736-478c-8d65-a331a8aec11d'} Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a74a7af-9736-478c-8d65-a331a8aec11d could not be found. Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:42.604002 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a74a7af-9736-478c-8d65-a331a8aec11d could not be found. Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a74a7af-9736-478c-8d65-a331a8aec11d could not be found. Sep 16 13:59:42.608941 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:42.616374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Returning 404 to user: Instance 9a74a7af-9736-478c-8d65-a331a8aec11d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:42.617724 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-987f74f6-1411-441c-926c-63d6dbb89c26 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d" status: 404 len: 111 microversion: 2.1 time: 0.110154 Sep 16 13:59:42.619581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 862/1731] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:42 2022] GET /compute/v2.1/servers/9a74a7af-9736-478c-8d65-a331a8aec11d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:42.621676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f46646d5-70bf-4281-a273-d3d23e68381b req-c1881e91-d943-4314-9831-d5870a0b9ded service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.622187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f46646d5-70bf-4281-a273-d3d23e68381b req-c1881e91-d943-4314-9831-d5870a0b9ded service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.622668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f46646d5-70bf-4281-a273-d3d23e68381b req-c1881e91-d943-4314-9831-d5870a0b9ded service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.640872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:42.642261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:42.642615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f46646d5-70bf-4281-a273-d3d23e68381b req-c1881e91-d943-4314-9831-d5870a0b9ded service nova] Creating event network-vif-deleted:63d31d28-e16d-4175-8c59-5ef3ebed49bc for instance 9a74a7af-9736-478c-8d65-a331a8aec11d on n-h1-858129-2 Sep 16 13:59:42.654987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.656090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f46646d5-70bf-4281-a273-d3d23e68381b req-c1881e91-d943-4314-9831-d5870a0b9ded service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093809 Sep 16 13:59:42.657282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.658326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 870/1732] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:42.658835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.661155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.662367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.663512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.717741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:42.791371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:42.792364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:42.813402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.818689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.819297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.827017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:42.827535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:42.833150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:42.976658 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f0dd122-4d4f-4f13-a9f3-1347635ff6c1 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 204 len: 0 microversion: 2.1 time: 0.334555 Sep 16 13:59:42.981286 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 863/1733] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 13:59:42 2022] DELETE /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 13:59:42.993149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:42.993867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:43.004409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:43.004905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:43.005341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:43.006073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:43.006686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:43.007127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:43.278327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:43.340925 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2deba667-0cc2-446a-9a47-95307a8467fe tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1935 microversion: 2.75 time: 0.554545 Sep 16 13:59:43.348899 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 871/1734] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:42 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1935 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:43.358648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:43.361030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:43.388880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:43.389670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:43.390328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:43.391258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:43.391914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:43.393158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:43.971754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:43.983280 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-edb8605e-2621-4a79-a491-9252dca2af3c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1264 microversion: 2.1 time: 0.632860 Sep 16 13:59:43.983886 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 872/1735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:43 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1264 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:43.995501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:43.996674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:44.009293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:44.012237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:44.017302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:44.017948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:44.018963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:44.019611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:44.025132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:44.161467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:44.180609 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb90b44b-85ef-4d7e-8c90-2fd761827d8e tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1469 microversion: 2.1 time: 1.192997 Sep 16 13:59:44.181648 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 864/1736] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:42 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1469 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:44.192507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:44.193132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:44.213674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:44.214170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:44.222864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:44.224486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:44.224985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:44.225429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:44.585919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:44.636991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:44.646900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:44.669533 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-669383f6-8bdd-4ff4-9e84-9244ce697983 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.677100 Sep 16 13:59:44.670181 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 873/1737] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:43 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:44.691078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:44.699683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:44.718704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:44.721795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:44.723145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:44.724823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:44.726712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:44.727973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:44.891451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:44.917636 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-634173de-5638-4c15-91c7-da8347cdf51b tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1468 microversion: 2.1 time: 0.734495 Sep 16 13:59:44.925599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 865/1738] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:44 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1468 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:45.027532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:45.028445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:45.038112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:45.052508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:45.055211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:45.056269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:45.059306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:45.059940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:45.125663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:45.189528 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9deb519-0ba1-4f49-85e7-448fddb502ab tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1935 microversion: 2.75 time: 0.516761 Sep 16 13:59:45.215243 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 874/1739] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:44 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1935 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:45.251433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:45.254357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:45.266470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:45.267821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:45.269779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:45.271531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:45.273165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:45.274540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:45.472419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:45.482202 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-10680c43-b611-41d7-a841-80a98273ef29 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1264 microversion: 2.1 time: 0.458609 Sep 16 13:59:45.495611 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 866/1740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:45 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1264 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:45.704457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:45.705083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:45.718482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:45.719243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:45.719689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:45.720431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:45.721251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:45.722537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:45.945055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:45.959874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:45.965485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68a2496d-8d1b-40dd-b81b-170924b440a9 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1469 microversion: 2.1 time: 0.746965 Sep 16 13:59:45.966660 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 875/1741] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:45 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1469 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:45.983057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:45.983681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:46.000873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:46.001692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:46.003026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:46.004000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:46.004473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:46.004914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:46.021283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:46.030144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:46.053562 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43357aa9-f1fe-4003-91c4-6cccffd402ef tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.353050 Sep 16 13:59:46.058287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 867/1742] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:45 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:59:46.259450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:46.260071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:46.271093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:46.288014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:46.288570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:46.289052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:46.289911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:46.290666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:46.291113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:46.900369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:46.997138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55a9d994-f5e9-4dd4-81bf-130c39df0438 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1935 microversion: 2.75 time: 0.741089 Sep 16 13:59:47.001786 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 868/1743] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:46 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1935 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:47.028640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:47.031888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:47.062577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:47.063832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:47.064619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:47.067959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:47.069056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:47.074956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:47.182375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:47.196605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac54bc70-7b89-4146-9345-d6ea41736ab7 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1468 microversion: 2.1 time: 1.224713 Sep 16 13:59:47.199470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 876/1744] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:45 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1468 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:47.215437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:47.216383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:47.261444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:47.273139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:47.274044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:47.275597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:47.282777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:47.283838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:47.911526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:47.956700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c513e36-e3cf-4af9-823a-abc7bde5eaef tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.949422 Sep 16 13:59:47.962624 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 869/1745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:47 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:47.995064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:47.999822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:48.042855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.043734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.044977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:48.046346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.047159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.050592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:48.490721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:48.510576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:48.525173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:48.545181 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-afd60d23-84a1-4874-921c-3ea091071aac tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.579144 Sep 16 13:59:48.552026 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 870/1746] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:47 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:48.562861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:48.575479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c8b00273-fe0f-47ef-9365-f405b85b5140 req-02f3f18c-090f-4b9f-a7e4-f3b82bb4de1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "name": "network-vif-unplugged", "status": "completed", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:48.612803 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9d84848-cd3d-42f3-995b-688a6eaa53da tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1469 microversion: 2.1 time: 1.409561 Sep 16 13:59:48.625126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 877/1747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:47 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1469 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:48.641450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:48.643076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:48.645800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:48.655372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.656244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.657220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:48.658259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.659043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.659731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:48.664839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8b00273-fe0f-47ef-9365-f405b85b5140 req-02f3f18c-090f-4b9f-a7e4-f3b82bb4de1a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.665574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8b00273-fe0f-47ef-9365-f405b85b5140 req-02f3f18c-090f-4b9f-a7e4-f3b82bb4de1a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.675765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8b00273-fe0f-47ef-9365-f405b85b5140 req-02f3f18c-090f-4b9f-a7e4-f3b82bb4de1a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:48.697744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:48.721555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:48.740511 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c8b00273-fe0f-47ef-9365-f405b85b5140 req-02f3f18c-090f-4b9f-a7e4-f3b82bb4de1a service nova] Creating event network-vif-unplugged:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h1-858129-2 Sep 16 13:59:48.779148 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c8b00273-fe0f-47ef-9365-f405b85b5140 req-02f3f18c-090f-4b9f-a7e4-f3b82bb4de1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.222166 Sep 16 13:59:48.784090 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 871/1748] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:48.811749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:48.817734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:48.867830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.868371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.870863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:48.870863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:48.891162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:48.895670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:49.333922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] Lazy-loading 'services' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:49.403785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:49.422094 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb9bb13e-ca25-4d01-a2ef-4d8b5421e483 tempest-ServersAdmin275Test-602390227 tempest-ServersAdmin275Test-602390227-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1920 microversion: 2.75 time: 0.783976 Sep 16 13:59:49.430056 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 878/1749] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:48 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1920 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:49.452385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ba57852a-8511-4b10-9596-aaf590e03eb1 req-99843039-fc83-4ba7-84ce-a1549cdab79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527c6ec8-295b-48c5-896f-7fb23a732824", "name": "network-vif-deleted", "tag": "08c84441-58ce-43af-ae94-913153efd718"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:49.535498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ba57852a-8511-4b10-9596-aaf590e03eb1 req-99843039-fc83-4ba7-84ce-a1549cdab79d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:49.545677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ba57852a-8511-4b10-9596-aaf590e03eb1 req-99843039-fc83-4ba7-84ce-a1549cdab79d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:49.546137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ba57852a-8511-4b10-9596-aaf590e03eb1 req-99843039-fc83-4ba7-84ce-a1549cdab79d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:49.584313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8708cac0c47b45c583fa86bde33134b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6193d04a0941c1b92374922423efa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:49.662157 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ba57852a-8511-4b10-9596-aaf590e03eb1 req-99843039-fc83-4ba7-84ce-a1549cdab79d service nova] Creating event network-vif-deleted:08c84441-58ce-43af-ae94-913153efd718 for instance 527c6ec8-295b-48c5-896f-7fb23a732824 on n-h2-858129-2 Sep 16 13:59:49.664520 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0533d2c0-42f8-4188-80c5-726475d73d8d tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 200 len: 1298 microversion: 2.1 time: 0.869334 Sep 16 13:59:49.675822 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 872/1750] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:48 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 1298 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:49.718213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ba57852a-8511-4b10-9596-aaf590e03eb1 req-99843039-fc83-4ba7-84ce-a1549cdab79d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286412 Sep 16 13:59:49.724253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:49.724419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 879/1751] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:49.734676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:49.749685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:49.750281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:49.769124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:49.772470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:49.775316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:49.782173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:49.787214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:49.788360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:49.790654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:49.796596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:49.797227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:49.798014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:49.804600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:49.805209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:49.886540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 13:59:49.909800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 13:59:50.330894 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ddd6345e-162d-4cf0-a551-e83bcfa382de tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "DELETE /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 204 len: 0 microversion: 2.75 time: 0.590465 Sep 16 13:59:50.330894 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 880/1752] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 13:59:49 2022] DELETE /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 13:59:50.361062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:50.365400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:50.424249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:50.427394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:50.430115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:50.431666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:50.434243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:50.436086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:50.920620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:50.933302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:50.944793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:50.984350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2a02c7e-2b88-494b-9a68-b26b7a293eb2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.651881 Sep 16 13:59:50.985004 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 881/1753] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:50 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:51.011039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:51.012807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:51.038159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.051319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.052905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.053711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.071440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.074090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.108242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:51.134435 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb1598f5-23b6-4f2f-88e5-8277c1181eed tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 1.452549 Sep 16 13:59:51.156586 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 873/1754] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:49 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:51.169108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:51.177408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:51.178683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.179307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.179873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.180946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lazy-loading 'fault' on Instance uuid 31e55dc2-0c6b-486f-a451-cb2712838b01 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:51.204500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.207283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.209361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.210668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.217178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.219693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.278164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae208d89fa7549198ef91ef307464763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67843449c98450aa14d5889893ceeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:51.294486 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7cc6020d-157c-4f8b-af54-014581237140 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 200 len: 1303 microversion: 2.1 time: 0.305865 Sep 16 13:59:51.299977 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 882/1755] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:50 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:51.316018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:51.320028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] [instance: 527c6ec8-295b-48c5-896f-7fb23a732824] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:51.339486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.341329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.343363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.344502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.347518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.350591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.476237 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] HTTP exception thrown: Instance 527c6ec8-295b-48c5-896f-7fb23a732824 could not be found. Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Request method failure captured: Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 HTTP/1.1 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIEkRvIFQqrzRHlb7P1xS6PxCZloZDkXJiYBlcMQJzt7kgBtsa14bKpJprENqeasmC0FTRhg6MCi-7WvISuYxcUI7UuxLki7L1BbzSdJNyxNVhrk4qj8KLSPMl-O6AATaXXz-uXbw8mpyKVzGbR99YCwGiY2fbKRlly7oWfv997T008 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ca6193d04a0941c1b92374922423efa6 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TenantUsagesTestJSON-11062953 Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 13:59:51.478537 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca6193d04a0941c1b92374922423efa6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca6193d04a0941c1b92374922423efa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca6193d04a0941c1b92374922423efa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca6193d04a0941c1b92374922423efa6"}]}] Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TenantUsagesTestJSON-11062953 Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ca6193d04a0941c1b92374922423efa6 Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TenantUsagesTestJSON-11062953 Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TenantUsagesTestJSON-11062953-project Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8708cac0c47b45c583fa86bde33134b8 Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TenantUsagesTestJSON-11062953-project Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 527c6ec8-295b-48c5-896f-7fb23a732824 could not be found. Sep 16 13:59:51.480137 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '527c6ec8-295b-48c5-896f-7fb23a732824'} Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527c6ec8-295b-48c5-896f-7fb23a732824 could not be found. Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:51.481136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527c6ec8-295b-48c5-896f-7fb23a732824 could not be found. Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527c6ec8-295b-48c5-896f-7fb23a732824 could not be found. Sep 16 13:59:51.482663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 13:59:51.488337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] Returning 404 to user: Instance 527c6ec8-295b-48c5-896f-7fb23a732824 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:51.492749 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2b1d192c-0416-4cfb-b5bc-179e1017a750 tempest-TenantUsagesTestJSON-11062953 tempest-TenantUsagesTestJSON-11062953-project] 10.222.0.60 "GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824" status: 404 len: 111 microversion: 2.1 time: 0.191253 Sep 16 13:59:51.503596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 883/1756] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:51 2022] GET /compute/v2.1/servers/527c6ec8-295b-48c5-896f-7fb23a732824 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:51.701215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:51.740867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:51.759041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:51.776512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec216fe1-1066-4449-8ad7-79786c53dae3 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1444 microversion: 2.75 time: 0.617038 Sep 16 13:59:51.798870 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 874/1757] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:51 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1444 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:51.833338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1701904d-0913-4883-9bf8-cf7d0e2fa6b9 req-102d6da6-ab1f-45a2-833c-2b158762556f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e55dc2-0c6b-486f-a451-cb2712838b01", "name": "network-vif-deleted", "tag": "76e662c1-941a-4435-ae01-24fabc07b262"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:51.873746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1701904d-0913-4883-9bf8-cf7d0e2fa6b9 req-102d6da6-ab1f-45a2-833c-2b158762556f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:51.891399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1701904d-0913-4883-9bf8-cf7d0e2fa6b9 req-102d6da6-ab1f-45a2-833c-2b158762556f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:51.894827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1701904d-0913-4883-9bf8-cf7d0e2fa6b9 req-102d6da6-ab1f-45a2-833c-2b158762556f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:51.929466 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1701904d-0913-4883-9bf8-cf7d0e2fa6b9 req-102d6da6-ab1f-45a2-833c-2b158762556f service nova] Creating event network-vif-deleted:76e662c1-941a-4435-ae01-24fabc07b262 for instance 31e55dc2-0c6b-486f-a451-cb2712838b01 on n-h1-858129-2 Sep 16 13:59:51.947429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1701904d-0913-4883-9bf8-cf7d0e2fa6b9 req-102d6da6-ab1f-45a2-833c-2b158762556f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118809 Sep 16 13:59:51.960827 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 884/1758] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:52.049520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:52.051165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:52.052208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-06b71405-d484-42fc-a280-4f726fb7bd4c req-77d9fdae-bf66-4ba2-85b7-a97bd7004546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a9c185-9fe8-40b1-a94a-230a3180363a", "tag": "1f688bff-2c2a-4b20-b461-6ff73ed49af6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:52.072029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:52.074316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:52.075332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:52.076386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:52.077130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:52.077881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:52.117959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-06b71405-d484-42fc-a280-4f726fb7bd4c req-77d9fdae-bf66-4ba2-85b7-a97bd7004546 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:52.123800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-06b71405-d484-42fc-a280-4f726fb7bd4c req-77d9fdae-bf66-4ba2-85b7-a97bd7004546 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:52.125122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-06b71405-d484-42fc-a280-4f726fb7bd4c req-77d9fdae-bf66-4ba2-85b7-a97bd7004546 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:52.175672 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-06b71405-d484-42fc-a280-4f726fb7bd4c req-77d9fdae-bf66-4ba2-85b7-a97bd7004546 service nova] Creating event network-changed:1f688bff-2c2a-4b20-b461-6ff73ed49af6 for instance a5a9c185-9fe8-40b1-a94a-230a3180363a on n-h2-858129-2 Sep 16 13:59:52.205412 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-06b71405-d484-42fc-a280-4f726fb7bd4c req-77d9fdae-bf66-4ba2-85b7-a97bd7004546 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159403 Sep 16 13:59:52.209741 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 885/1759] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 13:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 13:59:52.235431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:52.252811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:52.291333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:52.308015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:52.309606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:52.311722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:52.324191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:52.328657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:52.827588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:52.892357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:52.911882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:52.971157 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df11948d-1db4-4a16-8486-7d26fe60df3b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.925311 Sep 16 13:59:52.972338 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 875/1760] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:52 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:53.014523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:53.027410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] [instance: 31e55dc2-0c6b-486f-a451-cb2712838b01] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:53.079141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:53.082747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:53.083923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:53.085592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:53.091064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:53.096677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:53.225595 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] HTTP exception thrown: Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 could not be found. Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Request method failure captured: Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 HTTP/1.1 Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH-Ogxv9FYZmWGaDauUznTsbp_Nh9B63VxyqBkShgc8OMxb118aRRV3fBdHtvzalU_dm0YdZ5lcjM8kws8B-4wja2q9ru5ZsOMmw2byvldKpmf1AK17aiG4ZsZFauR5fTnY3V6j0oCtcjObywtMzkCkmdbJfNm4Jg65G1-YPo8I39Ow Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:59:53.261050 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c67843449c98450aa14d5889893ceeb4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c67843449c98450aa14d5889893ceeb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c67843449c98450aa14d5889893ceeb4"}]}] Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c67843449c98450aa14d5889893ceeb4 Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-MigrationsAdminTest-619097007 Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ae208d89fa7549198ef91ef307464763 Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-MigrationsAdminTest-619097007-project Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 could not be found. Sep 16 13:59:53.264058 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '31e55dc2-0c6b-486f-a451-cb2712838b01'} Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 could not be found. Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:53.265741 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 could not be found. Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 could not be found. Sep 16 13:59:53.269111 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:53.271553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] Returning 404 to user: Instance 31e55dc2-0c6b-486f-a451-cb2712838b01 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:53.271553 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45579511-ec40-49df-a647-63adec687163 tempest-MigrationsAdminTest-619097007 tempest-MigrationsAdminTest-619097007-project] 10.222.0.60 "GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01" status: 404 len: 111 microversion: 2.1 time: 0.281350 Sep 16 13:59:53.274439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 876/1761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:52 2022] GET /compute/v2.1/servers/31e55dc2-0c6b-486f-a451-cb2712838b01 => generated 111 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 13:59:53.307608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:53.327881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:53.366914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:53.367656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:53.368119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:53.368893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:53.377429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:53.378013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:53.867146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:53.891183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:53.895683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:53.927980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-670261f9-b8b1-482a-a4f0-a10ae9a24047 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1444 microversion: 2.75 time: 0.644977 Sep 16 13:59:53.929355 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 877/1762] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:53 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1444 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:54.019503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:54.036517 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4aeafcc-3ae1-4d42-8c31-70724ed5add7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 1.816875 Sep 16 13:59:54.060156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 886/1763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:52 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:54.069251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:54.070215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:54.078940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:54.079954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:54.081202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:54.083354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:54.087366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:54.088123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:54.541653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:54.616570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:54.633286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:54.669977 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8042dae6-8cd5-41f9-8ece-ee7148060d40 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.605045 Sep 16 13:59:54.689671 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 887/1764] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:54 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:54.966917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:54.968049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:54.985785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:54.990987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:54.994458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:54.997650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:54.999164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:55.000985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:55.167829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:55.167829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:55.229126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:55.230082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:55.230577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:55.233755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:55.239731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:55.246312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lazy-loading 'fault' on Instance uuid be6adfa9-553a-4a48-887d-9620d44c1deb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:55.250857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:55.252209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:55.265974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:55.268252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:55.775597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:55.810127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:55.821119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396f4bf519b416cad9381985fb5e9d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f47f8f2caf1b4ed9a6ef73aeb333211d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:55.823308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid 1a45620b-7d81-415b-8d59-3cda88cd19b5 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:55.855516 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b3959c89-2a4e-4933-8534-b0f11807921b tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 200 len: 1449 microversion: 2.75 time: 0.889048 Sep 16 13:59:55.874037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29b4954d-5e7e-4813-bea8-5e82b8371cca tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 2420 microversion: 2.25 time: 1.931512 Sep 16 13:59:55.891602 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 878/1765] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:53 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 2420 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:55.908064 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 888/1766] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:54 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 1449 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 13:59:55.930200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:55.931865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:55.946010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:55.947397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:55.948584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:55.951242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:55.953122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:55.954284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:55.954684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:55.955088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:56.009741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:56.010252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:56.026196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:56.032580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:56.036268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:56.036844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:56.404635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:56.426616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:56.430935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:56.449436 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da273546-fc87-4722-9171-96cafc359077 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.531824 Sep 16 13:59:56.450958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 889/1767] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:55 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:56.463648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858129-2", "block_migration": "auto"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 13:59:56.478876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:56.530669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:56.531659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:56.534090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:56.541170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:56.543796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:56.544719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:56.892900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'flavor' on Instance uuid 1a45620b-7d81-415b-8d59-3cda88cd19b5 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 13:59:57.033796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:57.047970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d38d57e8-f0b5-41da-8af4-0c7541a74b99 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 1.137519 Sep 16 13:59:57.064742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 879/1768] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:55 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:57.100483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:57.102072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] [instance: be6adfa9-553a-4a48-887d-9620d44c1deb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:57.146187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:57.154648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:57.155358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:57.157413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Going to try to live migrate instance to n-h2-858129-2 {{(pid=128642) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 13:59:57.159923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:57.160833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:57.161648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:57.251828 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] HTTP exception thrown: Instance be6adfa9-553a-4a48-887d-9620d44c1deb could not be found. Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Request method failure captured: Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb HTTP/1.1 Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJID3lxaLxd_6rw8SAKipeX97FlkJRXP7IlLEUQ0glqntNnK1XHzx_0zW_NVLFpcZeLa15od0_PAjrc4GhPjtM6Alo2nOykt-xO9ipN0zX2LvE-Y8_XOVdOyVB6mSFC1cQFSlhXW7Ck36KfLFkc9zhu7GIL_HtgH-Q1BpiA7DTv0Rp4Q Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.75 Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: f47f8f2caf1b4ed9a6ef73aeb333211d Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAdmin275Test-814611746 Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 13:59:57.258740 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f47f8f2caf1b4ed9a6ef73aeb333211d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f47f8f2caf1b4ed9a6ef73aeb333211d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f47f8f2caf1b4ed9a6ef73aeb333211d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f47f8f2caf1b4ed9a6ef73aeb333211d"}]}] Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAdmin275Test-814611746 Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: f47f8f2caf1b4ed9a6ef73aeb333211d Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAdmin275Test-814611746 Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAdmin275Test-814611746-project Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8396f4bf519b416cad9381985fb5e9d8 Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAdmin275Test-814611746-project Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance be6adfa9-553a-4a48-887d-9620d44c1deb could not be found. Sep 16 13:59:57.260850 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'be6adfa9-553a-4a48-887d-9620d44c1deb'} Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6adfa9-553a-4a48-887d-9620d44c1deb could not be found. Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 13:59:57.261900 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6adfa9-553a-4a48-887d-9620d44c1deb could not be found. Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6adfa9-553a-4a48-887d-9620d44c1deb could not be found. Sep 16 13:59:57.263682 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 13:59:57.265715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] Returning 404 to user: Instance be6adfa9-553a-4a48-887d-9620d44c1deb could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 13:59:57.265715 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec31946f-32b3-45d1-b2e3-15afc628d758 tempest-ServersAdmin275Test-814611746 tempest-ServersAdmin275Test-814611746-project] 10.222.0.60 "GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb" status: 404 len: 111 microversion: 2.75 time: 0.193567 Sep 16 13:59:57.274873 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 880/1769] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:57 2022] GET /compute/v2.1/servers/be6adfa9-553a-4a48-887d-9620d44c1deb => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 13:59:57.529788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:57.536345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:57.566902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:57.573399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:57.576219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:57.579643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:57.584202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:57.586877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:57.937243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:57.984404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:57.989451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:58.018393 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-016b3b47-3a00-424b-879d-24272b4c2c21 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.496894 Sep 16 13:59:58.020561 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 881/1770] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:57 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:58.107471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:58.110742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:58.139903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:58.145570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:58.148022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:58.153786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:58.155311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:58.164591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:58.763441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:58.813423 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b050a4b-0b0d-410b-9e7a-d4c419353b17 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.714977 Sep 16 13:59:58.838716 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 882/1771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:58 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 13:59:59.082217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:59.089019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:59.141343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:59.150588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:59.151586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:59.152847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:59.164480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:59.170539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:59.598074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:59.625969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:59.629792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 13:59:59.641581 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1506146b-1d23-404c-961e-2d78a0fde7be tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.569135 Sep 16 13:59:59.663527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 883/1772] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 13:59:59 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 13:59:59.882352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 13:59:59.887060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 13:59:59.914067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:59.915364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:59.920939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 13:59:59.924415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 13:59:59.925309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 13:59:59.927543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:00.321906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:00.331632 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-067d7344-34c5-4d98-8101-5fe90ae7c316 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.466470 Sep 16 14:00:00.335159 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 884/1773] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 13:59:59 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:00.693906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:00.695092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:00.709486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:00.713693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:00.715052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:00.721883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:00.722994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:00.724717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:01.080514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:01.130750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:01.137384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:01.153408 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27298e1e-f156-43bb-993f-a62ec03ef641 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.464688 Sep 16 14:00:01.155725 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 885/1774] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:00 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:01.375144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:01.376159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:01.408997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:01.416781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:01.424380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:01.428031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:01.429788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:01.432563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:02.353465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:02.365782 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-869b777f-8703-484f-9e22-2d6d64967e7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.992436 Sep 16 14:00:02.368304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 886/1775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:01 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:00:02.382241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:02.383002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:02.400558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:02.401073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:02.401522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:02.402291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:02.402879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:02.403321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:02.807350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:02.829024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:02.842616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:02.872916 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c476738-e8e2-401f-8810-a2933bda01a8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.503391 Sep 16 14:00:02.881399 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 887/1776] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:02 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:03.420817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:03.421934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:03.443598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:03.451854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:03.461791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:03.467772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:03.472054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:03.475357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:04.141492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:04.152411 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a3b0be9d-afb1-4dd9-9388-4da611be9ee4 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.735674 Sep 16 14:00:04.153734 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 888/1777] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:03 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:04.163447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:04.164588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:04.183435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:04.184346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:04.185053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:04.186066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:04.186837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:04.187566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:04.233971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:04.364212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:04.380981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:04.383130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:04.396625 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a8f12ad7-6c61-4f43-98c9-5456fd3c97e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.241473 Sep 16 14:00:04.404922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 889/1778] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:04 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:05.202151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:05.202913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:05.216252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:05.218723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:05.218723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:05.218723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:05.218723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:05.219670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:05.619562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:05.651395 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa7db471-dba4-4a67-ab49-590908122023 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.452808 Sep 16 14:00:05.660951 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 890/1779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:05 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:05.718256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:05.721360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:05.747785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:05.749170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:05.750293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:05.754093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:05.756147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:05.757312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:06.043651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:06.075050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:06.080303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:06.093174 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd2f0228-6f0e-4346-872d-a1007146af45 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.405368 Sep 16 14:00:06.153177 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 891/1780] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:05 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:06.775617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3ca2870-e3e7-4319-bf10-817264f5fee6 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/action" status: 202 len: 0 microversion: 2.25 time: 10.321847 Sep 16 14:00:06.777828 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 890/1781] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 13:59:56 2022] POST /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/action => generated 0 bytes in 10326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:00:06.807256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:06.811439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:06.857569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:06.863535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:06.867536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:06.869336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:06.870207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:06.871793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:07.408408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29606752-43b1-46e5-b948-8464b5751da3 tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] Calling method '.version_select at 0x7f724cfa4820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:07.442166 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29606752-43b1-46e5-b948-8464b5751da3 tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 1.264465 Sep 16 14:00:07.448074 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 892/1782] 10.222.0.60 () {60 vars in 1226 bytes} [Fri Sep 16 14:00:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 14:00:07.453794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:07.459390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:07.464006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:07.485881 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-053c4766-a044-491f-89c8-fe06e8632897 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.704793 Sep 16 14:00:07.488884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:07.490718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:07.491805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:07.496309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:07.497066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:07.499092 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 891/1783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:06 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:07.499933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:07.542511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-05c0bf43-c25d-4291-84ca-b548fbe5e0e7 req-402207c0-9338-4ad5-a9fe-827b6762f905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a9c185-9fe8-40b1-a94a-230a3180363a", "name": "network-vif-plugged", "status": "completed", "tag": "1f688bff-2c2a-4b20-b461-6ff73ed49af6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:07.566631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-05c0bf43-c25d-4291-84ca-b548fbe5e0e7 req-402207c0-9338-4ad5-a9fe-827b6762f905 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:07.570919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-05c0bf43-c25d-4291-84ca-b548fbe5e0e7 req-402207c0-9338-4ad5-a9fe-827b6762f905 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:07.571712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-05c0bf43-c25d-4291-84ca-b548fbe5e0e7 req-402207c0-9338-4ad5-a9fe-827b6762f905 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:07.611296 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-05c0bf43-c25d-4291-84ca-b548fbe5e0e7 req-402207c0-9338-4ad5-a9fe-827b6762f905 service nova] Creating event network-vif-plugged:1f688bff-2c2a-4b20-b461-6ff73ed49af6 for instance a5a9c185-9fe8-40b1-a94a-230a3180363a on n-h2-858129-2 Sep 16 14:00:07.628431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-05c0bf43-c25d-4291-84ca-b548fbe5e0e7 req-402207c0-9338-4ad5-a9fe-827b6762f905 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126993 Sep 16 14:00:07.639107 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 892/1784] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:07.645665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:07.663025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:07.670209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:07.671040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:07.671674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:07.672615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:07.673852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:07.679183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:08.105501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:08.115980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:08.149384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:08.159404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:08.231715 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61456049-9c6a-468a-8872-bb1d8db95117 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.590458 Sep 16 14:00:08.239586 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 893/1785] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:07 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:08.274615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eececdaf-ab06-466e-af6a-97a5d07ab2e8 tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] Action: 'update', calling method: .version_select at 0x7f724d7d2f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:08.640355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eececdaf-ab06-466e-af6a-97a5d07ab2e8 tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.397025 Sep 16 14:00:08.641240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 894/1786] 10.222.0.60 () {62 vars in 1247 bytes} [Fri Sep 16 14:00:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:00:08.661421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:08.664407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:08.672547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:08.681722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:08.685013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:08.687103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:08.688632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:08.689758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:08.690375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:08.760532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:08.775244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:08.781696 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d809939-829f-4786-8247-182fa3ff9da5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.331796 Sep 16 14:00:08.789181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 893/1787] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:07 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:08.810332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-627b5aed-c5f4-454d-b460-e9a994f8142e tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] Calling method '.version_select at 0x7f724cf72ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:08.863776 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-627b5aed-c5f4-454d-b460-e9a994f8142e tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.068504 Sep 16 14:00:08.869890 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 894/1788] 10.222.0.60 () {60 vars in 1226 bytes} [Fri Sep 16 14:00:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:00:08.897726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-89b3ef18-7379-4ede-b7a3-f43e9f821871 tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] Action: 'update', calling method: .version_select at 0x7f724cf72280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:09.256424 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-89b3ef18-7379-4ede-b7a3-f43e9f821871 tempest-QuotaClassesAdmin257Test-464414837 tempest-QuotaClassesAdmin257Test-464414837-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.372059 Sep 16 14:00:09.285460 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 895/1789] 10.222.0.60 () {62 vars in 1247 bytes} [Fri Sep 16 14:00:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:00:09.297505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:09.299952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:09.311516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:09.316456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:09.316939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:09.317931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:09.318438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:09.319020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:10.359194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.384548 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af1f69a0-cc2c-429b-a289-6b0472e08824 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 1.740036 Sep 16 14:00:10.385749 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 895/1790] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:08 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:10.392272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:10.398212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:10.402808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:10.418817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:10.419805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:10.420490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:10.422119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:10.423510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:10.424219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:10.597711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.654619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.674569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.728348 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28e7fcca-a288-4dcb-a3d8-65b64e4a9089 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 1.440627 Sep 16 14:00:10.729344 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 896/1791] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:09 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:10.858121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.893982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.898892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:10.904355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5721f1f1-1967-4765-bc74-e0be9e396517 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.515458 Sep 16 14:00:10.923569 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 896/1792] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:10 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:11.260621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.265589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.267233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.268081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.269449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.270845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.271696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.304403 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-243fd331-67a9-41fd-91be-5189c6d93038 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.563931 Sep 16 14:00:11.305602 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 897/1793] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:11.322220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.327856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.329598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.330491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.331647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.332330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.333029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.383679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0c050795-7c60-4d2f-beb3-d3cbc6b18ecd tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.068678 Sep 16 14:00:11.385087 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 897/1794] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:00:11.400109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.404231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.404712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.405448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.406455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.407667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.408309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.429602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.431320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:11.432846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=7 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:11.444249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.445549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.446877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.449510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.451053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.452098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.482461 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7818220-cf88-44ed-8a03-037e9ebd7a77 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.084992 Sep 16 14:00:11.498046 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 898/1795] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/os-services => generated 944 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:00:11.505293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.512475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.515570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.518837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.522872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.523558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.524107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.585487 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-750b2dac-200f-4535-8476-196c2ba3b9d4 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-858129-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.084265 Sep 16 14:00:11.587695 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 899/1796] 10.222.0.60 () {58 vars in 1194 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/os-services?host=n-d-858129-2&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:11.608364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.614433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.615226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.615866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.616865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.617331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.617765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.655065 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-959747a1-eda3-4ca3-a071-f72e79097f1e tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053441 Sep 16 14:00:11.656348 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 900/1797] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:11.685975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.690302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.694786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.695255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.696108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.698847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.699315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.727643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:11.738584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a0fa537-d3ac-4a62-920d-b6584916ec25 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1306 microversion: 2.1 time: 0.312484 Sep 16 14:00:11.738957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa0375b3-9577-4045-b745-72b94875bba8 tempest-ServicesAdminNegativeTestJSON-1878003313 tempest-ServicesAdminNegativeTestJSON-1878003313-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.066522 Sep 16 14:00:11.739927 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 898/1798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1306 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:11.740176 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 901/1799] 10.222.0.60 () {58 vars in 1198 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:11.760868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:11.761443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:11.790801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.791304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.791982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.799917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:11.800883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:11.801346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:11.931969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:11.964512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:11.976419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:11.990732 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3aa24a76-9241-4c10-baf9-3a943bfe90fa tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.234029 Sep 16 14:00:11.993692 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 902/1800] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:12.018019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:12.022316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:12.044406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:12.045175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:12.048355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:12.049398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:12.053816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:12.056323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:12.413112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-028b9129-31e4-4990-8f49-0748f9498115 tempest-ServicesAdminNegativeTestJSON-1841429069 tempest-ServicesAdminNegativeTestJSON-1841429069-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:12.420705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-028b9129-31e4-4990-8f49-0748f9498115 tempest-ServicesAdminNegativeTestJSON-1841429069 tempest-ServicesAdminNegativeTestJSON-1841429069-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '738f5738989f4c66bc5ef7881704a59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e80051a07ff487ababf48adb3547521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-028b9129-31e4-4990-8f49-0748f9498115 tempest-ServicesAdminNegativeTestJSON-1841429069 tempest-ServicesAdminNegativeTestJSON-1841429069-project] Request method failure captured: Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIFn9I3Jg0F7MD27UFG4km_vFoWm2XjpRVy4kO3yOx1k9InVX-fNMhNR1EEqPwGk-mz_v4s5nRAUnjEUVIERKh-G7-brQQXFL84q3H5eWdXI0AzFMEUtP6l8bUYo3sO42N48ExFhEnsN7kjDLTEkLHz6QLpKqf-FJScfWn7OmLfNvkw Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0e80051a07ff487ababf48adb3547521 Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1841429069 Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:00:12.430199 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e80051a07ff487ababf48adb3547521", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e80051a07ff487ababf48adb3547521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e80051a07ff487ababf48adb3547521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e80051a07ff487ababf48adb3547521"}]}] Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1841429069 Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0e80051a07ff487ababf48adb3547521 Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1841429069 Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServicesAdminNegativeTestJSON-1841429069-project Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 738f5738989f4c66bc5ef7881704a59e Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1841429069-project Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 14:00:12.432000 n-d-858129-2 devstack@n-api.service[128642]: action_args: {} Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 14:00:12.433081 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 16 14:00:12.434565 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:00:12.436624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-028b9129-31e4-4990-8f49-0748f9498115 tempest-ServicesAdminNegativeTestJSON-1841429069 tempest-ServicesAdminNegativeTestJSON-1841429069-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:00:12.436624 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-028b9129-31e4-4990-8f49-0748f9498115 tempest-ServicesAdminNegativeTestJSON-1841429069 tempest-ServicesAdminNegativeTestJSON-1841429069-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.680836 Sep 16 14:00:12.444767 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 899/1801] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 690 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:00:12.714736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:12.726183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:12.728089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:12.729538 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a35682be-b1d4-4fd3-a787-cdc05d40fba2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.733502 Sep 16 14:00:12.730634 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 903/1802] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:11 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:12.784426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:12.786303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:12.802887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:12.803177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:12.803596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:12.804457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:12.805926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:12.807473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:13.028857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:13.029595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:13.039090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:13.040605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:13.044160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:13.047603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:13.048499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:13.050727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:13.341007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:13.365487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:13.375774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:13.404756 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4fdfe47b-925e-4718-849b-4f9785720d38 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.382458 Sep 16 14:00:13.412599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 904/1803] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:13 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:13.451916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:13.504813 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-228c5b61-77d4-4bed-8dcf-9ede1d0b6935 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1486 microversion: 2.1 time: 0.725469 Sep 16 14:00:13.508713 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 900/1804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:12 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1486 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:13.531566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:13.532138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:13.542503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:13.543316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:13.543934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:13.545561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:13.546781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:13.547480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:13.578627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lazy-loading 'flavor' on Instance uuid a5a9c185-9fe8-40b1-a94a-230a3180363a {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:00:13.780799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:13.784019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:13.806623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:13.819124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:13.821000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:13.824108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:13.828590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:13.831635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:14.007116 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41b32012-b159-4ea8-b83f-67c19bbf6d1a tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a/action" status: 202 len: 0 microversion: 2.1 time: 0.479130 Sep 16 14:00:14.009162 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 905/1805] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:00:13 2022] POST /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:00:14.019338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-891ae9b2-ae11-40be-a4fc-646b285ff0ea tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf923a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:14.085299 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-891ae9b2-ae11-40be-a4fc-646b285ff0ea tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/fd7f812a-c146-4314-bebf-4287d2bd9ef7" status: 200 len: 662 microversion: 2.1 time: 0.074381 Sep 16 14:00:14.085988 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 906/1806] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:14 2022] GET /compute/v2.1/images/fd7f812a-c146-4314-bebf-4287d2bd9ef7 => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:14.116003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:14.116776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:14.133869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:14.137833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:14.138427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:14.139220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:14.143345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:14.143885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:14.207774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.221716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.233968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.235389 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0bbcf79-4f9c-4385-ae32-720be0cce350 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.481960 Sep 16 14:00:14.239839 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 901/1807] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:13 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:14.250251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1a2edcf-c6d1-407e-8434-069a0787f5e3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d0788b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:14.364510 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1a2edcf-c6d1-407e-8434-069a0787f5e3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/fd7f812a-c146-4314-bebf-4287d2bd9ef7" status: 200 len: 662 microversion: 2.1 time: 0.121360 Sep 16 14:00:14.367874 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 902/1808] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:14 2022] GET /compute/v2.1/images/fd7f812a-c146-4314-bebf-4287d2bd9ef7 => generated 662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:14.445941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:14.448604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:14.464352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.478234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:14.480397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:14.481449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:14.483424 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bfa12678-08b5-4489-98d8-ce7dc8c19aa1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1494 microversion: 2.1 time: 0.380083 Sep 16 14:00:14.484166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:14.484802 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 907/1809] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:14 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1494 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:14.486004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:14.487333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:14.635092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.652149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.656475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:14.680559 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54760ade-dea5-4926-9ca1-396cad0be74b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.239591 Sep 16 14:00:14.681725 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 903/1810] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:14 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:15.265029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:15.267218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:15.288934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:15.293202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:15.296261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:15.298297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:15.298887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:15.299341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:15.514022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:15.514962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:15.531761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:15.532893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:15.533537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:15.534705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:15.534973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:15.535406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:15.640641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.671462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.714481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.724313 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02809362-52bf-4c4d-a960-081c92b49132 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.464453 Sep 16 14:00:15.732404 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 908/1811] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:15 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:15.751466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:15.755323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:15.766497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:15.767027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:15.767476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:15.768235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:15.768711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:15.769144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:15.899514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.915252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.917315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.930943 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35f690d9-0796-41d1-aa7e-58ee2e1d5687 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.196400 Sep 16 14:00:15.947235 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 909/1812] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:15 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:15.953478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:15.963662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd0bfe8e-5409-457a-8b6d-298e5d99e5e2 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1494 microversion: 2.1 time: 0.456609 Sep 16 14:00:15.964567 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 904/1813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:15 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1494 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:16.762157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:16.763078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:16.776046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:16.777474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:16.779726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:16.780810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:16.783541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:16.784392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:16.963843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:16.966530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:17.011408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:17.016091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:17.018508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:17.019535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:17.021566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:17.023213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:17.210201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.224903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.231559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.233921 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb1af05a-5a98-4801-aa08-5947ee40e53b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.476381 Sep 16 14:00:17.238789 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 910/1814] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:16 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:17.246620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:17.247618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:17.255010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:17.255463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:17.256275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:17.269360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.284824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:17.286806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.291039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.291471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:17.292459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:17.316588 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75beb32b-21cb-4e70-a513-6c10bb815341 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.355839 Sep 16 14:00:17.318469 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 905/1815] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:16 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:17.324680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c23ea88-c641-4096-9712-9fd38a643d76 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d2719d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:17.441542 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c23ea88-c641-4096-9712-9fd38a643d76 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/1c6c8d66-6585-4c0c-834d-4f29e2ecb0e6" status: 200 len: 662 microversion: 2.1 time: 0.121770 Sep 16 14:00:17.443398 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 906/1816] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:17 2022] GET /compute/v2.1/images/1c6c8d66-6585-4c0c-834d-4f29e2ecb0e6 => generated 662 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:17.475447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34152734-f49e-4c9a-b3f9-d11c8818d054 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d7324c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:17.550733 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34152734-f49e-4c9a-b3f9-d11c8818d054 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/1c6c8d66-6585-4c0c-834d-4f29e2ecb0e6" status: 200 len: 662 microversion: 2.1 time: 0.097751 Sep 16 14:00:17.553841 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 907/1817] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:17 2022] GET /compute/v2.1/images/1c6c8d66-6585-4c0c-834d-4f29e2ecb0e6 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:17.648625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:17.653645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:17.660807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ecef5e2e-79de-4a7e-a710-53aa428815cc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 200 len: 1477 microversion: 2.1 time: 0.420296 Sep 16 14:00:17.680903 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 911/1818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:17 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 1477 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:17.716535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1967279503"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:17.721828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:17.731462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:17.732568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:17.733350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:17.734372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:17.736234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:17.736899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:18.286933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:18.287574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:18.304705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:18.305198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:18.305632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:18.306391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:18.306830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:18.307259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:18.617379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:18.620934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8,nova_cell0:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:18.635875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:18.642170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:18.644695 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46cdb067-f5a8-424d-913f-1d897113a8fd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.363986 Sep 16 14:00:18.646354 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 912/1819] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:18 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:18.673470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:18.675466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:18.704591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:18.705420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:18.713582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:18.715519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:18.717835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:18.718700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:18.884321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:18.916171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:18.918179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:18.926877 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4423b579-9326-4659-bb03-79f906aa59ed tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.263534 Sep 16 14:00:18.928193 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 913/1820] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:18 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:19.247382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:19.758043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7425b62-2d97-4a89-b87f-f2db33796ee9 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:19.770795 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7425b62-2d97-4a89-b87f-f2db33796ee9 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.528233 Sep 16 14:00:19.772189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 914/1821] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:19.791376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:19.792472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:19.803363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:19.804592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:19.805331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:19.806952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:19.808337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:19.809331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:20.071683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:20.086745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:20.089376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:20.091211 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71b0114b-e200-4e82-8a64-1d12287b276e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.316865 Sep 16 14:00:20.103802 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 915/1822] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:19 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:20.121836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3443a755-a7be-4cf9-8992-6eb9a34b249a tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.172652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3443a755-a7be-4cf9-8992-6eb9a34b249a tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.066704 Sep 16 14:00:20.173962 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 916/1823] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:20.186362 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-152b08fd-4e6e-4b99-b065-037b3a49aa55 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a/action" status: 202 len: 0 microversion: 2.1 time: 2.484936 Sep 16 14:00:20.197134 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 908/1824] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:00:17 2022] POST /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a/action => generated 0 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:00:20.205259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb0cce1b-eefe-480f-ac6d-a5449f220a8b tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.215226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.215854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:20.245662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:20.248170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:20.248682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:20.252722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:20.254252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:20.258666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:20.260883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb0cce1b-eefe-480f-ac6d-a5449f220a8b tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058775 Sep 16 14:00:20.264134 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 909/1825] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:20.287987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a6a7224-eaa0-4c92-980e-81988e6c3c39 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d818040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.414095 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a6a7224-eaa0-4c92-980e-81988e6c3c39 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.143106 Sep 16 14:00:20.417396 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 910/1826] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:20.442366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-713c9a15-e5fd-49f6-bcd5-76c2329c8cca tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.457877 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-713c9a15-e5fd-49f6-bcd5-76c2329c8cca tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038997 Sep 16 14:00:20.463904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 911/1827] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:20.487779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:20.489128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-238893c3-1169-485d-b2b8-afd7c12d89e8 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.508905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:20.517464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:20.534932 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-65d02222-9ac0-423f-a8aa-f5393621ace1 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1531 microversion: 2.91 time: 0.358160 Sep 16 14:00:20.537622 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 917/1828] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1531 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:20.568490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-238893c3-1169-485d-b2b8-afd7c12d89e8 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.096852 Sep 16 14:00:20.569385 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 912/1829] 10.222.0.60 () {58 vars in 1165 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:20.573967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.575335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:20.589208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:20.592223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8737125c-2b32-4148-854b-6903641d3dec tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.594430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:20.595718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:20.596960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:20.599063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:20.601050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:20.607658 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8737125c-2b32-4148-854b-6903641d3dec tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021504 Sep 16 14:00:20.617377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 913/1830] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:20.624708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7bcb0eae-cfe3-46ff-bdfb-8ed17352f50f tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.686975 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7bcb0eae-cfe3-46ff-bdfb-8ed17352f50f tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.068299 Sep 16 14:00:20.690752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 914/1831] 10.222.0.60 () {58 vars in 1169 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:20.709727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-386772ef-f123-4d06-b2bf-9814fb4671dc tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.752391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-386772ef-f123-4d06-b2bf-9814fb4671dc tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.046649 Sep 16 14:00:20.753154 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 915/1832] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:00:20.778459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b7407faf-fe88-45f9-93c2-449689e93ef4 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.794924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lazy-loading 'services' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:00:20.800805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b7407faf-fe88-45f9-93c2-449689e93ef4 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025882 Sep 16 14:00:20.813397 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 916/1833] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:20.843454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7d91fef-dd26-48a9-981b-caea4917cde4 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.899721 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ddb1d50f-b4cd-413e-8efc-a636a4d9720b tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1936 microversion: 2.91 time: 0.331779 Sep 16 14:00:20.901114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 918/1834] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1936 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:20.918114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf9f4e26-8c99-410e-84c6-26d5cc4c9985 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf921f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:20.965111 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7d91fef-dd26-48a9-981b-caea4917cde4 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.149494 Sep 16 14:00:20.979469 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 917/1835] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:20.986927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:20.988030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:20.997158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:20.998082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:20.999343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:21.001101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:21.001784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:21.002559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:21.015113 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf9f4e26-8c99-410e-84c6-26d5cc4c9985 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/96b6e964-469e-4dc6-b17b-43b3a1356914" status: 200 len: 662 microversion: 2.1 time: 0.112089 Sep 16 14:00:21.016209 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 919/1836] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:20 2022] GET /compute/v2.1/images/96b6e964-469e-4dc6-b17b-43b3a1356914 => generated 662 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:21.040040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lazy-loading 'flavor' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:00:21.045276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de6b98ba-4056-4fc5-8ab4-42142131efee tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.069405 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de6b98ba-4056-4fc5-8ab4-42142131efee tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041618 Sep 16 14:00:21.083264 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 920/1837] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:21.104028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e603e09-83be-45c8-8fed-69583d14cc65 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cfa49d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.220209 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e603e09-83be-45c8-8fed-69583d14cc65 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/96b6e964-469e-4dc6-b17b-43b3a1356914" status: 200 len: 662 microversion: 2.1 time: 0.132977 Sep 16 14:00:21.236085 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 921/1838] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/images/96b6e964-469e-4dc6-b17b-43b3a1356914 => generated 662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:21.265036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b280b0e-a7d5-4c12-a7f8-35f2cbf7067a tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.339135 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b280b0e-a7d5-4c12-a7f8-35f2cbf7067a tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.100486 Sep 16 14:00:21.355298 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 922/1839] 10.222.0.60 () {58 vars in 1144 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:21.355504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:21.362805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.373913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:21.398620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:21.399829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:21.400690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:21.401680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:21.402600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:21.403136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:21.582999 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc524c57-e708-4eb1-9231-14ef529327fc tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action" status: 202 len: 0 microversion: 2.91 time: 0.601831 Sep 16 14:00:21.583901 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 918/1840] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:00:20 2022] POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:00:21.598167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ea1ab91-8dad-4535-81f5-0aa845d6b756 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.623362 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ea1ab91-8dad-4535-81f5-0aa845d6b756 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037031 Sep 16 14:00:21.624678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 919/1841] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:21.635820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9b68dc3-511d-490b-abce-5f9540216231 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d9970d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.713517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:21.721874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9b68dc3-511d-490b-abce-5f9540216231 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.095748 Sep 16 14:00:21.722835 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 920/1842] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:21.728212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.729384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:21.736902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:21.737823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:21.738581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:21.739612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:21.740340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:21.741021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:21.897009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:21.917415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:21.921667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:21.927770 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-25b76567-750c-4664-9d66-00013428202f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.580192 Sep 16 14:00:21.929937 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 923/1843] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:21.943418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30b4b4e8-48c4-4f32-8211-c0d6a85464c8 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:21.947905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:21.961556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:21.964757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:21.971314 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cdb4b368-3a32-466d-bc1f-3f620a159282 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.247120 Sep 16 14:00:21.972522 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 921/1844] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:21.979216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-872908669", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:22.016893 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30b4b4e8-48c4-4f32-8211-c0d6a85464c8 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.082185 Sep 16 14:00:22.017974 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 924/1845] 10.222.0.60 () {58 vars in 1148 bytes} [Fri Sep 16 14:00:21 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:22.039808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-560c223a-fc4c-4ecb-94fa-a73e8c5c7f68 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.068756 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-560c223a-fc4c-4ecb-94fa-a73e8c5c7f68 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.032801 Sep 16 14:00:22.069982 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 925/1846] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:00:22.071877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:00:22.449319 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93b92f9d-be54-4443-b7ed-4645292f731a tempest-TenantUsagesNegativeTestJSON-215171989 tempest-TenantUsagesNegativeTestJSON-215171989-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-15T14%3A00%3A22.064863&end=2022-09-17T14%3A00%3A22.064863" status: 404 len: 112 microversion: - time: 0.378057 Sep 16 14:00:22.457728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 926/1847] 10.222.0.60 () {58 vars in 1316 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-15T14%3A00%3A22.064863&end=2022-09-17T14%3A00%3A22.064863 => generated 112 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 14:00:22.463942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43d64696-f7e1-4627-b55d-14c595fe671e tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.474353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43d64696-f7e1-4627-b55d-14c595fe671e tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015188 Sep 16 14:00:22.475394 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 927/1848] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:22.494286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16fe2696-a6b1-4c84-8f22-c65b86a4f4f6 tempest-TenantUsagesNegativeTestJSON-215171989 tempest-TenantUsagesNegativeTestJSON-215171989-project-admin] Calling method '.version_select at 0x7f724cf724c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.501991 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-16fe2696-a6b1-4c84-8f22-c65b86a4f4f6 tempest-TenantUsagesNegativeTestJSON-215171989 tempest-TenantUsagesNegativeTestJSON-215171989-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16fe2696-a6b1-4c84-8f22-c65b86a4f4f6 tempest-TenantUsagesNegativeTestJSON-215171989 tempest-TenantUsagesNegativeTestJSON-215171989-project-admin] Request method failure captured: Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-simple-tenant-usage/08aa3a3fe9c54dfda821069cd72c12b6?start=2022-09-17T14%3A00%3A22.064863&end=2022-09-15T14%3A00%3A22.064863 HTTP/1.1 Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIF1TaDLu7-Ssr1KF84t1Cy7ksIgeppzv9lo40BeXtkShBqsTrGVgI8xJs_vakyxGQPRVUlF7ggfDEzVB0-6JRc4gL0s-vnJ1DSZ9i15rl2kp91kWW9OktWPdgkHfOxEkO7SIXtw7K2d0tEIGBLKUoedi1Dw06Y3vmCCVhvdUeBRBy8 Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 35d123ab2d594a5dbfaae658c737dcff Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-215171989 Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 14:00:22.509986 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_35d123ab2d594a5dbfaae658c737dcff", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/35d123ab2d594a5dbfaae658c737dcff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/35d123ab2d594a5dbfaae658c737dcff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/35d123ab2d594a5dbfaae658c737dcff"}]}] Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-215171989 Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 35d123ab2d594a5dbfaae658c737dcff Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-215171989 Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TenantUsagesNegativeTestJSON-215171989-project-admin Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: de2a42d1f47148a88eeebdbd2505061a Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-215171989-project-admin Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid start time. The start time cannot occur after the end time. Sep 16 14:00:22.512344 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '08aa3a3fe9c54dfda821069cd72c12b6'} Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 16 14:00:22.513260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 16 14:00:22.516780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:00:22.518078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16fe2696-a6b1-4c84-8f22-c65b86a4f4f6 tempest-TenantUsagesNegativeTestJSON-215171989 tempest-TenantUsagesNegativeTestJSON-215171989-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:00:22.518530 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16fe2696-a6b1-4c84-8f22-c65b86a4f4f6 tempest-TenantUsagesNegativeTestJSON-215171989 tempest-TenantUsagesNegativeTestJSON-215171989-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/08aa3a3fe9c54dfda821069cd72c12b6?start=2022-09-17T14%3A00%3A22.064863&end=2022-09-15T14%3A00%3A22.064863" status: 400 len: 111 microversion: 2.1 time: 0.041755 Sep 16 14:00:22.528634 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 928/1849] 10.222.0.60 () {58 vars in 1412 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/os-simple-tenant-usage/08aa3a3fe9c54dfda821069cd72c12b6?start=2022-09-17T14%3A00%3A22.064863&end=2022-09-15T14%3A00%3A22.064863 => generated 111 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:00:22.536879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-825dbda7-f67f-441d-a2ce-764210056b45 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.559201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:00:22.560159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:00:22.561045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:00:22.561737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:00:22.564326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:00:22.587752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:22.588909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:22.590799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:22.592504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:22.595095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:22.596152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:22.596599 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-825dbda7-f67f-441d-a2ce-764210056b45 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.064652 Sep 16 14:00:22.598035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 929/1850] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:22.635797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Getting quotas for project b830faee7b63487b9bebd2aa1722a0bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:22.648029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Getting quotas for user 3e0ad91ea1e949ff9e44727dbd43e5c1 and project b830faee7b63487b9bebd2aa1722a0bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:22.668282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:00:22.671522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:00:22.743173 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bfb7d596-b3a9-49fe-9253-ccabc3cf3ee0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768189 Sep 16 14:00:22.745343 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 922/1851] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:00:22.751941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ccafa15-97bd-4f0f-9e1e-285fd84568aa tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.803896 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ccafa15-97bd-4f0f-9e1e-285fd84568aa tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054489 Sep 16 14:00:22.805252 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 923/1852] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:22.811462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd9f150c-c1b8-4992-8f97-1ff70b2e8a35 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d6ecee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.899176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd9f150c-c1b8-4992-8f97-1ff70b2e8a35 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.092229 Sep 16 14:00:22.901160 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 924/1853] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:22.923579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6872b9b3-46ff-4a63-9c2c-d7c3a39d7c28 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.951793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6872b9b3-46ff-4a63-9c2c-d7c3a39d7c28 tempest-FlavorsV2TestJSON-1622970715 tempest-FlavorsV2TestJSON-1622970715-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049156 Sep 16 14:00:22.955526 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 925/1854] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:22.965576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:22.967525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:22.988134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:22.988638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:22.992245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:22.993038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:22.993534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:22.993911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:23.247434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e93b2cfa-5881-4557-8263-21f234e0e5e8 tempest-TenantUsagesNegativeTestJSON-329816195 tempest-TenantUsagesNegativeTestJSON-329816195-project] Calling method '.version_select at 0x7f724d045280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:23.251949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e93b2cfa-5881-4557-8263-21f234e0e5e8 tempest-TenantUsagesNegativeTestJSON-329816195 tempest-TenantUsagesNegativeTestJSON-329816195-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '2f447fe5aa2b4d7c9f0a473967a492a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08aa3a3fe9c54dfda821069cd72c12b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e93b2cfa-5881-4557-8263-21f234e0e5e8 tempest-TenantUsagesNegativeTestJSON-329816195 tempest-TenantUsagesNegativeTestJSON-329816195-project] Request method failure captured: Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T14%3A00%3A22.064863&end=2022-09-17T14%3A00%3A22.064863&detailed=1 HTTP/1.1 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIF0GV8xLrxE2FZXpX6gwi2g85ByEfCF6oTmBqhtfGYq7vclJqMUGk_V7_Lyzi_r7eXj0_Mq3cXIxTq5BtKcIh_U1yo_tTTETU_gLarNyAXjKriQA3FqYziXMVBZW77h2E7nOvqHsUwF3VVa0Q80wzEkrCjAQh4KiojDyidZ76nA9i8 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 08aa3a3fe9c54dfda821069cd72c12b6 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-329816195 Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:00:23.254626 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_08aa3a3fe9c54dfda821069cd72c12b6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/08aa3a3fe9c54dfda821069cd72c12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/08aa3a3fe9c54dfda821069cd72c12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/08aa3a3fe9c54dfda821069cd72c12b6"}]}] Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-329816195 Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 08aa3a3fe9c54dfda821069cd72c12b6 Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-329816195 Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TenantUsagesNegativeTestJSON-329816195-project Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2f447fe5aa2b4d7c9f0a473967a492a5 Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-329816195-project Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 14:00:23.256452 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 16 14:00:23.257591 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 16 14:00:23.259227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 16 14:00:23.262228 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 16 14:00:23.262228 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:00:23.262228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e93b2cfa-5881-4557-8263-21f234e0e5e8 tempest-TenantUsagesNegativeTestJSON-329816195 tempest-TenantUsagesNegativeTestJSON-329816195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:00:23.262228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e93b2cfa-5881-4557-8263-21f234e0e5e8 tempest-TenantUsagesNegativeTestJSON-329816195 tempest-TenantUsagesNegativeTestJSON-329816195-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T14%3A00%3A22.064863&end=2022-09-17T14%3A00%3A22.064863&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.657359 Sep 16 14:00:23.272502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 930/1855] 10.222.0.60 () {58 vars in 1335 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-15T14%3A00%3A22.064863&end=2022-09-17T14%3A00%3A22.064863&detailed=1 => generated 123 bytes in 670 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:00:23.292926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-934176490", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:23.380048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.396636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.399311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.401550 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e116dd5-c5bf-4014-8c8d-fa6cbf9cd2f9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.444609 Sep 16 14:00:23.402901 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 926/1856] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:22 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:23.410386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:23.411250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:23.428985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:00:23.435259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:23.436090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:23.436477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:23.437238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:23.437958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:23.449910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:23.497008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:23.653266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.682227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.690677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:23.708580 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c637edbf-024b-49f4-be7a-5fbcbab5d56c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.303885 Sep 16 14:00:23.723200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 927/1857] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:23 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:23.934496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-359729eb-f05f-49d1-8ed8-3697333a8c4f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d078430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:24.070115 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-359729eb-f05f-49d1-8ed8-3697333a8c4f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.149181 Sep 16 14:00:24.071373 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 928/1858] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:23 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:00:24.115567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:00:24.116432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:00:24.117382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:00:24.118115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:00:24.118859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:00:24.149072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:24.149560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:24.149996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:24.150994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:24.151679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:24.152544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:24.204678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Getting quotas for project b830faee7b63487b9bebd2aa1722a0bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:24.212023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Getting quotas for user 3e0ad91ea1e949ff9e44727dbd43e5c1 and project b830faee7b63487b9bebd2aa1722a0bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:24.232033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:00:24.235749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:00:24.294185 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c930ddb9-e13a-4363-85bd-905ae8104ae8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020134 Sep 16 14:00:24.295961 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 931/1859] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:00:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:00:24.309192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c89f5b5b-a477-48ef-88b1-5999e025fe8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:24.310328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c89f5b5b-a477-48ef-88b1-5999e025fe8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:24.402438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c89f5b5b-a477-48ef-88b1-5999e025fe8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:24.413904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c89f5b5b-a477-48ef-88b1-5999e025fe8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1217 microversion: 2.1 time: 0.109663 Sep 16 14:00:24.414539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 929/1860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:24 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:00:24.434832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:24.435471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:24.465783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:24.466282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:24.468230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:24.469730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:24.472457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:24.474755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:24.756784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:24.757642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:24.772475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:24.773132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:24.773582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:24.774474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:24.774937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:24.775366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:24.875038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:24.899074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:24.901065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:24.902338 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73644115-e912-4d48-881d-1de53ab5f90f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.472065 Sep 16 14:00:24.902962 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 932/1861] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:24 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:25.059036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:25.071372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:25.073139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:25.090645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-283e2706-9942-4b44-802b-393aa2c9c5e1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f725183ab80>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:25.092626 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85a3a3bd-0578-4d46-8820-5820dbc5c2d6 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.340423 Sep 16 14:00:25.093207 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 930/1862] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:24 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:25.169392 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-283e2706-9942-4b44-802b-393aa2c9c5e1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.084987 Sep 16 14:00:25.171114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 933/1863] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:25 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:25.446351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:25.448436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:25.481510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:25.486480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:25.489412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:25.495214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:25.499955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:25.502687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:25.775781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:25.794305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed64a578-2598-40c3-a1fd-71ac9d4222bf tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1221 microversion: 2.1 time: 0.355530 Sep 16 14:00:25.800133 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 931/1864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:25 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1221 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:25.955920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:25.962896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:25.978266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:25.979323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:25.991167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:25.992681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:25.993646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:25.994491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:26.141387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:26.143927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:26.193975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:26.195383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:26.200620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:26.203774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:26.209419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:26.217782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:26.441034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:26.452669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:26.460899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:26.474263 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d602dd6c-bd96-4b38-bb29-4170721598eb tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.350759 Sep 16 14:00:26.480697 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 932/1865] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:26 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:26.494164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-040af0b0-3bcf-44d0-804f-5cb9baebd03c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d711af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:26.522955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:26.536270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:26.538285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:26.551406 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6a47a612-5388-4834-a31f-99f8cb02b9d2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.619530 Sep 16 14:00:26.552007 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 934/1866] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:25 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:26.657246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-040af0b0-3bcf-44d0-804f-5cb9baebd03c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.175056 Sep 16 14:00:26.657831 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 933/1867] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:26 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:26.821083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:26.821712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:26.837552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:26.837989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:26.840924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:26.844009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:26.847191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:26.850911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:27.137792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:27.149175 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1048bddd-8a44-4cae-ab3c-01028805ca8d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1269 microversion: 2.1 time: 0.331738 Sep 16 14:00:27.166233 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 935/1868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:26 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1269 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:27.517325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:27.527408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:27.571665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:27.575247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:27.577194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:27.583899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:27.586667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:27.592251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:27.594338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:27.594782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:27.629856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:27.630708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:27.631800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:27.633390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:27.634520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:27.635499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:28.298670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:28.333869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:28.344037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:28.366046 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4047aed6-cf3d-483a-a7ca-0c2b5be28719 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.860561 Sep 16 14:00:28.401200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 934/1869] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:27 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:28.448370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc8081ea-fb8d-462d-94f4-bb40e2995a61 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724ce3eca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:28.476644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:28.498431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:28.508676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:28.511105 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f5884ef-52d2-4032-abaa-56889f398b70 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.925727 Sep 16 14:00:28.514821 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 936/1870] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:27 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:28.525451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:28.526953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:28.539637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:28.541142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:28.542198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:28.543872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:28.545494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:28.548136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:28.967053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fc8081ea-fb8d-462d-94f4-bb40e2995a61 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.527399 Sep 16 14:00:28.972686 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 935/1871] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:28 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:29.065258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:29.111120 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b094843-bc47-4cb2-a5b5-6fab522a3589 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1275 microversion: 2.1 time: 0.593384 Sep 16 14:00:29.137141 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 937/1872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:28 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1275 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:29.455229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:29.460677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:29.494950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-29e653a4-1922-431b-9d54-f2c83d21838b req-4b3f65df-44fd-4a40-bb94-0cf21d3fcdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a9c185-9fe8-40b1-a94a-230a3180363a", "name": "network-vif-plugged", "status": "completed", "tag": "1f688bff-2c2a-4b20-b461-6ff73ed49af6"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:29.499636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:29.504961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:29.507016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:29.513584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:29.518125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:29.519869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:29.552618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:29.564624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-29e653a4-1922-431b-9d54-f2c83d21838b req-4b3f65df-44fd-4a40-bb94-0cf21d3fcdb8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:29.565089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-29e653a4-1922-431b-9d54-f2c83d21838b req-4b3f65df-44fd-4a40-bb94-0cf21d3fcdb8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:29.575355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-29e653a4-1922-431b-9d54-f2c83d21838b req-4b3f65df-44fd-4a40-bb94-0cf21d3fcdb8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:29.616881 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-29e653a4-1922-431b-9d54-f2c83d21838b req-4b3f65df-44fd-4a40-bb94-0cf21d3fcdb8 service nova] Creating event network-vif-plugged:1f688bff-2c2a-4b20-b461-6ff73ed49af6 for instance a5a9c185-9fe8-40b1-a94a-230a3180363a on n-h2-858129-2 Sep 16 14:00:29.635115 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-29e653a4-1922-431b-9d54-f2c83d21838b req-4b3f65df-44fd-4a40-bb94-0cf21d3fcdb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146758 Sep 16 14:00:29.636914 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 938/1873] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:29.643606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:29.648875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:29.660234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:29.661009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:29.661761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:29.663471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:29.664196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:29.664957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:29.783979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:29.809963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:29.820463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:29.840817 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e16066b-bc5c-4fbb-8771-8db4f79ff629 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.405769 Sep 16 14:00:29.861318 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 936/1874] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:29 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:30.006981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b48b1b5-9c55-4983-9d63-b430176c3744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724ce3e4c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:30.303457 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b48b1b5-9c55-4983-9d63-b430176c3744 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.306252 Sep 16 14:00:30.304470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 937/1875] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:29 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:30.320747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca9f4857-5a5b-46c3-b773-c18df380f728 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f724d690280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:30.442159 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca9f4857-5a5b-46c3-b773-c18df380f728 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8" status: 200 len: 637 microversion: 2.1 time: 0.136325 Sep 16 14:00:30.443597 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 938/1876] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:30 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8 => generated 637 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:30.468632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:30.472808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:30.496858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:30.497755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:30.498215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:30.499018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:30.504509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:30.505374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:30.761398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:30.774500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2abed3f8-9323-43d1-b2cf-7a16a273347a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1275 microversion: 2.1 time: 0.326504 Sep 16 14:00:30.784174 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 939/1877] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:30 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:30.803235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c07c8114-cd4d-4144-a716-677c6c0a1046 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f724d19b670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:30.848884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:30.912947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:30.916650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:30.921991 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-66ff7ad1-25a9-44ee-b43d-8eb378821e47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.281667 Sep 16 14:00:30.949032 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 939/1878] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:29 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:30.964272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:30.965717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:31.004072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:31.004691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:31.007598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:31.011907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:31.017993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:31.021287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:31.025401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:31.044005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-c07c8114-cd4d-4144-a716-677c6c0a1046 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:31.077000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-c07c8114-cd4d-4144-a716-677c6c0a1046 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:31.841485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:31.895286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:31.905143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:31.940594 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4edb69d4-011c-49c3-87d3-c6536e3d0d99 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.989562 Sep 16 14:00:31.945601 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 940/1879] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:30 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:31.980583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ba03011-ed44-4f8c-868f-33629e89af28 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517fe310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:32.619070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:32.746538 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c07c8114-cd4d-4144-a716-677c6c0a1046 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 1.957359 Sep 16 14:00:32.747583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 940/1880] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:30 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:32.755418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:32.757122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:32.786601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:32.788205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:32.789368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:32.791215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:32.792380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:32.793395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:32.798288 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ba03011-ed44-4f8c-868f-33629e89af28 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.848013 Sep 16 14:00:32.800953 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 941/1881] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:31 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:32.809128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:32.810213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:32.825958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:32.826902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:32.827611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:32.828874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:32.829776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:32.830492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:33.982996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.009390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f91b4b28-7d29-4539-8b54-821d904e29c5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.255138 Sep 16 14:00:34.032171 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 941/1882] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:32 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:34.055161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cec99757-72ca-4349-8758-0c0701135898 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f724d732f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:34.055416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.094630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.098229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.101052 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5a2867cc-1210-4438-9e4d-75abcf196a3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.297764 Sep 16 14:00:34.109269 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 942/1883] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:32 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:34.118732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:34.132339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:34.159295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:34.164310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:34.165814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:34.172398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:34.173405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:34.174495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:34.195196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:34.318196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:34.532843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.557658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.561182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:34.589149 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cec99757-72ca-4349-8758-0c0701135898 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "DELETE /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.551880 Sep 16 14:00:34.591294 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 942/1884] 10.222.0.60 () {58 vars in 1296 bytes} [Fri Sep 16 14:00:34 2022] DELETE /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata/os_version => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:00:34.609481 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-58c74840-6ff9-4bf2-a931-7b5b70f0e606 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.497423 Sep 16 14:00:34.617527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 943/1885] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:34 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:34.637723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d73b730-5403-4e03-95a1-b6a63476760d tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f72517fed30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:34.647411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74901b32-9cca-479c-ae16-4890b44b53d1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724ce3e280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:34.773098 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74901b32-9cca-479c-ae16-4890b44b53d1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.179895 Sep 16 14:00:34.773708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 943/1886] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:34 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:34.810226 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d73b730-5403-4e03-95a1-b6a63476760d tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 37 microversion: 2.1 time: 0.190243 Sep 16 14:00:34.818983 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 944/1887] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:00:34 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 37 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:34.834893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e323d06d-51d0-4842-996e-16055e8fd070 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f724ce529d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:34.932859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e323d06d-51d0-4842-996e-16055e8fd070 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:34.951225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e323d06d-51d0-4842-996e-16055e8fd070 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:35.091416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:35.106921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:35.168771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:35.169557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:35.169964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:35.173759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:35.174264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:35.178854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:35.371968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:35.593301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e323d06d-51d0-4842-996e-16055e8fd070 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.762406 Sep 16 14:00:35.594298 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 944/1888] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:34 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:35.607389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:35.608034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:35.629439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:35.639001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:35.645853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:35.648422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:35.651943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:35.654178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:36.761024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:36.787400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:36.794998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:36.796856 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eab02f36-713b-40f0-8c74-ba3605d1e8de tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.201257 Sep 16 14:00:36.797442 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 945/1889] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:35 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:36.813105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e54d066-0cc4-4552-801a-d0b1a55a1687 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f724d2714c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:36.824807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:36.841923 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c630d437-ddbd-45f8-a70c-43addf21c9ce tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.784216 Sep 16 14:00:36.852795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 945/1890] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:35 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:36.880324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:36.882858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:36.911433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:36.912117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:36.917280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:36.919109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:36.922040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:36.922270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e54d066-0cc4-4552-801a-d0b1a55a1687 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.118287 Sep 16 14:00:36.923093 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 946/1891] 10.222.0.60 () {58 vars in 1290 bytes} [Fri Sep 16 14:00:36 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata/os_distro => generated 33 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:36.929598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:36.936075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30bfa56e-1d8e-4bea-a156-b1fba0a71616 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724ceb6a60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:37.037765 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30bfa56e-1d8e-4bea-a156-b1fba0a71616 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.113431 Sep 16 14:00:37.038717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 947/1892] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:36 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:37.051655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25b2805f-3bd2-4380-b9e3-9851e1f8dbab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f724d711f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:37.146712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-25b2805f-3bd2-4380-b9e3-9851e1f8dbab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:37.163289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-25b2805f-3bd2-4380-b9e3-9851e1f8dbab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:37.383763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:37.435464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:37.450814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:37.465420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-363391fa-beae-4d34-ab1e-500854234067 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.604488 Sep 16 14:00:37.466036 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 946/1893] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:36 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:37.490165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ddfb9a04-cb79-4019-9098-e68920021087 req-e3103840-f5d7-48ea-aa63-255c9c19cc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:37.536934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ddfb9a04-cb79-4019-9098-e68920021087 req-e3103840-f5d7-48ea-aa63-255c9c19cc5c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:37.537478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ddfb9a04-cb79-4019-9098-e68920021087 req-e3103840-f5d7-48ea-aa63-255c9c19cc5c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:37.537940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ddfb9a04-cb79-4019-9098-e68920021087 req-e3103840-f5d7-48ea-aa63-255c9c19cc5c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:37.586265 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ddfb9a04-cb79-4019-9098-e68920021087 req-e3103840-f5d7-48ea-aa63-255c9c19cc5c service nova] Creating event network-changed:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:00:37.602355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ddfb9a04-cb79-4019-9098-e68920021087 req-e3103840-f5d7-48ea-aa63-255c9c19cc5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125348 Sep 16 14:00:37.604449 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 947/1894] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:00:37.661867 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25b2805f-3bd2-4380-b9e3-9851e1f8dbab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.620859 Sep 16 14:00:37.663640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 948/1895] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:37 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:37.673471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7cc2f6e-a63c-4076-9157-148354de53a1 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f72517fe4c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:37.744702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7cc2f6e-a63c-4076-9157-148354de53a1 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.075252 Sep 16 14:00:37.745304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 948/1896] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:00:37 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:00:37.759675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee50d6d8-14ee-4786-8e3d-29c72fd6998b tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f724ceb6f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:37.853683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:37.855161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:37.865685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ee50d6d8-14ee-4786-8e3d-29c72fd6998b tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:37.880116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:37.880897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:37.882218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:37.884716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:37.885442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:37.886922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:37.888336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ee50d6d8-14ee-4786-8e3d-29c72fd6998b tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:38.283364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:38.307586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:38.313022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:38.317158 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-412fe07b-c491-4386-83f5-824400f9169b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.469311 Sep 16 14:00:38.331943 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 949/1897] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:37 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:00:38.355727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:38.356693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:38.385122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:38.386644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:38.387769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:38.392332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:38.396331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:38.397296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:38.444565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee50d6d8-14ee-4786-8e3d-29c72fd6998b tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.691587 Sep 16 14:00:38.446218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 949/1898] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:37 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:38.472653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36c507b5-8330-4d30-a463-15bdcc9cdb7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d782ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:38.641494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36c507b5-8330-4d30-a463-15bdcc9cdb7e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.193042 Sep 16 14:00:38.652223 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 950/1899] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:38 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:38.658084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1261d89d-7321-4084-a79e-2eaec9070f79 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f724cf60820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:38.744543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1261d89d-7321-4084-a79e-2eaec9070f79 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:38.758504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1261d89d-7321-4084-a79e-2eaec9070f79 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:39.225030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:39.239330 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9dbfdcf2-5086-4bad-856d-829a05ff41f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 0.893500 Sep 16 14:00:39.243022 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 950/1900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:38 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:39.271307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:39.274628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:39.325817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:39.328069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:39.330150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:39.331098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:39.331628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:39.332088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:39.465610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1261d89d-7321-4084-a79e-2eaec9070f79 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.811913 Sep 16 14:00:39.469206 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 951/1901] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:38 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 64 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:39.481223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-43785f4f-d6c8-4622-895b-e1127ddebe6b req-e2a05ba2-186e-4d6e-9490-3669848e9f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45620b-7d81-415b-8d59-3cda88cd19b5", "name": "network-vif-unplugged", "status": "completed", "tag": "95690f41-ab10-4f0f-9aa7-7e1c74615840"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:39.540289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-43785f4f-d6c8-4622-895b-e1127ddebe6b req-e2a05ba2-186e-4d6e-9490-3669848e9f1a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:39.542875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-43785f4f-d6c8-4622-895b-e1127ddebe6b req-e2a05ba2-186e-4d6e-9490-3669848e9f1a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:39.544567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-43785f4f-d6c8-4622-895b-e1127ddebe6b req-e2a05ba2-186e-4d6e-9490-3669848e9f1a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:39.590382 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-43785f4f-d6c8-4622-895b-e1127ddebe6b req-e2a05ba2-186e-4d6e-9490-3669848e9f1a service nova] Creating event network-vif-unplugged:95690f41-ab10-4f0f-9aa7-7e1c74615840 for instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 on n-h1-858129-2 Sep 16 14:00:39.601247 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-43785f4f-d6c8-4622-895b-e1127ddebe6b req-e2a05ba2-186e-4d6e-9490-3669848e9f1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129575 Sep 16 14:00:39.602561 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 952/1902] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:39.609407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:39.610947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:39.633908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:39.634934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:39.635574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:39.636538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:39.637277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:39.637913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:39.871687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:39.896999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:39.900172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:39.930935 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-514c09be-e921-419a-a0a2-0465700ec1f2 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.672382 Sep 16 14:00:39.930935 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 951/1903] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:39 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:39.938803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-212e6737-61d8-4ce4-8633-3cf6c3b7b1d9 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f72517a8670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:39.988115 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-212e6737-61d8-4ce4-8633-3cf6c3b7b1d9 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.057392 Sep 16 14:00:39.996565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 952/1904] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:00:39 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 64 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:40.002994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc75020b-0b52-45f6-af0a-5a85fcf9a110 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cf72ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:40.084266 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc75020b-0b52-45f6-af0a-5a85fcf9a110 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.085902 Sep 16 14:00:40.084864 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 953/1905] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:39 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:40.095551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b3707c0-b457-4bd5-bd57-df11bd38bf3c tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f72517fea60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:40.183015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9b3707c0-b457-4bd5-bd57-df11bd38bf3c tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:40.197874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9b3707c0-b457-4bd5-bd57-df11bd38bf3c tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:40.645908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:40.699323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:40.703455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:40.705815 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5922c972-11d4-43ad-9ccc-dfa7132f7234 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.101509 Sep 16 14:00:40.713449 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 953/1906] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:39 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:40.734688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:40.736273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:40.763600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:40.768619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:40.769920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:40.779367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:40.781421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:40.782668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:41.018828 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b3707c0-b457-4bd5-bd57-df11bd38bf3c tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.932118 Sep 16 14:00:41.020316 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 954/1907] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:40 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:41.053900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:41.055083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:41.145339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:41.146279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:41.161058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:41.164830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:41.185019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:41.186301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:41.969138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:42.010562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:42.017699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:42.033272 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b97f7431-2c65-4921-90a9-c8042ba126db tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 1.011132 Sep 16 14:00:42.034486 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 955/1908] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:41 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:42.044334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21150142-f562-4af1-8ce4-d443d1f34513 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update', calling method: .version_select at 0x7f72517eda60>, body: {"meta": {"os_version": "alt"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:42.165860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-21150142-f562-4af1-8ce4-d443d1f34513 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:42.188887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:42.206988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-21150142-f562-4af1-8ce4-d443d1f34513 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:42.235086 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5eaa8d52-8d30-4cb6-86ff-f9170d3a7c54 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.518231 Sep 16 14:00:42.259943 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 954/1909] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:40 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:42.322375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57863646-b86b-49b2-84a7-e9e122b43020 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d0c30d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:42.581630 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57863646-b86b-49b2-84a7-e9e122b43020 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.303319 Sep 16 14:00:42.584468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 955/1910] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:42 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:42.634972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-172dabc5-86af-45ea-a67e-3567bd0f5605 req-54aaf64e-bb1b-4bbf-a7a7-9607615fb171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077b0270-538b-4d3c-bb57-fc02f8ae640c", "tag": "699c0d76-e03c-4a5f-a650-09e078d1aa6e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:42.715280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-172dabc5-86af-45ea-a67e-3567bd0f5605 req-54aaf64e-bb1b-4bbf-a7a7-9607615fb171 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:42.715764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-172dabc5-86af-45ea-a67e-3567bd0f5605 req-54aaf64e-bb1b-4bbf-a7a7-9607615fb171 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:42.747093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-172dabc5-86af-45ea-a67e-3567bd0f5605 req-54aaf64e-bb1b-4bbf-a7a7-9607615fb171 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:42.806452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-172dabc5-86af-45ea-a67e-3567bd0f5605 req-54aaf64e-bb1b-4bbf-a7a7-9607615fb171 service nova] Creating event network-changed:699c0d76-e03c-4a5f-a650-09e078d1aa6e for instance 077b0270-538b-4d3c-bb57-fc02f8ae640c on n-h1-858129-2 Sep 16 14:00:42.824237 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-172dabc5-86af-45ea-a67e-3567bd0f5605 req-54aaf64e-bb1b-4bbf-a7a7-9607615fb171 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215153 Sep 16 14:00:42.827676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 956/1911] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:42.842269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:42.852457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:42.882203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:42.884838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:42.885362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:42.891520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:42.892026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:42.894256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:43.342077 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21150142-f562-4af1-8ce4-d443d1f34513 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.306405 Sep 16 14:00:43.343169 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 956/1912] 10.222.0.60 () {60 vars in 1313 bytes} [Fri Sep 16 14:00:42 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata/os_version => generated 31 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:43.348366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-41b4c03f-d817-49ab-b506-c7a2ec6a4b98 req-b518bc94-1a18-4db8-86de-451c39a466de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a45620b-7d81-415b-8d59-3cda88cd19b5", "tag": "95690f41-ab10-4f0f-9aa7-7e1c74615840"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:43.422471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-41b4c03f-d817-49ab-b506-c7a2ec6a4b98 req-b518bc94-1a18-4db8-86de-451c39a466de service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:43.423116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-41b4c03f-d817-49ab-b506-c7a2ec6a4b98 req-b518bc94-1a18-4db8-86de-451c39a466de service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:43.424978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-41b4c03f-d817-49ab-b506-c7a2ec6a4b98 req-b518bc94-1a18-4db8-86de-451c39a466de service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:43.482447 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-41b4c03f-d817-49ab-b506-c7a2ec6a4b98 req-b518bc94-1a18-4db8-86de-451c39a466de service nova] Creating event network-changed:95690f41-ab10-4f0f-9aa7-7e1c74615840 for instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 on n-h1-858129-2 Sep 16 14:00:43.500168 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-41b4c03f-d817-49ab-b506-c7a2ec6a4b98 req-b518bc94-1a18-4db8-86de-451c39a466de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155601 Sep 16 14:00:43.502114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 957/1913] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:43.521758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:43.522513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:43.547347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:43.548187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:43.548817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:43.549742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:43.551425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:43.554357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:43.863586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:43.878812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:43.899608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:43.900762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:43.905889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:43.906744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:43.908270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b20cf15a-7e83-4134-a081-97ff6d35e221 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.079019 Sep 16 14:00:43.912321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 957/1914] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:42 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:43.922209 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f213a4b-f400-46f0-81be-9ef25f1e84f4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.418720 Sep 16 14:00:43.923347 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 958/1915] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:43 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:43.937695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:43.938974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:43.957857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f4dcaf4-48e2-48b0-bec5-f5db033ebddb tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f72517fec10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:43.969402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:43.970340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:43.973058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:43.974204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:43.975010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:43.977542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:44.082167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f4dcaf4-48e2-48b0-bec5-f5db033ebddb tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 58 microversion: 2.1 time: 0.147720 Sep 16 14:00:44.082167 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 959/1916] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:00:43 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 58 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:44.082167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9249df9b-c562-4b5e-b256-d1384675b47d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517a8310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:44.230230 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9249df9b-c562-4b5e-b256-d1384675b47d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.155389 Sep 16 14:00:44.237542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 960/1917] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:44 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:44.271740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5b2f05b-5da0-4e5e-b75f-3d703a7c6fab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'update_all', calling method: .version_select at 0x7f72517fee50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:44.396105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f5b2f05b-5da0-4e5e-b75f-3d703a7c6fab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:44.448709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f5b2f05b-5da0-4e5e-b75f-3d703a7c6fab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:44.901037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:44.943371 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed364d82-c2da-48b6-b2c5-962f28563e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.029110 Sep 16 14:00:44.960327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 958/1918] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:43 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:44.986760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:44.992314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:45.047346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:45.050460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:45.055633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:45.057684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:45.063560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:45.067614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:45.361980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5b2f05b-5da0-4e5e-b75f-3d703a7c6fab tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 61 microversion: 2.1 time: 1.121029 Sep 16 14:00:45.368149 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 961/1919] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:00:44 2022] PUT /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 61 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:45.399462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:45.431464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:45.460429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:45.460936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:45.461376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:45.462108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:45.462644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:45.463116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:45.723737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:45.773609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:45.793271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:45.823081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3af44bd7-419b-4b08-931d-3456d3044124 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.860746 Sep 16 14:00:45.827052 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 959/1920] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:44 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:45.838198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ce068ac-5f8a-4365-9734-1dc6c85d6a7f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d2af550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:46.017199 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ce068ac-5f8a-4365-9734-1dc6c85d6a7f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.188668 Sep 16 14:00:46.018815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 960/1921] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:45 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:46.037501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:46.044678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca3f6f5e-4f03-4d53-812e-4df88c9a0bf1 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Action: 'create', calling method: .version_select at 0x7f724ce58040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:46.051967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:46.061679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:46.063437 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97c8c569-28ad-4796-aa4b-2b22dd417085 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 0.692938 Sep 16 14:00:46.064153 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 962/1922] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:45 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:46.084875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:46.087998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:46.107338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:46.109283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:46.112368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:46.113685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:46.116137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:46.116885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:46.228957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ca3f6f5e-4f03-4d53-812e-4df88c9a0bf1 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:00:46.267269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ca3f6f5e-4f03-4d53-812e-4df88c9a0bf1 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Getting quotas for user f1bff8d487804c78beffac1b09078046 and project cc1cb70077da430db8751e9734e47194. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:00:46.982228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:47.001904 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39eb2670-01fc-4ba5-a345-7e2a2f21544a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 0.936301 Sep 16 14:00:47.002524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:46 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:47.012434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:47.028304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:47.078196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:47.078573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:47.078937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:47.079889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:47.080357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:47.080951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:47.271683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:47.289907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:47.297234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:47.310932 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79d2d0b8-a0ba-4690-bb39-c7c047f6ec2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.307055 Sep 16 14:00:47.318603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 964/1924] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:47 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:47.328721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-365f65ad-4826-40d1-af89-2771f83959de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517ed8b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:47.780236 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca3f6f5e-4f03-4d53-812e-4df88c9a0bf1 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "POST /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 85 microversion: 2.1 time: 1.739408 Sep 16 14:00:47.785505 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 961/1925] 10.222.0.60 () {60 vars in 1281 bytes} [Fri Sep 16 14:00:46 2022] POST /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 85 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:47.793041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:47.793668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:47.826558 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-365f65ad-4826-40d1-af89-2771f83959de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.506293 Sep 16 14:00:47.827218 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 965/1926] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:47 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:47.846916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:47.848405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b46df11c-7533-4ad7-bdc0-e9707a9c7e72 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] Calling method '.version_select at 0x7f72517dc940>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:47.849899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:47.851453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:47.856499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:47.860597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:47.861613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:48.024574 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b46df11c-7533-4ad7-bdc0-e9707a9c7e72 tempest-ImagesMetadataTestJSON-1472361806 tempest-ImagesMetadataTestJSON-1472361806-project] 10.222.0.60 "GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.196220 Sep 16 14:00:48.025570 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 966/1927] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:00:47 2022] GET /compute/v2.1/images/7495aabd-fd80-42d7-b468-ff4f357a9ab8/metadata => generated 85 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:00:48.045004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:48.046185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:48.064808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:48.065309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:48.065747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:48.066536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:48.067005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:48.067394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:49.717255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:49.721052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:49.737059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8771ca3-dee9-4c10-bdf6-7860c3018a34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.705030 Sep 16 14:00:49.737668 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 967/1928] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:48 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:49.748664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:49.755374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:49.769283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:49.770374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:49.771226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:49.772530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:49.773239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:49.781648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:49.817560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:49.820656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:49.833864 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee473976-d464-4104-9f8d-b61d0ea5fdbb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 2.045155 Sep 16 14:00:49.835070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 962/1929] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:47 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:49.897458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1db37cf7-8ff0-4c45-ba67-556cdd7eec0f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d078430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:50.037949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:50.040528 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1db37cf7-8ff0-4c45-ba67-556cdd7eec0f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.174376 Sep 16 14:00:50.046519 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 963/1930] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:49 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:50.079435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:50.084772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:50.108817 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8c449af-b053-48e6-a09b-55d0e7dd5d42 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.368658 Sep 16 14:00:50.122516 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 968/1931] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:49 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:50.608806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0fbfa81f-d85d-4784-8572-3a297fdfee3f req-1cc41010-62fe-4fa7-b248-78c57f5ba647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "name": "network-vif-plugged", "status": "completed", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:50.655153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0fbfa81f-d85d-4784-8572-3a297fdfee3f req-1cc41010-62fe-4fa7-b248-78c57f5ba647 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:50.656426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0fbfa81f-d85d-4784-8572-3a297fdfee3f req-1cc41010-62fe-4fa7-b248-78c57f5ba647 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:50.657425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0fbfa81f-d85d-4784-8572-3a297fdfee3f req-1cc41010-62fe-4fa7-b248-78c57f5ba647 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:50.687119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0fbfa81f-d85d-4784-8572-3a297fdfee3f req-1cc41010-62fe-4fa7-b248-78c57f5ba647 service nova] Creating event network-vif-plugged:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:00:50.702795 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0fbfa81f-d85d-4784-8572-3a297fdfee3f req-1cc41010-62fe-4fa7-b248-78c57f5ba647 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112579 Sep 16 14:00:50.705557 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 964/1932] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:00:50.780662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:50.781572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:50.814319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:50.819052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:50.821166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:50.825033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:50.826811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:50.831511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:50.893333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:50.894660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:50.924888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:50.927219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:50.942570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:50.947728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:50.952703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:50.953736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:52.377161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:52.393774 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-511c6c2c-99e3-4c0f-9e05-0ce860cda1e2 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.618172 Sep 16 14:00:52.398659 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 969/1933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:50 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:52.410062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1162127-604d-4c6c-86aa-b54e8d0c22c1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517dc790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:52.453645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:52.522437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:52.532843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:52.539689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-11363dc7-6897-426c-8c6a-2a8e43507a71 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.652950 Sep 16 14:00:52.571013 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 965/1934] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:50 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:52.620261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:52.629026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:52.656014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1162127-604d-4c6c-86aa-b54e8d0c22c1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.255712 Sep 16 14:00:52.657026 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 970/1935] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:52 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:52.666682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:52.670944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:52.672003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:52.673078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:52.674450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:52.675788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:52.683342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:53.110076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:53.150462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:53.159895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:53.208805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01139672-f4de-4b88-8013-382548c79221 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.624876 Sep 16 14:00:53.251703 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 966/1936] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:52 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:53.436529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:53.437382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:53.447217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:53.454245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:53.454925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:53.455990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:53.456987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:53.457607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:53.632765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:53.657878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:53.703652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:53.711615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:53.719547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:53.721893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:53.723150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:53.724264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:54.484549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:55.049920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.102900 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5813d7a2-7d04-4c17-9617-67bade71c663 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.658833 Sep 16 14:00:55.122792 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 971/1937] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:53 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:55.139236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb3a538e-ae4d-4e95-b8f7-a158982b75d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517eda60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:55.209533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.284886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.325491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.343996 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d68addfc-ee8c-44f3-b27a-c936385c9c4f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.753760 Sep 16 14:00:55.346246 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb3a538e-ae4d-4e95-b8f7-a158982b75d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.227850 Sep 16 14:00:55.351330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 967/1938] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:53 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:55.353828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 972/1939] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:55 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:55.371208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:55.385276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:55.415708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:55.417167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:55.418393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:55.420287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:55.421624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:55.426075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:55.666587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.678060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.683936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:55.703276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2030171-c32e-4a06-8efa-82a43d2c42c8 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.345671 Sep 16 14:00:55.708629 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 968/1940] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:55 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:56.149828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:56.152197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:56.184233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:56.188571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:56.190158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:56.194146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:56.195520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:56.197590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:56.372788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-834f3e8d-9b0d-4d33-b7b1-79ff08c6b80e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cead310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:56.389544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=32 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:00:56.484923 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-834f3e8d-9b0d-4d33-b7b1-79ff08c6b80e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.119550 Sep 16 14:00:56.498378 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 969/1941] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:56 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:56.520121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:56.520996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:56.539522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:56.545639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:56.551092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:56.556171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:56.560043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:56.562523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:57.671479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:57.707678 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60cd913c-4635-447f-bab8-475f41605cd1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 1.580179 Sep 16 14:00:57.751577 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 973/1942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:56 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:58.031670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9734946b-d088-4390-9400-d467adf93183 tempest-ListImagesTestJSON-143831779 tempest-ListImagesTestJSON-143831779-project] Calling method '.version_select at 0x7f72517dcca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:58.121014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9734946b-d088-4390-9400-d467adf93183 tempest-ListImagesTestJSON-143831779 tempest-ListImagesTestJSON-143831779-project] 10.222.0.60 "GET /compute/v2.1/images/b0b65f17-d770-469f-9ae4-7c7011730f1b" status: 200 len: 784 microversion: 2.1 time: 0.367579 Sep 16 14:00:58.144923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 974/1943] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:57 2022] GET /compute/v2.1/images/b0b65f17-d770-469f-9ae4-7c7011730f1b => generated 784 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:58.148498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:58.162345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:58.164229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:58.175558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:58.176987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:58.178125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:58.179835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:58.180950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:58.181980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:58.182932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:58.193480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:58.201605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-573edf5d-b6ba-484c-aeb5-5c87a8463083 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.699002 Sep 16 14:00:58.207027 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 970/1944] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:56 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:58.390592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:58.429198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:58.433401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:00:58.437111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4254a51b-835c-40e6-ab20-f9fa9e126909 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Action: 'create', calling method: .version_select at 0x7f724d271b80>, body: {"pool": null} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:00:58.476253 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93575463-43fc-4697-ae65-20a11a09a73d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1558 microversion: 2.91 time: 0.329139 Sep 16 14:00:58.485360 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 975/1945] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:00:58 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:00:58.509547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82cd0fd2-5339-445b-954e-f519c487551b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517a8ee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:58.679320 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82cd0fd2-5339-445b-954e-f519c487551b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1440 microversion: 2.1 time: 0.190596 Sep 16 14:00:58.681676 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 976/1946] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:00:58 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1440 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:00:58.717640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83c56d3c-b512-4829-8e91-e1922e6539f6 tempest-ListImagesTestJSON-143831779 tempest-ListImagesTestJSON-143831779-project] Calling method '.version_select at 0x7f72517a81f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:58.959505 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83c56d3c-b512-4829-8e91-e1922e6539f6 tempest-ListImagesTestJSON-143831779 tempest-ListImagesTestJSON-143831779-project] 10.222.0.60 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.272803 Sep 16 14:00:58.960058 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 977/1947] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 16 14:00:58 2022] GET /compute/v2.1/images => generated 445 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:00:58.970773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:00:58.971706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:00:59.009076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:59.012018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:59.015189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:59.017414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:00:59.019733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:00:59.023485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:00:59.109414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:01.098794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:01.158319 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1bd126fe-4b67-4220-888d-cda24733242f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 2.192398 Sep 16 14:01:01.177827 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 978/1948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:00:58 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:01.249134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f163d36-dc37-4613-bc36-23163fac098c tempest-ListImagesTestJSON-143831779 tempest-ListImagesTestJSON-143831779-project] Calling method '.version_select at 0x7f724cf72040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:06.539744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=84 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:07.191627 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f163d36-dc37-4613-bc36-23163fac098c tempest-ListImagesTestJSON-143831779 tempest-ListImagesTestJSON-143831779-project] 10.222.0.60 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 6.010221 Sep 16 14:01:07.193287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 979/1949] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 14:01:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 6013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:07.265542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:07.275723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:07.286300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=90 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:07.321946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:07.326815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:07.342641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:07.344647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:07.345766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:07.346772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:08.167155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=22 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:08.529452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:08.547682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:08.553393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:08.558371 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5cc9a5f2-6d31-4529-b92f-5a35251d0e52 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.315948 Sep 16 14:01:08.559380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 980/1950] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:07 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:08.574132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:08.577406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:08.607706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:08.608586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:08.609314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:08.610293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:08.610981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:08.611589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:09.145409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:09.158617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:09.162808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:09.193698 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad92cc64-18d6-4527-9ae3-aeb370220e83 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.628739 Sep 16 14:01:09.227841 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 981/1951] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:08 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:09.245307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1b19bc9-6f15-4438-91d4-f21763095abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cf03d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:09.357915 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1b19bc9-6f15-4438-91d4-f21763095abe tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1449 microversion: 2.1 time: 0.128509 Sep 16 14:01:09.367693 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 982/1952] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:01:09 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:09.374371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:09.375322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:09.394338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:09.406388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:09.407128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:09.408114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:09.408766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:09.409374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:09.675085 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4254a51b-835c-40e6-ab20-f9fa9e126909 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 11.456842 Sep 16 14:01:09.686076 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 971/1953] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:00:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 11471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:09.695520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f38ed8c6-58ff-4874-8012-69b781fd6645 req-b6f76830-bbc8-4ad7-ba7d-b128e79d2a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077b0270-538b-4d3c-bb57-fc02f8ae640c", "name": "network-vif-plugged", "status": "completed", "tag": "699c0d76-e03c-4a5f-a650-09e078d1aa6e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:09.753868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f38ed8c6-58ff-4874-8012-69b781fd6645 req-b6f76830-bbc8-4ad7-ba7d-b128e79d2a05 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:09.764867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f38ed8c6-58ff-4874-8012-69b781fd6645 req-b6f76830-bbc8-4ad7-ba7d-b128e79d2a05 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:09.772336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f38ed8c6-58ff-4874-8012-69b781fd6645 req-b6f76830-bbc8-4ad7-ba7d-b128e79d2a05 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:09.833589 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f38ed8c6-58ff-4874-8012-69b781fd6645 req-b6f76830-bbc8-4ad7-ba7d-b128e79d2a05 service nova] Creating event network-vif-plugged:699c0d76-e03c-4a5f-a650-09e078d1aa6e for instance 077b0270-538b-4d3c-bb57-fc02f8ae640c on n-h1-858129-2 Sep 16 14:01:09.874861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f38ed8c6-58ff-4874-8012-69b781fd6645 req-b6f76830-bbc8-4ad7-ba7d-b128e79d2a05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185790 Sep 16 14:01:09.876896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 972/1954] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:09.897590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-568cbfda-430a-4407-a722-7b6c1922a8d0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d19b670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:10.184256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-568cbfda-430a-4407-a722-7b6c1922a8d0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 200 len: 1449 microversion: 2.1 time: 0.300671 Sep 16 14:01:10.214169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 973/1955] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:01:09 2022] GET /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 1449 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:10.240772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:10.250351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:10.300210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:10.302968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:10.311955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:10.323915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:10.335207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:10.336220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:11.405889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:11.433865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1fc4096-0028-4eb0-8e1d-9d0e11bac4c3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1317 microversion: 2.1 time: 2.064322 Sep 16 14:01:11.437524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 983/1956] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:09 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1317 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:11.453207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1146fcd-16f0-4cbb-9544-6d3cefc321de tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Action: 'create', calling method: .version_select at 0x7f72517ed550>, body: {"pool": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:11.857798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:11.896381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:11.905456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:11.909418 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b87f2ba8-909f-484a-8a8b-71b0ed068aaa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1812 microversion: 2.25 time: 1.688175 Sep 16 14:01:11.926453 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 974/1957] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:10 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1812 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:12.529446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ed2c01d-0789-46f4-a1e7-c590d364e5c3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f725182b160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:15.002771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ed2c01d-0789-46f4-a1e7-c590d364e5c3 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 204 len: 0 microversion: 2.1 time: 3.086715 Sep 16 14:01:15.003429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 975/1958] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:11 2022] DELETE /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 0 bytes in 3088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:01:15.013462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:15.014322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:15.047473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:15.047995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:15.048454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:15.052081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:15.052595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:15.053053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:15.411423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:15.436148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:15.438606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:15.473803 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7892d015-89a4-4a38-8735-6bc779554e69 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.461413 Sep 16 14:01:15.487434 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 976/1959] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:15 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:15.515482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:15.521548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:15.547655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:15.552857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:15.553735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:15.557772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:15.560102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:15.561697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:16.825949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:16.889760 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46dfae72-c9f2-4c76-b4c9-8fd9693f2f91 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1467 microversion: 2.1 time: 1.400377 Sep 16 14:01:16.893423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 977/1960] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:15 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1467 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:16.929945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:16.935174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:16.956948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:16.966762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:16.968045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:16.969791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:16.971118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:16.972280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:18.377773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:18.407418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:18.414916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:18.416942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85081bf3-f49b-4450-9363-2f139f80273d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1802 microversion: 2.25 time: 1.518175 Sep 16 14:01:18.457338 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 978/1961] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:16 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1802 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:18.495501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-26846bfc-083c-430d-9756-85a80ab566b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Action: 'create', calling method: .version_select at 0x7f7251824940>, body: {"keypair": {"name": "tempest-keypair-1624999119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4xFjip43+64lB/4I/7SlapPqUkR6Tc0ZE+CJeO0AsFt8BDXEPg+wQtBaX7pnvAa4VRTtTF1f1ws3lPvUrRNe80FsVOjOf+5HU3RVR9GWnq+SSveAiJ0nTAY1BGvCqzfA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:18.598277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-26846bfc-083c-430d-9756-85a80ab566b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Getting quotas for project 289bec6033074acb97a59abc8bd0ee1d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:18.649054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-26846bfc-083c-430d-9756-85a80ab566b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Getting quotas for user 7495b1a889034a07a4b40f871ddc701f and project 289bec6033074acb97a59abc8bd0ee1d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:18.746050 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-26846bfc-083c-430d-9756-85a80ab566b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.284538 Sep 16 14:01:18.760547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 979/1962] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 14:01:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 302 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 14:01:18.775338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:18.776848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:18.796358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:18.798284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:18.800240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:18.803014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:18.807334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:18.808985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:18.901399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:01:19.265016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68b27e49-4043-4305-ba1a-62b0213a96d7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 204 len: 0 microversion: 2.1 time: 0.496882 Sep 16 14:01:19.273838 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 980/1963] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:01:18 2022] DELETE /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:01:19.298713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8a63fcc3-34b3-4940-9454-f75a1a7100b7 req-6b3f54d1-1fa9-4ca4-b70f-ce2af6b8cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a9c185-9fe8-40b1-a94a-230a3180363a", "name": "network-vif-unplugged", "status": "completed", "tag": "1f688bff-2c2a-4b20-b461-6ff73ed49af6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:19.346104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8a63fcc3-34b3-4940-9454-f75a1a7100b7 req-6b3f54d1-1fa9-4ca4-b70f-ce2af6b8cd92 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:19.348381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8a63fcc3-34b3-4940-9454-f75a1a7100b7 req-6b3f54d1-1fa9-4ca4-b70f-ce2af6b8cd92 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:19.350782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8a63fcc3-34b3-4940-9454-f75a1a7100b7 req-6b3f54d1-1fa9-4ca4-b70f-ce2af6b8cd92 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:19.393724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=7 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:19.404948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8a63fcc3-34b3-4940-9454-f75a1a7100b7 req-6b3f54d1-1fa9-4ca4-b70f-ce2af6b8cd92 service nova] Creating event network-vif-unplugged:1f688bff-2c2a-4b20-b461-6ff73ed49af6 for instance a5a9c185-9fe8-40b1-a94a-230a3180363a on n-h2-858129-2 Sep 16 14:01:19.423717 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8a63fcc3-34b3-4940-9454-f75a1a7100b7 req-6b3f54d1-1fa9-4ca4-b70f-ce2af6b8cd92 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152112 Sep 16 14:01:19.431377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 981/1964] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:19.460091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:19.464463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:19.489309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:19.492177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:19.495986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:19.500664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:19.507239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:19.508715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:20.111325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:20.139122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:20.147306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:20.171932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4402ae6e-3d78-4f34-ac1a-5a311cd6195e tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.738348 Sep 16 14:01:20.202171 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 982/1965] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:19 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:20.214182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:20.221075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:20.231754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:20.238959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:20.239638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:20.240786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:20.241480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:20.242148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:20.314798 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1146fcd-16f0-4cbb-9544-6d3cefc321de tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.873769 Sep 16 14:01:20.319845 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 984/1966] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:01:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:20.325218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-121528f9-98c0-48d6-a5cb-4243750a8451 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '.version_select at 0x7f72517cc550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:20.336865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121528f9-98c0-48d6-a5cb-4243750a8451 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:20.338266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121528f9-98c0-48d6-a5cb-4243750a8451 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:20.338995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-121528f9-98c0-48d6-a5cb-4243750a8451 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:20.364477 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-121528f9-98c0-48d6-a5cb-4243750a8451 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.037879 Sep 16 14:01:20.366733 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 985/1967] 10.222.0.60 () {60 vars in 1184 bytes} [Fri Sep 16 14:01:20 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:20.372803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-120792065", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:20.950524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:21.049940 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de93376e-8f19-4b26-bf21-971e2009f5a0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 1466 microversion: 2.1 time: 0.835051 Sep 16 14:01:21.055952 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 983/1968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:20 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 1466 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:21.110457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62fabe2b-1939-44b4-897a-d1bd1e353bc0 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Action: 'create', calling method: .version_select at 0x7f724d23bb80>, body: {"pool": null} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:22.778711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] validate_networks() for [('b8ddb65a-0c29-46ee-ae03-b6ee9d8220aa', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:01:25.223724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:01:25.263314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:01:25.274962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:01:25.276382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:01:25.280506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:01:25.385857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:25.394565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:25.398601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:25.403470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:25.419156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:25.428452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:25.538461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:25.573568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Getting quotas for user f410179d3cca47dbb7ea031494bd1b07 and project 2a2baefe708641e7bdb8239812b2ac9b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:25.650354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:01:25.657463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:01:26.021746 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4412d482-376b-401c-9f06-fc84b6f2407b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.651980 Sep 16 14:01:26.029621 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 986/1969] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 5661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:01:26.050182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:26.063031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:26.098704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:26.104156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:26.105395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:26.110435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:26.112945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:26.115661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:28.007999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid 1a45620b-7d81-415b-8d59-3cda88cd19b5 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:01:28.086190 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8186c49a-c645-427c-b3cc-a960224e94e2 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 2420 microversion: 2.25 time: 2.052498 Sep 16 14:01:28.097711 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 987/1970] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:26 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 2420 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:28.115013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-18979907"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:28.125109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:28.142813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:28.143371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:28.145979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:28.150272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:28.151308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:28.153340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:28.692109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:28.812793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62fabe2b-1939-44b4-897a-d1bd1e353bc0 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.755561 Sep 16 14:01:28.814261 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 984/1971] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:01:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:28.828850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:28.831100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:28.831894 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-265b7255-6e98-4f4e-9fdd-3ba8ed24c11b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "POST /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f/action" status: 202 len: 0 microversion: 2.1 time: 0.729222 Sep 16 14:01:28.835149 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 988/1972] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:01:28 2022] POST /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:01:28.857266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:28.858686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:28.861748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:28.864356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:28.867201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:28.870382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:29.065168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:29.077768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:29.079885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:29.087812 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af531ade-8bc6-40e9-9485-70f3b8e4bc02 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1553 microversion: 2.91 time: 0.272037 Sep 16 14:01:29.096132 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 985/1973] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:28 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:29.110508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-463424070", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "20b7307f-2026-484c-a30d-3a1ae1623b62"}, {"port": "62052e73-99d2-4387-aedc-43a848392aa4", "tag": "port-1"}, {"port": "f0960c66-20d0-48d3-ab48-6129bb80f786", "tag": "port-2"}, {"uuid": "a5f7ba06-632a-4b04-9eac-c193f89295bf", "tag": "net-1"}, {"uuid": "a5f7ba06-632a-4b04-9eac-c193f89295bf"}, {"uuid": "48fbb909-48a2-4eb2-9cf8-3775083444fd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "48fbb909-48a2-4eb2-9cf8-3775083444fd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e8f1e7a2-6208-4519-8bf5-25d8f838a8e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "844883fb-0a4f-4edb-b03f-4a4af22dce48", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1be12c05-cf57-4be0-a238-92ab50503cc7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2072311360"}], "key_name": "tempest-keypair-1624999119", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:29.380590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] validate_networks() for [('20b7307f-2026-484c-a30d-3a1ae1623b62', None, None, None, None, None), (None, None, '62052e73-99d2-4387-aedc-43a848392aa4', None, None, None), (None, None, 'f0960c66-20d0-48d3-ab48-6129bb80f786', None, None, None), ('a5f7ba06-632a-4b04-9eac-c193f89295bf', None, None, None, None, None), ('a5f7ba06-632a-4b04-9eac-c193f89295bf', None, None, None, None, None), ('48fbb909-48a2-4eb2-9cf8-3775083444fd', '10.2.2.100', None, None, None, None), ('48fbb909-48a2-4eb2-9cf8-3775083444fd', '10.2.2.200', None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:01:29.494790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1484957978", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "3dbe5db3-b47d-45db-ba89-14e610fb29f3"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:29.686898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] validate_networks() for [('3dbe5db3-b47d-45db-ba89-14e610fb29f3', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:01:31.282275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:01:31.283552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:01:31.284449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:01:31.285334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:01:31.286121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:01:31.349723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:31.354764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:31.356082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:31.357144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:31.357840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:31.361427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:31.392790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:31.457484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Getting quotas for project 48b4ca9353de4d098fbdaf1f17eabaf2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:31.488048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Getting quotas for user e2c36218bbfe443c81bf925b19660080 and project 48b4ca9353de4d098fbdaf1f17eabaf2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:31.554705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:01:31.557721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:01:31.680999 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd728ac9-6102-4520-b43a-138b73ff8269 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.844043 Sep 16 14:01:31.683776 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 989/1974] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:01:31.701848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:31.708165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:31.733528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:31.734363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:31.735054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:31.739645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:31.740435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:31.741124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:31.965364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:31.977855 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8e8ed6b7-8e09-43ba-9011-546bb227fda6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1265 microversion: 2.1 time: 0.290102 Sep 16 14:01:32.000744 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 990/1975] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:31 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:32.024667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4bcd3b69-29f6-4acb-b009-d73016c1295b req-4f8b0d18-7b14-48e1-bf77-769378d90526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a9c185-9fe8-40b1-a94a-230a3180363a", "name": "network-vif-deleted", "tag": "1f688bff-2c2a-4b20-b461-6ff73ed49af6"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:32.082371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4bcd3b69-29f6-4acb-b009-d73016c1295b req-4f8b0d18-7b14-48e1-bf77-769378d90526 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:32.091896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4bcd3b69-29f6-4acb-b009-d73016c1295b req-4f8b0d18-7b14-48e1-bf77-769378d90526 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:32.093159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4bcd3b69-29f6-4acb-b009-d73016c1295b req-4f8b0d18-7b14-48e1-bf77-769378d90526 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:32.169539 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4bcd3b69-29f6-4acb-b009-d73016c1295b req-4f8b0d18-7b14-48e1-bf77-769378d90526 service nova] Creating event network-vif-deleted:1f688bff-2c2a-4b20-b461-6ff73ed49af6 for instance a5a9c185-9fe8-40b1-a94a-230a3180363a on n-h2-858129-2 Sep 16 14:01:32.198284 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4bcd3b69-29f6-4acb-b009-d73016c1295b req-4f8b0d18-7b14-48e1-bf77-769378d90526 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196165 Sep 16 14:01:32.207815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 991/1976] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:32.234306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:32.247829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:32.284690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:32.285404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:32.285863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:32.303029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:32.306710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:32.307721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:32.828261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid 1a45620b-7d81-415b-8d59-3cda88cd19b5 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:01:32.884513 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd2f3920-a66d-4e1b-b460-2567f1af0f2c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 2420 microversion: 2.25 time: 0.675066 Sep 16 14:01:32.887599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 992/1977] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:32 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 2420 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:32.910222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb9092cd-aa1c-40fe-bb1a-647ed96496ba tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Action: 'create', calling method: .version_select at 0x7f72517dcb80>, body: {"pool": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:38.966022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb9092cd-aa1c-40fe-bb1a-647ed96496ba tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.073785 Sep 16 14:01:38.967723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 993/1978] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:01:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:38.981342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7545ffb1-2d8c-49c7-a10e-cbe976fbb2d4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517a8e50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:39.071917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:39.133402 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7545ffb1-2d8c-49c7-a10e-cbe976fbb2d4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 200 len: 1453 microversion: 2.1 time: 0.156478 Sep 16 14:01:39.135131 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 994/1979] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:01:38 2022] GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:39.140621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:39.141718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:39.150391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:39.151451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:39.152167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:39.153345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:39.154030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:39.154685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:39.401498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:39.439967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:39.444735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:39.454533 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00ce8bb2-4971-4a6c-8fd6-6b997130255d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1535 microversion: 2.91 time: 0.317162 Sep 16 14:01:39.455911 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 995/1980] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:39 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1535 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:39.467816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1192375326", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "3dbe5db3-b47d-45db-ba89-14e610fb29f3"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:39.638235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] validate_networks() for [('3dbe5db3-b47d-45db-ba89-14e610fb29f3', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:01:41.321601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:01:41.322469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:01:41.323485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:01:41.323908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:01:41.324332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:01:41.327205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:41.388882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:41.389468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:41.389920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:41.390793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:41.391267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:41.391696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:41.394151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:41.505120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Getting quotas for project 289bec6033074acb97a59abc8bd0ee1d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:41.521136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:41.531909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Getting quotas for user 7495b1a889034a07a4b40f871ddc701f and project 289bec6033074acb97a59abc8bd0ee1d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:41.625737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:01:41.626555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:01:41.627512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:01:41.628237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:01:41.631170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:01:41.673865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:41.675265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:41.677226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:41.678987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:41.680352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:41.681520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:41.749107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Getting quotas for project 48b4ca9353de4d098fbdaf1f17eabaf2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:41.770214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Getting quotas for user e2c36218bbfe443c81bf925b19660080 and project 48b4ca9353de4d098fbdaf1f17eabaf2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:41.821299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:01:41.830200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:01:42.020769 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc990aac-cdbf-4ed5-bc19-52ae7b96929b tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.560767 Sep 16 14:01:42.034184 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 996/1981] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:01:42.046293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:42.046939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:42.067190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:42.070234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:42.070695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:42.071442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:42.075707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:01:42.081374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:42.081797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:42.084683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e8f1e7a2-6208-4519-8bf5-25d8f838a8e7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='844883fb-0a4f-4edb-b03f-4a4af22dce48',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1be12c05-cf57-4be0-a238-92ab50503cc7',volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:01:42.608727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:42.621688 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73e4b22e-88b4-4d42-b862-df458cecdbc7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1307 microversion: 2.1 time: 0.586229 Sep 16 14:01:42.634210 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 997/1982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:42 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:42.649189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:42.664466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:42.685295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:42.685855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:42.686456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:42.687250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:42.687773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:42.688121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:43.154186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lazy-loading 'services' on Instance uuid 1a45620b-7d81-415b-8d59-3cda88cd19b5 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:01:43.444687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a638174-3b1f-4201-b9ef-6f245bf9e0fd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 14.346008 Sep 16 14:01:43.449501 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 986/1983] 10.222.0.60 () {62 vars in 1189 bytes} [Fri Sep 16 14:01:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 14352 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:01:43.476315 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5529ee24-fe1c-4eaa-8a1b-b393c280576d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments/e990daeb-a942-429f-8f31-7b057fa32453" status: 202 len: 0 microversion: 2.25 time: 0.833426 Sep 16 14:01:43.480533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3bc11b08-2606-483f-b967-a00014fa1311 req-87bea288-dc83-4af5-9e72-f7ebb58ad360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bca62c0-e918-42bb-a2b2-66a5c8e8290b", "tag": "6b9d400c-8fa8-46d5-b90b-44d14f96dcf8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:43.481136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 998/1984] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Sep 16 14:01:42 2022] DELETE /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments/e990daeb-a942-429f-8f31-7b057fa32453 => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:01:43.487216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c861cbfb-2fce-49ce-9269-a38a752d6620 req-5b9d3d6c-3a83-4f70-914c-630c42147e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "name": "network-vif-plugged", "status": "completed", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:43.509360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3bc11b08-2606-483f-b967-a00014fa1311 req-87bea288-dc83-4af5-9e72-f7ebb58ad360 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:43.512462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3bc11b08-2606-483f-b967-a00014fa1311 req-87bea288-dc83-4af5-9e72-f7ebb58ad360 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:43.513237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3bc11b08-2606-483f-b967-a00014fa1311 req-87bea288-dc83-4af5-9e72-f7ebb58ad360 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:43.521451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c861cbfb-2fce-49ce-9269-a38a752d6620 req-5b9d3d6c-3a83-4f70-914c-630c42147e22 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:43.522443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c861cbfb-2fce-49ce-9269-a38a752d6620 req-5b9d3d6c-3a83-4f70-914c-630c42147e22 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:43.523076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c861cbfb-2fce-49ce-9269-a38a752d6620 req-5b9d3d6c-3a83-4f70-914c-630c42147e22 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:43.537029 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3bc11b08-2606-483f-b967-a00014fa1311 req-87bea288-dc83-4af5-9e72-f7ebb58ad360 service nova] Creating event network-changed:6b9d400c-8fa8-46d5-b90b-44d14f96dcf8 for instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b on n-h1-858129-2 Sep 16 14:01:43.545353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c861cbfb-2fce-49ce-9269-a38a752d6620 req-5b9d3d6c-3a83-4f70-914c-630c42147e22 service nova] Creating event network-vif-plugged:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:01:43.554993 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3bc11b08-2606-483f-b967-a00014fa1311 req-87bea288-dc83-4af5-9e72-f7ebb58ad360 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104102 Sep 16 14:01:43.570876 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 987/1985] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:43.576646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30b63e21-35c8-4b32-8280-a87fb32dcafd tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f724ce5bdc0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:43.580223 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c861cbfb-2fce-49ce-9269-a38a752d6620 req-5b9d3d6c-3a83-4f70-914c-630c42147e22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097198 Sep 16 14:01:43.580841 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 999/1986] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:43.596580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b655aaf7-b0c0-4df5-891c-7947307ec500 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517dc670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:44.534944 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30b63e21-35c8-4b32-8280-a87fb32dcafd tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/2246aa93-46ea-442b-b880-909cdd611d99" status: 200 len: 141 microversion: 2.1 time: 0.962072 Sep 16 14:01:44.544961 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 988/1987] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:01:43 2022] GET /compute/v2.1/os-floating-ips/2246aa93-46ea-442b-b880-909cdd611d99 => generated 141 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:44.550927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:44.555928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:44.570882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:44.575462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:44.576525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:44.577746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:44.578572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:44.586117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:44.692556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:44.703121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:44.705056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:44.716963 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5227f938-c88f-4639-9926-7bd5549ccb5f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1478 microversion: 2.91 time: 0.170593 Sep 16 14:01:44.718341 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 989/1988] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:44 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:44.728210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1058822779", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "451", "networks": [{"uuid": "3dbe5db3-b47d-45db-ba89-14e610fb29f3"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:51.444810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:51.560992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:51.703577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:51.804333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:53.520677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:53.534730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:54.701437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:54.759125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:01:55.735737 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b655aaf7-b0c0-4df5-891c-7947307ec500 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 200 len: 1453 microversion: 2.1 time: 12.152370 Sep 16 14:01:55.736380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1000/1989] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:01:43 2022] GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 1453 bytes in 12155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:55.771066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-985e0d04-8676-4451-b0bf-3da49978685d req-b5215892-b99d-4c8d-8b13-7793f2f705f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48160e8-3b83-40a4-a130-e12551287121", "tag": "54ab302d-7b0c-498b-abfb-42777277e48a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:55.789945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] validate_networks() for [('3dbe5db3-b47d-45db-ba89-14e610fb29f3', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:01:55.817775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-985e0d04-8676-4451-b0bf-3da49978685d req-b5215892-b99d-4c8d-8b13-7793f2f705f6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:55.818800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-985e0d04-8676-4451-b0bf-3da49978685d req-b5215892-b99d-4c8d-8b13-7793f2f705f6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:55.819690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-985e0d04-8676-4451-b0bf-3da49978685d req-b5215892-b99d-4c8d-8b13-7793f2f705f6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:55.846180 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-985e0d04-8676-4451-b0bf-3da49978685d req-b5215892-b99d-4c8d-8b13-7793f2f705f6 service nova] Creating event network-changed:54ab302d-7b0c-498b-abfb-42777277e48a for instance f48160e8-3b83-40a4-a130-e12551287121 on n-h2-858129-2 Sep 16 14:01:55.938476 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-985e0d04-8676-4451-b0bf-3da49978685d req-b5215892-b99d-4c8d-8b13-7793f2f705f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187471 Sep 16 14:01:55.940020 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1001/1990] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:55.954253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:55.955578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:55.970014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:55.971580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:55.972746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:55.974377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:55.975842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:55.976918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:57.089249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:57.130315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:57.137930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:57.139819 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e38d2c2-766b-40b8-8c2f-128ef70ae9b4 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1755 microversion: 2.32 time: 1.196825 Sep 16 14:01:57.141402 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1002/1991] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:55 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1755 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:01:57.148399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:57.152081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:57.160729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:57.161672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:57.162388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:57.163590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:57.164315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:57.165030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:57.209765 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a0846b0-551e-4119-aada-e8f8fc0b681f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065608 Sep 16 14:01:57.210357 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1003/1992] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:01:57 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:01:57.233301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:57.249469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:57.273157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:57.273950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:57.274628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:57.276096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:57.276745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:57.277366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:57.920410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:01:57.942087 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7c376fc-8f53-44cc-b370-997d387c3127 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1307 microversion: 2.1 time: 0.725302 Sep 16 14:01:57.944873 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1004/1993] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:01:57 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1307 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:57.950074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-946db207-348d-4bd0-a8a7-853c92425f46 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f724cf07d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:58.104591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:01:58.107381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:01:58.108404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:01:58.109088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:01:58.109849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:01:58.124344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:58.127240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:58.129925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:58.130998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:58.133154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:58.139055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:58.169580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Getting quotas for project 48b4ca9353de4d098fbdaf1f17eabaf2. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:58.178341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Getting quotas for user e2c36218bbfe443c81bf925b19660080 and project 48b4ca9353de4d098fbdaf1f17eabaf2. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:58.202370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:01:58.205891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:01:58.283874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-141df4ae-5f52-4f2d-8353-b4e6e7ee56e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.564099 Sep 16 14:01:58.287774 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 990/1994] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 13568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:01:58.302903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:58.317180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:58.325297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:58.326055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:58.327017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:58.328992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:58.329792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:58.330641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:58.418176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858129-2". {{(pid=128642) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 14:01:58.688699 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd1705ef-93b8-4210-9b9c-e47d9df87d9f tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action" status: 202 len: 0 microversion: 2.91 time: 0.399045 Sep 16 14:01:58.693550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 991/1995] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:01:58 2022] POST /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:01:58.709797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8924fb8e-3ef6-473f-ae30-d874c8643b1d req-7457618e-369a-4524-b26f-570a8c8a193d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bca62c0-e918-42bb-a2b2-66a5c8e8290b", "name": "network-vif-plugged", "status": "completed", "tag": "6b9d400c-8fa8-46d5-b90b-44d14f96dcf8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:58.748614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8924fb8e-3ef6-473f-ae30-d874c8643b1d req-7457618e-369a-4524-b26f-570a8c8a193d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:58.749415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8924fb8e-3ef6-473f-ae30-d874c8643b1d req-7457618e-369a-4524-b26f-570a8c8a193d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:58.750630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8924fb8e-3ef6-473f-ae30-d874c8643b1d req-7457618e-369a-4524-b26f-570a8c8a193d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:58.770501 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8924fb8e-3ef6-473f-ae30-d874c8643b1d req-7457618e-369a-4524-b26f-570a8c8a193d service nova] Creating event network-vif-plugged:6b9d400c-8fa8-46d5-b90b-44d14f96dcf8 for instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b on n-h1-858129-2 Sep 16 14:01:58.788614 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8924fb8e-3ef6-473f-ae30-d874c8643b1d req-7457618e-369a-4524-b26f-570a8c8a193d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090387 Sep 16 14:01:58.790167 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 992/1996] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:59.083152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f74b7cf-7aee-4f4a-a520-09fbc643819b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Action: 'create', calling method: .version_select at 0x7f724ce63f70>, body: {"keypair": {"name": "tempest-keypair-415261458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2NROpyj+Y6HRnopjgAu3jtcGhIzKV9EnvzR3EdlmHOK4Sb+DrBBwvbsaDBVmOZaN+sc73dgZN/fzgiywdzpvQmPtwPsnvV3bdL53rsFeRSBUsvJfhk6+E39q1cHvPyFQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:59.162263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8f74b7cf-7aee-4f4a-a520-09fbc643819b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Getting quotas for project b0f0b7f48f3e4a24866ea77a8336f662. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:01:59.184475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8f74b7cf-7aee-4f4a-a520-09fbc643819b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Getting quotas for user bf933142c4e74dea8707a0c0d8a53b1b and project b0f0b7f48f3e4a24866ea77a8336f662. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:01:59.235505 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f74b7cf-7aee-4f4a-a520-09fbc643819b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.442002 Sep 16 14:01:59.237652 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 993/1997] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:01:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:59.248350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f038195d-0624-41ad-95d5-8abe593c4122 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d271550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:59.464623 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f038195d-0624-41ad-95d5-8abe593c4122 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 200 len: 1453 microversion: 2.1 time: 0.220666 Sep 16 14:01:59.480944 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 994/1998] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:01:59 2022] GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:01:59.484611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8b90b39d-7407-4c2e-b8e1-398df96f14fd req-d630cc87-a1de-4aca-834a-6e96b004544b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec4dbfbe-4d92-4774-b14c-1e9f69d751c4", "tag": "b90e61ea-d969-4a78-884d-96971db1795e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:01:59.509432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b90b39d-7407-4c2e-b8e1-398df96f14fd req-d630cc87-a1de-4aca-834a-6e96b004544b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:59.510957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b90b39d-7407-4c2e-b8e1-398df96f14fd req-d630cc87-a1de-4aca-834a-6e96b004544b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:59.511843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b90b39d-7407-4c2e-b8e1-398df96f14fd req-d630cc87-a1de-4aca-834a-6e96b004544b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:59.541325 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8b90b39d-7407-4c2e-b8e1-398df96f14fd req-d630cc87-a1de-4aca-834a-6e96b004544b service nova] Creating event network-changed:b90e61ea-d969-4a78-884d-96971db1795e for instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 on n-h1-858129-2 Sep 16 14:01:59.575075 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8b90b39d-7407-4c2e-b8e1-398df96f14fd req-d630cc87-a1de-4aca-834a-6e96b004544b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100448 Sep 16 14:01:59.579546 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 995/1999] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:01:59.617068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:01:59.620662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:01:59.644735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:59.647095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:59.649758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:01:59.666932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:01:59.669229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:01:59.669229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:00.971067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:00.990486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:01.002570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:01.005701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ba30713-8380-4e24-81a8-9c74684df0b6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1755 microversion: 2.32 time: 1.421308 Sep 16 14:02:01.030234 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 996/2000] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:01:59 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1755 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:01.044500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:01.065206 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-946db207-348d-4bd0-a8a7-853c92425f46 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/2246aa93-46ea-442b-b880-909cdd611d99" status: 202 len: 0 microversion: 2.1 time: 3.118365 Sep 16 14:02:01.070498 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1005/2001] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:01:57 2022] DELETE /compute/v2.1/os-floating-ips/2246aa93-46ea-442b-b880-909cdd611d99 => generated 0 bytes in 3123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:02:01.080342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:01.097718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:01.099829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.104616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.106876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.108036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.111150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.111882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.115086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:01.148372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.154539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.158086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.163464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.167987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.172494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.197835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a838989-e315-4cef-80b1-30e624f84325 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.165432 Sep 16 14:02:01.199010 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 997/2002] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:02:01 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:01.227281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:01.230458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:01.270238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.270789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.271251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.272008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.272484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.272923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.604005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:01.628910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:01.641128 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-236c9525-faa8-4e0d-b6ec-b446b2c4052d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1273 microversion: 2.1 time: 0.569604 Sep 16 14:02:01.650695 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1006/2003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:01 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1273 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:01.680027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:01.681854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:01.685484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:01.690020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:01.716694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5d4ff08-542f-4c6a-be28-b751f68c04d9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1486 microversion: 2.91 time: 0.515748 Sep 16 14:02:01.717756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 998/2004] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:01 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1486 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:01.727925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.727925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.727925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.727925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:01.728998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:01.728998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:01.748752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e74265d-b69b-43c3-80ce-83dd45002dc5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d711ca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:01.964407 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e74265d-b69b-43c3-80ce-83dd45002dc5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 200 len: 1453 microversion: 2.1 time: 0.231177 Sep 16 14:02:01.965466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 999/2005] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:01 2022] GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 1453 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:01.989133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48160e8-3b83-40a4-a130-e12551287121", "name": "network-vif-plugged", "status": "completed", "tag": "54ab302d-7b0c-498b-abfb-42777277e48a"}, {"server_uuid": "ec4dbfbe-4d92-4774-b14c-1e9f69d751c4", "name": "network-vif-plugged", "status": "completed", "tag": "b90e61ea-d969-4a78-884d-96971db1795e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:02.030996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:02.031665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:02.032304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:02.082497 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] Creating event network-vif-plugged:54ab302d-7b0c-498b-abfb-42777277e48a for instance f48160e8-3b83-40a4-a130-e12551287121 on n-h2-858129-2 Sep 16 14:02:02.083221 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] Creating event network-vif-plugged:b90e61ea-d969-4a78-884d-96971db1795e for instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 on n-h1-858129-2 Sep 16 14:02:02.122026 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5085e864-6292-4d78-8147-94b1c5289c06 req-bfbcc2fd-1a90-4857-afeb-daa052162474 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.153381 Sep 16 14:02:02.129640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1000/2006] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:02.137790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21d225d9-4622-4905-83ea-1e65146d3ea9 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f725184db80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:02.490623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:02.504236 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f70378b-2316-4ff9-b4c3-25376bd9480f tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1307 microversion: 2.1 time: 0.851559 Sep 16 14:02:02.507957 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1007/2007] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:01 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1307 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:02.550490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:02.554738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:02.584363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:02.590875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:02.592914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:02.596899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:02.601474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:02.605033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:03.269603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21d225d9-4622-4905-83ea-1e65146d3ea9 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.138500 Sep 16 14:02:03.276769 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1001/2008] 10.222.0.60 () {58 vars in 1164 bytes} [Fri Sep 16 14:02:02 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:02:03.283081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:03.284285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:03.298610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:03.303333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:03.304186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:03.305185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:03.308008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:03.308700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:04.367764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.392401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.394285 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-588c9981-7ae7-4b14-af42-90f1fe63c193 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1279 microversion: 2.1 time: 1.115621 Sep 16 14:02:04.408203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.412979 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1002/2009] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:03 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1279 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:04.415380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.417050 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7bee49ca-4e02-438d-ad18-e32c11ece76e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1802 microversion: 2.32 time: 1.887011 Sep 16 14:02:04.419112 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1008/2010] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:02 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1802 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:04.432182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15564299-d492-4754-899e-f97d61d16214 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517cc3a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:04.472478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:04.479491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:04.509011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:04.509878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:04.517332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:04.521926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:04.522842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:04.523512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:04.838464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.865613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.867812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:04.892781 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42c5fd9e-c002-43d4-be5f-8e105f9817e4 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.468737 Sep 16 14:02:04.898393 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1003/2011] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:04 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:04.904259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7b26f58-4c86-471e-903b-bc64bcf92c55 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f7251832c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:05.894264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7b26f58-4c86-471e-903b-bc64bcf92c55 tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.994297 Sep 16 14:02:05.895850 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1004/2012] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 14:02:04 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:05.902649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:05.904640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:05.927035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:05.928032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:05.928832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:05.934790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:05.935654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:05.936461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:06.737386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:06.778372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97ed2a08-cf83-4a54-b915-ceebfe3e2528 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1487 microversion: 2.1 time: 0.880294 Sep 16 14:02:06.815293 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1005/2013] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:05 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1487 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:06.857818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-10949006", "imageRef": "06870093-a850-4c06-91f7-f60bbec7f5a0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a981b211-2a67-4ebc-a87d-3ba05138017c"}], "security_groups": [{"name": "tempest-securitygroup--418745985"}], "key_name": "tempest-keypair-415261458", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:08.147235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:08.650835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15564299-d492-4754-899e-f97d61d16214 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 200 len: 1462 microversion: 2.1 time: 4.221472 Sep 16 14:02:08.652183 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1009/2014] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:04 2022] GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 1462 bytes in 4225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:08.658626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:08.667648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:08.696168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:08.697147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:08.697850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:08.698936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:08.701862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:08.702694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:09.201536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:10.086557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:10.142726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:10.156055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:10.160646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a51d1e99-dc0c-46bb-bb67-9b239dc7681f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1849 microversion: 2.32 time: 1.505588 Sep 16 14:02:10.215011 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1010/2015] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:08 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1849 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:10.253446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:10.261777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:10.311996 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:02:10.314008 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:02:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 (ip 10.222.0.60) !!! Sep 16 14:02:10.322699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:10.324362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:10.325950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:10.327976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:10.329504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:10.333548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:11.331971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:11.345426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90d00fca-8aea-48da-8e86-7e7dffd65bcb tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1321 microversion: 2.1 time: 1.128070 Sep 16 14:02:11.365175 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1011/2016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:10 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1321 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:11.374227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ebfcc32b-06dc-45f5-9944-36e66cd9b67b tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f72517eddc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:14.231727 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ebfcc32b-06dc-45f5-9944-36e66cd9b67b tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/32e46072-2f7e-4d71-9365-d618d1a02671" status: 202 len: 0 microversion: 2.1 time: 2.864309 Sep 16 14:02:14.233154 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1012/2017] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:02:11 2022] DELETE /compute/v2.1/os-floating-ips/32e46072-2f7e-4d71-9365-d618d1a02671 => generated 0 bytes in 2867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:02:14.238585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:14.239565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:14.262641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:14.267986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:14.268882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:14.270097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:14.270995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:14.271722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:14.620812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:14.634623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:14.636389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:14.651659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe9a1f72-728b-4afc-be7f-f1a495c78c2d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.416995 Sep 16 14:02:14.655703 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1013/2018] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:14 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:14.661146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-983008823"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:14.673239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:14.686194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:14.687059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:14.687716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:14.688693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:14.691176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:14.691928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:16.777145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:16.969097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:24.175193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] validate_networks() for [('a981b211-2a67-4ebc-a87d-3ba05138017c', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:02:24.297867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=63 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:24.384090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69631d29-c02b-4758-973a-4b99ef3f3df9 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "POST /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b/action" status: 202 len: 0 microversion: 2.1 time: 9.726086 Sep 16 14:02:24.386022 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1014/2019] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:02:14 2022] POST /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b/action => generated 0 bytes in 9729 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:02:24.392771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29a9afed-f7a6-4d98-bc2a-3f1febc02fdc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517ed280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:24.451906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29a9afed-f7a6-4d98-bc2a-3f1febc02fdc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 200 len: 1462 microversion: 2.1 time: 0.064370 Sep 16 14:02:24.453046 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1015/2020] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:24 2022] GET /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 1462 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:24.458941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2710c47c-cdc1-44b9-8b38-7dbab4f1c223 req-c11ecd04-6bf7-4674-9fba-667bd8b77672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "484d374c-86ba-4273-b72f-ac0fe7b5ce96"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:24.473425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=25 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:24.477981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2710c47c-cdc1-44b9-8b38-7dbab4f1c223 req-c11ecd04-6bf7-4674-9fba-667bd8b77672 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:24.478740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2710c47c-cdc1-44b9-8b38-7dbab4f1c223 req-c11ecd04-6bf7-4674-9fba-667bd8b77672 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:24.479382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2710c47c-cdc1-44b9-8b38-7dbab4f1c223 req-c11ecd04-6bf7-4674-9fba-667bd8b77672 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:24.496397 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2710c47c-cdc1-44b9-8b38-7dbab4f1c223 req-c11ecd04-6bf7-4674-9fba-667bd8b77672 service nova] Creating event network-changed:484d374c-86ba-4273-b72f-ac0fe7b5ce96 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:24.502341 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2710c47c-cdc1-44b9-8b38-7dbab4f1c223 req-c11ecd04-6bf7-4674-9fba-667bd8b77672 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047909 Sep 16 14:02:24.503699 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1016/2021] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:24.511078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:24.511964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:24.520644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:24.521638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:24.522209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:24.523189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:24.523840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:24.524436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:25.264130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:25.283317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:25.286938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:25.289686 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4ce81861-95e8-4047-8c38-fc47b2f28531 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1891 microversion: 2.32 time: 0.784232 Sep 16 14:02:25.292004 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1017/2022] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:24 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1891 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:25.302886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:25.305721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:25.318653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:25.320547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:25.322350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:25.324183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:25.325734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:25.327149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:25.776891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:02:25.781907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:02:25.782810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:25.783707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:02:25.786510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:02:25.787831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:02:25.800633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-25a12198-677e-49b3-a1bd-280b408a96d9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1321 microversion: 2.1 time: 0.506147 Sep 16 14:02:25.802010 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1018/2023] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:25 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:25.812584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-696329c3-5294-4caf-afc2-1a8a657a8b8e tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f72517fe160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:25.841421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:25.841787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:25.845695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:25.849238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:25.849748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:25.850199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:25.918536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Getting quotas for project b0f0b7f48f3e4a24866ea77a8336f662. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:02:25.938038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Getting quotas for user bf933142c4e74dea8707a0c0d8a53b1b and project b0f0b7f48f3e4a24866ea77a8336f662. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:02:25.969394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:02:25.991584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='06870093-a850-4c06-91f7-f60bbec7f5a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:02:26.136202 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b18704c-c1b2-4e63-b4c3-d341684793eb tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 19.313278 Sep 16 14:02:26.146920 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1006/2024] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:02:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 19328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:02:26.152381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:26.153323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:26.168215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:26.169016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:26.169680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:26.170803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:26.171471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:26.172165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:26.382839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:26.398128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:26.400029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:26.418229 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ffe6a4fd-1a86-4017-a943-c91ec729ec34 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.269610 Sep 16 14:02:26.438435 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1007/2025] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:26 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:26.438435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0c35a05c-c82d-425b-8dcb-f87095ed3d8e req-2379158e-5ef6-4ebb-a749-e05b5132b1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a18fbe-e35c-484f-90d2-6773e3bf3f35", "name": "network-vif-plugged", "status": "completed", "tag": "bdfedaac-ad89-4285-87be-c7fb4af9d82c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:26.454832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0c35a05c-c82d-425b-8dcb-f87095ed3d8e req-2379158e-5ef6-4ebb-a749-e05b5132b1ec service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:26.454832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0c35a05c-c82d-425b-8dcb-f87095ed3d8e req-2379158e-5ef6-4ebb-a749-e05b5132b1ec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:26.454832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0c35a05c-c82d-425b-8dcb-f87095ed3d8e req-2379158e-5ef6-4ebb-a749-e05b5132b1ec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:26.485266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0c35a05c-c82d-425b-8dcb-f87095ed3d8e req-2379158e-5ef6-4ebb-a749-e05b5132b1ec service nova] Creating event network-vif-plugged:bdfedaac-ad89-4285-87be-c7fb4af9d82c for instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 on n-h1-858129-2 Sep 16 14:02:26.493483 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0c35a05c-c82d-425b-8dcb-f87095ed3d8e req-2379158e-5ef6-4ebb-a749-e05b5132b1ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070856 Sep 16 14:02:26.494337 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1008/2026] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:26.499681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ba16a4a-d68a-4e1f-8e73-5bcdba51489c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724ceb6ca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:26.589889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ba16a4a-d68a-4e1f-8e73-5bcdba51489c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40" status: 200 len: 1413 microversion: 2.1 time: 0.092016 Sep 16 14:02:26.590589 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1009/2027] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:26 2022] GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:26.601249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:26.605700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:26.619337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:26.620009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:26.620712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:26.621780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:26.622605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:26.623308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:27.862542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:27.894140 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f803c0e-f46c-4ab2-aa91-aa2b9103bf20 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 1466 microversion: 2.1 time: 1.301722 Sep 16 14:02:27.895595 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1010/2028] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:26 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 1466 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:27.911423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:27.918824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:27.952029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:27.954842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:27.956965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:27.972898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:27.979576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:27.980033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.163006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:28.182025 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7f10156-ccce-41d9-a1fa-91c48ed88c18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1247 microversion: 2.1 time: 0.283839 Sep 16 14:02:28.183704 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1011/2029] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:27 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1247 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:28.194797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:28.196463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:28.204876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-696329c3-5294-4caf-afc2-1a8a657a8b8e tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/0d5d7f07-0ee3-4b7d-a115-e9885c60ebca" status: 202 len: 0 microversion: 2.1 time: 2.400926 Sep 16 14:02:28.205686 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1019/2030] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:02:25 2022] DELETE /compute/v2.1/os-floating-ips/0d5d7f07-0ee3-4b7d-a115-e9885c60ebca => generated 0 bytes in 2403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:02:28.210226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a18fbe-e35c-484f-90d2-6773e3bf3f35", "tag": "bdfedaac-ad89-4285-87be-c7fb4af9d82c"}, {"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "62052e73-99d2-4387-aedc-43a848392aa4"}, {"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "f0960c66-20d0-48d3-ab48-6129bb80f786"}, {"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "a0b047d1-6918-4557-a37e-fbe607080f35"}, {"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "66d9e776-025b-45b3-9ba2-ecd62c2b3ffc"}, {"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "e7bd9cbb-3d6a-4456-be7c-87dc15b9bccf"}, {"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "f958f626-5770-476e-ba66-3f86c7c6d242"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:28.211877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.212763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.213639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.215018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.215866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.216958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.254207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.255331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.256748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.282952 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:bdfedaac-ad89-4285-87be-c7fb4af9d82c for instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 on n-h1-858129-2 Sep 16 14:02:28.283468 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:62052e73-99d2-4387-aedc-43a848392aa4 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:28.283967 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:f0960c66-20d0-48d3-ab48-6129bb80f786 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:28.284687 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:a0b047d1-6918-4557-a37e-fbe607080f35 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:28.285380 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:66d9e776-025b-45b3-9ba2-ecd62c2b3ffc for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:28.286069 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:e7bd9cbb-3d6a-4456-be7c-87dc15b9bccf for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:28.286787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] Creating event network-changed:f958f626-5770-476e-ba66-3f86c7c6d242 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:02:28.313315 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f3cc8f42-d8b8-4d67-bd4a-6ed973bd92d9 req-913f6526-82f4-4bf2-9951-b7c02f05b48c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1181 microversion: 2.1 time: 0.106540 Sep 16 14:02:28.314285 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1020/2031] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 1181 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:28.320750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b41c9975-395e-4828-8051-d59119903f40 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517ede50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:28.408222 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b41c9975-395e-4828-8051-d59119903f40 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40" status: 200 len: 1413 microversion: 2.1 time: 0.092180 Sep 16 14:02:28.409958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1021/2032] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:28 2022] GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:28.417023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:28.418086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:28.438626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.443050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.443520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.444380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.444758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.445178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.809871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:28.842243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:28.852448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:28.856909 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6072ceb9-a397-4d32-9ff7-952f4a162743 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1891 microversion: 2.32 time: 0.671153 Sep 16 14:02:28.863642 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1012/2033] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:28 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1891 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:28.881140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:28.886822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:28.912307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.913590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.920729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:28.922470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:28.923518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:28.924475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:29.127402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:29.160164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:29.163552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:29.184178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:29.184475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f6eec3d-d4f5-468b-8bb5-8f63701e087f tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.317245 Sep 16 14:02:29.212850 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1013/2034] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:28 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:29.225488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05699a7d-6098-4c9f-8820-a304309bdad8 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1321 microversion: 2.1 time: 0.812473 Sep 16 14:02:29.233497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1581284395"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:29.235258 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1022/2035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:28 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1321 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:29.242622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:29.250820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad3698a3-030a-4bf4-bfb1-4f819037717a tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] Calling method '.version_select at 0x7f72517fe5e0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:29.263496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:29.264791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:29.265892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:29.267726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:29.268901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:29.269992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:29.897974 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-35d2e333-e49a-4d9b-b893-c7121eab9c82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "POST /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c/action" status: 202 len: 0 microversion: 2.1 time: 0.675285 Sep 16 14:02:29.899805 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1014/2036] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:02:29 2022] POST /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:02:29.906805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45e7f294-fb60-48a9-87b1-f11baf931254 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724ce3a790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:30.299101 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45e7f294-fb60-48a9-87b1-f11baf931254 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40" status: 204 len: 0 microversion: 2.1 time: 0.397477 Sep 16 14:02:30.304359 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1015/2037] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:29 2022] DELETE /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:02:30.313736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:30.318637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:30.330060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:30.331054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:30.331910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:30.332971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:30.334532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:30.335269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:30.429409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:30.440912 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9e86fe6-387b-4c73-8716-2d7c40933813 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1295 microversion: 2.1 time: 0.134143 Sep 16 14:02:30.441813 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1016/2038] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:30 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1295 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:30.451895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2df0ff93-7c23-405f-8458-c5b9154fca00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d6fe040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:30.518768 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2df0ff93-7c23-405f-8458-c5b9154fca00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.072898 Sep 16 14:02:30.520014 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1017/2039] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:30 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:30.527084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:30.528962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:30.542147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:30.543096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:30.544413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:30.546242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:30.546870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:30.547345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:30.963057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:30.975092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:30.976705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:30.978015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69747cd6-57f5-4cdf-9864-c562564ba56f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1891 microversion: 2.32 time: 0.456745 Sep 16 14:02:30.979276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1018/2040] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:30 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1891 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:30.984743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:30.985672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:30.993653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:30.994964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:30.995693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:30.996722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:30.997375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:30.997967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.137754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:31.166778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:31.174807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:31.196347 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08d7a0d4-7265-483b-9294-ca825fdbb38a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.215146 Sep 16 14:02:31.197359 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1019/2041] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:30 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:31.223606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:31.225055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:31.242122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.256362 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad3698a3-030a-4bf4-bfb1-4f819037717a tempest-FloatingIPDetailsTestJSON-481995482 tempest-FloatingIPDetailsTestJSON-481995482-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/87cb7808-fefc-46eb-b344-ae2c0d712ab0" status: 202 len: 0 microversion: 2.1 time: 2.018758 Sep 16 14:02:31.256962 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1023/2042] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:02:29 2022] DELETE /compute/v2.1/os-floating-ips/87cb7808-fefc-46eb-b344-ae2c0d712ab0 => generated 0 bytes in 2020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:02:31.259109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.259935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.261439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.262369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.263148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.266350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8440767-154d-4c2b-a3ca-ce8228a2a561 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724cf59ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:31.304536 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d8440767-154d-4c2b-a3ca-ce8228a2a561 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Image not found. Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8440767-154d-4c2b-a3ca-ce8228a2a561 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 HTTP/1.1 Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:02:31.348891 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'da041340-9ccf-4490-abeb-4059c474aa40'} Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:02:31.351008 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da041340-9ccf-4490-abeb-4059c474aa40 Sep 16 14:02:31.352879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:02:31.354658 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da041340-9ccf-4490-abeb-4059c474aa40 could not be found. Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:02:31.356304 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:02:31.357948 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:31.362471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8440767-154d-4c2b-a3ca-ce8228a2a561 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:02:31.362471 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d8440767-154d-4c2b-a3ca-ce8228a2a561 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40" status: 404 len: 62 microversion: 2.1 time: 0.098766 Sep 16 14:02:31.369146 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1024/2043] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:31 2022] GET /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:02:31.384749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-072f3740-34a4-4b7a-9456-0949a4931297 req-924366de-138f-434b-b238-bce3f25c224b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "name": "network-vif-unplugged", "status": "completed", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:31.404606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-072f3740-34a4-4b7a-9456-0949a4931297 req-924366de-138f-434b-b238-bce3f25c224b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.406088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-072f3740-34a4-4b7a-9456-0949a4931297 req-924366de-138f-434b-b238-bce3f25c224b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.407367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-072f3740-34a4-4b7a-9456-0949a4931297 req-924366de-138f-434b-b238-bce3f25c224b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.429885 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-072f3740-34a4-4b7a-9456-0949a4931297 req-924366de-138f-434b-b238-bce3f25c224b service nova] Creating event network-vif-unplugged:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:02:31.444008 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-072f3740-34a4-4b7a-9456-0949a4931297 req-924366de-138f-434b-b238-bce3f25c224b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070011 Sep 16 14:02:31.445873 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1025/2044] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:31.463373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:31.465337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:31.479726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.481135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.482823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.484666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.486000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.487218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.599290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:31.612170 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18cdd47e-0637-4f1e-b766-8d31884e43f5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1321 microversion: 2.1 time: 0.404159 Sep 16 14:02:31.627205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1020/2045] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:31 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:31.639613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:31.640671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:31.649137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.649791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.650296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.651151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:31.651687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:31.652197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:31.752766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:31.766596 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c13912cf-6411-42bf-945c-f5f128002fcd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1295 microversion: 2.1 time: 0.137150 Sep 16 14:02:31.776057 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1021/2046] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:31 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1295 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:31.787714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:31.794445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59cbe182-42bc-465f-afdc-daab45bdf2d7 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce3a160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:31.797676 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e2c8046-c02c-43de-b2d1-7e3f41b58fbc tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1499 microversion: 2.1 time: 0.347080 Sep 16 14:02:31.798281 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1026/2047] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:31 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1499 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:31.864661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59cbe182-42bc-465f-afdc-daab45bdf2d7 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.085020 Sep 16 14:02:31.865264 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1022/2048] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:31 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:32.013465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:32.015234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:32.028477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.030046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.031269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.032868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.033895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.035062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.229594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:32.230865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:32.242115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.247192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.247960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.249365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.249760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.251143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.523156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:32.532264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:32.534268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:32.541412 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40f69e4b-2619-46ae-b751-ca58cf055435 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.315721 Sep 16 14:02:32.542017 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1023/2049] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:32 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:02:32.603580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:32.621478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:32.626788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:32.628188 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b9b7bb4-c2b0-4971-81aa-0b133babe8e7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.622467 Sep 16 14:02:32.633645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1027/2050] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:32 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:02:32.647978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:32.649537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:32.661416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.664929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.665838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.666851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.671270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.672131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.804403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:32.806102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:32.824201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.825092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.825530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:32.826292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:32.826775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:32.827203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.194062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:33.219149 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97f05b84-8421-4ea8-a1da-da8c026f1b1b tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1295 microversion: 2.1 time: 0.418758 Sep 16 14:02:33.219750 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1028/2051] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:32 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1295 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:02:33.224990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:33.225717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:33.246903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:33.247491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:33.248069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.249110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:33.249763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:33.250484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.381127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:33.393889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-935089f8-f06a-4d2a-ae69-88e6bfeea02c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1321 microversion: 2.1 time: 0.756634 Sep 16 14:02:33.394529 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1024/2052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:32 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:33.410981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e46c505f-6a5a-4110-be8e-74f3d1ef183a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce52550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:33.500603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e46c505f-6a5a-4110-be8e-74f3d1ef183a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.104960 Sep 16 14:02:33.502095 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1025/2053] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:33 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:33.576361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:33.577886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:33.591561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:33.592787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:33.593851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.595180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:33.596324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:33.597396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.646148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:33.658230 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4247107-86ed-4638-ba19-4a033d972549 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1505 microversion: 2.1 time: 0.437128 Sep 16 14:02:33.678600 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1029/2054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:33 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:33.685136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:33.686191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:33.693802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:33.694745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:33.695994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.697249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:33.698165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:33.699067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:33.931862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:33.951881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:33.953429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:33.973583 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e974fb0-7c76-449b-83bd-7d0540009e1a tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1544 microversion: 2.91 time: 0.407039 Sep 16 14:02:33.974600 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1026/2055] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:33 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1544 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:02:34.158579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:34.170321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:34.172694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:34.174470 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-64ef8530-8854-4eed-84d7-b0a7155a174d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.494054 Sep 16 14:02:34.191585 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1030/2056] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:33 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:34.260906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:34.261865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:34.269922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:34.270531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:34.270987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:34.271733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:34.272420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:34.273036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:34.328600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:34.424180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:34.424810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:34.445849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:34.453586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:34.454563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:34.456451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:34.458785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:34.466660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:34.493404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:34.507878 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b772a22a-abd4-4ced-a4f4-aab76fe1459a tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1301 microversion: 2.1 time: 0.250954 Sep 16 14:02:34.508546 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1027/2057] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:34 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1301 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:02:34.533039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c187ef7-43f5-4cd1-ae84-51ca1d048187 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d078ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:34.666579 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c187ef7-43f5-4cd1-ae84-51ca1d048187 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.142710 Sep 16 14:02:34.671226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1028/2058] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:34 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:34.708676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:34.710690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:34.732086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:34.733839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:34.735185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:34.736992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:34.738842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:34.740708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:35.561445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:35.585616 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-288d6508-0b3b-458b-9f63-79415ad0439f tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1512 microversion: 2.1 time: 1.161571 Sep 16 14:02:35.587723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1031/2059] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:34 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1512 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:02:35.604356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-653d8da9-4f13-44e8-9ffd-8fbd4f10e7c1 req-dde0542f-d1e5-408c-9391-84b331f2f8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bca62c0-e918-42bb-a2b2-66a5c8e8290b", "name": "network-vif-plugged", "status": "completed", "tag": "6b9d400c-8fa8-46d5-b90b-44d14f96dcf8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:35.634868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-653d8da9-4f13-44e8-9ffd-8fbd4f10e7c1 req-dde0542f-d1e5-408c-9391-84b331f2f8c3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:35.636298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-653d8da9-4f13-44e8-9ffd-8fbd4f10e7c1 req-dde0542f-d1e5-408c-9391-84b331f2f8c3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:35.638500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-653d8da9-4f13-44e8-9ffd-8fbd4f10e7c1 req-dde0542f-d1e5-408c-9391-84b331f2f8c3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:35.680292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-653d8da9-4f13-44e8-9ffd-8fbd4f10e7c1 req-dde0542f-d1e5-408c-9391-84b331f2f8c3 service nova] Creating event network-vif-plugged:6b9d400c-8fa8-46d5-b90b-44d14f96dcf8 for instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b on n-h1-858129-2 Sep 16 14:02:35.690218 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-653d8da9-4f13-44e8-9ffd-8fbd4f10e7c1 req-dde0542f-d1e5-408c-9391-84b331f2f8c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097565 Sep 16 14:02:35.697330 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1032/2060] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:35.708173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:35.713709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:35.739494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:35.741276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:35.742874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:35.744074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:35.745295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:35.750117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:35.881613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:35.955418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:36.213773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:36.245159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:36.246931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:36.252816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:36.254301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d363d61-ea63-4ad4-a86d-f89d80bc4905 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1505 microversion: 2.1 time: 1.569588 Sep 16 14:02:36.258273 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1029/2061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:34 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1505 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:36.267329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:36.268260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:36.276544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9fe352b9-b363-44ec-86ae-2b3220b3af3c tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1531 microversion: 2.91 time: 0.576829 Sep 16 14:02:36.277565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1033/2062] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:35 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1531 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:36.286263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:36.293201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:36.293201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:36.293201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:36.293201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:36.293709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:36.324111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:36.325440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:36.361423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:36.365055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:36.366331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:36.367482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:36.367979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:36.368426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:36.532676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:36.550251 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c728edf-3705-47f5-95aa-94b71500263f tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1301 microversion: 2.1 time: 0.266844 Sep 16 14:02:36.553188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1034/2063] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:36 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1301 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:36.572348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:36.573699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:36.590998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:36.591837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:36.592634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:36.598523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:36.599905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:36.600635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:37.457526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:37.482975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:37.545760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:37.548338 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2bf3c2ed-941e-4145-a154-d9c73e515113 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1512 microversion: 2.1 time: 0.977313 Sep 16 14:02:37.549724 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1035/2064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:36 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1512 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:37.562394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:37.564815 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9231e19f-d857-4624-8a40-0542ae158f5f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.305171 Sep 16 14:02:37.576932 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1030/2065] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:36 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:37.581782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad96f852-9f7f-4015-bc87-b5f400d2fc11 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517b7790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:37.614322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:37.622791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:37.651106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:37.652509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:37.653432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:37.654945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:37.656084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:37.657211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:37.744576 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad96f852-9f7f-4015-bc87-b5f400d2fc11 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.192825 Sep 16 14:02:37.745666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1036/2066] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:37 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:37.777871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:37.785536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:37.831710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:37.838979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:37.840129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:37.841379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:37.842167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:37.848410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.008111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] Lazy-loading 'services' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:02:38.059517 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efa25e44-7e62-44f1-a3a3-20cb9cfae018 tempest-UnshelveToHostMultiNodesTest-1403714901 tempest-UnshelveToHostMultiNodesTest-1403714901-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1936 microversion: 2.91 time: 0.478818 Sep 16 14:02:38.061386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1031/2067] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:37 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1936 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:38.072334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:38.074059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:38.087014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:38.088292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:38.089343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.091087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:38.092220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:38.093334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.532308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:38.550269 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41c2a4e5-b0ec-42fc-a9eb-6c29cbaa6425 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1505 microversion: 2.1 time: 0.798908 Sep 16 14:02:38.551008 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1037/2068] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:37 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1505 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:38.586114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:38.606550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:38.652220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:38.657196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:38.657877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.659178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:38.659958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:38.664969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.679014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:38.694157 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04c936c4-ad16-4e8f-8e70-0a64822588c1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1513 microversion: 2.1 time: 0.624266 Sep 16 14:02:38.695027 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1032/2069] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:38 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1513 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:38.706261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:38.707246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:38.742952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:38.746015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:38.746759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.752459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:38.753244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:38.753950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:38.834595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:02:39.225268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:39.238739 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8e68652-7966-4c49-8ae5-59fc4de57304 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "DELETE /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 204 len: 0 microversion: 2.91 time: 0.541075 Sep 16 14:02:39.244531 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1033/2070] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:02:38 2022] DELETE /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:02:39.272768 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61498f83-b2d5-416f-ad90-a5568a1af63d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.717813 Sep 16 14:02:39.278369 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1038/2071] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:38 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:39.279025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:39.282922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:39.294461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:39.313890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:39.315074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:39.315642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:39.322376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:39.330171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:39.331536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:39.371936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:39.376415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:39.457977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:39.459564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:39.462283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:39.464495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:39.465905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:39.467141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:39.889853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:40.037295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:40.360849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:40.381246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:40.382018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:40.382522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:41.687593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:41.716076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:41.722722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:41.724684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ed486d7-3b09-438e-bf24-13cdba8ed689 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 2.443618 Sep 16 14:02:41.725527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1039/2072] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 14:02:39 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:41.731066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be0470d5-eea4-4614-ab71-14114df152b4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf8f4c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:41.738594 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9865466e-993c-4873-8d94-77abd6032071 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 2.492075 Sep 16 14:02:41.739315 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1034/2073] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:39 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:41.752686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:41.753780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:41.767965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:41.778136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:41.778859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:41.779848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:41.780518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:41.781189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:41.816024 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be0470d5-eea4-4614-ab71-14114df152b4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.089623 Sep 16 14:02:41.816965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1040/2074] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:41 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:41.822590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:41.823222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:41.834488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:41.834942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:41.835429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:41.836201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:41.837164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:41.837907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:41.936160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:41.953788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:41.956935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:41.966625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92a29b83-ca38-4d9d-bcfa-118726d4a778 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.226221 Sep 16 14:02:41.967687 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1035/2075] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:41 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:41.973847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:41.974626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:41.982751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:41.983420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:41.983876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:41.984645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:41.985313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:41.985840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.329784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:42.343609 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c2bf5a2-590b-417f-90c8-cd5de12d5d3b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1500 microversion: 2.1 time: 0.524898 Sep 16 14:02:42.344721 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1041/2076] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:41 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1500 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:42.360411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5f52c1af-d776-4bd9-a761-4d6166080307 req-a4897277-98b3-4872-913d-7b8a4857cf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077b0270-538b-4d3c-bb57-fc02f8ae640c", "name": "network-vif-plugged", "status": "completed", "tag": "699c0d76-e03c-4a5f-a650-09e078d1aa6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:42.396341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5f52c1af-d776-4bd9-a761-4d6166080307 req-a4897277-98b3-4872-913d-7b8a4857cf10 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.398692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5f52c1af-d776-4bd9-a761-4d6166080307 req-a4897277-98b3-4872-913d-7b8a4857cf10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.399451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5f52c1af-d776-4bd9-a761-4d6166080307 req-a4897277-98b3-4872-913d-7b8a4857cf10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.409788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:42.420889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5f52c1af-d776-4bd9-a761-4d6166080307 req-a4897277-98b3-4872-913d-7b8a4857cf10 service nova] Creating event network-vif-plugged:699c0d76-e03c-4a5f-a650-09e078d1aa6e for instance 077b0270-538b-4d3c-bb57-fc02f8ae640c on n-h1-858129-2 Sep 16 14:02:42.430832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5f52c1af-d776-4bd9-a761-4d6166080307 req-a4897277-98b3-4872-913d-7b8a4857cf10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082799 Sep 16 14:02:42.431889 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1042/2077] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:42.438475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab0024be-0b46-494b-9d72-0d923a2ab7e3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.469190 Sep 16 14:02:42.440166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1036/2078] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:41 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:42.463086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:42.469791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:42.471130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1484957978', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:42.478261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.479484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.480234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.481358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.482067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.482881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.598013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:42.654050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c689f841-213b-4aec-b0b2-3d02f78c8e69 req-f08c63cd-b8e3-4fb6-aaf8-137d0bc81357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a64ce67-150d-4430-805a-9cbab3489620", "tag": "018cdf29-f7de-4244-9662-c83de9039962"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:42.690677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c689f841-213b-4aec-b0b2-3d02f78c8e69 req-f08c63cd-b8e3-4fb6-aaf8-137d0bc81357 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.691791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c689f841-213b-4aec-b0b2-3d02f78c8e69 req-f08c63cd-b8e3-4fb6-aaf8-137d0bc81357 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.695686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c689f841-213b-4aec-b0b2-3d02f78c8e69 req-f08c63cd-b8e3-4fb6-aaf8-137d0bc81357 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.711701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:42.727859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.728530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.729183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.748336 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c689f841-213b-4aec-b0b2-3d02f78c8e69 req-f08c63cd-b8e3-4fb6-aaf8-137d0bc81357 service nova] Creating event network-changed:018cdf29-f7de-4244-9662-c83de9039962 for instance 2a64ce67-150d-4430-805a-9cbab3489620 on n-h1-858129-2 Sep 16 14:02:42.767884 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c689f841-213b-4aec-b0b2-3d02f78c8e69 req-f08c63cd-b8e3-4fb6-aaf8-137d0bc81357 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.333528 Sep 16 14:02:42.769903 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1043/2079] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:42.781409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:42.782730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:42.797982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.799440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.800530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:42.803698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:42.823081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:42.824095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:43.166342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f36dfbe-742e-40de-8adf-fad91bf60ec5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1484957978" status: 200 len: 1515 microversion: 2.1 time: 0.713253 Sep 16 14:02:43.166991 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1037/2080] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:02:42 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1484957978 => generated 1515 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:43.172164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4947216a-6f06-420d-956a-8716cb3e1895 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517690d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:43.343209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4947216a-6f06-420d-956a-8716cb3e1895 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.174850 Sep 16 14:02:43.343819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1038/2081] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:43 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:43.363459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-243217645", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "72957846-66c4-4f63-b24e-6ce8e865631e"}], "block_device_mapping_v2": [{"uuid": "0fd138e5-1e8b-48c5-aeb1-8e49fcc2cbf7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:43.439876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:43.467247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:43.469209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:43.470556 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-10de5bf8-7f6b-420e-ac20-c94ac23813b9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.698157 Sep 16 14:02:43.471120 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1044/2082] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:42 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:43.491187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] validate_networks() for [('72957846-66c4-4f63-b24e-6ce8e865631e', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:02:43.505912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:43.508941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:43.523254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:43.524853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:43.529637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:43.531056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:43.531747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:43.533147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:44.136598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:44.158621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:44.160200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:44.169008 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-18b161a5-d72c-46e5-ad71-ebd2a70a9368 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.683913 Sep 16 14:02:44.169689 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1045/2083] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:43 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:44.175241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:44.183274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:44.184620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:44.191157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:44.191944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:44.192542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:44.193452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:44.194120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:44.195304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:44.358369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:44.538473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:44.551150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:44.551658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:44.552105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:44.983114 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3319d8a5-f330-4452-b351-ffffdd2de831 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.812189 Sep 16 14:02:44.983824 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1046/2084] 10.222.0.60 () {58 vars in 1173 bytes} [Fri Sep 16 14:02:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:44.989718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:44.990358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:45.051755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:45.052644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:45.057988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:45.060022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:45.060279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:45.060932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:45.154602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:02:45.155750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:02:45.156454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:02:45.157069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:02:45.157680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:02:45.169962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:45.170501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:45.170956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:45.172058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:45.172719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:45.180236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:45.211486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:02:45.241110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Getting quotas for user 916231d4d6114380b4e48d428d6dd843 and project 54dfa47e4a424466bbfb73c6864caeed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:02:45.286049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:45.459139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:02:45.461554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fd138e5-1e8b-48c5-aeb1-8e49fcc2cbf7',volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:02:45.561421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:45.573263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-85d1cb94-6719-40ae-903c-73ac89dff62e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1500 microversion: 2.1 time: 0.587873 Sep 16 14:02:45.586505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1047/2085] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:44 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1500 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:45.609997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:45.612907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:45.633613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:45.634774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:45.635696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:45.637857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:45.639317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:45.640357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:45.939964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:45.949904 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfa2ee11-9ae0-4af3-8e9d-014fcdf88a28 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.360511 Sep 16 14:02:45.955194 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1048/2086] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:45 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:45.967903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-628bf264-3f40-4c79-81d7-8ae794e91a51 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf074c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:45.983777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d17956f-0a06-45ea-a69f-914e79c60832 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.631185 Sep 16 14:02:45.984562 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1039/2087] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:02:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:02:45.989705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:45.990339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:46.010856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.011360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.011805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.012551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.013021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.013454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.131678 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-628bf264-3f40-4c79-81d7-8ae794e91a51 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.174712 Sep 16 14:02:46.132295 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1049/2088] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:45 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:46.146992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:46.167288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.168289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.servers [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Removing options 'limit' from query {{(pid=128643) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 16 14:02:46.169521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:46.183882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.185306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.188692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.189961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.192548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.193344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.276440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.294589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.299345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.299869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.682900 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91ac1d55-aed4-4346-b05c-9879bee0ae90 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.540078 Sep 16 14:02:46.684132 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1050/2089] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 14:02:46 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:46.689190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:46.691212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:46.722884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.723389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.723837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.724572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.725040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.725642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.755782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.771123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.773599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.775477 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6175f955-b35b-47b9-8a68-5a467efa8f64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.789718 Sep 16 14:02:46.791507 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1040/2090] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:45 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:46.802490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afc1f22a-6042-49b5-9f24-408971ed25bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:46.805677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-afc1f22a-6042-49b5-9f24-408971ed25bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:46.905980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afc1f22a-6042-49b5-9f24-408971ed25bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.923862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afc1f22a-6042-49b5-9f24-408971ed25bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.928849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afc1f22a-6042-49b5-9f24-408971ed25bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:46.934714 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-afc1f22a-6042-49b5-9f24-408971ed25bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1103 microversion: 2.25 time: 0.138879 Sep 16 14:02:46.936087 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1041/2091] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:46 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1103 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:46.949797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:46.952940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:46.969794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.973209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.973963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:46.978917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:46.980120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:46.980888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.102559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.133614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.136258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.153832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-568b2a35-2d4d-4188-8cb7-e8ed194fbc75 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1537 microversion: 2.91 time: 0.467802 Sep 16 14:02:47.161592 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1051/2092] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:46 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1537 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:47.167756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:47.180311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.184429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:47.198384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.199333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.200425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.203611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.206328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.213194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.329873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.344276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34d2274d-dfe3-4a9a-aa58-34f649868a31 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1500 microversion: 2.1 time: 0.403770 Sep 16 14:02:47.347418 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1042/2093] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:46 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1500 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:47.354773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:47.364118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:47.377967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.378951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.379631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.380587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.383025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.383767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.554807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:47.665004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.696094 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-22718e30-d2e2-4f78-a4ed-7375c6f28b18 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.346943 Sep 16 14:02:47.699096 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1043/2094] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:47 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:47.709781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12363519-356d-4e7d-a546-f1ef08b73219 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f7251817700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:47.813174 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12363519-356d-4e7d-a546-f1ef08b73219 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.112497 Sep 16 14:02:47.815175 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1044/2095] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:47 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:47.816940 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c702a105-f05a-4e9b-9a78-e21656b85fa0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.652736 Sep 16 14:02:47.820266 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1052/2096] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:02:47 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:47.823451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:47.824685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:47.831386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.831871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.832512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.833439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.834101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.834708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.852008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:47.866034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:47.867444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.servers [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Removing options 'limit' from query {{(pid=128643) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 16 14:02:47.869958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:47.886122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.887689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.888623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.890283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:47.891347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:47.892272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:47.988816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:48.080216 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3501caa5-6371-42b5-b7c0-06ebda1c067d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.240808 Sep 16 14:02:48.081605 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1053/2097] 10.222.0.60 () {58 vars in 1150 bytes} [Fri Sep 16 14:02:47 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:48.087534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.088303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:48.095347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.096053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.096728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.097545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.098079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.098624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.249058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.259306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.260857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.265726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.273569 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb22bb0b-8128-4882-be36-435c88450d07 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1232 microversion: 2.25 time: 0.189681 Sep 16 14:02:48.286440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1054/2098] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1232 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:48.286440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.327300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.327300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.327300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa5233f6-2580-4b7c-87cf-40b5ffd0ee6d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.486238 Sep 16 14:02:48.328333 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1045/2099] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:47 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:48.328440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.328440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:48.330319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.331585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.332348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.333421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.334237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:48.335854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.337567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.339084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.342788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.343566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.344745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.346765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.347256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.347870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.356295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:48.408952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:48.425307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.425915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.426417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.428099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lazy-loading 'fault' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:02:48.457245 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e9a4f3d-6e85-4905-a434-7f7dd4e3bd7d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.179774 Sep 16 14:02:48.457906 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1055/2100] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers => generated 1012 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:48.486572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.488675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:48.496535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.497058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.497479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.498212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.498770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.499143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.524915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.540840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.543178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.550512 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a7e95d3-d5a9-4a08-8a7d-10033edd5c7d tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1542 microversion: 2.91 time: 0.244169 Sep 16 14:02:48.551410 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1046/2101] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:48.558743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.564054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.564745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:48.576929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.577421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.577866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.578698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.579398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.579827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.669948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:48.730859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.735069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:48.737993 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41858bfa-8d24-461b-a82d-1427dc3da3ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.185055 Sep 16 14:02:48.738691 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1047/2102] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:48.742610 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-57486045-1ce3-4143-bbb9-0e006b794c1d tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1487 microversion: 2.1 time: 0.283367 Sep 16 14:02:48.758551 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1056/2103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1487 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:48.758864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.758864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:48.759239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.760768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.761281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.761725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.762485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.763113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.763245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.763553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.763676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.servers [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Removing options 'limit' from query {{(pid=128643) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 16 14:02:48.764259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:48.770804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.771330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.771747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.772565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.773519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.773951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.809692 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aec821c7-56b7-4c64-8aab-e181c26c9678 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.057950 Sep 16 14:02:48.810655 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1057/2104] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:48.824713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:48.825421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:48.832348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.832967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.833501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.834345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:48.835857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:48.836141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:48.865136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:02:48.965282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:48.979692 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2b070de-3f0c-4459-9341-4a92149815f1 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.230642 Sep 16 14:02:48.981550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1048/2105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:48.990888 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba363502-8aab-420e-bfe3-377b304af7b7 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 204 len: 0 microversion: 2.1 time: 0.161342 Sep 16 14:02:48.990888 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1058/2106] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:02:48 2022] DELETE /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:02:48.996497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.006426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:49.008259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1484957978', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:02:49.012426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7cf4b7b-7854-4433-8f01-0eea8afc371f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf074c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.018261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.019830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.021286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.022035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.025367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.026287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.072651 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7cf4b7b-7854-4433-8f01-0eea8afc371f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.084570 Sep 16 14:02:49.075890 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1059/2107] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:49.081361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa671dcc-83ac-4243-b57c-e243ae5d02f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f72517b7550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.159256 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-aa671dcc-83ac-4243-b57c-e243ae5d02f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Image not found. Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa671dcc-83ac-4243-b57c-e243ae5d02f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 HTTP/1.1 Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:02:49.164398 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'da041340-9ccf-4490-abeb-4059c474aa40'} Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:02:49.166224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image da041340-9ccf-4490-abeb-4059c474aa40 to delete Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.167361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da041340-9ccf-4490-abeb-4059c474aa40 could not be found. Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:02:49.169060 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:02:49.171729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:49.175075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa671dcc-83ac-4243-b57c-e243ae5d02f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:02:49.176486 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa671dcc-83ac-4243-b57c-e243ae5d02f1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40" status: 404 len: 62 microversion: 2.1 time: 0.099124 Sep 16 14:02:49.177373 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1060/2108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:49 2022] DELETE /compute/v2.1/images/da041340-9ccf-4490-abeb-4059c474aa40 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:02:49.192176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.193369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:49.206128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.206945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.207669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.208644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.209351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.210600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.294662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:02:49.401645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.compute.api [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Instance is already in deleting state, ignoring this request Sep 16 14:02:49.403607 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abf7d99c-d6a9-4259-9ff8-7b9340c61005 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 204 len: 0 microversion: 2.1 time: 0.220376 Sep 16 14:02:49.411355 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1061/2109] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:02:49 2022] DELETE /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:02:49.422171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.423751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:49.436823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.437623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.438348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.439860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.440665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.442074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.509105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:02:49.602734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:49.610729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ec5856f-9a37-4a5b-9a9a-9a4441acda8a tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1484957978" status: 200 len: 346 microversion: 2.1 time: 0.626256 Sep 16 14:02:49.611831 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1049/2110] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 14:02:48 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1484957978 => generated 346 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:49.620100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.620860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:49.624059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:49.627381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:49.628780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.628780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.629074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.630713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.633263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.633478 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c741c455-1ef2-4b97-910e-73e81514a3a0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1250 microversion: 2.25 time: 0.219851 Sep 16 14:02:49.634095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.646502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1062/2111] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:49 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1250 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:49.647846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:49.655253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:49.661517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.662014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.662527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:49.663311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:49.663777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:49.664207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.019829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.029655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eae7203a-006a-438f-b2c7-642649bd77de tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1493 microversion: 2.1 time: 0.391032 Sep 16 14:02:50.046994 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1063/2112] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:49 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1493 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:50.053437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:50.054838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:50.061810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.062593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.063154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.064150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.064727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.065250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.101279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:50.106387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.107216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.107787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.108509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lazy-loading 'fault' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:02:50.242953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.256621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.264176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.268414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.270133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.270934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.272453 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a2d0e8e-d18e-4279-9476-b8892a0bea3f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.659457 Sep 16 14:02:50.279874 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1e9dc352-2cdf-4736-9836-d214cfe76bc9 tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1542 microversion: 2.91 time: 0.231013 Sep 16 14:02:50.280136 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1050/2113] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:49 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:50.297899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1064/2114] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:50 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1542 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:50.301282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0bd62023-f0b7-4222-817c-c939a1266a00 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:50.308835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:50.309983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:50.317220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.318486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.319177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.320715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.320964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bd62023-f0b7-4222-817c-c939a1266a00 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.321470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bd62023-f0b7-4222-817c-c939a1266a00 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.321711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.321905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bd62023-f0b7-4222-817c-c939a1266a00 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.323159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.436915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0bd62023-f0b7-4222-817c-c939a1266a00 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Going to try to stop instance {{(pid=128642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:02:50.541584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0bd62023-f0b7-4222-817c-c939a1266a00 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "POST /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121/action" status: 202 len: 0 microversion: 2.1 time: 0.258889 Sep 16 14:02:50.543333 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1051/2115] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:02:50 2022] POST /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:02:50.555885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d3364ca-4021-4395-a061-64dd2167a11c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ceaeb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:50.640465 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d3364ca-4021-4395-a061-64dd2167a11c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.094041 Sep 16 14:02:50.641661 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1052/2116] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:50 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:50.647067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:50.648775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:50.658569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.658569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.659514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.661040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.661635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.662445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.790297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:50.807426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d86bcb13-8e8d-4205-b62c-01cb17e12d63 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.507945 Sep 16 14:02:50.809384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1065/2117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:50 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:50.817528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:50.818355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:50.826744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.827805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.828498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:50.829455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:50.830113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:50.830785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.237030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.260024 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ecc99ddc-175e-462a-aad2-da65612027b7 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1522 microversion: 2.1 time: 0.615951 Sep 16 14:02:51.261964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1053/2118] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:50 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:51.306894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-eb5e23a4-675d-417a-9ea5-9ecdaf39b3d1 req-0eda2395-2a48-494d-ac1e-b1eeec81af67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bca62c0-e918-42bb-a2b2-66a5c8e8290b", "name": "network-vif-unplugged", "status": "completed", "tag": "6b9d400c-8fa8-46d5-b90b-44d14f96dcf8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:51.325643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb5e23a4-675d-417a-9ea5-9ecdaf39b3d1 req-0eda2395-2a48-494d-ac1e-b1eeec81af67 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.328369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb5e23a4-675d-417a-9ea5-9ecdaf39b3d1 req-0eda2395-2a48-494d-ac1e-b1eeec81af67 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.328855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb5e23a4-675d-417a-9ea5-9ecdaf39b3d1 req-0eda2395-2a48-494d-ac1e-b1eeec81af67 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.360589 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-eb5e23a4-675d-417a-9ea5-9ecdaf39b3d1 req-0eda2395-2a48-494d-ac1e-b1eeec81af67 service nova] Creating event network-vif-unplugged:6b9d400c-8fa8-46d5-b90b-44d14f96dcf8 for instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b on n-h1-858129-2 Sep 16 14:02:51.366863 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-eb5e23a4-675d-417a-9ea5-9ecdaf39b3d1 req-0eda2395-2a48-494d-ac1e-b1eeec81af67 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103396 Sep 16 14:02:51.367751 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1054/2119] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:51.373623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:51.374446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:51.396606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.397102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.398124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.399745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.400534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.400534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.400991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.423616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.427131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.430758 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d0f7576-14be-49a3-9975-f794836e32f3 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1292 microversion: 2.25 time: 0.619321 Sep 16 14:02:51.433461 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1066/2120] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:50 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1292 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:51.447794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:51.451381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:51.464536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.465825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.466987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.468588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.469702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.470795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.552374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.553724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.558309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.561942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lazy-loading 'fault' on Instance uuid 37128dfd-116d-4d1c-ba5c-35065008505a {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:02:51.695756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.719547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.723946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62b0ebd1924f4dc2a4101755e7ce63df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de194b4db22463e837f94115b86ed36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.746066 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98725088-fbfc-4000-9de0-86d7661d13da tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 200 len: 1542 microversion: 2.91 time: 0.307399 Sep 16 14:02:51.759769 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1067/2121] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:51 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:51.787776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:51.792035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:51.808497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:51.818543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.820873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.822285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.824136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.825423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.827037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.837688 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ecd1091-6d91-4e34-a7f6-fd7734dc6a6e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1493 microversion: 2.1 time: 0.468265 Sep 16 14:02:51.839210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1055/2122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:51 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1493 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:51.867999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6040a66c-f730-4f78-9361-924e15a701b6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d271820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:51.949569 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6040a66c-f730-4f78-9361-924e15a701b6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.107570 Sep 16 14:02:51.951700 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1056/2123] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:51 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:51.965103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:51.967444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:51.987181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.988592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.989675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:51.992151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:51.994489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:51.995976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:52.434216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:52.466765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:52.469683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:52.489662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-95301d28-2de4-4cc3-943a-de4202da4bc9 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.723054 Sep 16 14:02:52.490995 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1068/2124] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:51 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:52.519411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:52.521409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:52.556273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:52.574639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:52.575972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:52.577589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:52.578675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:52.579346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:52.659917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:52.682080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-062a6edb-5346-4856-a9d9-49f1b897a2f9 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.728013 Sep 16 14:02:52.691979 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1057/2125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:51 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:52.735219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:52.738626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:52.796307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:52.805488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:52.806672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:52.809884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:52.814607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:52.823580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:53.711942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:53.731779 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-feaf17b2-0181-4545-82b0-7ebeb6888f9d tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1522 microversion: 2.1 time: 1.235465 Sep 16 14:02:53.733203 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1069/2126] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:52 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1522 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:53.738951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:53.742494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] [instance: 37128dfd-116d-4d1c-ba5c-35065008505a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:53.771348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:53.774315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:53.775284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:53.777440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:53.780906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:53.784009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:53.912088 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] HTTP exception thrown: Instance 37128dfd-116d-4d1c-ba5c-35065008505a could not be found. Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Request method failure captured: Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a HTTP/1.1 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIDq-m-7Lt6Q_7QSNLUN13AVLqoBWnhgbeS-UrvbmdXqIsHZ9L0U_vhSkKEYdnuzQ-lAeXzemptVVZkTtUUZHyF8EwvS7pTqcijRcnrfwZ_CEbWAXQuOjcumdI42JGiAY7q307ekJkpWvAP2-cXvd4Mto2nfZYvVztvvN2h7nlrFw7E Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.91 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 8de194b4db22463e837f94115b86ed36 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1678929278 Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:02:53.922370 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8de194b4db22463e837f94115b86ed36", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8de194b4db22463e837f94115b86ed36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8de194b4db22463e837f94115b86ed36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8de194b4db22463e837f94115b86ed36"}]}] Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1678929278 Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 8de194b4db22463e837f94115b86ed36 Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1678929278 Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-UnshelveToHostMultiNodesTest-1678929278-project Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 62b0ebd1924f4dc2a4101755e7ce63df Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1678929278-project Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 37128dfd-116d-4d1c-ba5c-35065008505a could not be found. Sep 16 14:02:53.924214 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '37128dfd-116d-4d1c-ba5c-35065008505a'} Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37128dfd-116d-4d1c-ba5c-35065008505a could not be found. Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:02:53.925143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37128dfd-116d-4d1c-ba5c-35065008505a could not be found. Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37128dfd-116d-4d1c-ba5c-35065008505a could not be found. Sep 16 14:02:53.927172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:53.929955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] Returning 404 to user: Instance 37128dfd-116d-4d1c-ba5c-35065008505a could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:02:53.929955 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4879ea08-afdf-44dc-9aeb-fc9674c2941b tempest-UnshelveToHostMultiNodesTest-1678929278 tempest-UnshelveToHostMultiNodesTest-1678929278-project] 10.222.0.60 "GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a" status: 404 len: 111 microversion: 2.91 time: 0.191043 Sep 16 14:02:53.930223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1070/2127] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:53 2022] GET /compute/v2.1/servers/37128dfd-116d-4d1c-ba5c-35065008505a => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:02:53.945153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:53.946050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:53.953364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:53.954293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:53.955050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:53.956094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:53.956808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:53.957464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:53.975330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:53.996149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:54.004772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:54.012466 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e9f4cd1-1c87-4710-8d67-5a852e84dc7a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1292 microversion: 2.25 time: 1.318521 Sep 16 14:02:54.013678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1058/2128] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:52 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1292 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:54.033486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93f0ac35-a400-42a7-b44e-e4f0645c98ee tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f725182bb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:54.118887 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93f0ac35-a400-42a7-b44e-e4f0645c98ee tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.095045 Sep 16 14:02:54.120930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1059/2129] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:54 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:54.134228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:54.135243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:54.145589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:54.147937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:54.148621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:54.149576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:54.150242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:54.151008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:54.588303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:54.604998 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc1fc737-cdf7-47d2-8464-53472d967fd5 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1493 microversion: 2.1 time: 0.669051 Sep 16 14:02:54.607146 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1071/2130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:53 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1493 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:54.619475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:54.620200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:54.640571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:54.641081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:54.641525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:54.642275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:54.642781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:54.643217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:55.312600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:55.334444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:55.336479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:55.349987 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ddeeef6-a34a-4f88-80fc-b5d52b2408c5 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.225997 Sep 16 14:02:55.358387 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1060/2131] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:54 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:55.377011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:55.377652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:55.422236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:55.427216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:55.429784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:55.430733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:55.432085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:55.438111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:55.439141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:55.441266 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d9acb0f-9a6b-4bc7-9bd7-3420db6a0134 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.833169 Sep 16 14:02:55.441878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1072/2132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:54 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:55.458764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:55.459387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:55.509456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:55.510152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:55.510779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:55.511606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:55.512398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:55.531447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:55.554169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:56.036082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:56.060273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:56.078302 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c08e21eb-4bd4-4d01-b056-d32163355d97 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1522 microversion: 2.1 time: 0.711160 Sep 16 14:02:56.079664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:56.080319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1061/2133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:55 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1522 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:56.088255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:56.096689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6324058c-434b-4e97-b3f7-8994dbe87786 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1292 microversion: 2.25 time: 0.646144 Sep 16 14:02:56.112719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1073/2134] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:55 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1292 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:56.126983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7dc39bec-06b6-44ec-ad71-d4ad469352b5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d7c09d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:56.152446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9456fb07-3db9-49b9-bfd6-b99fef547d7d req-6b2d8f1d-3b34-4c3f-9cc5-b05eef62c292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bca62c0-e918-42bb-a2b2-66a5c8e8290b", "name": "network-vif-deleted", "tag": "6b9d400c-8fa8-46d5-b90b-44d14f96dcf8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:56.200505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9456fb07-3db9-49b9-bfd6-b99fef547d7d req-6b2d8f1d-3b34-4c3f-9cc5-b05eef62c292 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.204267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9456fb07-3db9-49b9-bfd6-b99fef547d7d req-6b2d8f1d-3b34-4c3f-9cc5-b05eef62c292 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.205072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9456fb07-3db9-49b9-bfd6-b99fef547d7d req-6b2d8f1d-3b34-4c3f-9cc5-b05eef62c292 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:56.242109 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9456fb07-3db9-49b9-bfd6-b99fef547d7d req-6b2d8f1d-3b34-4c3f-9cc5-b05eef62c292 service nova] Creating event network-vif-deleted:6b9d400c-8fa8-46d5-b90b-44d14f96dcf8 for instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b on n-h1-858129-2 Sep 16 14:02:56.253634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9456fb07-3db9-49b9-bfd6-b99fef547d7d req-6b2d8f1d-3b34-4c3f-9cc5-b05eef62c292 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129009 Sep 16 14:02:56.256267 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1074/2135] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:56.263926 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7dc39bec-06b6-44ec-ad71-d4ad469352b5 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.176674 Sep 16 14:02:56.265237 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1062/2136] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:56 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:56.279189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:56.279730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:56.299573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:56.304963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.308273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.309763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:56.312356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.313637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.314849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:56.391171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:56.391984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:56.407566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.408072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.422032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:56.422856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.423387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.423838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:56.845327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f410179d3cca47dbb7ea031494bd1b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2baefe708641e7bdb8239812b2ac9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:56.893137 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-091ca278-2f1f-46bb-9fa6-25de21089b8b tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 200 len: 1451 microversion: 2.1 time: 0.634947 Sep 16 14:02:56.912451 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1075/2137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:56 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 1451 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:56.922396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:56.926457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:56.945984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:56.965173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.965961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.966503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:56.970938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:56.971508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:56.972884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:58.036436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.067867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.079720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.087192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5fa7be6b-174e-43f6-9932-50b5c22464af tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.695477 Sep 16 14:02:58.088033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1063/2138] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:56 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:02:58.112930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:58.123503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:58.146329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:58.147017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:58.147470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:58.152044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:58.154286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:58.155051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:58.278823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.313398 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe0ba762-4542-48de-830a-3415c19cbd93 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 1.395550 Sep 16 14:02:58.315013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1076/2139] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:56 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:58.367442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:58.385126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:58.462030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:58.466817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:58.470391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:58.471515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:58.472776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:58.473324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:58.784196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=14 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:58.918440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.944708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.956499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:58.958376 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a10d1d6e-c080-47fb-9cae-624771ec062d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1292 microversion: 2.25 time: 0.627786 Sep 16 14:02:58.976804 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1077/2140] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:58 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1292 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:02:58.982375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-76a84ee2-1efc-4caf-bf57-703de95a7326 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517edee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:59.015456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:02:59.060979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ebeeede-78eb-4adf-990d-bf711295f4db tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1522 microversion: 2.1 time: 0.968988 Sep 16 14:02:59.078451 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-76a84ee2-1efc-4caf-bf57-703de95a7326 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.099966 Sep 16 14:02:59.091278 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1078/2141] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:02:58 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:59.099410 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1064/2142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:58 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1522 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:02:59.109049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:59.109233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 2bca62c0-e918-42bb-a2b2-66a5c8e8290b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:59.143240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.143759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.144259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.144975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.145171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-96a10b5f-742a-45ce-8492-79f0bacd4b34 req-6fc9a755-0a1d-49dd-80f5-d940701c23ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d42251-9a1b-4702-afa6-ef58d5b2bb96", "tag": "270026fb-ac51-4adc-b0ff-c15b43a583a2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:02:59.145429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.154122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.173337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:02:59.204599 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b could not be found. Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b HTTP/1.1 Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:02:59.208071 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b could not be found. Sep 16 14:02:59.211464 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2bca62c0-e918-42bb-a2b2-66a5c8e8290b'} Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b could not be found. Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:02:59.212686 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b could not be found. Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b could not be found. Sep 16 14:02:59.214342 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.215995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance 2bca62c0-e918-42bb-a2b2-66a5c8e8290b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:02:59.215995 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-daf8829e-37a1-42ab-840f-86b5a10d825e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b" status: 404 len: 111 microversion: 2.1 time: 0.118823 Sep 16 14:02:59.215995 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1079/2143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:59 2022] GET /compute/v2.1/servers/2bca62c0-e918-42bb-a2b2-66a5c8e8290b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:02:59.227569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:59.228023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-96a10b5f-742a-45ce-8492-79f0bacd4b34 req-6fc9a755-0a1d-49dd-80f5-d940701c23ed service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.230972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:59.242043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.244545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-96a10b5f-742a-45ce-8492-79f0bacd4b34 req-6fc9a755-0a1d-49dd-80f5-d940701c23ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.245763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-96a10b5f-742a-45ce-8492-79f0bacd4b34 req-6fc9a755-0a1d-49dd-80f5-d940701c23ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.247362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.248001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.252055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.257700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.260055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.337016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-96a10b5f-742a-45ce-8492-79f0bacd4b34 req-6fc9a755-0a1d-49dd-80f5-d940701c23ed service nova] Creating event network-changed:270026fb-ac51-4adc-b0ff-c15b43a583a2 for instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 on n-h2-858129-2 Sep 16 14:02:59.351216 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-96a10b5f-742a-45ce-8492-79f0bacd4b34 req-6fc9a755-0a1d-49dd-80f5-d940701c23ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249347 Sep 16 14:02:59.354758 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1065/2144] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:02:59.375509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eed1a714-7c4d-40d4-9762-6416761e6e5e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d711af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:59.445732 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-eed1a714-7c4d-40d4-9762-6416761e6e5e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Image not found. Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eed1a714-7c4d-40d4-9762-6416761e6e5e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db HTTP/1.1 Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:02:59.452053 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3749627d-cba8-49af-9151-3d8edad039db'} Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:02:59.453908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3749627d-cba8-49af-9151-3d8edad039db to delete Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.454983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3749627d-cba8-49af-9151-3d8edad039db could not be found. Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:02:59.456405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eed1a714-7c4d-40d4-9762-6416761e6e5e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eed1a714-7c4d-40d4-9762-6416761e6e5e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db" status: 404 len: 62 microversion: 2.1 time: 0.093703 Sep 16 14:02:59.457976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1066/2145] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:59 2022] DELETE /compute/v2.1/images/3749627d-cba8-49af-9151-3d8edad039db => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:02:59.471933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:02:59.472804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:02:59.494192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.495667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.498503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.502632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:02:59.503285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:02:59.503901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:02:59.560437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:00.470560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:00.496142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:00.513626 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1fa02f6f-4428-4076-ae5d-4a6fb97a83bf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 1.054596 Sep 16 14:03:00.515994 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1067/2146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:02:59 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:00.529906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:00.533847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:00.549366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:00.550872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:00.552837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:00.555147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:00.557899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:00.558759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:00.559238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:00.564924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:00.580864 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7484c123-0b08-4b8b-ba4d-d231f1740851 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.361062 Sep 16 14:03:00.602961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:00.604295 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1080/2147] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:02:59 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a HTTP/1.1 Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:00.618441 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:00.621833 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a5a9c185-9fe8-40b1-a94a-230a3180363a'} Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:00.639495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:00.646362 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:00.650041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:00.650041 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14ad3e4f-2598-490c-b57e-6bbe7d8102c6 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 404 len: 111 microversion: 2.1 time: 0.093739 Sep 16 14:03:00.650041 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1068/2148] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:03:00 2022] DELETE /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:00.664957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ddb94f60-5449-4a26-849f-fda82b42849b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d3e5b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:00.676277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:00.683783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:00.723930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:00.731878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:00.733196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:00.737881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:00.741995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:00.744810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:00.925471 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ddb94f60-5449-4a26-849f-fda82b42849b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.300667 Sep 16 14:03:00.937211 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1069/2149] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:00 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:00.977232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:00.985396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:01.048844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:01.049657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:01.062900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:01.069793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:01.075441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:01.079879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:01.971246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:02.015298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:02.019032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:02.031659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e403c392-711e-4b45-813b-7e9f793617bf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1292 microversion: 2.25 time: 1.360419 Sep 16 14:03:02.037080 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1081/2150] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:00 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1292 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:02.065943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:02.092119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: a5a9c185-9fe8-40b1-a94a-230a3180363a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:02.130018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:02.131467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:02.132329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:02.133720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:02.134577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:02.135293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:02.182250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:02.198638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a HTTP/1.1 Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:03:02.216785 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:02.219767 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'a5a9c185-9fe8-40b1-a94a-230a3180363a'} Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:02.221392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. Sep 16 14:03:02.228409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:02.239002 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54802d3a-827c-42b3-a964-a8268250fbaf tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1522 microversion: 2.1 time: 1.281786 Sep 16 14:03:02.239002 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1070/2151] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:00 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1522 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:02.241921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance a5a9c185-9fe8-40b1-a94a-230a3180363a could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:02.246875 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e0870a5-d8df-47c9-a63d-2f7863c0c46e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a" status: 404 len: 111 microversion: 2.1 time: 0.205375 Sep 16 14:03:02.253507 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1082/2152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:02 2022] GET /compute/v2.1/servers/a5a9c185-9fe8-40b1-a94a-230a3180363a => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:02.275268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:02.276404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:02.280047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:02.293669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:02.295700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:02.296700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:02.297304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:02.298908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:02.300179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:02.301679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:02.358138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:02.360093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:02.361112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:02.364703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:02.366137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:02.367294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:03.390052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.402337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2bf5de1-a84f-4cb0-8940-ccd8f925aef5 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 1.166704 Sep 16 14:03:03.410784 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1071/2153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:02 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:03.422725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fbc139ae-3a27-40f7-8f9a-73bd2ad34c31 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72518241f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:03.433303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.466753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.470513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.479626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2165c744-3ed8-46fb-afe4-874092e441a6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.215883 Sep 16 14:03:03.481058 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1083/2154] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:02 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:03.489476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4020f5f-38e8-4f62-8d8c-4db89dc2115c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f724d082d30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:03.556001 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b4020f5f-38e8-4f62-8d8c-4db89dc2115c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Image not found. Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4020f5f-38e8-4f62-8d8c-4db89dc2115c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 HTTP/1.1 Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:03:03.560111 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '68320685-447c-4835-bada-9569617b5336'} Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:03.561788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 68320685-447c-4835-bada-9569617b5336 to delete Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.562880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 68320685-447c-4835-bada-9569617b5336 could not be found. Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:03.564634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:03:03.567402 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:03.571340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4020f5f-38e8-4f62-8d8c-4db89dc2115c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:03.572021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4020f5f-38e8-4f62-8d8c-4db89dc2115c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336" status: 404 len: 62 microversion: 2.1 time: 0.089641 Sep 16 14:03:03.577343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1084/2155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:03 2022] DELETE /compute/v2.1/images/68320685-447c-4835-bada-9569617b5336 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:03:03.578307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:03.579041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:03.588691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:03.592901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:03.593609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:03.594497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:03.595132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:03.595675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:03.605302 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fbc139ae-3a27-40f7-8f9a-73bd2ad34c31 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.192096 Sep 16 14:03:03.610005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1072/2156] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:03 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:03.647457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:03.649498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:03.693020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:03.693555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:03.701157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:03.703509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:03.704023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:03.707915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:03.963434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.984768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.986493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:03.994473 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-68d98bec-6c7c-4fe0-aea8-9f3ba173521b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 0.420146 Sep 16 14:03:03.999094 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1085/2157] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:03 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:04.007195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.019390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:04.043543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.044255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.044922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.049090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.050218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.050950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.055918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:04.091930 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-51dfed4d-d898-4630-93c1-c0c813b0db82 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1499 microversion: 2.1 time: 0.475914 Sep 16 14:03:04.108839 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1073/2158] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:03 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1499 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:04.118849 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 HTTP/1.1 Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:03:04.125402 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.127026 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'bcfdc316-c9c9-4fad-ac55-a87d2e79a296'} Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:04.127924 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.129353 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.133175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:04.134581 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-489815d0-e219-4d7a-838e-2385d206afd1 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 404 len: 111 microversion: 2.1 time: 0.131482 Sep 16 14:03:04.136292 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1086/2159] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:03:03 2022] DELETE /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:04.146537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.148423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6f9498ee-ef0a-4013-839f-9493c2bb77e3 req-3ab7273b-d8a3-433a-bc3e-b542a5cfad5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a64ce67-150d-4430-805a-9cbab3489620", "name": "network-vif-plugged", "status": "completed", "tag": "018cdf29-f7de-4244-9662-c83de9039962"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:04.160807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:04.169597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:04.173271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6f9498ee-ef0a-4013-839f-9493c2bb77e3 req-3ab7273b-d8a3-433a-bc3e-b542a5cfad5c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.173816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6f9498ee-ef0a-4013-839f-9493c2bb77e3 req-3ab7273b-d8a3-433a-bc3e-b542a5cfad5c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.174271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6f9498ee-ef0a-4013-839f-9493c2bb77e3 req-3ab7273b-d8a3-433a-bc3e-b542a5cfad5c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.178452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.179419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.180125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.181181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.182566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.184243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.207395 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6f9498ee-ef0a-4013-839f-9493c2bb77e3 req-3ab7273b-d8a3-433a-bc3e-b542a5cfad5c service nova] Creating event network-vif-plugged:018cdf29-f7de-4244-9662-c83de9039962 for instance 2a64ce67-150d-4430-805a-9cbab3489620 on n-h1-858129-2 Sep 16 14:03:04.223543 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6f9498ee-ef0a-4013-839f-9493c2bb77e3 req-3ab7273b-d8a3-433a-bc3e-b542a5cfad5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108204 Sep 16 14:03:04.229073 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1074/2160] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:04.245710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.246332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: bcfdc316-c9c9-4fad-ac55-a87d2e79a296] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:04.253495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:04.265882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.267822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.270196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.271439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.273759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.274537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.333062 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 HTTP/1.1 Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:04.342976 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.344658 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'bcfdc316-c9c9-4fad-ac55-a87d2e79a296'} Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:04.345547 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. Sep 16 14:03:04.347059 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.351898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance bcfdc316-c9c9-4fad-ac55-a87d2e79a296 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:04.354088 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43eeeac0-34dd-4c9a-94bd-97d6921262e0 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296" status: 404 len: 111 microversion: 2.1 time: 0.122549 Sep 16 14:03:04.356732 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1075/2161] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:04 2022] GET /compute/v2.1/servers/bcfdc316-c9c9-4fad-ac55-a87d2e79a296 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:04.376057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2051daca-a5e7-4204-adaf-6851f774cc0e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '.version_select at 0x7f7251782550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.405257 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a7a9df6d-a60c-4f28-993f-3776c77c23ce tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.263731 Sep 16 14:03:04.409730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1087/2162] 10.222.0.60 () {58 vars in 1154 bytes} [Fri Sep 16 14:03:04 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:03:04.432006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.432815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:04.447384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.448661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.449237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.458239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.460231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.466607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.470832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2051daca-a5e7-4204-adaf-6851f774cc0e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Image not found. Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2051daca-a5e7-4204-adaf-6851f774cc0e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be HTTP/1.1 Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:04.473474 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '2afdccac-9fe5-4352-b907-8858c83772be'} Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:04.476712 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2afdccac-9fe5-4352-b907-8858c83772be to delete Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.478802 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2afdccac-9fe5-4352-b907-8858c83772be could not be found. Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:04.481166 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2051daca-a5e7-4204-adaf-6851f774cc0e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2051daca-a5e7-4204-adaf-6851f774cc0e tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be" status: 404 len: 62 microversion: 2.1 time: 0.113840 Sep 16 14:03:04.491364 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1076/2163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:04 2022] DELETE /compute/v2.1/images/2afdccac-9fe5-4352-b907-8858c83772be => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:03:04.500502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe17f16b-ab26-4392-b051-b6dd07bf383e tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:04.538145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe17f16b-ab26-4392-b051-b6dd07bf383e tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.538693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe17f16b-ab26-4392-b051-b6dd07bf383e tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.547554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe17f16b-ab26-4392-b051-b6dd07bf383e tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.640592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe17f16b-ab26-4392-b051-b6dd07bf383e tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Going to try to start instance {{(pid=128642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 14:03:04.904086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:04.904612 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe17f16b-ab26-4392-b051-b6dd07bf383e tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "POST /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121/action" status: 202 len: 0 microversion: 2.1 time: 0.420365 Sep 16 14:03:04.905562 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1077/2164] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:03:04 2022] POST /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:03:04.922469 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31128992-54bd-447b-b62a-4855737836e0 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 0.496386 Sep 16 14:03:04.934441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.934441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:04.940260 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1088/2165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:04 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:04.944141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:04.944765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:04.960128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.960663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.961130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.967231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.971011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.971647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.986946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.987949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.994155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:04.995074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:04.995575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:04.996025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:05.002648 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 HTTP/1.1 Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:05.005192 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.006979 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '75cdbfcc-18c8-4219-9fb2-c40f4517a561'} Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:05.007868 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.009361 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.012935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:05.014221 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-051888b4-21c8-48db-9136-6050cc62584c tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "DELETE /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 404 len: 111 microversion: 2.1 time: 0.107491 Sep 16 14:03:05.015474 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1078/2166] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:03:04 2022] DELETE /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:05.033094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ba9a1dc-31e2-4275-9f7b-506411101552 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72518240d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:05.127464 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ba9a1dc-31e2-4275-9f7b-506411101552 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.110583 Sep 16 14:03:05.130487 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1079/2167] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:05 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:05.169096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:05.182608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:05.216634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:05.218465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:05.219640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:05.223384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:05.226545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:05.227321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:05.819042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:05.841394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:05.843363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:05.845198 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bfbb5c0d-3f5d-4ac7-81d3-e5858d8167e6 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.905017 Sep 16 14:03:05.859468 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1089/2168] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:04 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:05.872478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:05.880663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] [instance: 75cdbfcc-18c8-4219-9fb2-c40f4517a561] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:05.881528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:05.888863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:05.890012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:05.890929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:05.891913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:05.892603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:05.893218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:05.893724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-225838d0-f67f-4b62-ba25-661ceb0b3cec tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1508 microversion: 2.1 time: 0.761774 Sep 16 14:03:05.896121 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1080/2169] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:05 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1508 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:05.914034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:05.914749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:05.935981 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] HTTP exception thrown: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Request method failure captured: Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 HTTP/1.1 Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIB6l_EmL8EHwBbH5-AFTpnfZw5hKKjtzDfFjLn0a9nC8Th-2vlX_E6KcxQfbVaia-sF8UieM4Rhnfnd7H7pNmKuLOMKMNPF7K66qXHchqp8GJaZlYnVuLciCbeu0a_gxUZ7juflWWUFOY9GCtJmNwtbjMRWHk08Q_A7y2A4wAv-5mA Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:03:05.937997 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2a2baefe708641e7bdb8239812b2ac9b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2a2baefe708641e7bdb8239812b2ac9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2a2baefe708641e7bdb8239812b2ac9b"}]}] Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2a2baefe708641e7bdb8239812b2ac9b Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesTestJSON-1485145251 Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: f410179d3cca47dbb7ea031494bd1b07 Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesTestJSON-1485145251-project Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.939652 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '75cdbfcc-18c8-4219-9fb2-c40f4517a561'} Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:05.940688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. Sep 16 14:03:05.942175 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:05.955971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] Returning 404 to user: Instance 75cdbfcc-18c8-4219-9fb2-c40f4517a561 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:05.957374 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f590750-1f5d-4fbe-a957-80eab3759780 tempest-ImagesTestJSON-1485145251 tempest-ImagesTestJSON-1485145251-project] 10.222.0.60 "GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561" status: 404 len: 111 microversion: 2.1 time: 0.096468 Sep 16 14:03:05.958261 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1090/2170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:05 2022] GET /compute/v2.1/servers/75cdbfcc-18c8-4219-9fb2-c40f4517a561 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:05.974591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:05.976567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:05.983060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:05.984379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:05.984726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:05.994202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:05.996913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:06.000235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:06.001378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:06.003163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:06.004756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:06.005173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:06.007223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:06.012711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:07.099645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:07.117955 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30f45ef3-8523-4d64-9b4c-3d517f515fb3 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1368 microversion: 2.1 time: 1.157620 Sep 16 14:03:07.134166 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1091/2171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:05 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1368 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:07.170390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ab5bb04-db71-418f-b255-302b595c9064 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d045dc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:07.202642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:07.217724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:07.219337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:07.225875 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0173f26b-6f5f-4e9d-bc01-11307c35d5fe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 1.325545 Sep 16 14:03:07.226541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1081/2172] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:05 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:07.244952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:07.246582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:07.255728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:07.256541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:07.257216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:07.258420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:07.259147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:07.260331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:07.348259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ab5bb04-db71-418f-b255-302b595c9064 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.208059 Sep 16 14:03:07.359661 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1092/2173] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:07 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:07.381763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:07.383759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:07.394543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:07.395369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:07.395993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:07.397262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:07.398225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:07.399078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:08.608922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:08.641427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:08.654393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:08.657286 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0dae8f0d-33ae-422c-8b50-7e016cfaaef7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.426214 Sep 16 14:03:08.669900 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1082/2174] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:07 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:08.692368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:08.722109 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28bbc1ae-d90d-4f1e-af23-8534a441ec94 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1508 microversion: 2.1 time: 1.360826 Sep 16 14:03:08.736958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1093/2175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:07 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1508 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:08.757659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:08.763920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:08.782859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:08.787743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:08.791453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:08.793196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:08.800479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:08.801907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:08.982066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aec3ab23-bb3e-4bd8-8ce1-b6e67894e77d tempest-FloatingIPDetailsNegativeTestJSON-105485286 tempest-FloatingIPDetailsNegativeTestJSON-105485286-project] Calling method '.version_select at 0x7f725182b1f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:09.791889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-aec3ab23-bb3e-4bd8-8ce1-b6e67894e77d tempest-FloatingIPDetailsNegativeTestJSON-105485286 tempest-FloatingIPDetailsNegativeTestJSON-105485286-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f5898bdb-1628-4720-80fc-f1bf5f0d3186 could not be found", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:03:09.795251 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-aec3ab23-bb3e-4bd8-8ce1-b6e67894e77d tempest-FloatingIPDetailsNegativeTestJSON-105485286 tempest-FloatingIPDetailsNegativeTestJSON-105485286-project] HTTP exception thrown: Floating IP not found for ID f5898bdb-1628-4720-80fc-f1bf5f0d3186 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aec3ab23-bb3e-4bd8-8ce1-b6e67894e77d tempest-FloatingIPDetailsNegativeTestJSON-105485286 tempest-FloatingIPDetailsNegativeTestJSON-105485286-project] Request method failure captured: Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-floating-ips/f5898bdb-1628-4720-80fc-f1bf5f0d3186 HTTP/1.1 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIIbhwdS5YQKeGLOtp7qbKYLd-QT-bpfwszbdDH0cihr0BMxRHcbwm4rKw6pTuIjhbdPwjlYqmKPTWOVFv40kCvff3k7aiH9AXyERh_A3FPLkqHxuZhjgcvQeW99jWM1KpI-wY9X1hYCkU0eyEJS-asy3pJv3yUKGqLIOI9z4i9Ur0k Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 62a65a7a610b461ebc0e0aa966f660a8 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-105485286 Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:09.814232 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_62a65a7a610b461ebc0e0aa966f660a8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a65a7a610b461ebc0e0aa966f660a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/62a65a7a610b461ebc0e0aa966f660a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/62a65a7a610b461ebc0e0aa966f660a8"}]}] Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-105485286 Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 62a65a7a610b461ebc0e0aa966f660a8 Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-105485286 Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-105485286-project Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ac102064a34e4b20849577e0109857fb Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-105485286-project Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: exception: Floating IP not found for ID f5898bdb-1628-4720-80fc-f1bf5f0d3186 Sep 16 14:03:09.817231 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f5898bdb-1628-4720-80fc-f1bf5f0d3186'} Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:03:09.818912 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f5898bdb-1628-4720-80fc-f1bf5f0d3186 could not be found Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7018bd11-754e-42c7-96a5-9c9d103c3f4b'] Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f5898bdb-1628-4720-80fc-f1bf5f0d3186. Sep 16 14:03:09.821818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f5898bdb-1628-4720-80fc-f1bf5f0d3186 Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:09.832968 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:09.838395 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:09.838395 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f5898bdb-1628-4720-80fc-f1bf5f0d3186 Sep 16 14:03:09.838395 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:09.838395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aec3ab23-bb3e-4bd8-8ce1-b6e67894e77d tempest-FloatingIPDetailsNegativeTestJSON-105485286 tempest-FloatingIPDetailsNegativeTestJSON-105485286-project] Returning 404 to user: Floating IP not found for ID f5898bdb-1628-4720-80fc-f1bf5f0d3186 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:09.838395 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aec3ab23-bb3e-4bd8-8ce1-b6e67894e77d tempest-FloatingIPDetailsNegativeTestJSON-105485286 tempest-FloatingIPDetailsNegativeTestJSON-105485286-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/f5898bdb-1628-4720-80fc-f1bf5f0d3186" status: 404 len: 111 microversion: 2.1 time: 1.157144 Sep 16 14:03:09.843846 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1083/2176] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:03:08 2022] GET /compute/v2.1/os-floating-ips/f5898bdb-1628-4720-80fc-f1bf5f0d3186 => generated 111 bytes in 1173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:09.857966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:09.859779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:09.890435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:09.890968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:09.892643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:09.893529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:09.894020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:09.894575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:10.065398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:10.098121 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e55ab366-d70e-4876-94ee-8c5c274bddc2 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1554 microversion: 2.1 time: 1.348114 Sep 16 14:03:10.114736 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1094/2177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:08 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1554 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:10.149593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cdfc266d-2538-4ab3-968e-d00226a277a4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d09ddc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:10.281601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:10.308738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:10.320012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:10.324223 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba8f41cf-ccd0-4059-97e6-d5bc48c2fbc6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 0.478123 Sep 16 14:03:10.332760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1084/2178] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:09 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:10.334129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cdfc266d-2538-4ab3-968e-d00226a277a4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.216587 Sep 16 14:03:10.350137 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1095/2179] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:10 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:10.352377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:10.354019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:10.377428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:10.379239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:10.382750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:10.383690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:10.384802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:10.388613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:10.392924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:10.394184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:10.412771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:10.417499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:10.420186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:10.423327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:10.426300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:10.431138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:11.369870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:11.373761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:11.420789 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-052ee520-bb90-4e30-9af7-9abaa0901c77 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1512 microversion: 2.1 time: 1.061500 Sep 16 14:03:11.424598 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1096/2180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:10 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1512 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:11.461738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:11.462634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:11.504265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:11.511262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:11.517425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:11.521688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:11.522610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:11.543498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:11.661368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:11.700869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:11.717771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:11.720713 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f07cc2b7-176a-4c1b-8c26-42243c532bef tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.385391 Sep 16 14:03:11.727479 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1085/2181] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:10 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:11.744728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:11.745913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:11.778443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:11.779458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:11.780317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:11.781696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:11.782621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:11.783431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:11.833762 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4822448f-c36a-426b-955f-e59f31c4fafd tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.406794 Sep 16 14:03:11.850781 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1097/2182] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:03:11 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-interface => generated 284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:11.869796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35132529-d76c-4b9a-ab6a-bacfbd611989 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d17eb80>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:12.007316 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35132529-d76c-4b9a-ab6a-bacfbd611989 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.154183 Sep 16 14:03:12.008699 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1098/2183] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:11 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:12.015608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:12.048767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:12.049885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.servers [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Removing options 'limit' from query {{(pid=128643) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 16 14:03:12.051231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:12.053513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:12.054697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:12.055769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:12.057528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:12.058200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:12.059005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:12.062716 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3316de0-6032-4927-a77b-f87559cfdd14 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.049994 Sep 16 14:03:12.077807 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1099/2184] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Sep 16 14:03:12 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:03:12.093111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:12.094292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:12.108493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:12.109870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:12.111033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:12.112841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:12.114150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:12.115533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:12.663243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:12.707123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:12.712716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:12.720379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2e12bc7-8b02-474d-9891-67db47c3ea5f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 0.990786 Sep 16 14:03:12.731262 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1086/2185] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:11 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:12.780258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:12.784682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:12.813018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:12.834160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:12.835281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:12.839537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:12.844071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:12.845393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:13.383459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:13.394902 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af9fae6e-8dea-4ce2-b1a0-c369e517c8fd tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1512 microversion: 2.1 time: 1.309759 Sep 16 14:03:13.395627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1100/2186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:12 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1512 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:03:13.428608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-88b6d11b-da4c-465c-8494-f8373d7c90ed tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d0cbc10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:13.578950 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-88b6d11b-da4c-465c-8494-f8373d7c90ed tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.181705 Sep 16 14:03:13.581150 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1101/2187] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:13 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:13.594457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:13.624271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:13.651307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:13.679745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:13.682747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:13.692980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:13.712531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:13.713457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:14.201573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:15.071920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:15.087361 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f29a417-19a3-4269-90cd-d33369fe7797 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1513 microversion: 2.1 time: 1.504149 Sep 16 14:03:15.102433 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1102/2188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:13 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1513 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:15.106427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:15.109401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:15.124616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:15.127488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:15.128454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:15.129424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:15.130083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:15.131324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:16.549266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:16.570867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:16.579369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:16.581008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9b3870c1-3014-4c68-8dc8-53995163ecd3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 3.809650 Sep 16 14:03:16.581910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1087/2189] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:12 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 3812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:03:16.598822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4e2a82f-164f-4ec2-ab6c-ad79d663e0d8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d1bfee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:16.707796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4e2a82f-164f-4ec2-ab6c-ad79d663e0d8 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.124269 Sep 16 14:03:16.711192 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1088/2190] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:16 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:16.722979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:16.730309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:16.741483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:16.746756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:16.747472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:16.747968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:16.748797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:16.749278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:16.760756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:17.188252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:17.220041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:17.222658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:17.224905 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0048bb66-e8cf-4771-81b5-de6801da5d0f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 2.129784 Sep 16 14:03:17.246318 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1103/2191] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:15 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:17.399402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:17.410222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-045dc109-d796-44ae-b5f2-c0c6b73b0a83 req-8c63e3b9-32fc-4c99-a93e-977056f946a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "484d374c-86ba-4273-b72f-ac0fe7b5ce96"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:17.412408 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7fa28f0d-2594-4bfb-9fa9-2f9125e022d1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1512 microversion: 2.1 time: 0.699223 Sep 16 14:03:17.416636 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1089/2192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:16 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:17.443565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:17.449355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-045dc109-d796-44ae-b5f2-c0c6b73b0a83 req-8c63e3b9-32fc-4c99-a93e-977056f946a6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:17.450132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-045dc109-d796-44ae-b5f2-c0c6b73b0a83 req-8c63e3b9-32fc-4c99-a93e-977056f946a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:17.451852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-045dc109-d796-44ae-b5f2-c0c6b73b0a83 req-8c63e3b9-32fc-4c99-a93e-977056f946a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:17.461127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:17.462008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:17.487659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-045dc109-d796-44ae-b5f2-c0c6b73b0a83 req-8c63e3b9-32fc-4c99-a93e-977056f946a6 service nova] Creating event network-vif-plugged:484d374c-86ba-4273-b72f-ac0fe7b5ce96 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:17.515271 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-045dc109-d796-44ae-b5f2-c0c6b73b0a83 req-8c63e3b9-32fc-4c99-a93e-977056f946a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267104 Sep 16 14:03:17.516282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1104/2193] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:17.616160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:17.616899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:17.636503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:17.650221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:17.651527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:17.653204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:17.657305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:17.673552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:18.345324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:18.347686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:18.348766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:18.351042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:18.352525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:18.354199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:18.952893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:19.257518 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ad211798-0112-4544-afd8-2cc508bc0ca9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 1.818585 Sep 16 14:03:19.274319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1090/2194] 10.222.0.60 () {58 vars in 1154 bytes} [Fri Sep 16 14:03:17 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:03:19.284406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1f65b0a-ce4b-4d25-8a4f-039aa21481ea tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d711940>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:19.435359 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1f65b0a-ce4b-4d25-8a4f-039aa21481ea tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.155361 Sep 16 14:03:19.453338 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1091/2195] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:19 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:19.486068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:19.495753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:19.515955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:19.527699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:19.527699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:19.528256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:19.529088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:19.529798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:19.543004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:19.768774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:19.782424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:19.798436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:19.800331 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4de84bd0-2723-4c7b-9b2b-c91fbcc96c9f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 2.190482 Sep 16 14:03:19.815226 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1105/2196] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:17 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:19.826690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:19.827676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:19.834967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:19.835968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:19.836631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:19.837606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:19.838290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:19.838935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:20.595835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:20.638819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:20.647212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:20.648974 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-272ef2ad-99b7-4411-a093-aad90de2f838 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 1.193741 Sep 16 14:03:20.662706 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1092/2197] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:19 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:20.680885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "a0b047d1-6918-4557-a37e-fbe607080f35"}, {"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "f0960c66-20d0-48d3-ab48-6129bb80f786"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:20.701628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:20.702623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:20.703330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:20.728341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] Creating event network-vif-plugged:a0b047d1-6918-4557-a37e-fbe607080f35 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:20.735945 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] Creating event network-vif-plugged:f0960c66-20d0-48d3-ab48-6129bb80f786 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:20.753142 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-55b8a248-f9ba-4681-8379-b9d343deb7d7 req-5f79e53b-42ba-40fe-aa2a-970f4df98994 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091442 Sep 16 14:03:20.754609 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1093/2198] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:20.767924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be8795eb-c050-4001-9dec-9da92b95ed41 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d407160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:20.863051 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be8795eb-c050-4001-9dec-9da92b95ed41 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.105513 Sep 16 14:03:20.872921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1094/2199] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:20 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:20.875978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:20.883966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:20.891563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:20.897787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:20.898461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:20.899335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:20.899934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:20.901824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:21.021241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:21.030921 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-51c58486-dee0-42bc-9f95-71c5ed6d6765 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1512 microversion: 2.1 time: 1.214019 Sep 16 14:03:21.037542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1106/2200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:19 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1512 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:21.065108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:21.066255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:21.069805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=78 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:21.081883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:21.091231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:21.091733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:21.092621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:21.093209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:21.093744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:21.994580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.021081 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8a96dc2b-037c-40a8-8f65-ff57e423ffbc tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1513 microversion: 2.1 time: 0.959651 Sep 16 14:03:22.030106 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1107/2201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:21 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1513 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:03:22.059825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:22.065467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:22.106098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:22.106641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:22.107092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:22.107853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:22.108316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:22.108747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:22.119560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.195669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.211090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.232930 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b7c8eb5-c230-4fdc-9376-e64f123bdd48 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.359254 Sep 16 14:03:22.247601 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1095/2202] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:20 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:22.326680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ed2c1e7-8132-4d08-9e7a-9f167a931052 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724def5670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:22.499417 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ed2c1e7-8132-4d08-9e7a-9f167a931052 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.249724 Sep 16 14:03:22.510551 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1096/2203] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:22 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:22.521335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-51a6c33a-efe9-4d35-b45f-a5705e629c59 req-b5cf665e-7525-433f-aa99-7eb45556f04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a64ce67-150d-4430-805a-9cbab3489620", "tag": "018cdf29-f7de-4244-9662-c83de9039962"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:22.610761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-51a6c33a-efe9-4d35-b45f-a5705e629c59 req-b5cf665e-7525-433f-aa99-7eb45556f04c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:22.613562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-51a6c33a-efe9-4d35-b45f-a5705e629c59 req-b5cf665e-7525-433f-aa99-7eb45556f04c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:22.616459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-51a6c33a-efe9-4d35-b45f-a5705e629c59 req-b5cf665e-7525-433f-aa99-7eb45556f04c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:22.665279 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-51a6c33a-efe9-4d35-b45f-a5705e629c59 req-b5cf665e-7525-433f-aa99-7eb45556f04c service nova] Creating event network-changed:018cdf29-f7de-4244-9662-c83de9039962 for instance 2a64ce67-150d-4430-805a-9cbab3489620 on n-h1-858129-2 Sep 16 14:03:22.682996 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-51a6c33a-efe9-4d35-b45f-a5705e629c59 req-b5cf665e-7525-433f-aa99-7eb45556f04c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167870 Sep 16 14:03:22.691552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1097/2204] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:22.717203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:22.719182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:22.756476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.760335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:22.762258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:22.765447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:22.767069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:22.769983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:22.777358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:22.778990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.780577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:22.799394 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f29e1b7-cddd-4877-89bf-fb98a6a777d6 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 0.748972 Sep 16 14:03:22.800107 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1108/2205] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:22 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:22.960713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "e7bd9cbb-3d6a-4456-be7c-87dc15b9bccf"}, {"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "62052e73-99d2-4387-aedc-43a848392aa4"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:23.002330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:23.003223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:23.003883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:23.086195 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] Creating event network-vif-plugged:e7bd9cbb-3d6a-4456-be7c-87dc15b9bccf for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:23.087700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] Creating event network-vif-plugged:62052e73-99d2-4387-aedc-43a848392aa4 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:23.095998 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0d263c70-334b-4c9f-baf9-6cffe36c1bd9 req-da30664a-764c-473c-b0e4-39cfe6e2cf9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.143004 Sep 16 14:03:23.098005 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1109/2206] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:03:23.307283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:23.308852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:23.347201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:23.348127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:23.348766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:23.350576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:23.351327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:23.362723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:24.352237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:24.377506 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a1d4104-06cf-4023-a513-59ea3c442d31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1512 microversion: 2.1 time: 1.682945 Sep 16 14:03:24.379246 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1098/2207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:22 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1512 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:24.392270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65f5a4b5-0a49-4a22-b7b1-0a9365fa78dd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f7251824040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:24.549832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65f5a4b5-0a49-4a22-b7b1-0a9365fa78dd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.163669 Sep 16 14:03:24.558986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1099/2208] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:24 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:24.581645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:24.581645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:24.599750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:24.603683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:24.617687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:24.619225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:24.620601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:24.621429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:24.622188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:24.668806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:24.672272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:24.681370 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-77fd102b-f585-468f-a31f-a449cafb78ac tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.395302 Sep 16 14:03:24.691282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1110/2209] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:23 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:24.702671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:24.738617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:24.740295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:24.762042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:24.763117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:24.763751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:24.764788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:24.765476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:24.766071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:24.817669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:24.987817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:25.010177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:25.011998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:25.012901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:25.745146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:25.788471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:25.800123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:25.806756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b21dd2c-46b1-4bea-90e3-9c05cb449259 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 1.250639 Sep 16 14:03:25.809243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46c82361-add9-44f5-bdb7-4864ab25066c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 1.115586 Sep 16 14:03:25.810762 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1100/2210] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:24 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:25.821255 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1111/2211] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:03:24 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:25.829465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-25c4a079-21ee-4a38-bf93-8943bf34cb80 req-01716325-494d-4803-aee2-4ec7f393eaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "f958f626-5770-476e-ba66-3f86c7c6d242"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:25.829797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1877e770-d617-4160-80df-6405a783ee86 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cff3550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:25.888589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-25c4a079-21ee-4a38-bf93-8943bf34cb80 req-01716325-494d-4803-aee2-4ec7f393eaab service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:25.889865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-25c4a079-21ee-4a38-bf93-8943bf34cb80 req-01716325-494d-4803-aee2-4ec7f393eaab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:25.890833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-25c4a079-21ee-4a38-bf93-8943bf34cb80 req-01716325-494d-4803-aee2-4ec7f393eaab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:25.930978 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1877e770-d617-4160-80df-6405a783ee86 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.107961 Sep 16 14:03:25.932175 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1112/2212] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:25 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:25.951379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:25.952789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:25.957731 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-25c4a079-21ee-4a38-bf93-8943bf34cb80 req-01716325-494d-4803-aee2-4ec7f393eaab service nova] Creating event network-vif-plugged:f958f626-5770-476e-ba66-3f86c7c6d242 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:25.974365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:25.975395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:25.984959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:25.986273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.005490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-25c4a079-21ee-4a38-bf93-8943bf34cb80 req-01716325-494d-4803-aee2-4ec7f393eaab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190373 Sep 16 14:03:26.022973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.025704 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1101/2213] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:26.031048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:26.070200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:26.086870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:26.087750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:26.524915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.525419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.525871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:26.526690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.527398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.528018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:26.587229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:26.657336 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d9f101d-d9d5-4fa9-bac7-50d7235bc964 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.622673 Sep 16 14:03:26.673172 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1102/2214] 10.222.0.60 () {58 vars in 1150 bytes} [Fri Sep 16 14:03:26 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:26.680019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:26.685987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:26.687043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:26.693120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.693957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.694654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:26.695669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.696353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.696992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:26.862316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:26.881627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:26.883542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:26.885189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ede445a8-fd29-4726-bb33-46868149c72d tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 0.950991 Sep 16 14:03:26.886379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1113/2215] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:25 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:26.895513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:26.897311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:26.907501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.908594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.909380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:26.910502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:26.911345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:26.912096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:27.027448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:27.220601 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b99b4c7c-3ae5-427b-9c5a-3f137dd48619 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.545408 Sep 16 14:03:27.223177 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1103/2216] 10.222.0.60 () {58 vars in 1212 bytes} [Fri Sep 16 14:03:26 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:27.229402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0fb02eb7-0add-4020-9fc6-ccd0d876d5ca tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d81eaf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:27.348217 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0fb02eb7-0add-4020-9fc6-ccd0d876d5ca tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.122643 Sep 16 14:03:27.350157 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1104/2217] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:27 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:27.376114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:27.393332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:27.394534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:27.407801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:27.408692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:27.412142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:27.417844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:27.420018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:27.422993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:27.734574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:27.925300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6565dc82-e7f1-4917-a2bb-e234799022e4 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.572113 Sep 16 14:03:27.943203 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1105/2218] 10.222.0.60 () {58 vars in 1196 bytes} [Fri Sep 16 14:03:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:27.955514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:27.957282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:27.980277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:27.981230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:27.984206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:27.987217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:27.988318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:27.991397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:28.127281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:28.139761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:28.143510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:28.150576 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05fe38bd-911d-42b2-bc37-7423b402141e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 1.261053 Sep 16 14:03:28.152076 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1114/2219] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:26 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:28.162358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:28.181740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:28.183378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': '1484957978', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:28.198116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:28.198921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:28.199576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:28.200547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:28.201224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:28.201841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:28.394949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:28.572721 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6130c7dc-4d6d-4c96-918d-95fd5fb07984 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?name=1484957978" status: 200 len: 346 microversion: 2.1 time: 0.418727 Sep 16 14:03:28.584351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1115/2220] 10.222.0.60 () {58 vars in 1156 bytes} [Fri Sep 16 14:03:28 2022] GET /compute/v2.1/servers?name=1484957978 => generated 346 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:28.590250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-aaaacc63-cdca-4df9-b664-58ab64de3a4f req-503ca573-c0a8-4fb6-9a4e-20c6c05b32e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-plugged", "status": "completed", "tag": "66d9e776-025b-45b3-9ba2-ecd62c2b3ffc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:28.610826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-aaaacc63-cdca-4df9-b664-58ab64de3a4f req-503ca573-c0a8-4fb6-9a4e-20c6c05b32e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:28.612255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-aaaacc63-cdca-4df9-b664-58ab64de3a4f req-503ca573-c0a8-4fb6-9a4e-20c6c05b32e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:28.614709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-aaaacc63-cdca-4df9-b664-58ab64de3a4f req-503ca573-c0a8-4fb6-9a4e-20c6c05b32e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:28.634363 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-aaaacc63-cdca-4df9-b664-58ab64de3a4f req-503ca573-c0a8-4fb6-9a4e-20c6c05b32e2 service nova] Creating event network-vif-plugged:66d9e776-025b-45b3-9ba2-ecd62c2b3ffc for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:28.644689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-aaaacc63-cdca-4df9-b664-58ab64de3a4f req-503ca573-c0a8-4fb6-9a4e-20c6c05b32e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057674 Sep 16 14:03:28.646856 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1116/2221] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:28.657701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27453a85-c86a-406c-adb0-20ce40d2878f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517feee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:28.751730 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27453a85-c86a-406c-adb0-20ce40d2878f tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.101650 Sep 16 14:03:28.753037 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1117/2222] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:28 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:28.762557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:28.773685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:28.775245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:28.785317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:28.786253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:28.787055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:28.789488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:28.791666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:28.792606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:29.076134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:29.247504 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ddc5b06c-6ffe-4e74-8497-174aaa45c6e2 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.490497 Sep 16 14:03:29.269516 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1118/2223] 10.222.0.60 () {58 vars in 1154 bytes} [Fri Sep 16 14:03:28 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:29.281750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:29.289843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:29.321962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:29.325599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:29.330019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:29.331875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:29.335083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:29.337854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:29.433858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:29.759434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:29.791927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:29.794954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:29.797053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82ae2908-9401-42e4-8293-b00c9dff0a23 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.852201 Sep 16 14:03:29.798338 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1106/2224] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:27 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:29.814353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:29.863041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:29.865201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-148495797', 'deleted': False, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:03:29.890149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:29.891044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:29.891844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:29.893210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:29.894033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:29.896918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.048757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:30.077908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:30.087829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:30.089895 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f6f34e1f-7c0f-449c-bb5e-e5a5e7770f4e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 0.817544 Sep 16 14:03:30.095442 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1119/2225] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:29 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:30.108131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0709abae-7c19-4e60-9b9d-52a9bfd02d1a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf03ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:30.174792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:03:30.221971 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0709abae-7c19-4e60-9b9d-52a9bfd02d1a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.119690 Sep 16 14:03:30.228025 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1120/2226] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:30 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:30.336762 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fda0af1a-2473-4034-891f-4d1167935775 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-148495797" status: 200 len: 346 microversion: 2.1 time: 0.528581 Sep 16 14:03:30.351232 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1107/2227] 10.222.0.60 () {58 vars in 1228 bytes} [Fri Sep 16 14:03:29 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-148495797 => generated 346 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:30.361524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:30.362592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:30.390702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.392336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.393412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.396249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.397445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.398956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.492710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:03:30.713590 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2ce0f88-b957-4099-90a6-a8b4bf68b5a9 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 204 len: 0 microversion: 2.1 time: 0.360013 Sep 16 14:03:30.717883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-eb259275-d75b-41d4-935c-47e7a4ecb241 req-75193048-fa9b-43bd-987e-1333409fbabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d42251-9a1b-4702-afa6-ef58d5b2bb96", "name": "network-vif-plugged", "status": "completed", "tag": "270026fb-ac51-4adc-b0ff-c15b43a583a2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:30.718521 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1121/2228] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:03:30 2022] DELETE /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:03:30.741257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:30.772389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:30.780266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb259275-d75b-41d4-935c-47e7a4ecb241 req-75193048-fa9b-43bd-987e-1333409fbabc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.782085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb259275-d75b-41d4-935c-47e7a4ecb241 req-75193048-fa9b-43bd-987e-1333409fbabc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.782876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eb259275-d75b-41d4-935c-47e7a4ecb241 req-75193048-fa9b-43bd-987e-1333409fbabc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.792345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.793183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.816207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.818049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.818927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.819700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.867550 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-eb259275-d75b-41d4-935c-47e7a4ecb241 req-75193048-fa9b-43bd-987e-1333409fbabc service nova] Creating event network-vif-plugged:270026fb-ac51-4adc-b0ff-c15b43a583a2 for instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 on n-h2-858129-2 Sep 16 14:03:30.876117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-eb259275-d75b-41d4-935c-47e7a4ecb241 req-75193048-fa9b-43bd-987e-1333409fbabc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183314 Sep 16 14:03:30.879523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1108/2229] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:30.895778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:30.896990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:30.919962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.922814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.923584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:30.926261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:30.927214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:30.931016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:31.913119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:31.936809 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa2c9c59-9433-4b1b-9f38-2cd2c75c9418 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1518 microversion: 2.1 time: 1.205350 Sep 16 14:03:31.941181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1122/2230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:30 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1518 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:31.956894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:31.961004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:31.980424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:31.981452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:31.986223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:31.993232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:32.001310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:32.003395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:32.004115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:32.009357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:32.017335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:32.017335 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d09371f9-5c96-42e5-9df4-c67338244325 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1879 microversion: 2.32 time: 1.133562 Sep 16 14:03:32.030355 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1109/2231] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:30 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1879 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:32.039065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9664cadf-ffec-44f4-8dfd-a8204ec0e442 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d8cc550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:32.174857 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9664cadf-ffec-44f4-8dfd-a8204ec0e442 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1455 microversion: 2.1 time: 0.142103 Sep 16 14:03:32.175948 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1110/2232] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:32 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:32.668467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1807137308", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "5437ac41-bd4e-4bea-9a86-640cb50d1db2"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:32.686843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:32.708249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:32.716022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:32.717625 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d29f35e2-9ebd-4e81-9f6d-3ccdb10276f0 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1280 microversion: 2.25 time: 0.772930 Sep 16 14:03:32.718659 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1123/2233] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:31 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1280 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:32.769782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] validate_networks() for [('5437ac41-bd4e-4bea-9a86-640cb50d1db2', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:03:32.991905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:32.993364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:33.027124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:33.029180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:33.030006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:33.031524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:33.032572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:33.041420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:33.579615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:33.593725 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c670a9d-11d7-4852-abd8-1c7ed88c4de5 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1518 microversion: 2.1 time: 0.616471 Sep 16 14:03:33.594726 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1124/2234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:32 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1518 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:33.606789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:33.607767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:33.625734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:33.631234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:33.631784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:33.632612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:33.633324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:33.636980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:34.572634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:34.600629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:34.609037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:34.613184 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-841c493c-351d-42cc-8b7d-56cb0ff8b67f tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2831 microversion: 2.32 time: 1.017026 Sep 16 14:03:34.625084 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1125/2235] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:33 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2831 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:34.652889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86ef0644-4728-48f5-875d-376c0da48dc0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d4bb310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:34.779247 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86ef0644-4728-48f5-875d-376c0da48dc0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1464 microversion: 2.1 time: 0.151888 Sep 16 14:03:34.781328 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1126/2236] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:34 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:34.788317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:34.789778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:34.797543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:34.798470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:34.799561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:34.800618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:34.801576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:34.802859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:34.981393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:36.067710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:03:36.068571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:03:36.068963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:03:36.069609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:03:36.070323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:03:36.077600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:36.094541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.095763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.097832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.100231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.103181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.104330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.171823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:36.177185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:36.183341 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7abedb9f-86e3-4c95-9cae-3e8e68e22e9e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1475 microversion: 2.25 time: 1.399420 Sep 16 14:03:36.191283 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1127/2237] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:34 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1475 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:36.210918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:36.223032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:36.230586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Getting quotas for project 997c95646a2b40489cf53d5538786bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:03:36.251899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.252404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.257038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Getting quotas for user e0441b7c0ea04bb08f871af5c2f1f46a and project 997c95646a2b40489cf53d5538786bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:03:36.259992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.263826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.264463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.264964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.339418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:03:36.346066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:03:36.436182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.439612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.444975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.448845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lazy-loading 'fault' on Instance uuid 93a18fbe-e35c-484f-90d2-6773e3bf3f35 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:03:36.602058 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f3e1a10-6d87-448a-a6fa-7fc87f7f93bd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.424245 Sep 16 14:03:36.616200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1111/2238] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:03:36.641825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:36.643951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:36.675780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.680147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.683515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.693466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:36.694645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:36.695691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:36.804328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:36.826754 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8259c6a-5a88-44d2-a5fe-9f3bb43244ca tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 200 len: 1311 microversion: 2.1 time: 0.628113 Sep 16 14:03:36.833304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1128/2239] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:36 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 1311 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:36.853640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d3169536-0e9a-41d0-8234-6c87550259fb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d4213a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:37.058816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d3169536-0e9a-41d0-8234-6c87550259fb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 200 len: 1464 microversion: 2.1 time: 0.193901 Sep 16 14:03:37.060737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1129/2240] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:36 2022] GET /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 1464 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:37.254284 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-571c2cb8-1cfa-4c52-b2f4-93457fae46e3 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.635863 Sep 16 14:03:37.255697 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1112/2241] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 14:03:36 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d/os-interface => generated 1832 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:37.278769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:37.284991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:37.318581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:37.320153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:37.326801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:37.338134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:37.340079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:37.341091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:37.515147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6acf8742-0791-4e73-8328-46184350ce56 req-986b058f-72f3-49aa-ac8a-c099bb043205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a18fbe-e35c-484f-90d2-6773e3bf3f35", "name": "network-vif-deleted", "tag": "bdfedaac-ad89-4285-87be-c7fb4af9d82c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:37.604470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6acf8742-0791-4e73-8328-46184350ce56 req-986b058f-72f3-49aa-ac8a-c099bb043205 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:37.605190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6acf8742-0791-4e73-8328-46184350ce56 req-986b058f-72f3-49aa-ac8a-c099bb043205 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:37.611681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6acf8742-0791-4e73-8328-46184350ce56 req-986b058f-72f3-49aa-ac8a-c099bb043205 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:37.664589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6acf8742-0791-4e73-8328-46184350ce56 req-986b058f-72f3-49aa-ac8a-c099bb043205 service nova] Creating event network-vif-deleted:bdfedaac-ad89-4285-87be-c7fb4af9d82c for instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 on n-h1-858129-2 Sep 16 14:03:37.712573 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6acf8742-0791-4e73-8328-46184350ce56 req-986b058f-72f3-49aa-ac8a-c099bb043205 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.647446 Sep 16 14:03:37.715724 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1130/2242] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:37.731495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d2faf6ca-dc37-4dae-832b-e25ec4e8afb1 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:37.740622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d2faf6ca-dc37-4dae-832b-e25ec4e8afb1 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:38.296305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d2faf6ca-dc37-4dae-832b-e25ec4e8afb1 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:38.305305 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d2faf6ca-dc37-4dae-832b-e25ec4e8afb1 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1224 microversion: 2.1 time: 0.585371 Sep 16 14:03:38.327063 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1131/2243] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:37 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1224 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:38.341000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:38.341817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:38.360122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:38.368173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:38.368807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:38.369701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:38.370294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:38.371155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:38.769525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid e6d42251-9a1b-4702-afa6-ef58d5b2bb96 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:03:38.821627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0a94ea7-697c-4689-81de-ba08e0dc862d tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1967 microversion: 2.25 time: 1.564189 Sep 16 14:03:38.827186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1113/2244] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:37 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1967 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:38.841197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fe053f8e-6f8d-4ce9-9d83-bf78774a4fb1 req-f28123a0-80ff-4868-a635-42b11d31d7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077b0270-538b-4d3c-bb57-fc02f8ae640c", "name": "network-vif-unplugged", "status": "completed", "tag": "699c0d76-e03c-4a5f-a650-09e078d1aa6e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:38.900313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fe053f8e-6f8d-4ce9-9d83-bf78774a4fb1 req-f28123a0-80ff-4868-a635-42b11d31d7da service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:38.924673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:38.927028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fe053f8e-6f8d-4ce9-9d83-bf78774a4fb1 req-f28123a0-80ff-4868-a635-42b11d31d7da service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:38.946987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fe053f8e-6f8d-4ce9-9d83-bf78774a4fb1 req-f28123a0-80ff-4868-a635-42b11d31d7da service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.014995 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fe053f8e-6f8d-4ce9-9d83-bf78774a4fb1 req-f28123a0-80ff-4868-a635-42b11d31d7da service nova] Creating event network-vif-unplugged:699c0d76-e03c-4a5f-a650-09e078d1aa6e for instance 077b0270-538b-4d3c-bb57-fc02f8ae640c on n-h1-858129-2 Sep 16 14:03:39.027299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fe053f8e-6f8d-4ce9-9d83-bf78774a4fb1 req-f28123a0-80ff-4868-a635-42b11d31d7da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190805 Sep 16 14:03:39.029594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1114/2245] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:39.042284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:39.044083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: 93a18fbe-e35c-484f-90d2-6773e3bf3f35] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:39.057063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.058952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.059673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.060624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.061441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.062071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.088030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] HTTP exception thrown: Instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 could not be found. Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Request method failure captured: Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 HTTP/1.1 Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIGwJaRrkABcN2IrTxPYkpElv3oBHSpJchImJDYHYuWxXtwpExn1R34s6yMYyj031I55e6wWGh8lj50cKDMNy96tEnLwVzG8MRHSXplQKb_51afuAdndT0_lI3BwI2ZJGKgSYDmKnbylZ2C0w0uuwFJp37xpZJe0xdaOyNen0JaKAec Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 48b4ca9353de4d098fbdaf1f17eabaf2 Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:39.091452 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48b4ca9353de4d098fbdaf1f17eabaf2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48b4ca9353de4d098fbdaf1f17eabaf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48b4ca9353de4d098fbdaf1f17eabaf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48b4ca9353de4d098fbdaf1f17eabaf2"}]}] Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 48b4ca9353de4d098fbdaf1f17eabaf2 Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListServerFiltersTestJSON-813025276-project Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2c36218bbfe443c81bf925b19660080 Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListServerFiltersTestJSON-813025276-project Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 could not be found. Sep 16 14:03:39.093542 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '93a18fbe-e35c-484f-90d2-6773e3bf3f35'} Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 could not be found. Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:39.094678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 could not be found. Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 could not be found. Sep 16 14:03:39.096632 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:39.099757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Returning 404 to user: Instance 93a18fbe-e35c-484f-90d2-6773e3bf3f35 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:39.101077 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4aca79a5-58f8-4a72-b2e5-bf08fa15b3a0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35" status: 404 len: 111 microversion: 2.1 time: 0.069557 Sep 16 14:03:39.102200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1115/2246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:39 2022] GET /compute/v2.1/servers/93a18fbe-e35c-484f-90d2-6773e3bf3f35 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:39.116834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:39.119723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:39.144452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.146471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.149969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.157203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.158857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.159790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.267631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:39.303260 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-814b5cc6-03ac-4ac4-8a3a-1e88c4cd7353 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1467 microversion: 2.1 time: 0.974495 Sep 16 14:03:39.308078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1132/2247] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:38 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1467 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:39.329229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:39.330713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:39.371817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.374004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.375678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.381541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.383549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.385493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.554394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:03:39.637794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid e6d42251-9a1b-4702-afa6-ef58d5b2bb96 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:03:39.642258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:39.668417 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-669bc53e-b4da-4bc2-8ae9-1d8aaad5d93c tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1967 microversion: 2.25 time: 0.564836 Sep 16 14:03:39.679545 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1116/2248] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:39 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1967 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:39.699210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:39.699210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:39.715628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.715753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.716121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.716858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:39.717325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:39.717765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:39.929587 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf6f4265-7732-4c39-8db8-0ffab79b60ff tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 204 len: 0 microversion: 2.1 time: 0.610754 Sep 16 14:03:39.933134 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1133/2249] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:03:39 2022] DELETE /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:03:39.961876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-328111499"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:39.978352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:40.009193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.010049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.017262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.018780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.019865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.038049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.080924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:40.093249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47b59c04-b143-4f62-8bd4-c64a1792c24b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1284 microversion: 2.1 time: 0.412539 Sep 16 14:03:40.094708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1117/2250] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:39 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1284 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:40.100390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:40.115972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.121348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.122950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.124036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.124735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.125419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.133002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=13 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:40.198841 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec9eccec-cf5f-4659-9c0a-b0e99c0323e7 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.102663 Sep 16 14:03:40.215592 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1118/2251] 10.222.0.60 () {60 vars in 1217 bytes} [Fri Sep 16 14:03:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:03:40.221575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:40.222517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:40.250973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.251753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.252407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.253383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.255695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.257865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.539251 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dffb8b55-bbe6-45a1-b178-ed7b4b4c43f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "POST /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f/action" status: 202 len: 0 microversion: 2.1 time: 0.596235 Sep 16 14:03:40.541873 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1134/2252] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:03:39 2022] POST /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:03:40.567763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858129-2", "block_migration": "auto"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:40.580891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:40.588434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:40.598017 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f379ce0e-626e-45e1-a5be-7d896c2b3602 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1519 microversion: 2.1 time: 0.380773 Sep 16 14:03:40.603874 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1119/2253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:40 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1519 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:40.611802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.612987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.618737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e0d5c68-6b88-4a0a-b36c-0a31ea232ecd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d1c6c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:40.627704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.631007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:40.631931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:40.632701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:40.704128 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e0d5c68-6b88-4a0a-b36c-0a31ea232ecd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.098607 Sep 16 14:03:40.709207 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1120/2254] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:40 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:40.776829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'flavor' on Instance uuid e6d42251-9a1b-4702-afa6-ef58d5b2bb96 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:03:40.822949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:40.835858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Going to try to live migrate instance to n-h1-858129-2 {{(pid=128643) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:03:41.135703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:41.136507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:41.149868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:41.150370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:41.150841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:41.151584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:41.163024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:41.167014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:41.446926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:41.460109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-533eb50f-5cba-4e9c-88e2-9b44287bb9be tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1294 microversion: 2.1 time: 0.329668 Sep 16 14:03:41.462282 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1121/2255] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:41 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1294 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:03:41.569130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5f50c3ba-d6be-4748-a19e-bf5198eaaf96 req-6cda930f-b2eb-4dbd-8670-4fd83b00f0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "tag": "484d374c-86ba-4273-b72f-ac0fe7b5ce96"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:41.587315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5f50c3ba-d6be-4748-a19e-bf5198eaaf96 req-6cda930f-b2eb-4dbd-8670-4fd83b00f0e1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:41.590617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5f50c3ba-d6be-4748-a19e-bf5198eaaf96 req-6cda930f-b2eb-4dbd-8670-4fd83b00f0e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:41.591448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5f50c3ba-d6be-4748-a19e-bf5198eaaf96 req-6cda930f-b2eb-4dbd-8670-4fd83b00f0e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:41.622391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5f50c3ba-d6be-4748-a19e-bf5198eaaf96 req-6cda930f-b2eb-4dbd-8670-4fd83b00f0e1 service nova] Creating event network-changed:484d374c-86ba-4273-b72f-ac0fe7b5ce96 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:03:41.641063 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5f50c3ba-d6be-4748-a19e-bf5198eaaf96 req-6cda930f-b2eb-4dbd-8670-4fd83b00f0e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076362 Sep 16 14:03:41.642351 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1122/2256] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:03:41.649317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:41.656868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:41.667801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:41.671162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:41.671641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:41.672471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:41.674470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:41.678547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:42.122361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:42.137185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a0b8615-a0e6-4b3e-9942-d8cd313ec424 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1519 microversion: 2.1 time: 0.493298 Sep 16 14:03:42.138772 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1123/2257] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:41 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:42.155393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb95b8d9-efa4-4224-8015-7cafa1368385 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d0c3160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:42.318087 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb95b8d9-efa4-4224-8015-7cafa1368385 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.175169 Sep 16 14:03:42.322311 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1124/2258] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:42 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:42.501943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:42.502779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:42.514372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:42.514915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:42.515402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:42.516100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:42.516570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:42.517010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:43.167519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:43.182969 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac11ab60-02ac-4ae4-8472-f7db61ec2b7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.695342 Sep 16 14:03:43.183854 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1125/2259] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:42 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:43.196057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:43.196855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:43.219973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:43.220488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:43.221001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:43.221769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:43.222253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:43.222763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:44.012524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:44.029839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0094e50-1840-4e16-b6b0-0fd877ade870 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1519 microversion: 2.1 time: 0.841222 Sep 16 14:03:44.033283 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1126/2260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:43 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1519 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:44.049753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5a7606b-403b-4f8c-a1fe-3b6551122e09 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724df145e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:44.171500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5a7606b-403b-4f8c-a1fe-3b6551122e09 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.135660 Sep 16 14:03:44.175847 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1127/2261] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:44 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:44.221288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:44.221932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:44.258100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:44.261095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:44.262191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:44.263123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:44.263571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:44.271582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:45.056772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:45.082316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-daa0568a-f17c-4451-9c3d-2dee19e86d9e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.870630 Sep 16 14:03:45.084734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1128/2262] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:44 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:45.096034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4b435d09-d1e7-4c84-8991-d1be0d04c28d req-0b6b9788-6c06-4c36-ac32-2c4de6a32ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:45.145223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4b435d09-d1e7-4c84-8991-d1be0d04c28d req-0b6b9788-6c06-4c36-ac32-2c4de6a32ba1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:45.147019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4b435d09-d1e7-4c84-8991-d1be0d04c28d req-0b6b9788-6c06-4c36-ac32-2c4de6a32ba1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:45.148952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4b435d09-d1e7-4c84-8991-d1be0d04c28d req-0b6b9788-6c06-4c36-ac32-2c4de6a32ba1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:45.220436 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4b435d09-d1e7-4c84-8991-d1be0d04c28d req-0b6b9788-6c06-4c36-ac32-2c4de6a32ba1 service nova] Creating event network-changed:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:03:45.235748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4b435d09-d1e7-4c84-8991-d1be0d04c28d req-0b6b9788-6c06-4c36-ac32-2c4de6a32ba1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147934 Sep 16 14:03:45.237753 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1129/2263] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:45.251732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:45.252808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:45.263067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:45.263813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:45.264879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:45.279711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:45.280981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:45.282071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:45.650076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:45.687928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a5ed3d9-55c5-4548-b6fb-63609b602620 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 200 len: 1477 microversion: 2.1 time: 0.445187 Sep 16 14:03:45.690779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1130/2264] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:45 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:45.717063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5d531ac-3ecc-4a72-a5db-66725582389e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf60ca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:45.803657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7386a426-0ab9-43a1-a533-def98c392f20 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96/action" status: 202 len: 0 microversion: 2.25 time: 5.258281 Sep 16 14:03:45.810734 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1135/2265] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:03:40 2022] POST /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96/action => generated 0 bytes in 5268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:03:45.843000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-36a402ce-5579-4e3f-92bc-e79780abf6ed req-8482a198-2b40-4322-ba70-90acfb5607e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec4dbfbe-4d92-4774-b14c-1e9f69d751c4", "name": "network-vif-deleted", "tag": "b90e61ea-d969-4a78-884d-96971db1795e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:45.889523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-36a402ce-5579-4e3f-92bc-e79780abf6ed req-8482a198-2b40-4322-ba70-90acfb5607e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:45.892987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-36a402ce-5579-4e3f-92bc-e79780abf6ed req-8482a198-2b40-4322-ba70-90acfb5607e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:45.895846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-36a402ce-5579-4e3f-92bc-e79780abf6ed req-8482a198-2b40-4322-ba70-90acfb5607e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:45.935772 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5d531ac-3ecc-4a72-a5db-66725582389e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.241683 Sep 16 14:03:45.938165 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1131/2266] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:45 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:45.953739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:45.966047 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-36a402ce-5579-4e3f-92bc-e79780abf6ed req-8482a198-2b40-4322-ba70-90acfb5607e2 service nova] Creating event network-vif-deleted:b90e61ea-d969-4a78-884d-96971db1795e for instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 on n-h1-858129-2 Sep 16 14:03:45.966367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:45.983679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:45.985497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:45.992085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:45.997102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:46.001128 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-36a402ce-5579-4e3f-92bc-e79780abf6ed req-8482a198-2b40-4322-ba70-90acfb5607e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173880 Sep 16 14:03:46.002097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:46.003978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:46.006212 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1136/2267] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:46.133009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:46.142676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:46.209207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:46.232305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:46.236135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:46.237729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:46.245043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:46.252549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:46.302611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:47.408534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:47.410012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:47.421737 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3d48796-aeec-40f1-8267-c4827a4865cd tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 1.305179 Sep 16 14:03:47.425543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1137/2268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:46 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:47.472801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:47.478032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:47.482262 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86cee465-30ad-4973-a39d-1c18a12ebb9a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 1.538801 Sep 16 14:03:47.497360 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1132/2269] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:45 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:47.498107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-93771508", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "575d05a6-4ba6-41a5-9a08-5c4f5b088b3e"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:47.498314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:47.498314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: ec4dbfbe-4d92-4774-b14c-1e9f69d751c4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:47.508954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:47.515211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:47.517785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:47.519694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:47.520683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:47.521344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:47.521973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:47.588344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] validate_networks() for [('575d05a6-4ba6-41a5-9a08-5c4f5b088b3e', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:03:47.610808 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] HTTP exception thrown: Instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 could not be found. Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Request method failure captured: Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 HTTP/1.1 Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIGwJaRrkABcN2IrTxPYkpElv3oBHSpJchImJDYHYuWxXtwpExn1R34s6yMYyj031I55e6wWGh8lj50cKDMNy96tEnLwVzG8MRHSXplQKb_51afuAdndT0_lI3BwI2ZJGKgSYDmKnbylZ2C0w0uuwFJp37xpZJe0xdaOyNen0JaKAec Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 48b4ca9353de4d098fbdaf1f17eabaf2 Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:03:47.617096 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48b4ca9353de4d098fbdaf1f17eabaf2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48b4ca9353de4d098fbdaf1f17eabaf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48b4ca9353de4d098fbdaf1f17eabaf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48b4ca9353de4d098fbdaf1f17eabaf2"}]}] Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 48b4ca9353de4d098fbdaf1f17eabaf2 Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListServerFiltersTestJSON-813025276-project Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2c36218bbfe443c81bf925b19660080 Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListServerFiltersTestJSON-813025276-project Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 could not be found. Sep 16 14:03:47.620437 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ec4dbfbe-4d92-4774-b14c-1e9f69d751c4'} Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 could not be found. Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:47.622267 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 could not be found. Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 could not be found. Sep 16 14:03:47.625413 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:03:47.631536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Returning 404 to user: Instance ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:47.636908 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f991399b-028e-44e7-9e66-f82a2aab26ee tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4" status: 404 len: 111 microversion: 2.1 time: 0.148802 Sep 16 14:03:47.644428 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1133/2270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:47 2022] GET /compute/v2.1/servers/ec4dbfbe-4d92-4774-b14c-1e9f69d751c4 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:47.655551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72da4ab7-d1c9-45d2-8bad-be4e650dcfdd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d2af4c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:47.755767 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72da4ab7-d1c9-45d2-8bad-be4e650dcfdd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.107751 Sep 16 14:03:47.757716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1134/2271] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:47 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:47.771385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:47.772686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:47.784756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:47.786700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:47.788184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:47.790096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:47.791354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:47.792461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:47.890975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:03:48.190876 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30d82c44-5c03-4e04-887d-34b55a1f89d0 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 204 len: 0 microversion: 2.1 time: 0.423276 Sep 16 14:03:48.198604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1135/2272] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:03:47 2022] DELETE /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:03:48.214528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:48.216702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:48.234579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.235506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.236589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.238153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.242304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.243686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.304940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:48.558195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:03:48.559382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:03:48.560035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:03:48.560645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:03:48.561248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:03:48.578901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.580722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.581352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.587242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.588713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.589373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.629397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:48.635308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Getting quotas for project 89b4bacbf16c4151a5791f8eff94602b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:03:48.643005 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d491df0-7728-42a3-b261-3a3d48d25f8c tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1518 microversion: 2.1 time: 0.438980 Sep 16 14:03:48.644457 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1136/2273] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:48 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1518 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:48.648423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Getting quotas for user 1da29458cf5d4997bab871b631fdb1b4 and project 89b4bacbf16c4151a5791f8eff94602b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:03:48.654492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:48.655275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:48.665225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.666362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.667095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.668068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.669458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.670147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.682482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:03:48.692291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:03:48.800415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e41eb9ba-1550-4ed0-8563-c35c1eebce24 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372751 Sep 16 14:03:48.809887 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1138/2274] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:03:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:03:48.824229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:48.825161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:48.836703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.838201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.838944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.840114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:48.840767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:48.841571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:48.963632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:48.994148 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c80e569-c3e1-410e-a795-885a98d7887a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.340097 Sep 16 14:03:48.996510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1137/2275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:48 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:49.019291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b5ab0e6-7535-4ea9-8bd8-8f01f476a01d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d197790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:49.180486 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b5ab0e6-7535-4ea9-8bd8-8f01f476a01d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.177884 Sep 16 14:03:49.189873 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1138/2276] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:48 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:49.211898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8293e5f-92a2-46ba-b27c-9c769b1aeef8 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:49.218574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8293e5f-92a2-46ba-b27c-9c769b1aeef8 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:49.271881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:49.284128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:49.289564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:49.291314 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-34981a51-81fb-449f-abb4-8d921881f7eb tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.479781 Sep 16 14:03:49.292543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1139/2277] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:48 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:49.390036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8293e5f-92a2-46ba-b27c-9c769b1aeef8 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:49.410099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8293e5f-92a2-46ba-b27c-9c769b1aeef8 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1214 microversion: 2.1 time: 0.218189 Sep 16 14:03:49.412191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1139/2278] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:49 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:49.694918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:49.696944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:49.707778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:49.708572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:49.709272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:49.710701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:49.711391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:49.711642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:49.898326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:49.939600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9809781f-8749-4210-9b3a-a9f9176f1341 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1518 microversion: 2.1 time: 0.251144 Sep 16 14:03:49.940514 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1140/2279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:49 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:50.020848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:50.021472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:50.029508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.030426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.031199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.031974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.032475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.032894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.174119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:50.206086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a304583-fd79-460e-8f90-9eea3e49ca92 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d54f670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:50.247640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:50.264607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b22d6687-4455-4e7c-9724-409d7db5050a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.247571 Sep 16 14:03:50.266251 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1140/2280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:50 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:03:50.293369 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a304583-fd79-460e-8f90-9eea3e49ca92 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.091128 Sep 16 14:03:50.294383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1141/2281] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:50 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:50.344953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:50.345887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:50.389809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.390449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.391135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.392108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.394316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.397707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.451327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:50.452297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:50.468918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.471114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.471570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:50.472353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.478367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.479704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.481330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.673483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:50.692525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-222b652f-b1c7-468a-892c-b23aa675bf0a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1218 microversion: 2.1 time: 0.256478 Sep 16 14:03:50.695278 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1142/2282] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:50 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1218 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:50.926791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:50.950637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:50.955702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:50.963647 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bebdc009-f187-41ca-a55b-fbfd980f440b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.619322 Sep 16 14:03:50.969441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:50.970375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:50.976375 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1141/2283] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:50 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:50.990460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.991509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.992355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:50.993420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:50.994194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:50.994891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:51.289621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:51.290978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:51.309083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:51.309883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:51.310336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:51.311128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:51.311598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:51.312038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:51.621819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:51.681750 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad92b801-67e2-4121-b5ee-8ee96545da25 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1518 microversion: 2.1 time: 0.712377 Sep 16 14:03:51.685827 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1143/2284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:50 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1518 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:03:51.700632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fffb6c2b-7925-4f1b-8a4d-5def400b0417 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d1b79d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:51.922348 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fffb6c2b-7925-4f1b-8a4d-5def400b0417 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.230258 Sep 16 14:03:51.926803 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1144/2285] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:51 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:51.952013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:51.954010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:51.957977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:51.970275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:51.970722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19ec770a-e66b-47f4-9ab7-f0c03f466a39 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.684755 Sep 16 14:03:51.975409 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1142/2286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:51 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:52.001352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.008525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.014614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.019628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:52.019960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.020252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:52.021614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.023150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.038288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.038829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.039283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.040229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.040778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.041217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.303957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:52.366075 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1137706d-cb40-48e2-bea8-5fccc6262f6a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1274 microversion: 2.1 time: 0.435923 Sep 16 14:03:52.370476 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1145/2287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:51 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1274 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:52.384268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-acb3031b-b252-48d3-bdcc-b00df847cd20 req-f86de93c-9429-493d-a343-d8a78400c36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "name": "network-vif-plugged", "status": "completed", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:52.412615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-acb3031b-b252-48d3-bdcc-b00df847cd20 req-f86de93c-9429-493d-a343-d8a78400c36a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.413470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-acb3031b-b252-48d3-bdcc-b00df847cd20 req-f86de93c-9429-493d-a343-d8a78400c36a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.414288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-acb3031b-b252-48d3-bdcc-b00df847cd20 req-f86de93c-9429-493d-a343-d8a78400c36a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.436727 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-acb3031b-b252-48d3-bdcc-b00df847cd20 req-f86de93c-9429-493d-a343-d8a78400c36a service nova] Creating event network-vif-plugged:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:03:52.470170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-acb3031b-b252-48d3-bdcc-b00df847cd20 req-f86de93c-9429-493d-a343-d8a78400c36a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089800 Sep 16 14:03:52.474142 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1146/2288] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:52.572606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:52.590110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:52.603043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:52.606566 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6899c2b-c13d-496e-89f4-44ba605706fa tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.590928 Sep 16 14:03:52.625044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1143/2289] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:52 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:03:52.729576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:52.732241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:52.759581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.760319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.761092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.762428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:52.763363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:52.764000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:52.914841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c36218bbfe443c81bf925b19660080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4ca9353de4d098fbdaf1f17eabaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:52.927654 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b38d8e38-50ab-4bc2-9eb9-3740b7881bc1 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 200 len: 1476 microversion: 2.1 time: 0.220455 Sep 16 14:03:52.930567 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1147/2290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:52 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:52.952532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56afe818-14ee-4475-a7dd-602a1d7277e7 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d0c3a60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:53.000094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:53.001773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:53.024818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:53.033672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:53.038136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:53.042959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:53.045315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:53.048979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:53.073482 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56afe818-14ee-4475-a7dd-602a1d7277e7 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.125414 Sep 16 14:03:53.077780 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1144/2291] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:52 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:53.392920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-46596246", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "e3e4f01d-b338-4f02-af18-87ac221a4f19"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:53.744732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] validate_networks() for [('e3e4f01d-b338-4f02-af18-87ac221a4f19', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:03:54.283986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:54.327851 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d213080-8055-48a6-92f1-f3c9d3921416 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 1.327077 Sep 16 14:03:54.348209 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1148/2292] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:52 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:54.393513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d983f33d-5e98-4ee0-ac23-3893c4a94151 req-64ac0923-a4d3-4516-b6d6-45a80200d868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48160e8-3b83-40a4-a130-e12551287121", "name": "network-vif-deleted", "tag": "54ab302d-7b0c-498b-abfb-42777277e48a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:54.420895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d983f33d-5e98-4ee0-ac23-3893c4a94151 req-64ac0923-a4d3-4516-b6d6-45a80200d868 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:54.422701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d983f33d-5e98-4ee0-ac23-3893c4a94151 req-64ac0923-a4d3-4516-b6d6-45a80200d868 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:54.424322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d983f33d-5e98-4ee0-ac23-3893c4a94151 req-64ac0923-a4d3-4516-b6d6-45a80200d868 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:54.453996 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d983f33d-5e98-4ee0-ac23-3893c4a94151 req-64ac0923-a4d3-4516-b6d6-45a80200d868 service nova] Creating event network-vif-deleted:54ab302d-7b0c-498b-abfb-42777277e48a for instance f48160e8-3b83-40a4-a130-e12551287121 on n-h2-858129-2 Sep 16 14:03:54.467416 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d983f33d-5e98-4ee0-ac23-3893c4a94151 req-64ac0923-a4d3-4516-b6d6-45a80200d868 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116116 Sep 16 14:03:54.469907 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1149/2293] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:03:54.486216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:54.489187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:54.505954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:54.507710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:54.508947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:54.510958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:54.513283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:54.515441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:54.978589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:54.994825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-63d1f078-3123-4f2e-a8f5-b8a48045812f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1272 microversion: 2.1 time: 0.519274 Sep 16 14:03:54.997188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1150/2294] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:54 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1272 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:55.009537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:55.015815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:55.035258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:55.036255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:55.037004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:55.038140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:55.038951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:55.039634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:55.600106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:55.627652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:55.630305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:55.635247 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-323873f1-1c4f-476d-9d7b-82148b23e27d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.631276 Sep 16 14:03:55.638909 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1151/2295] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:54 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:55.650264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:55.659583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] [instance: f48160e8-3b83-40a4-a130-e12551287121] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:55.673548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:55.674175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:55.676238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:55.681024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:55.681947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:55.684523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:55.686218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:03:55.686904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:03:55.687398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:03:55.688022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:03:55.688812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:03:55.719260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:55.721323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:55.724183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:55.728489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:55.729531 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] HTTP exception thrown: Instance f48160e8-3b83-40a4-a130-e12551287121 could not be found. Sep 16 14:03:55.730511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:55.731559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Request method failure captured: Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 HTTP/1.1 Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIGwJaRrkABcN2IrTxPYkpElv3oBHSpJchImJDYHYuWxXtwpExn1R34s6yMYyj031I55e6wWGh8lj50cKDMNy96tEnLwVzG8MRHSXplQKb_51afuAdndT0_lI3BwI2ZJGKgSYDmKnbylZ2C0w0uuwFJp37xpZJe0xdaOyNen0JaKAec Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 48b4ca9353de4d098fbdaf1f17eabaf2 Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:03:55.736888 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48b4ca9353de4d098fbdaf1f17eabaf2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48b4ca9353de4d098fbdaf1f17eabaf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48b4ca9353de4d098fbdaf1f17eabaf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48b4ca9353de4d098fbdaf1f17eabaf2"}]}] Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 48b4ca9353de4d098fbdaf1f17eabaf2 Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-813025276 Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ListServerFiltersTestJSON-813025276-project Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e2c36218bbfe443c81bf925b19660080 Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ListServerFiltersTestJSON-813025276-project Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f48160e8-3b83-40a4-a130-e12551287121 could not be found. Sep 16 14:03:55.740122 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f48160e8-3b83-40a4-a130-e12551287121'} Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48160e8-3b83-40a4-a130-e12551287121 could not be found. Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:03:55.741570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48160e8-3b83-40a4-a130-e12551287121 could not be found. Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48160e8-3b83-40a4-a130-e12551287121 could not be found. Sep 16 14:03:55.743593 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:03:55.748417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] Returning 404 to user: Instance f48160e8-3b83-40a4-a130-e12551287121 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:03:55.750997 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfd2b98c-ea20-4060-9fcb-31ddfa2c7a31 tempest-ListServerFiltersTestJSON-813025276 tempest-ListServerFiltersTestJSON-813025276-project] 10.222.0.60 "GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121" status: 404 len: 111 microversion: 2.1 time: 0.106880 Sep 16 14:03:55.754475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1152/2296] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:55 2022] GET /compute/v2.1/servers/f48160e8-3b83-40a4-a130-e12551287121 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:03:55.765514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcb375ce-9106-432d-83ba-c593cf02b985 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d433dc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:55.803769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:03:55.812409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for user 8c6bcf9620664cd2a156abfa959f3c50 and project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:03:55.831411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:03:55.834522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:03:55.957109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4337fb60-e2b4-4686-8f73-39955fba4d31 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.851127 Sep 16 14:03:55.957654 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bcb375ce-9106-432d-83ba-c593cf02b985 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.197928 Sep 16 14:03:55.961126 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1153/2297] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:55 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:55.970174 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1145/2298] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:03:55.976001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:55.976952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:55.989289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b550b79-a844-4c3b-a92d-0a71a49e17ea tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:55.992391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b550b79-a844-4c3b-a92d-0a71a49e17ea tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:56.020862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:56.024319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:56.024890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:56.029097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:56.029652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:56.030103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:56.207984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b550b79-a844-4c3b-a92d-0a71a49e17ea tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:56.218380 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b550b79-a844-4c3b-a92d-0a71a49e17ea tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1223 microversion: 2.1 time: 0.235634 Sep 16 14:03:56.225674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1146/2299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:55 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1223 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:56.254884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:56.255833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:56.293228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:56.296806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:56.298519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:56.301277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:56.304227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:56.305278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:56.743711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:56.754163 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-727cf5f4-8bdb-4b8e-a528-418c76fe3e74 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.791281 Sep 16 14:03:56.774606 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1154/2300] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:55 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:56.817810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:56.818794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:56.838105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:56.838813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:56.841039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:56.842101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:56.844264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:56.847068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:57.165083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:57.174780 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1b23fde-ae8e-4f36-b0dc-783de9ad8f2d tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 0.947834 Sep 16 14:03:57.190620 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1147/2301] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:56 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:57.210452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de580de5-c09d-4d8e-87f7-4838c6bf02f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d099ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:57.341831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de580de5-c09d-4d8e-87f7-4838c6bf02f9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.145106 Sep 16 14:03:57.343777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1148/2302] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:57 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:57.356440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:57.359726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:57.376327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:57.377944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:57.378741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:57.382791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:57.383820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:57.384526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:57.405284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:57.423217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:57.433092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:57.439565 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e2e96a2-65c3-4cbb-8547-0d699fd2e1ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.659553 Sep 16 14:03:57.446514 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1155/2303] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:56 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:03:57.564541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6257d2bb-0776-4d0a-8ed3-506fda24aa72 req-f344b767-4da3-4a2c-a91d-f6068ec9b4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62fa1ed-86d1-4305-a271-b4e8006b22c2", "tag": "32483bcd-64ce-475c-9852-520fdf886603"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:03:57.595758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6257d2bb-0776-4d0a-8ed3-506fda24aa72 req-f344b767-4da3-4a2c-a91d-f6068ec9b4c2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:57.600296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6257d2bb-0776-4d0a-8ed3-506fda24aa72 req-f344b767-4da3-4a2c-a91d-f6068ec9b4c2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:57.601536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6257d2bb-0776-4d0a-8ed3-506fda24aa72 req-f344b767-4da3-4a2c-a91d-f6068ec9b4c2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:57.636414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6257d2bb-0776-4d0a-8ed3-506fda24aa72 req-f344b767-4da3-4a2c-a91d-f6068ec9b4c2 service nova] Creating event network-changed:32483bcd-64ce-475c-9852-520fdf886603 for instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 on n-h1-858129-2 Sep 16 14:03:57.649908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6257d2bb-0776-4d0a-8ed3-506fda24aa72 req-f344b767-4da3-4a2c-a91d-f6068ec9b4c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091141 Sep 16 14:03:57.653069 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1156/2304] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 16 14:03:57.674031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:57.688213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3f14cd82-a049-465c-9bd2-f9c74179c42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1227 microversion: 2.1 time: 0.342369 Sep 16 14:03:57.693102 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1149/2305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:57 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:57.788298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:57.789773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:57.825388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:57.835118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:57.836268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:57.837712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:57.841898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:57.847917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:57.934941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:58.211439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:58.214091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:58.246532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:58.249775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:58.256470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:58.263915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:58.268590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:58.275176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:58.611285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:58.673409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:03:58.896743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:58.915027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:58.919261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29993c74-12e2-4f8f-9046-372837679694 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 0.706352 Sep 16 14:03:58.926479 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1150/2306] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:58 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:58.944321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1855406c-48ce-4e9f-9b9e-d42ff06a358d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 1.161847 Sep 16 14:03:58.951136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1157/2307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:57 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:58.954041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ef5d18e-d527-4c57-b173-66fa7e1c3564 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d0c34c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:58.969895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:58.970527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:58.996717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:58.997223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:58.997660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:59.002496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:59.002915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:59.004058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:59.151260 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ef5d18e-d527-4c57-b173-66fa7e1c3564 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.221251 Sep 16 14:03:59.152188 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1151/2308] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:03:58 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:03:59.172008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:03:59.179759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:03:59.212001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:59.219913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:59.221702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:59.229792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:03:59.232069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:03:59.237270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:03:59.805619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:03:59.844478 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e55f099-7926-4113-915a-c12f5a551a8e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1275 microversion: 2.1 time: 0.689440 Sep 16 14:03:59.869335 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1152/2309] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:59 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1275 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:00.002179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:00.003774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:00.023915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.026558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.027306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:00.031184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.033726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.035106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:00.284092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:00.311521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:00.335952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:00.346781 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-95fd8b4a-8cae-4c74-a865-bdc0b03f89da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 1.386157 Sep 16 14:04:00.350382 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1158/2310] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:03:58 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:00.391969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:00.392666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:00.414704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.415207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.418420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:00.421721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.422520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.423613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:00.584857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:00.609015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b61c406c-235a-4102-8202-bee66a0fc97a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 0.615105 Sep 16 14:04:00.613808 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1153/2311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:03:59 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:00.623092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08a53338-936d-4abb-84ca-623c2412cce6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce63550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:00.827866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08a53338-936d-4abb-84ca-623c2412cce6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.211766 Sep 16 14:04:00.833344 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1154/2312] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:00 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:00.855937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7a055826-6ba9-4bf3-b7b7-725999aab461 req-22b5b2e9-1ba9-4131-bc85-fe8c276001c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "name": "network-vif-plugged", "status": "completed", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:00.866980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:00.896804 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82e763d5-9417-4823-b8aa-0a122fe2d114 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 0.513278 Sep 16 14:04:00.902253 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1159/2313] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:00 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:00.916194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a055826-6ba9-4bf3-b7b7-725999aab461 req-22b5b2e9-1ba9-4131-bc85-fe8c276001c0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.919679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a055826-6ba9-4bf3-b7b7-725999aab461 req-22b5b2e9-1ba9-4131-bc85-fe8c276001c0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.926295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a055826-6ba9-4bf3-b7b7-725999aab461 req-22b5b2e9-1ba9-4131-bc85-fe8c276001c0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:00.926698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:00.945004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:00.965003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.966186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.967369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:00.971692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:00.973445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:00.975721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:01.020865 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7a055826-6ba9-4bf3-b7b7-725999aab461 req-22b5b2e9-1ba9-4131-bc85-fe8c276001c0 service nova] Creating event network-vif-plugged:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:04:01.049618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7a055826-6ba9-4bf3-b7b7-725999aab461 req-22b5b2e9-1ba9-4131-bc85-fe8c276001c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210568 Sep 16 14:04:01.058918 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1155/2314] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:01.237760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:01.264869 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d86a19ea-2c42-4bd8-a9e5-21ee654710c3 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1281 microversion: 2.1 time: 0.357083 Sep 16 14:04:01.268098 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1160/2315] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:00 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:01.396064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:01.397677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:01.417013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:01.418317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:01.426124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:01.428048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:01.429194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:01.435210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:01.661138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:01.663291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:01.710436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:01.716883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:01.724891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:01.732836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:01.739685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:01.740639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:02.025979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:02.056703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:02.062376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:02.064219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a7de633-4244-448d-a94e-35beac9d2cea tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.682927 Sep 16 14:04:02.071484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1156/2316] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:01 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:04:02.076694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-650caff6-c152-48a7-963d-f591174e1d49 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d1a93a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:02.270364 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-650caff6-c152-48a7-963d-f591174e1d49 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.193225 Sep 16 14:04:02.274032 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1157/2317] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:02 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:02.283758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:02.290128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:02.306436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:02.308792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:02.313739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:02.315958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:02.318375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:02.319890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:03.003181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:03.045506 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-96428887-3f1f-40ba-b062-fd6b75ee16f6 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 1.387393 Sep 16 14:04:03.049804 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1161/2318] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:01 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:03.094759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:03.100382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:03.135382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:03.138892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:03.141365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:03.147468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:03.151122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:03.156891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:03.553798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:03.594535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c03e4d6-e47f-4c7f-8077-6f5811a9bc2b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 1.317877 Sep 16 14:04:03.601762 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1158/2319] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:02 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:03.625404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:03.631655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:03.669957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:03.673002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:03.677014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:03.681355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:03.686676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:03.688840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:04.184290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:04.228096 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19e58c3f-0226-4265-b82d-e5752d0c5d94 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 1.174713 Sep 16 14:04:04.236890 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1162/2320] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:03 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:04.269223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e5353e3-a3a3-4342-be63-a2d0e93cab0d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d18faf0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:04.389887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:04.424973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:04.429624 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e5353e3-a3a3-4342-be63-a2d0e93cab0d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.190443 Sep 16 14:04:04.430240 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1163/2321] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:04 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:04.434161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:04.440441 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-933727d2-cf78-426d-af1c-51c91647a4a9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.836480 Sep 16 14:04:04.445753 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1159/2322] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:03 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:04.450787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:04.451424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:04.493451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:04.493951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:04.494393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:04.505992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:04.506673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:04.507091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:04.643679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:04.645010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:04.702220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:04.702768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:04.703225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:04.703987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:04.704450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:04.717596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:05.716617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:05.761687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45c3aa91-4b84-42e5-9be7-d63fe98b6bef tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1324 microversion: 2.1 time: 1.121603 Sep 16 14:04:05.763896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1160/2323] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:04 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1324 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:04:05.816533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:05.820139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:05.840913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:05.848621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:05.852233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:05.854225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:05.858391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:05.860397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:05.862280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:05.982803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:06.040288 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5dfd2def-fbb2-40f2-8efa-35bd09d740b1 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 1.602888 Sep 16 14:04:06.077273 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1164/2324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:04 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:06.140016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e727c507-144f-4564-ab89-8f7878c81376 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d421160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:06.220601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:06.400131 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e727c507-144f-4564-ab89-8f7878c81376 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.306151 Sep 16 14:04:06.407562 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1165/2325] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:06 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:06.455543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:06.471447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:06.477408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:06.496240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-187f2eac-712a-43f5-96b1-5003c60cc9a4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 0.729526 Sep 16 14:04:06.505490 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1161/2326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:05 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:06.539810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7675c1be-f4a9-4c1d-98b8-76cf64b8ce94 req-257faab7-f3c6-46df-84bf-7d3ef772b4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df69a17-2485-4730-8ace-ef319cdc22ee", "tag": "b821d3b8-aca2-4796-8e65-9bd62d217b85"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:06.550680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:06.552721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:06.553368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:06.559672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:06.576898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:06.579815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:06.607795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7675c1be-f4a9-4c1d-98b8-76cf64b8ce94 req-257faab7-f3c6-46df-84bf-7d3ef772b4e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:06.610841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7675c1be-f4a9-4c1d-98b8-76cf64b8ce94 req-257faab7-f3c6-46df-84bf-7d3ef772b4e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:06.614177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7675c1be-f4a9-4c1d-98b8-76cf64b8ce94 req-257faab7-f3c6-46df-84bf-7d3ef772b4e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:06.665785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7675c1be-f4a9-4c1d-98b8-76cf64b8ce94 req-257faab7-f3c6-46df-84bf-7d3ef772b4e2 service nova] Creating event network-changed:b821d3b8-aca2-4796-8e65-9bd62d217b85 for instance 9df69a17-2485-4730-8ace-ef319cdc22ee on n-h2-858129-2 Sep 16 14:04:06.691493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7675c1be-f4a9-4c1d-98b8-76cf64b8ce94 req-257faab7-f3c6-46df-84bf-7d3ef772b4e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183274 Sep 16 14:04:06.695760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1162/2327] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:06.818245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:06.826937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:06.869518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:06.885954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:06.896857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:06.901027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:06.917524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:06.918202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:08.141628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:08.181917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:08.186656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:08.188701 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e56db9d-03b4-4f14-b69d-3d9d4f151fae tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 1.771024 Sep 16 14:04:08.192205 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1166/2328] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:06 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:08.204856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:08.206907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:08.220951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:08.224341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:08.225177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:08.228139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:08.229749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:08.230476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:08.280335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:08.293510 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13cc571e-d794-4b00-8f40-96b150d62d7d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1520 microversion: 2.1 time: 1.490392 Sep 16 14:04:08.308143 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1163/2329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:06 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1520 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:04:08.324014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04e1bb4c-77dc-44b7-b190-ed8c2c6c0fbc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d099e50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:08.507817 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04e1bb4c-77dc-44b7-b190-ed8c2c6c0fbc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.196130 Sep 16 14:04:08.512475 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1164/2330] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:08 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:08.528605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:08.530391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:08.551744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:08.553454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:08.554737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:08.557490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:08.559211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:08.560539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:08.735269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:08.752592 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4c089e11-6343-4c3f-a972-371af2d41108 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 0.553794 Sep 16 14:04:08.753886 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1167/2331] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:08 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:08.780860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0c9583c-3fe7-45c8-96b8-613f5fe7b39a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'create', calling method: .version_select at 0x7f724d16b4c0>, body: {"pool": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:09.045249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:09.065222 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb41d3fe-859a-4d27-b5e7-513121fa0626 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 0.550577 Sep 16 14:04:09.081129 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1165/2332] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:08 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:09.263485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:09.268760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:09.297125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:09.299403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:09.302566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:09.306019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:09.306924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:09.307671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:10.844302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:10.861966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:10.870420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:10.879578 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee70a83c-73e7-4576-91a8-f356a62c0edd tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 1.625153 Sep 16 14:04:10.882596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1166/2333] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:09 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:04:10.901089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d55e297-b70d-47ff-8fdc-3cf03e0df0b7 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72516c31f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:10.995150 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d55e297-b70d-47ff-8fdc-3cf03e0df0b7 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.110629 Sep 16 14:04:10.996386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1167/2334] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:10 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:11.003877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:11.004729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:11.012737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:11.013605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:11.014193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:11.015248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:11.015916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:11.016634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:11.023842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:12.356803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:12.434771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f9b3986-a627-4378-ac1e-9ebcf20ee0e3 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 1.436503 Sep 16 14:04:12.475151 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1168/2335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:10 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:12.504251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c9fad408-82c8-4cd3-bdbf-0e2790c7ab61 req-2fac3c3e-ef39-4518-81cd-3d7a903581eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62fa1ed-86d1-4305-a271-b4e8006b22c2", "name": "network-vif-plugged", "status": "completed", "tag": "32483bcd-64ce-475c-9852-520fdf886603"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:12.529931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c9fad408-82c8-4cd3-bdbf-0e2790c7ab61 req-2fac3c3e-ef39-4518-81cd-3d7a903581eb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:12.535259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c9fad408-82c8-4cd3-bdbf-0e2790c7ab61 req-2fac3c3e-ef39-4518-81cd-3d7a903581eb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:12.536617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c9fad408-82c8-4cd3-bdbf-0e2790c7ab61 req-2fac3c3e-ef39-4518-81cd-3d7a903581eb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:12.576711 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c9fad408-82c8-4cd3-bdbf-0e2790c7ab61 req-2fac3c3e-ef39-4518-81cd-3d7a903581eb service nova] Creating event network-vif-plugged:32483bcd-64ce-475c-9852-520fdf886603 for instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 on n-h1-858129-2 Sep 16 14:04:12.588053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c9fad408-82c8-4cd3-bdbf-0e2790c7ab61 req-2fac3c3e-ef39-4518-81cd-3d7a903581eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110500 Sep 16 14:04:12.597765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1169/2336] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:12.611585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:12.614862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:12.640333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:12.642439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:12.643762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:12.645755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:12.647252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:12.648908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:14.081524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:14.125483 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d8e6fea-1732-4117-802b-1ee82f3111c4 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 1.522183 Sep 16 14:04:14.128135 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1170/2337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:12 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:14.143249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:14.145848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:14.183706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:14.187350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:14.192439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:14.197031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:14.204273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:14.205645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:14.876731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:14.892440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:14.896547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:14.897850 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a68ced52-9bac-4e2a-aff8-5505ee3efe82 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.767880 Sep 16 14:04:14.902583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1171/2338] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:14 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:14.912565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e76be79d-cdd9-4480-a534-16f7577e6541 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d0780d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:15.083687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e76be79d-cdd9-4480-a534-16f7577e6541 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.179688 Sep 16 14:04:15.095298 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1172/2339] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:14 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:15.102855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:15.104855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:15.120897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:15.121913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:15.122652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:15.124662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:15.125806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:15.126511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:15.450898 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0c9583c-3fe7-45c8-96b8-613f5fe7b39a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.674220 Sep 16 14:04:15.451799 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1168/2340] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:04:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:15.459990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:15.464352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:15.482014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:15.483780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:15.485859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:15.488040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:15.490248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:15.491051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:15.742995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:15.776821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b1350a6-de42-445b-802e-9ac5faad1613 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1314 microversion: 2.1 time: 0.678092 Sep 16 14:04:15.808193 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1173/2341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:15 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:15.868507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-913119911", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "5437ac41-bd4e-4bea-9a86-640cb50d1db2"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:15.974362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:15.990243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d08794a-c8ea-445f-8782-5b29401e8155 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 0.536960 Sep 16 14:04:15.990957 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1169/2342] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:15 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:16.016893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:16.017517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:16.030782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:16.031542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:16.032130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:16.033173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] validate_networks() for [('5437ac41-bd4e-4bea-9a86-640cb50d1db2', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:04:16.033575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:16.034996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:16.035654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:16.592919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:16.662179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:16.673884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:16.688941 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f79c9540-2668-4f73-8215-2fdebda8c846 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.696193 Sep 16 14:04:16.696548 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1170/2343] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:15 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:16.720605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3682dc7a-249b-4e39-8400-0e99ec1e7054 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d18f940>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:16.841200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3682dc7a-249b-4e39-8400-0e99ec1e7054 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.141511 Sep 16 14:04:16.849075 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1171/2344] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:16 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:16.868956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:16.876036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:16.905734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:16.906239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:16.912060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:16.912970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:16.913476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:16.913923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.335775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:04:17.350144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:04:17.352478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:04:17.353120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:04:17.353687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:04:17.409634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:17.410388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:17.411040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.412062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:17.412719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:17.413309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.416566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:17.433214 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb558129-9ef4-44e4-a726-ed9eaa5b7850 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1502 microversion: 2.1 time: 0.582345 Sep 16 14:04:17.457878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1172/2345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:16 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1502 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:17.467531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:17.472528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:17.491523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:17.492314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:17.494518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.495548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:17.499656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:17.500374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.527934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Getting quotas for project 997c95646a2b40489cf53d5538786bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:04:17.580472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Getting quotas for user e0441b7c0ea04bb08f871af5c2f1f46a and project 997c95646a2b40489cf53d5538786bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:04:17.614729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:17.685324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:04:17.688154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:04:17.757434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:17.773479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dcbbdf05-3129-4914-ad64-b93718bbb51a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 0.314040 Sep 16 14:04:17.775165 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1173/2346] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:17 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:17.785444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:17.786049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:17.805552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:17.811074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:17.811074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.811598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:17.812162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:17.812691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:17.868156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:04:17.936987 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f23e512b-5c3a-4946-9545-9d44d83f66ba tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.073391 Sep 16 14:04:17.942593 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1174/2347] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:04:17.974865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5dc8a956-3005-4751-bd5c-6c8953ac6333 req-eb44a0fe-a224-430f-98f4-08f18facaab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df69a17-2485-4730-8ace-ef319cdc22ee", "name": "network-vif-plugged", "status": "completed", "tag": "b821d3b8-aca2-4796-8e65-9bd62d217b85"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:18.010268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5dc8a956-3005-4751-bd5c-6c8953ac6333 req-eb44a0fe-a224-430f-98f4-08f18facaab6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.012788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5dc8a956-3005-4751-bd5c-6c8953ac6333 req-eb44a0fe-a224-430f-98f4-08f18facaab6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.014017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5dc8a956-3005-4751-bd5c-6c8953ac6333 req-eb44a0fe-a224-430f-98f4-08f18facaab6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:18.041878 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5dc8a956-3005-4751-bd5c-6c8953ac6333 req-eb44a0fe-a224-430f-98f4-08f18facaab6 service nova] Creating event network-vif-plugged:b821d3b8-aca2-4796-8e65-9bd62d217b85 for instance 9df69a17-2485-4730-8ace-ef319cdc22ee on n-h2-858129-2 Sep 16 14:04:18.053766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5dc8a956-3005-4751-bd5c-6c8953ac6333 req-eb44a0fe-a224-430f-98f4-08f18facaab6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106286 Sep 16 14:04:18.058043 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1175/2348] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:18.066758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:18.067870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:18.076616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.077459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.078695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:18.079732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.080526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.081954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:18.263417 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39f9eccd-a29e-4c6a-ab3f-877abcd4a015 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 204 len: 0 microversion: 2.1 time: 0.484146 Sep 16 14:04:18.282899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1174/2349] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:04:17 2022] DELETE /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:18.336326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16750b2b-d275-4a4a-94c3-2b04e507a37e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724e2de3a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:18.502048 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16750b2b-d275-4a4a-94c3-2b04e507a37e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.216713 Sep 16 14:04:18.520302 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1175/2350] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:18 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:18.535306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be6db4fc-da7a-440f-aa95-4228669a0e29 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:18.536692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be6db4fc-da7a-440f-aa95-4228669a0e29 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:18.791946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be6db4fc-da7a-440f-aa95-4228669a0e29 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:18.812730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:18.839184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:18.843104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:18.848110 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bdf9ad1d-c221-4aa4-91f9-47171602d081 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.787895 Sep 16 14:04:18.854298 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1176/2351] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:18 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:18.859741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:18.861335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:18.887290 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be6db4fc-da7a-440f-aa95-4228669a0e29 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1223 microversion: 2.1 time: 0.356426 Sep 16 14:04:18.889626 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1176/2352] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:18 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1223 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:18.894085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.903703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.906246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:18.906943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.925444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.926354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:18.929829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:18.932790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:18.951136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.951823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.952320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:18.955803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:18.956446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:18.963225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:19.340492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:19.390659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8cb0d112-9e7c-4445-a93f-4cde76c7a884 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1508 microversion: 2.1 time: 0.525752 Sep 16 14:04:19.396540 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1177/2353] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:18 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:19.429429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7a7a5a6e-a2b3-49e6-8e29-ed62fd8f181f req-e9da96e1-9b6b-447f-bd03-83befa856c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d42251-9a1b-4702-afa6-ef58d5b2bb96", "name": "network-vif-unplugged", "status": "completed", "tag": "270026fb-ac51-4adc-b0ff-c15b43a583a2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:19.517906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a7a5a6e-a2b3-49e6-8e29-ed62fd8f181f req-e9da96e1-9b6b-447f-bd03-83befa856c59 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:19.520106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a7a5a6e-a2b3-49e6-8e29-ed62fd8f181f req-e9da96e1-9b6b-447f-bd03-83befa856c59 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:19.524569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7a7a5a6e-a2b3-49e6-8e29-ed62fd8f181f req-e9da96e1-9b6b-447f-bd03-83befa856c59 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:19.595673 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7a7a5a6e-a2b3-49e6-8e29-ed62fd8f181f req-e9da96e1-9b6b-447f-bd03-83befa856c59 service nova] Creating event network-vif-unplugged:270026fb-ac51-4adc-b0ff-c15b43a583a2 for instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 on n-h2-858129-2 Sep 16 14:04:19.628602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7a7a5a6e-a2b3-49e6-8e29-ed62fd8f181f req-e9da96e1-9b6b-447f-bd03-83befa856c59 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.227635 Sep 16 14:04:19.633550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1178/2354] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:19.665279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46f2b06f-eeb6-4ca2-82ae-70699c2a3a14 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f725175bca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:19.786913 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46f2b06f-eeb6-4ca2-82ae-70699c2a3a14 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.149038 Sep 16 14:04:19.798173 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1179/2355] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:19 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:19.799242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:19.817463 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c397e1c-f05e-42cb-b3f1-d3847ca62290 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1323 microversion: 2.1 time: 0.921362 Sep 16 14:04:19.835524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1177/2356] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:18 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1323 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:19.918922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:19.921908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:19.949012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:19.959641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:19.976793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:19.978876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:19.981087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:19.982112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:19.982766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:19.984965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:20.010798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:20.012623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:20.013398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:20.037186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:20.043548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:20.050426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:20.126194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:20.857080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:20.915396 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f062154-7af3-48d9-8ab9-4bda801f3adb tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1227 microversion: 2.1 time: 0.980441 Sep 16 14:04:20.925580 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1178/2357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:19 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1227 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:20.972005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:20.984872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:21.008491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:21.029471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:21.030363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:21.032787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:21.040972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:21.041203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:21.042870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:21.044045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:21.045115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:21.047512 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5805ef08-952e-426a-b3f4-5b2c83984bde tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 1.141754 Sep 16 14:04:21.062449 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1180/2358] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:19 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:21.075425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be6efb0c-5aa3-4c79-82a3-04748c707eaa tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce5b040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:21.230342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be6efb0c-5aa3-4c79-82a3-04748c707eaa tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.175528 Sep 16 14:04:21.231701 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1181/2359] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:21 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:21.258720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:21.260202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:21.304014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:21.304542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:21.315885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:21.316885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:21.317383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:21.317835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:21.998773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:22.030982 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-db703538-d9b1-4b51-9ef0-568da9e0cd1f tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1508 microversion: 2.1 time: 1.100671 Sep 16 14:04:22.042581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1179/2360] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:20 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1508 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:22.076605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:22.077839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:22.112509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:22.123238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:22.124501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:22.125564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:22.133599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:22.134885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:22.138944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:22.473352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:22.494265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:22.515126 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a21c9ecf-4701-429b-9be7-ed626b1ca1b3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1283 microversion: 2.1 time: 0.467155 Sep 16 14:04:22.516315 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1180/2361] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:22 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1283 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:22.524910 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dbceb726-2c41-4a99-8cab-f8c5589e2907 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 1.290025 Sep 16 14:04:22.530610 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1182/2362] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:21 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:22.544959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:22.564098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:22.568549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d57bccbc-d0e8-4661-9a16-d4be38c605bd req-bf33c830-4aa3-4c7a-b89e-42964eea8903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d42251-9a1b-4702-afa6-ef58d5b2bb96", "tag": "270026fb-ac51-4adc-b0ff-c15b43a583a2"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:22.593319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:22.597114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:22.598327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:22.600721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:22.601993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:22.606085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:22.655801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d57bccbc-d0e8-4661-9a16-d4be38c605bd req-bf33c830-4aa3-4c7a-b89e-42964eea8903 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:22.663301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d57bccbc-d0e8-4661-9a16-d4be38c605bd req-bf33c830-4aa3-4c7a-b89e-42964eea8903 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:22.669678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d57bccbc-d0e8-4661-9a16-d4be38c605bd req-bf33c830-4aa3-4c7a-b89e-42964eea8903 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:22.767544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d57bccbc-d0e8-4661-9a16-d4be38c605bd req-bf33c830-4aa3-4c7a-b89e-42964eea8903 service nova] Creating event network-changed:270026fb-ac51-4adc-b0ff-c15b43a583a2 for instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 on n-h2-858129-2 Sep 16 14:04:22.801135 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d57bccbc-d0e8-4661-9a16-d4be38c605bd req-bf33c830-4aa3-4c7a-b89e-42964eea8903 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276534 Sep 16 14:04:22.804510 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1181/2363] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:22.820138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-630a7fb0-27a5-4700-965a-f315d5e97529 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d54f790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:22.996994 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-630a7fb0-27a5-4700-965a-f315d5e97529 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.188208 Sep 16 14:04:23.014042 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1182/2364] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:22 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:23.036455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:23.038191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:23.069049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:23.078068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:23.083722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:23.087966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:23.093159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:23.095352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:23.833243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:23.852275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:23.861094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:23.863886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b075b9d-9d86-491e-9d7f-4345184f6b28 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 1.331314 Sep 16 14:04:23.869227 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1183/2365] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:22 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:24.068635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:24.113868 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d57e753e-fdc0-42d0-b5b5-e00c55134af6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 1.096708 Sep 16 14:04:24.130140 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1183/2366] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:23 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:24.198424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:24.206796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:24.241751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:24.242370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:24.242853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:24.251915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:24.253596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:24.254008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:24.682266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2125928159", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "763702cd-28bf-4c79-b77b-01c764a146ce"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:24.881830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da29458cf5d4997bab871b631fdb1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4bacbf16c4151a5791f8eff94602b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:24.886884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] validate_networks() for [('763702cd-28bf-4c79-b77b-01c764a146ce', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:04:24.919444 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-25f74915-a713-4f74-adaa-92ace6f92450 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 200 len: 1466 microversion: 2.1 time: 0.762996 Sep 16 14:04:24.920523 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1184/2367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:24 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 1466 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:25.009582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:25.010347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:25.053957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:25.054612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:25.059828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:25.062371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:25.065949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:25.066519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:26.778343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:26.793033 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ed801d8-5936-4755-90c9-c1a6a1d0c959 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1323 microversion: 2.1 time: 1.796077 Sep 16 14:04:26.800024 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1185/2368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:24 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1323 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:26.823237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7869e815-796f-4d35-a510-36824d79016c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724cf03040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:26.940638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7869e815-796f-4d35-a510-36824d79016c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.138534 Sep 16 14:04:26.941255 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1186/2369] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:26 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:26.953356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-765ffffb-6adc-45a1-81ba-e9efa3e08a46 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-773179926", "metadata": {"": ""}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-765ffffb-6adc-45a1-81ba-e9efa3e08a46 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action HTTP/1.1 Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 106 Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:26.959800 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-773179926", "metadata": {"": ""}}} Sep 16 14:04:26.961087 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-773179926', 'metadata': {'': ''}}}} Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'': ''} Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:26.962306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.964183 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-765ffffb-6adc-45a1-81ba-e9efa3e08a46 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:26.966006 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-765ffffb-6adc-45a1-81ba-e9efa3e08a46 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action" status: 400 len: 170 microversion: 2.1 time: 0.019033 Sep 16 14:04:26.968924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1187/2370] 10.222.0.60 () {60 vars in 1279 bytes} [Fri Sep 16 14:04:26 2022] POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:04:26.980257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9e2ba98a-680b-4a57-8960-1cd904fc6624 req-e9b3da88-2542-45cf-aa7b-6ff6f81b60a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62fa1ed-86d1-4305-a271-b4e8006b22c2", "name": "network-vif-deleted", "tag": "32483bcd-64ce-475c-9852-520fdf886603"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:27.015350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9e2ba98a-680b-4a57-8960-1cd904fc6624 req-e9b3da88-2542-45cf-aa7b-6ff6f81b60a0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.016302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9e2ba98a-680b-4a57-8960-1cd904fc6624 req-e9b3da88-2542-45cf-aa7b-6ff6f81b60a0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.016948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9e2ba98a-680b-4a57-8960-1cd904fc6624 req-e9b3da88-2542-45cf-aa7b-6ff6f81b60a0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.042763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9e2ba98a-680b-4a57-8960-1cd904fc6624 req-e9b3da88-2542-45cf-aa7b-6ff6f81b60a0 service nova] Creating event network-vif-deleted:32483bcd-64ce-475c-9852-520fdf886603 for instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 on n-h1-858129-2 Sep 16 14:04:27.061227 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9e2ba98a-680b-4a57-8960-1cd904fc6624 req-e9b3da88-2542-45cf-aa7b-6ff6f81b60a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089007 Sep 16 14:04:27.064309 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1188/2371] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:27.080822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:27.082853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:27.101863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.116731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.117708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.119011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.120667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.121550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.430066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:27.635621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:27.690459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:27.722612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:27.730101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:27.739919 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2d156ef-67b1-446c-a307-483084f6a039 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.668584 Sep 16 14:04:27.747957 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1189/2372] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:27 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:27.774304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:27.777886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:27.794395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.797266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.801744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.802813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.804845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.806607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.868309 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 HTTP/1.1 Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:27.878482 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:27.881754 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'a62fa1ed-86d1-4305-a271-b4e8006b22c2'} Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:27.882771 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:27.886341 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:27.899138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:27.900771 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6fc9a8af-c74e-4b05-9206-2cef66b7b779 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 404 len: 111 microversion: 2.1 time: 0.148736 Sep 16 14:04:27.907379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1190/2373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:27 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:27.923972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:04:27.924771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:27.925809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:27.926836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:04:27.927365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:04:27.928279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:04:27.928717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:04:27.959783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.966238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.966682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.968042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.969223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.971010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.974748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.979233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.980633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:27.982040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:27.982531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:27.983073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:28.073837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Getting quotas for project 311811e7ca8c4b08b2c3edf8e4192d12. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:04:28.089515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Getting quotas for user 0e4bfe8580f1494d81551b8293ff37d9 and project 311811e7ca8c4b08b2c3edf8e4192d12. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:04:28.172742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Going to run 2 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:04:28.180119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 84f8288b-89f5-4d23-88f6-9a6c6043304a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:04:28.317712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=84f8288b-89f5-4d23-88f6-9a6c6043304a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:04:28.602365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:28.611268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cfca2216-46ec-4bc0-9289-b730e751e466 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.740475 Sep 16 14:04:28.617245 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28bea6b1-275a-43e1-a36e-17d7c94da26a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 0.708090 Sep 16 14:04:28.617852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1184/2374] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:04:28.622114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1191/2375] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:27 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:28.630506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:28.631724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:28.639717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-bd0793d5-b23b-4488-b165-b8f0fbcb6d0b req-3206646e-241f-4b07-a799-26f21c035405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4", "tag": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:28.660672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:28.661690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:28.662348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:28.663548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:28.666515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:28.672053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:28.683972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bd0793d5-b23b-4488-b165-b8f0fbcb6d0b req-3206646e-241f-4b07-a799-26f21c035405 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:28.691482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bd0793d5-b23b-4488-b165-b8f0fbcb6d0b req-3206646e-241f-4b07-a799-26f21c035405 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:28.692896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bd0793d5-b23b-4488-b165-b8f0fbcb6d0b req-3206646e-241f-4b07-a799-26f21c035405 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:28.750936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-bd0793d5-b23b-4488-b165-b8f0fbcb6d0b req-3206646e-241f-4b07-a799-26f21c035405 service nova] Creating event network-changed:de83dc31-de7b-4d3b-8d3b-e5915c6009ba for instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 on n-h1-858129-2 Sep 16 14:04:28.758290 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-bd0793d5-b23b-4488-b165-b8f0fbcb6d0b req-3206646e-241f-4b07-a799-26f21c035405 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138639 Sep 16 14:04:28.761066 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1185/2376] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:28.780197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2078639937", "metadata": {"image_type": "test"}}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:28.783911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:28.805318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:28.808382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:28.809108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:28.809999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:28.813312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:28.813966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:28.851093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:28.866082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2/action HTTP/1.1 Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 112 Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:04:28.871380 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2078639937", "metadata": {"image_type": "test"}}} Sep 16 14:04:28.873742 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a62fa1ed-86d1-4305-a271-b4e8006b22c2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2078639937', 'metadata': {'image_type': 'test'}}}} Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:28.877715 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:28.880683 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3bb5f48-abe8-482b-9529-5343774cfc19 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "POST /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2/action" status: 404 len: 111 microversion: 2.1 time: 0.110899 Sep 16 14:04:28.886503 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1186/2377] 10.222.0.60 () {60 vars in 1279 bytes} [Fri Sep 16 14:04:28 2022] POST /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2/action => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:28.899949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66fbee6d-7679-481a-82fe-d0261451aa82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d200f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:28.985014 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66fbee6d-7679-481a-82fe-d0261451aa82 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.101071 Sep 16 14:04:28.986216 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1187/2378] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:28 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:29.000585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b3f6cd-f9f0-4e2c-811b-ea90c0eb1c8a"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:29.009408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:29.028943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:29.029870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:29.030985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:29.033793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:29.037868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:29.038744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:29.366528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:29.391897 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d2f5d93-c6e8-4e79-accd-87a9c7ae3609 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1323 microversion: 2.1 time: 0.766794 Sep 16 14:04:29.396565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1192/2379] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:28 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1323 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:29.416446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:29.427961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:29.430149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Searching by: {'deleted': False, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:04:29.462427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:29.464007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:29.466248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:29.468998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:29.471345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:29.472831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:29.529622 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-08a3d33e-79af-4010-bf68-4a15a30a4cd1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.126277 Sep 16 14:04:29.538740 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1193/2380] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:04:29 2022] GET /compute/v2.1/servers => generated 677 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:29.538740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:29.538740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:29.570831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:29.572474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:29.573600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:29.575425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:29.576672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:29.577815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:30.007154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:30.058745 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f10886a-ca49-4cd5-b099-e1b9346cffd2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 0.522073 Sep 16 14:04:30.075537 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1194/2381] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:29 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:30.109265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:30.110261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:30.123939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:30.125711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:30.127093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:30.129070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:30.130484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:30.131680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:30.900826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:30.933000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:30.934700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:30.935971 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a848b012-d9eb-4759-bcbe-c0b681cf58da tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.859105 Sep 16 14:04:30.936627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1195/2382] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:30 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:30.958582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-78d16da1-9814-4f5c-a5fc-e4be858e2907 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1992322995", "metadata": {"image_type": "test"}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:30.961669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-78d16da1-9814-4f5c-a5fc-e4be858e2907 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Failed to fetch instance by id tempest-invalid-231559193 {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 14:04:30.974596 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-78d16da1-9814-4f5c-a5fc-e4be858e2907 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance tempest-invalid-231559193 could not be found. Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-78d16da1-9814-4f5c-a5fc-e4be858e2907 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/tempest-invalid-231559193/action HTTP/1.1 Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 112 Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:30.976530 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1992322995", "metadata": {"image_type": "test"}}} Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:30.980151 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance tempest-invalid-231559193 could not be found. Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'tempest-invalid-231559193', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1992322995', 'metadata': {'image_type': 'test'}}}} Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-231559193 could not be found. Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:30.980926 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-231559193 could not be found. Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-231559193 could not be found. Sep 16 14:04:30.981912 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:30.984667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-78d16da1-9814-4f5c-a5fc-e4be858e2907 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance tempest-invalid-231559193 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:30.984667 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-78d16da1-9814-4f5c-a5fc-e4be858e2907 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "POST /compute/v2.1/servers/tempest-invalid-231559193/action" status: 404 len: 100 microversion: 2.1 time: 0.026371 Sep 16 14:04:30.984667 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1196/2383] 10.222.0.60 () {60 vars in 1246 bytes} [Fri Sep 16 14:04:30 2022] POST /compute/v2.1/servers/tempest-invalid-231559193/action => generated 100 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:30.990509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:30.991139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:31.005290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:31.005804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:31.006249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:31.007034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:31.007506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:31.008096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:31.108175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:31.135690 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54cd2c3e-afdf-401e-bb06-8ed64db30900 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1216 microversion: 2.1 time: 0.155588 Sep 16 14:04:31.150541 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1197/2384] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:30 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:31.161367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-936a0ef1-fc87-4cb2-b54b-e7e646f7d96d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f725179d280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:31.321744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-936a0ef1-fc87-4cb2-b54b-e7e646f7d96d tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1454 microversion: 2.1 time: 0.169458 Sep 16 14:04:31.323101 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1198/2385] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:31 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:31.332503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c418b9a-5b06-42b5-924e-f864b032a42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2129264019", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c418b9a-5b06-42b5-924e-f864b032a42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action HTTP/1.1 Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 619 Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:31.337544 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:31.339842 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:04:31.340678 n-d-858129-2 devstack@n-api.service[128643]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2129264019", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 16 14:04:31.340678 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:31.340678 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2129264019', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 16 14:04:31.340929 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:31.341847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.342966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:31.343880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:31.343880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:31.343880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:04:31.343880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:04:31.343880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:04:31.343880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:31.348333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c418b9a-5b06-42b5-924e-f864b032a42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:31.353296 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c418b9a-5b06-42b5-924e-f864b032a42a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action" status: 400 len: 938 microversion: 2.1 time: 0.028815 Sep 16 14:04:31.357021 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1199/2386] 10.222.0.60 () {60 vars in 1279 bytes} [Fri Sep 16 14:04:31 2022] POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action => generated 938 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:04:31.370681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:31.373288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:31.383400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:31.384286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:31.384974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:31.386511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:31.387282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:31.387934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:31.964524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:31.980736 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0013240a-7c92-4a87-a99f-fa64609b0a50 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1323 microversion: 2.1 time: 0.622264 Sep 16 14:04:31.996549 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1200/2387] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:31 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1323 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:32.008701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-538c171c-3c52-4553-aa1d-f0fb7a373b3a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-399166459"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:32.016449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-538c171c-3c52-4553-aa1d-f0fb7a373b3a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 14:04:32.019109 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-538c171c-3c52-4553-aa1d-f0fb7a373b3a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-538c171c-3c52-4553-aa1d-f0fb7a373b3a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 56 Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:32.021778 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: {"createImage": {"name": "tempest-test-snap-399166459"}} Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:32.023050 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-399166459'}}} Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:32.023828 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:32.024847 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:32.028436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-538c171c-3c52-4553-aa1d-f0fb7a373b3a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:32.029802 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-538c171c-3c52-4553-aa1d-f0fb7a373b3a tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.031826 Sep 16 14:04:32.031011 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1201/2388] 10.222.0.60 () {60 vars in 1275 bytes} [Fri Sep 16 14:04:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:32.037358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:32.039419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:32.049167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:32.050042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:32.050771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:32.051768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:32.052474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:32.053153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:32.306235 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-beebfa51-2d87-461d-8845-ea01389aec98 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "POST /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.314634 Sep 16 14:04:32.328209 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1188/2389] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:04:28 2022] POST /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments => generated 194 bytes in 3341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:32.373761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:32.376519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:32.435660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:32.436179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:32.436635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:32.446598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:32.447217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:32.447745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:33.478270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:33.491536 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08ef24ba-9c25-49e1-9aa2-73ce873c32e8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 1.152787 Sep 16 14:04:33.494112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:33.494962 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1189/2390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:32 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:33.506078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:33.510165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:33.531431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:33.548837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:33.550651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:33.556370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:33.580984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:33.594846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:33.595188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:33.608890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:33.610981 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38fa5079-2722-446d-9179-679f23fae680 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2949 microversion: 2.32 time: 1.578454 Sep 16 14:04:33.614574 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1202/2391] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:32 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2949 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:33.628869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3df13af-88e9-4d84-bdb6-416da76f8ba0 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1909141637"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:33.646916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3df13af-88e9-4d84-bdb6-416da76f8ba0 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 14:04:33.652325 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-e3df13af-88e9-4d84-bdb6-416da76f8ba0 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3df13af-88e9-4d84-bdb6-416da76f8ba0 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 57 Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:33.656002 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: {"createImage": {"name": "tempest-test-snap-1909141637"}} Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:33.658705 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1909141637'}}} Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:33.661409 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 16 14:04:33.665616 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:33.672793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3df13af-88e9-4d84-bdb6-416da76f8ba0 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:33.675570 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3df13af-88e9-4d84-bdb6-416da76f8ba0 tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.054441 Sep 16 14:04:33.687383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1203/2392] 10.222.0.60 () {60 vars in 1281 bytes} [Fri Sep 16 14:04:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:33.726545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:33.730787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:33.785727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:33.791114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:33.792166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:33.794453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:33.796073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:33.796966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:34.059248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:34.084198 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba685979-86f7-49d2-995e-c06baf024201 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1278 microversion: 2.1 time: 0.397501 Sep 16 14:04:34.103046 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1204/2393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:33 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1278 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:34.129279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e047ad95-6587-429d-a1f9-7a213794b527 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517cc3a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:34.221770 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e047ad95-6587-429d-a1f9-7a213794b527 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1463 microversion: 2.1 time: 0.116587 Sep 16 14:04:34.234649 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1205/2394] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:34 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1463 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:34.246454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:34.247384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:34.266526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:34.268736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:34.270615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:34.277626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:34.278396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:34.281902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:34.443602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:34.475370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:34.478440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:34.480727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8ef0d647-43eb-4e43-bb21-7fe5d1acd236 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.982447 Sep 16 14:04:34.482586 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1190/2395] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:33 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:34.510675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:34.512149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:34.524435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:34.525322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:34.526088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:34.527485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:34.528670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:34.529884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:34.814829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:34.817345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:34.831414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6a14bea9-1ad6-4469-9125-d611f662459a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1323 microversion: 2.1 time: 0.595252 Sep 16 14:04:34.834360 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1206/2396] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:34 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1323 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:34.845334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:34.847948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:34.864706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:34.865504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:34.870728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:34.871859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:34.872503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:34.873098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.136189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9097d4dc-e293-4599-9418-113ca5e875b1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.299588 Sep 16 14:04:35.137666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1207/2397] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 14:04:34 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d/os-interface => generated 1832 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:35.143527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:35.148405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:35.164427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.165187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.165828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.166824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.167581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.179240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.190776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:35.204084 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b33daa61-a1f3-4cad-9545-530526bb1022 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 0.719866 Sep 16 14:04:35.214454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1191/2398] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:34 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:35.214820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3466e1df-d465-4476-a5dc-a00906cff8bd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d2d0160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:35.216853 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 HTTP/1.1 Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:35.218654 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.220046 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'a62fa1ed-86d1-4305-a271-b4e8006b22c2'} Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:35.220793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.221775 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.233455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:35.234492 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60e941d9-115c-40ca-8118-46548fc81b1e tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 404 len: 111 microversion: 2.1 time: 0.095452 Sep 16 14:04:35.237226 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1208/2399] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:04:35 2022] DELETE /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:35.253370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:35.253990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:35.274092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.274619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.275259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.276162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.276851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.277562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.320320 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3466e1df-d465-4476-a5dc-a00906cff8bd tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 200 len: 1463 microversion: 2.1 time: 0.112516 Sep 16 14:04:35.321593 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1192/2400] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:35 2022] GET /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:35.327023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1e5bf6c-8ac4-4594-bb61-31237e400572 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1e5bf6c-8ac4-4594-bb61-31237e400572 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action HTTP/1.1 Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 285 Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:04:35.332842 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:04:35.334011 n-d-858129-2 devstack@n-api.service[128642]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:04:35.334979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:04:35.335511 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:04:35.336489 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:04:35.338627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:04:35.338627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.340037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1e5bf6c-8ac4-4594-bb61-31237e400572 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:35.341186 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1e5bf6c-8ac4-4594-bb61-31237e400572 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action" status: 400 len: 619 microversion: 2.1 time: 0.018442 Sep 16 14:04:35.342388 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1193/2401] 10.222.0.60 () {60 vars in 1279 bytes} [Fri Sep 16 14:04:35 2022] POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:04:35.350771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:35.351791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] [instance: a62fa1ed-86d1-4305-a271-b4e8006b22c2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:35.362646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.363557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.366004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.367156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.367849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.368875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.375068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:35.388965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] HTTP exception thrown: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Request method failure captured: Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 HTTP/1.1 Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJBnrFjGAdg0B5q9CkGo0crGKAyeLyITflAETqxum4m1yt0OrvzsUQ5pAxVMnSZr0AyN7RuIi0oMRhJ6IoAQ3g_H104nEyW6F0zHMdoxOIm3wavG3t1tXgImoFKYgd2dfar24m6YJTxR1lzo_D53CtLCRzOWLlRksc2WPcBGR1F3FI Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:04:35.390995 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89b4bacbf16c4151a5791f8eff94602b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89b4bacbf16c4151a5791f8eff94602b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89b4bacbf16c4151a5791f8eff94602b"}]}] Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 89b4bacbf16c4151a5791f8eff94602b Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-12203043 Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1da29458cf5d4997bab871b631fdb1b4 Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesNegativeTestJSON-12203043-project Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.392108 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a62fa1ed-86d1-4305-a271-b4e8006b22c2'} Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:35.392800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. Sep 16 14:04:35.393761 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:35.403773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] Returning 404 to user: Instance a62fa1ed-86d1-4305-a271-b4e8006b22c2 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:35.405052 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d21bd52b-28c1-46b3-86d4-b098d09933ab tempest-ImagesNegativeTestJSON-12203043 tempest-ImagesNegativeTestJSON-12203043-project] 10.222.0.60 "GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2" status: 404 len: 111 microversion: 2.1 time: 0.061202 Sep 16 14:04:35.405865 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1194/2402] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:35 2022] GET /compute/v2.1/servers/a62fa1ed-86d1-4305-a271-b4e8006b22c2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:04:35.413312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:35.415587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:35.435306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.436638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.438048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:35.439963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:35.441145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:35.442245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:36.232219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:36.240744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:36.256378 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53ba521b-87d6-422b-8c84-f3287554f02b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 1466 microversion: 2.1 time: 0.849081 Sep 16 14:04:36.260863 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1195/2403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:35 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 1466 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:36.263222 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d316e047-e6af-469c-814e-c1763339f85b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 1.003122 Sep 16 14:04:36.264377 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1209/2404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:35 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:36.295512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:36.297391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:36.303769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:36.305068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:36.321468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:36.322939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:36.324083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:36.327219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:36.331936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:36.333210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:36.354921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:36.356247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:36.358865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:36.366461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:36.367928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:36.376425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.000650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:37.029231 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d84dded4-13a9-420e-9bc2-7d1a8b4ed074 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 0.764326 Sep 16 14:04:37.033018 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1196/2405] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:36 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:37.044791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:37.049476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:37.068383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:37.071044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.071560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.072017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.074464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.077588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.079999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.110166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:37.122675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:37.129160 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed4fd24c-28a9-4435-8044-99607750969a tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1485 microversion: 2.25 time: 0.854280 Sep 16 14:04:37.130265 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1210/2406] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:36 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1485 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:37.175760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-63f322b5-8fa3-4806-a923-f9f4fb01a498 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d16b1f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:37.633870 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-63f322b5-8fa3-4806-a923-f9f4fb01a498 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?changes-since=2022-09-16T14%3A00%3A18Z" status: 200 len: 2327 microversion: 2.1 time: 0.501619 Sep 16 14:04:37.638536 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1211/2407] 10.222.0.60 () {58 vars in 1199 bytes} [Fri Sep 16 14:04:37 2022] GET /compute/v2.1/images?changes-since=2022-09-16T14%3A00%3A18Z => generated 2327 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:37.649764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-603f1da2-0f24-48b8-92a9-04053f675ea4 req-37eaf5f8-6158-4bce-b616-df8e52f3294f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4", "name": "network-vif-plugged", "status": "completed", "tag": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:37.668096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:37.691461 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0565064-3cc8-45fa-af67-99ade7050b8c tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1323 microversion: 2.1 time: 0.652986 Sep 16 14:04:37.692177 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1197/2408] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:37 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:37.693936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-603f1da2-0f24-48b8-92a9-04053f675ea4 req-37eaf5f8-6158-4bce-b616-df8e52f3294f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.703026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-603f1da2-0f24-48b8-92a9-04053f675ea4 req-37eaf5f8-6158-4bce-b616-df8e52f3294f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.704145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-603f1da2-0f24-48b8-92a9-04053f675ea4 req-37eaf5f8-6158-4bce-b616-df8e52f3294f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.726897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:37.727404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:37.760598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-603f1da2-0f24-48b8-92a9-04053f675ea4 req-37eaf5f8-6158-4bce-b616-df8e52f3294f service nova] Creating event network-vif-plugged:de83dc31-de7b-4d3b-8d3b-e5915c6009ba for instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 on n-h1-858129-2 Sep 16 14:04:37.764111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.764861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.769534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.771406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.774756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.775514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.781219 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-603f1da2-0f24-48b8-92a9-04053f675ea4 req-37eaf5f8-6158-4bce-b616-df8e52f3294f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139948 Sep 16 14:04:37.793023 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1212/2409] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:37.803914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:37.805233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:37.831636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.842130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.843278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:37.845320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:37.847124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:37.848113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:38.015323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:38.122424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:38.379637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:38.416734 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0ec5f90-bb34-4b8c-b219-1ade71020614 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 0.722280 Sep 16 14:04:38.417350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1198/2410] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:37 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:38.420525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:38.429392 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-062b56ea-e146-4454-b0d5-25673f8fbea4 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.634057 Sep 16 14:04:38.441931 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1213/2411] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:37 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:38.443119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:38.443750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:38.454179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9092b90-b537-4e7d-a934-84daec5d49f6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724df27af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:38.461847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:38.462425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:38.462984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:38.463777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:38.464258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:38.475259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:38.658273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9092b90-b537-4e7d-a934-84daec5d49f6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1233564516" status: 200 len: 485 microversion: 2.1 time: 0.218671 Sep 16 14:04:38.659036 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1199/2412] 10.222.0.60 () {58 vars in 1231 bytes} [Fri Sep 16 14:04:38 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1233564516 => generated 485 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:38.672520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1231344388"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:38.676721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:38.691060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:38.692684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:38.693336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:38.694462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:38.695306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:38.696007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.219211 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8cde2bc9-ebe8-44d6-a211-61f1dcf1c592 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action" status: 202 len: 0 microversion: 2.1 time: 0.549769 Sep 16 14:04:39.220503 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1200/2413] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:04:38 2022] POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:04:39.232965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a5c1ccf-da71-498f-b694-046725498dba tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f7251691310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:39.316826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:39.334827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:39.337445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:39.339239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f288f938-14e8-4ece-bd4c-b75ed1217f09 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1475 microversion: 2.25 time: 0.903857 Sep 16 14:04:39.340351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1214/2414] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:38 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1475 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:39.347755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:39.349541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:39.357520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.358259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.358991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.359915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.360561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.361200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.503109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:39.552730 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a5c1ccf-da71-498f-b694-046725498dba tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?server=c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 955 microversion: 2.1 time: 0.326933 Sep 16 14:04:39.557322 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1201/2415] 10.222.0.60 () {58 vars in 1209 bytes} [Fri Sep 16 14:04:39 2022] GET /compute/v2.1/images?server=c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 955 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:39.580988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-154031599"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:39.597289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:39.622036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.623638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.624968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.627213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.628344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.629369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.721650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:39.733811 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e60244a-4093-454f-8ea6-96235a9907cc tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1323 microversion: 2.1 time: 0.392062 Sep 16 14:04:39.736866 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1215/2416] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:39 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1323 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:39.742298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-729f52ba-81c1-443b-a118-fd95373119e5 req-5efe1aa4-cd14-43f1-8014-dad5eede6766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd", "tag": "edaa4ce3-67cc-427e-9a01-3f52b5e14f65"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:39.742537 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Cannot 'createImage' instance 9df69a17-2485-4730-8ace-ef319cdc22ee while it is in task_state image_snapshot Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action HTTP/1.1 Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 84 Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:04:39.749894 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-154031599"}} Sep 16 14:04:39.751120 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'createImage' instance 9df69a17-2485-4730-8ace-ef319cdc22ee while it is in task_state image_snapshot Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-154031599'}}} Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:39.752277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9df69a17-2485-4730-8ace-ef319cdc22ee while it is in task_state image_snapshot Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9df69a17-2485-4730-8ace-ef319cdc22ee while it is in task_state image_snapshot Sep 16 14:04:39.753329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:04:39.754322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 409 to user: Cannot 'createImage' instance 9df69a17-2485-4730-8ace-ef319cdc22ee while it is in task_state image_snapshot {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:39.757119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1ad376ca-f98d-4fca-9d62-4332373832fa tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action" status: 409 len: 159 microversion: 2.1 time: 0.193837 Sep 16 14:04:39.761581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-729f52ba-81c1-443b-a118-fd95373119e5 req-5efe1aa4-cd14-43f1-8014-dad5eede6766 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.762286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-729f52ba-81c1-443b-a118-fd95373119e5 req-5efe1aa4-cd14-43f1-8014-dad5eede6766 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.762904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-729f52ba-81c1-443b-a118-fd95373119e5 req-5efe1aa4-cd14-43f1-8014-dad5eede6766 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.763324 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1202/2417] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:04:39 2022] POST /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee/action => generated 159 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:04:39.778151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c8d2f12-ec85-45e5-b8e5-2d9f0140e695 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '.version_select at 0x7f724d322b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:39.785942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c8d2f12-ec85-45e5-b8e5-2d9f0140e695 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.787800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c8d2f12-ec85-45e5-b8e5-2d9f0140e695 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.788846 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-729f52ba-81c1-443b-a118-fd95373119e5 req-5efe1aa4-cd14-43f1-8014-dad5eede6766 service nova] Creating event network-changed:edaa4ce3-67cc-427e-9a01-3f52b5e14f65 for instance e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd on n-h2-858129-2 Sep 16 14:04:39.789160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c8d2f12-ec85-45e5-b8e5-2d9f0140e695 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.805233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-729f52ba-81c1-443b-a118-fd95373119e5 req-5efe1aa4-cd14-43f1-8014-dad5eede6766 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066629 Sep 16 14:04:39.805832 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1216/2418] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:39.837386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c8d2f12-ec85-45e5-b8e5-2d9f0140e695 tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.071538 Sep 16 14:04:39.844342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:39.850575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1203/2419] 10.222.0.60 () {60 vars in 1184 bytes} [Fri Sep 16 14:04:39 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:39.860736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:39.872302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-778d0014-9d96-4692-afca-8d55f9a8b813 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d099790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:39.892338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.893210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.893976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.895199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:39.896026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:39.903512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:39.987920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-778d0014-9d96-4692-afca-8d55f9a8b813 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 485 microversion: 2.1 time: 0.135104 Sep 16 14:04:39.996838 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1204/2420] 10.222.0.60 () {58 vars in 1317 bytes} [Fri Sep 16 14:04:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 485 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:40.015228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-123ec736-4088-4a5f-abf6-13c55b52273c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '.version_select at 0x7f724d197040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:40.249453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:40.269658 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b133f72-80bf-41ed-8056-5988774d2639 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.455723 Sep 16 14:04:40.272835 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1217/2421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:39 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:40.285386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-92c09aa3-105f-4131-bd19-732b4346c56a req-8084980a-02e0-437b-b37d-7f6fd8321aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f8288b-89f5-4d23-88f6-9a6c6043304a", "tag": "2b18eb1f-294f-409c-9550-9efe682af9a5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:40.328043 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-123ec736-4088-4a5f-abf6-13c55b52273c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/images/26a08c49-df66-45b6-a7d9-e1cb3d2970fc" status: 204 len: 0 microversion: 2.1 time: 0.329160 Sep 16 14:04:40.333447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1205/2422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:39 2022] DELETE /compute/v2.1/images/26a08c49-df66-45b6-a7d9-e1cb3d2970fc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:40.333689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-92c09aa3-105f-4131-bd19-732b4346c56a req-8084980a-02e0-437b-b37d-7f6fd8321aef service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:40.334120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-92c09aa3-105f-4131-bd19-732b4346c56a req-8084980a-02e0-437b-b37d-7f6fd8321aef service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:40.334550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-92c09aa3-105f-4131-bd19-732b4346c56a req-8084980a-02e0-437b-b37d-7f6fd8321aef service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:40.346689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2bec1dd4-0af0-4510-9b28-6e0bc065043e req-2979e0c5-532d-4204-ad47-55d1b80e0eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "name": "network-vif-unplugged", "status": "completed", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:40.359991 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-92c09aa3-105f-4131-bd19-732b4346c56a req-8084980a-02e0-437b-b37d-7f6fd8321aef service nova] Creating event network-changed:2b18eb1f-294f-409c-9550-9efe682af9a5 for instance 84f8288b-89f5-4d23-88f6-9a6c6043304a on n-h1-858129-2 Sep 16 14:04:40.376186 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-92c09aa3-105f-4131-bd19-732b4346c56a req-8084980a-02e0-437b-b37d-7f6fd8321aef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100933 Sep 16 14:04:40.379230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2bec1dd4-0af0-4510-9b28-6e0bc065043e req-2979e0c5-532d-4204-ad47-55d1b80e0eb1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:40.379510 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1218/2423] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:40.380160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2bec1dd4-0af0-4510-9b28-6e0bc065043e req-2979e0c5-532d-4204-ad47-55d1b80e0eb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:40.381098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2bec1dd4-0af0-4510-9b28-6e0bc065043e req-2979e0c5-532d-4204-ad47-55d1b80e0eb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:40.391361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:40.396213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:40.411778 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2bec1dd4-0af0-4510-9b28-6e0bc065043e req-2979e0c5-532d-4204-ad47-55d1b80e0eb1 service nova] Creating event network-vif-unplugged:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:04:40.417201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:40.421057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:40.422383 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2bec1dd4-0af0-4510-9b28-6e0bc065043e req-2979e0c5-532d-4204-ad47-55d1b80e0eb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089716 Sep 16 14:04:40.423208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:40.427802 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1206/2424] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:40.429828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:40.430966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:40.433124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:40.433342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5024f390-1eee-4dd0-8944-9ddafd7bf480 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f725175baf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:40.614370 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5024f390-1eee-4dd0-8944-9ddafd7bf480 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 485 microversion: 2.1 time: 0.186365 Sep 16 14:04:40.623285 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1207/2425] 10.222.0.60 () {58 vars in 1303 bytes} [Fri Sep 16 14:04:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 485 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:40.649807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:40.651115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:40.670519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:40.671709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:40.674289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:40.676085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:40.677114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:40.678273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:40.889570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] Lazy-loading 'services' on Instance uuid e6d42251-9a1b-4702-afa6-ef58d5b2bb96 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:04:40.914129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a3755142-5ae8-4663-9548-4239ee13858b tempest-LiveAutoBlockMigrationV225Test-1784642263 tempest-LiveAutoBlockMigrationV225Test-1784642263-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1967 microversion: 2.25 time: 0.532856 Sep 16 14:04:40.927670 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1219/2426] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:40 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1967 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:40.940437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8dffe18-5092-47c5-b29a-570540c0ba49 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d17e700>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:41.176888 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8dffe18-5092-47c5-b29a-570540c0ba49 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.246984 Sep 16 14:04:41.178285 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1220/2427] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 14:04:40 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:41.188679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:41.191800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:41.205872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:41.207441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:41.209683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:41.212496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:41.214965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:41.216160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:41.352360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:41.365411 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-803d1d72-1ab3-4666-a472-eba65d9ede61 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1531 microversion: 2.1 time: 0.740495 Sep 16 14:04:41.366352 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1208/2428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:40 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1531 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:41.383807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:41.384333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:41.404202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:41.404714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:41.405160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:41.406281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:41.406425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:41.406818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:41.483182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:04:41.813341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02d3bf9b-2909-44db-8d17-9c772365a047 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 204 len: 0 microversion: 2.25 time: 0.440825 Sep 16 14:04:41.823199 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1209/2429] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:04:41 2022] DELETE /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:04:41.833586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a37015a1-25a2-4ea2-8bde-dba473f8c5e3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d3224c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:41.969582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:41.980301 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bcc9c85f-884d-4558-9b1b-9b66580f9985 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 200 len: 1519 microversion: 2.1 time: 0.800070 Sep 16 14:04:41.981456 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1221/2430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:41 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 1519 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:41.989925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:41.990873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:42.000176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.000989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.001828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.003032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.003722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.004368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.024418 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a37015a1-25a2-4ea2-8bde-dba473f8c5e3 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.197551 Sep 16 14:04:42.025464 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1210/2431] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 14:04:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:42.035672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:42.037125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:42.054994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.055763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.056578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.057860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.058879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.059696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.255049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:42.271168 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ef8f2714-b148-4201-adbe-efd66518be43 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.284719 Sep 16 14:04:42.275293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1222/2432] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:41 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:42.280734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'action', calling method: .version_select at 0x7f724f0f8670>, body: {"addFloatingIp": {"address": "172.25.3.184"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:42.289106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:42.308963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.314675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.315158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.315924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.319145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.320167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.361142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:42.372035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:42.373760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:42.375410 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8db09a8-84ea-4d4d-bf2b-e2e1ca3c52cf tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1481 microversion: 2.25 time: 0.347974 Sep 16 14:04:42.390592 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1211/2433] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:42 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1481 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:42.390592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5714a710-c832-49b4-9b6e-4b90cae70852 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f725177a3a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:42.492216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:04:42.492647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquired lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:04:42.496785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5714a710-c832-49b4-9b6e-4b90cae70852 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.118952 Sep 16 14:04:42.508015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1212/2434] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:04:42 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:42.511041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:42.511677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:42.519409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.519983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.520437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.521178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:42.521666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:42.522089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:42.949721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:42.959337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-64b3dbb9-e2ac-48ff-ac82-c8f62144a2b7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1531 microversion: 2.1 time: 0.452407 Sep 16 14:04:42.960224 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1213/2435] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:42 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1531 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:42.975466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81dfd9f8-6173-4332-b957-80d18e270173 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724df27430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:43.182299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81dfd9f8-6173-4332-b957-80d18e270173 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?changes-since=2022-09-16T14%3A00%3A11Z" status: 200 len: 7021 microversion: 2.1 time: 0.220876 Sep 16 14:04:43.183350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1214/2436] 10.222.0.60 () {58 vars in 1220 bytes} [Fri Sep 16 14:04:42 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-16T14%3A00%3A11Z => generated 7021 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:43.206837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d04f48a-9862-4c43-a82f-1518a72a4689 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f7251691310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:43.324320 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d04f48a-9862-4c43-a82f-1518a72a4689 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1233564516" status: 200 len: 665 microversion: 2.1 time: 0.122357 Sep 16 14:04:43.339995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1215/2437] 10.222.0.60 () {58 vars in 1252 bytes} [Fri Sep 16 14:04:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1233564516 => generated 665 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:04:43.345068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:43.345776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:43.353969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:43.354519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:43.354965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:43.355766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:43.356383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:43.356928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:43.771192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:43.790839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e85f7cc-d7f0-4052-a27e-d0af0c53f3a9 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.448843 Sep 16 14:04:43.792769 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1216/2438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:43 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:43.803020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01a92d79-0b7e-4c42-9ebf-5588ae0325d9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d2d0b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:43.961154 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01a92d79-0b7e-4c42-9ebf-5588ae0325d9 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1467 microversion: 2.1 time: 0.165980 Sep 16 14:04:43.978028 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1217/2439] 10.222.0.60 () {58 vars in 1338 bytes} [Fri Sep 16 14:04:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:43.995992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:43.995992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:44.007917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:44.008861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:44.009692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:44.011053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:44.014872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:44.018944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:44.333673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:44.369970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:44.378629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:44.392700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1b8f8fa-8194-4164-9635-9716967f5c47 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1481 microversion: 2.25 time: 0.411769 Sep 16 14:04:44.393977 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1218/2440] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:43 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1481 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:44.413068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b8f2ded-4927-4ec4-92c6-a6766f4292fa tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d2d0670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:44.504416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b8f2ded-4927-4ec4-92c6-a6766f4292fa tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1467 microversion: 2.1 time: 0.106063 Sep 16 14:04:44.507157 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1219/2441] 10.222.0.60 () {58 vars in 1324 bytes} [Fri Sep 16 14:04:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2F077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:44.545946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:44.550273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:44.565908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:44.566832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:44.567679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:44.569261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:44.570499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:44.571688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:45.043233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:45.047334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:45.065019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1332459-0154-4421-b490-00d01cf22553 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1537 microversion: 2.1 time: 0.554507 Sep 16 14:04:45.070030 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1220/2442] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:44 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1537 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:45.083088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Building network info cache for instance {{(pid=128643) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:04:45.096784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5776c13-6c0a-46d5-b6fe-daa0f6baf9d1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d2d0b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:45.342768 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a5776c13-6c0a-46d5-b6fe-daa0f6baf9d1 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7796 microversion: 2.1 time: 0.270318 Sep 16 14:04:45.344432 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1221/2443] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 14:04:45 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7796 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:45.376461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:45.377821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:45.436608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:45.445326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:45.446307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:45.447833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:45.448802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:45.449454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:46.147015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:46.164506 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7fe47675-bafb-4acd-89d9-b6e6c7eb3e35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.817331 Sep 16 14:04:46.167484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1222/2444] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:45 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:46.211196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2065fd6d-a5a6-4c94-89a8-7d05f97ab578 req-67075af9-dac7-470f-be24-4569ebcf9e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:46.243320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2065fd6d-a5a6-4c94-89a8-7d05f97ab578 req-67075af9-dac7-470f-be24-4569ebcf9e54 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:46.243320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2065fd6d-a5a6-4c94-89a8-7d05f97ab578 req-67075af9-dac7-470f-be24-4569ebcf9e54 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:46.243320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2065fd6d-a5a6-4c94-89a8-7d05f97ab578 req-67075af9-dac7-470f-be24-4569ebcf9e54 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:46.262096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2065fd6d-a5a6-4c94-89a8-7d05f97ab578 req-67075af9-dac7-470f-be24-4569ebcf9e54 service nova] Creating event network-changed:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:04:46.271089 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2065fd6d-a5a6-4c94-89a8-7d05f97ab578 req-67075af9-dac7-470f-be24-4569ebcf9e54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085080 Sep 16 14:04:46.272070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1223/2445] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:46.279520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efa076ac-acb9-4699-abf3-9bfb30466c7c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72516915e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:46.420763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efa076ac-acb9-4699-abf3-9bfb30466c7c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.146247 Sep 16 14:04:46.422757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1224/2446] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 14:04:46 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:46.438181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:46.439153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:46.454980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:46.462289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:46.463478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:46.464603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:46.465326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:46.466280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:46.862765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:46.880117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:46.881774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:46.885107 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-586071a0-c3fc-46e6-ba3f-60263da5f88b tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1481 microversion: 2.25 time: 0.458981 Sep 16 14:04:46.885752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1225/2447] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:46 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1481 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:46.898037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:46.902357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:46.922250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:46.923182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:46.925512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:46.927871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:46.929022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:46.932569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:46.953706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Updating instance_info_cache with network_info: [{"id": "99cef5ac-cf6f-4042-8117-71f655fc8e9e", "address": "fa:16:3e:e5:fd:43", "network": {"id": "5437ac41-bd4e-4bea-9a86-640cb50d1db2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1493049766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "997c95646a2b40489cf53d5538786bb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99cef5ac-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128643) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:04:46.977570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Releasing lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:04:46.980341 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0783a352-f46f-4529-9e68-129b90ccf7a6 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action" status: 202 len: 0 microversion: 2.1 time: 4.703035 Sep 16 14:04:46.983901 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1223/2448] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:04:42 2022] POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action => generated 0 bytes in 4708 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:04:46.996913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ebc2fc90-b714-467e-94d7-e00a32423f4a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d54f670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:47.120597 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ebc2fc90-b714-467e-94d7-e00a32423f4a tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/b0b65f17-d770-469f-9ae4-7c7011730f1b" status: 200 len: 784 microversion: 2.1 time: 0.134485 Sep 16 14:04:47.146842 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1224/2449] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:04:46 2022] GET /compute/v2.1/images/b0b65f17-d770-469f-9ae4-7c7011730f1b => generated 784 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:47.323026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:47.340369 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25ea751d-f483-4832-8023-9243846ed068 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1537 microversion: 2.1 time: 0.450298 Sep 16 14:04:47.344959 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1226/2450] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:46 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1537 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:47.364716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'action', calling method: .version_select at 0x7f724f6e6a60>, body: {"addFloatingIp": {"address": "172.25.3.184"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:47.367871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:47.379363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:47.380490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:47.381348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:47.382546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:47.383244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:47.383895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:47.545847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1239871100", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:47.562855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "refresh_cache-14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:04:47.564452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquired lock "refresh_cache-14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:04:47.703438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:04:48.942020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:04:48.943707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:04:48.944722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:04:48.945979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:04:48.948159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:04:48.972574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:48.973818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:48.975353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:48.978543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:48.981147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:48.982292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.016822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Getting quotas for project 3513e9bc3e7447a19e6879e8bc68d787. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:04:49.024657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Getting quotas for user 8f49d0bfb2a6439ba5de6b74fd7b2901 and project 3513e9bc3e7447a19e6879e8bc68d787. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:04:49.042434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:04:49.047620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:04:49.129729 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b5aff6bf-424d-4cc8-995f-720e9e5b5036 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978785 Sep 16 14:04:49.130532 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1225/2451] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:04:49.143353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d95b5254-de60-4215-815c-13fca6f1a9e4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d339040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:49.216878 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d95b5254-de60-4215-815c-13fca6f1a9e4 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.078120 Sep 16 14:04:49.230552 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1226/2452] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 14:04:49 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:49.236499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:49.237117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:49.244520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.244737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.245153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.245881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.246331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.246788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.568515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:49.586715 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5eb5d00-e61c-409b-90a9-f6f70ab74b69 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.354631 Sep 16 14:04:49.588383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1227/2453] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:49 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:49.600129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f1396166-695a-4624-8708-57c8e0d93275 req-1c6831a6-ac9c-430c-8ebe-0cf14a4b6c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d42251-9a1b-4702-afa6-ef58d5b2bb96", "name": "network-vif-deleted", "tag": "270026fb-ac51-4adc-b0ff-c15b43a583a2"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:49.626823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f1396166-695a-4624-8708-57c8e0d93275 req-1c6831a6-ac9c-430c-8ebe-0cf14a4b6c26 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.628348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f1396166-695a-4624-8708-57c8e0d93275 req-1c6831a6-ac9c-430c-8ebe-0cf14a4b6c26 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.629615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f1396166-695a-4624-8708-57c8e0d93275 req-1c6831a6-ac9c-430c-8ebe-0cf14a4b6c26 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.654666 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f1396166-695a-4624-8708-57c8e0d93275 req-1c6831a6-ac9c-430c-8ebe-0cf14a4b6c26 service nova] Creating event network-vif-deleted:270026fb-ac51-4adc-b0ff-c15b43a583a2 for instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 on n-h1-858129-2 Sep 16 14:04:49.660999 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f1396166-695a-4624-8708-57c8e0d93275 req-1c6831a6-ac9c-430c-8ebe-0cf14a4b6c26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069336 Sep 16 14:04:49.662172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1228/2454] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:49.669217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:49.670149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:49.677363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.678430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.679038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.680017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.680688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.681323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.788390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:49.812666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:49.816491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:49.819220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-07866648-d95b-4bd0-b535-fae77fbe1894 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1265 microversion: 2.25 time: 0.155175 Sep 16 14:04:49.833924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1229/2455] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:49 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:49.836274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:49.842494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:49.858534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.859672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.860619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.863620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:49.864871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:49.865642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:49.910703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:50.193462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:50.236936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28e1c031-0c4a-4e45-bd85-395271d6bd79 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1537 microversion: 2.1 time: 0.410126 Sep 16 14:04:50.241981 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1230/2456] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:49 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1537 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:50.267354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:50.268584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:50.286222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:50.288858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:50.290073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:50.295380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:50.296295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:50.301115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:50.518998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:50.533919 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-001a512a-daca-49ca-8a04-5b3f605a18b8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1269 microversion: 2.1 time: 0.286533 Sep 16 14:04:50.535021 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1231/2457] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:50 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1269 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:50.542248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-636dfc13-22a7-40fc-bf24-090c85bcbe34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517dc700>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:52.081701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.neutron [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] re-assign floating IP 172.25.3.184 from instance e3e7730a-4bda-4ae5-9595-934cf25ea683 Sep 16 14:04:52.127204 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-636dfc13-22a7-40fc-bf24-090c85bcbe34 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64" status: 204 len: 0 microversion: 2.1 time: 1.588988 Sep 16 14:04:52.128495 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1232/2458] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:50 2022] DELETE /compute/v2.1/images/98832738-2dea-4340-8bdb-a7d815c61f64 => generated 0 bytes in 1592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:52.134746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-28af63f6-3221-4e1c-aaa9-ac5c7ef56d27 req-d6c1a578-bebf-48e8-8563-3c920954543d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f8288b-89f5-4d23-88f6-9a6c6043304a", "name": "network-vif-plugged", "status": "completed", "tag": "2b18eb1f-294f-409c-9550-9efe682af9a5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:52.167139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28af63f6-3221-4e1c-aaa9-ac5c7ef56d27 req-d6c1a578-bebf-48e8-8563-3c920954543d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:52.167139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28af63f6-3221-4e1c-aaa9-ac5c7ef56d27 req-d6c1a578-bebf-48e8-8563-3c920954543d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:52.167139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28af63f6-3221-4e1c-aaa9-ac5c7ef56d27 req-d6c1a578-bebf-48e8-8563-3c920954543d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:52.195325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:04:52.199690 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-28af63f6-3221-4e1c-aaa9-ac5c7ef56d27 req-d6c1a578-bebf-48e8-8563-3c920954543d service nova] Creating event network-vif-plugged:2b18eb1f-294f-409c-9550-9efe682af9a5 for instance 84f8288b-89f5-4d23-88f6-9a6c6043304a on n-h1-858129-2 Sep 16 14:04:52.210988 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-28af63f6-3221-4e1c-aaa9-ac5c7ef56d27 req-d6c1a578-bebf-48e8-8563-3c920954543d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081085 Sep 16 14:04:52.213961 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1233/2459] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:52.244625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:52.250319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:52.259421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:52.261514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:52.262155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:52.262653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:52.263405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:52.264600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:52.264600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:52.632082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:52.647395 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a99bacf9-16ea-478d-ad2e-d14646526390 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.425369 Sep 16 14:04:52.648101 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1234/2460] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:52 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:52.664045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:52.664666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:52.687488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:52.688017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:52.688467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:52.690549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:52.695575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:52.696218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:53.057905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:53.088818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:53.099634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:53.111170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7fc7826-6370-4873-a57c-4fbd7b19a60d tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1265 microversion: 2.25 time: 0.452465 Sep 16 14:04:53.116507 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1235/2461] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:52 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1265 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:53.139073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:53.144324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:53.155747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:53.156654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:53.158050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:53.159549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:53.160566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:53.161354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:53.528119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:53.541329 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ecf1ccd9-d38e-40f9-bf8c-614b4f1c4f14 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1519 microversion: 2.1 time: 0.422788 Sep 16 14:04:53.542450 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1236/2462] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:53 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1519 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:53.547745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:53.550373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:53.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:53.557797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:53.558241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:53.559043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:53.559495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:53.559925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:53.597229 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52b519f3-3510-4ec2-bef6-53c038a9e865 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053496 Sep 16 14:04:53.602481 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1237/2463] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:04:53 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:53.602788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Updating instance_info_cache with network_info: [{"id": "99cef5ac-cf6f-4042-8117-71f655fc8e9e", "address": "fa:16:3e:e5:fd:43", "network": {"id": "5437ac41-bd4e-4bea-9a86-640cb50d1db2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1493049766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "997c95646a2b40489cf53d5538786bb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99cef5ac-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:04:53.603623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:53.604259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:53.629465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:53.630097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:53.630363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:04:53.630720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:53.631456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:53.631928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:53.632362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:54.069137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:54.081082 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a92a8a23-5863-4d1f-81ce-830400aead56 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.481991 Sep 16 14:04:54.084611 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1238/2464] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:53 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:54.093427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-edc0ff0c-11ba-4571-b2b7-dc1f8f17a051 req-d7fd7ec9-2707-4a78-a7c5-f728a9a75aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:54.122475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-edc0ff0c-11ba-4571-b2b7-dc1f8f17a051 req-d7fd7ec9-2707-4a78-a7c5-f728a9a75aee service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:54.123378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-edc0ff0c-11ba-4571-b2b7-dc1f8f17a051 req-d7fd7ec9-2707-4a78-a7c5-f728a9a75aee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:54.124035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-edc0ff0c-11ba-4571-b2b7-dc1f8f17a051 req-d7fd7ec9-2707-4a78-a7c5-f728a9a75aee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:54.168894 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-edc0ff0c-11ba-4571-b2b7-dc1f8f17a051 req-d7fd7ec9-2707-4a78-a7c5-f728a9a75aee service nova] Creating event network-changed:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:04:54.182243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-edc0ff0c-11ba-4571-b2b7-dc1f8f17a051 req-d7fd7ec9-2707-4a78-a7c5-f728a9a75aee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091630 Sep 16 14:04:54.184529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1239/2465] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:54.191524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ddf1a73-475a-426e-afa6-36699ff9c1cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f72517dc4c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:55.131201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Updating instance_info_cache with network_info: [{"id": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba", "address": "fa:16:3e:bd:f3:9c", "network": {"id": "5437ac41-bd4e-4bea-9a86-640cb50d1db2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1493049766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "997c95646a2b40489cf53d5538786bb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapde83dc31-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:04:55.168242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Releasing lock "refresh_cache-14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:04:55.171500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25312e25-edbf-4e3a-98bd-cdef57de57a7 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4/action" status: 202 len: 0 microversion: 2.1 time: 7.823315 Sep 16 14:04:55.179401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1227/2466] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:04:47 2022] POST /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4/action => generated 0 bytes in 7833 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:04:55.188258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:55.190080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:55.200250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:55.205983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.207421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.208656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.209869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.210976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.211999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.224387 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ddf1a73-475a-426e-afa6-36699ff9c1cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac" status: 204 len: 0 microversion: 2.1 time: 1.037127 Sep 16 14:04:55.225542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1240/2467] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:54 2022] DELETE /compute/v2.1/images/c3cf8cc3-5e52-4f71-8040-1a700df95fac => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:55.233745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:55.236104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:55.253554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.254826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.255870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.257452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.258577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.259304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.277202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:04:55.474532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lazy-loading 'services' on Instance uuid 2a64ce67-150d-4430-805a-9cbab3489620 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:04:55.516456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4349bdb3-e47d-4597-93bd-4d0fe1c293cd tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 204 len: 0 microversion: 2.1 time: 0.334348 Sep 16 14:04:55.518316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1228/2468] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:04:55 2022] DELETE /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:55.533910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:55.544165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:55.559672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.560937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.562102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.563913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.565053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.566050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.743910 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1940b10b-d044-4518-9cfd-8c9631a6ab73 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments/43b3f6cd-f9f0-4e2c-811b-ea90c0eb1c8a" status: 202 len: 0 microversion: 2.1 time: 0.516268 Sep 16 14:04:55.754261 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1241/2469] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:04:55 2022] DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments/43b3f6cd-f9f0-4e2c-811b-ea90c0eb1c8a => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:04:55.793237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:55.795997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:55.835937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.836983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.838106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.840114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.843604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.849093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:55.918745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:55.933556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7b956495-5b76-48da-ad30-ee0a693e0083 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.406683 Sep 16 14:04:55.937772 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1229/2470] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:55 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:55.965238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd", "name": "network-vif-plugged", "status": "completed", "tag": "edaa4ce3-67cc-427e-9a01-3f52b5e14f65"}, {"server_uuid": "9df69a17-2485-4730-8ace-ef319cdc22ee", "name": "network-vif-plugged", "status": "completed", "tag": "b821d3b8-aca2-4796-8e65-9bd62d217b85"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:55.979904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:55.981107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:55.981806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:56.011000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] Creating event network-vif-plugged:edaa4ce3-67cc-427e-9a01-3f52b5e14f65 for instance e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd on n-h2-858129-2 Sep 16 14:04:56.011921 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] Creating event network-vif-plugged:b821d3b8-aca2-4796-8e65-9bd62d217b85 for instance 9df69a17-2485-4730-8ace-ef319cdc22ee on n-h2-858129-2 Sep 16 14:04:56.020659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:56.022347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:56.023547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:56.026254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lazy-loading 'fault' on Instance uuid e6d42251-9a1b-4702-afa6-ef58d5b2bb96 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:04:56.028260 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fbe32533-a99c-4203-a8c7-1ce5814506af req-58ed6eb0-602a-428c-90f3-9412c3b97f4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088895 Sep 16 14:04:56.031063 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1230/2471] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:56.046810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:56.049491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:56.079600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:56.080803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:56.081818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:56.083720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:56.085247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:56.087197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:56.117987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:56.142461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:56.149680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:56.152539 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b126ec5b-7ebc-45e6-8d19-12660b95db3e tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 200 len: 1270 microversion: 2.25 time: 0.394468 Sep 16 14:04:56.154701 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1242/2472] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:55 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 1270 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:04:56.165499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'action', calling method: .version_select at 0x7f724fb93790>, body: {"removeFloatingIp": {"address": "172.25.3.184"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:56.683338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:56.694056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4171e52e-88e8-4a0d-97c8-2439cc7e9c26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.657406 Sep 16 14:04:56.696121 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1231/2473] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:56 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:56.701155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42ccb1c5-aa43-4aa3-b434-13a2e3a0b88b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce523a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:56.708360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:56.717472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:56.718039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:56.718723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:56.721528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:56.722237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:56.723046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.120431 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] HTTP exception thrown: Floating IP 172.25.3.184 is not associated with instance e3e7730a-4bda-4ae5-9595-934cf25ea683. Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Request method failure captured: Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action HTTP/1.1 Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 49 Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIIz5q47Tue6lV-M-Jn4okqWHfbU4HH2OVw8FNUudeLntuiTaVLSke4f3_Y9a276xzdkK7nR_edSOEmVEd6Ft5iPgHndmf7eMNPo8CBqO6bbqiDyZwlrjV1GTx3ed6mXALV_JJcQl2wFEgceQvlzRt2YQdZ-_WKJ22LKN1nZQtwKnVA Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:57.123248 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997c95646a2b40489cf53d5538786bb3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}] Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e0441b7c0ea04bb08f871af5c2f1f46a Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: {"removeFloatingIp": {"address": "172.25.3.184"}} Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:04:57.125311 n-d-858129-2 devstack@n-api.service[128643]: exception: Floating IP 172.25.3.184 is not associated with instance e3e7730a-4bda-4ae5-9595-934cf25ea683. Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e3e7730a-4bda-4ae5-9595-934cf25ea683', 'body': {'removeFloatingIp': {'address': '172.25.3.184'}}} Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.184 is not associated with instance e3e7730a-4bda-4ae5-9595-934cf25ea683. Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:57.126923 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:57.130846 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:57.130846 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:57.130846 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:57.130846 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:57.130846 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.184 is not associated with instance e3e7730a-4bda-4ae5-9595-934cf25ea683. Sep 16 14:04:57.130846 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:57.133346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Returning 409 to user: Floating IP 172.25.3.184 is not associated with instance e3e7730a-4bda-4ae5-9595-934cf25ea683. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:57.135408 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-072d36ed-c55e-490c-9d9d-058e8d055c2e tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action" status: 409 len: 146 microversion: 2.1 time: 0.978354 Sep 16 14:04:57.136675 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1243/2474] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:04:56 2022] POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action => generated 146 bytes in 981 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:04:57.145540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:57.147219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:57.158592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.159819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.160981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.162704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.163845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.164989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.398562 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42ccb1c5-aa43-4aa3-b434-13a2e3a0b88b tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446" status: 204 len: 0 microversion: 2.1 time: 0.701138 Sep 16 14:04:57.400226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1232/2475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:56 2022] DELETE /compute/v2.1/images/412ee641-373a-448f-84b4-957885bcc446 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:57.406667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-df1886a1-7518-4ac6-b82b-58d8179e6f6a req-402e75af-c326-442e-a0b6-b4f4ecbcfa7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:57.420063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-df1886a1-7518-4ac6-b82b-58d8179e6f6a req-402e75af-c326-442e-a0b6-b4f4ecbcfa7e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.420812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-df1886a1-7518-4ac6-b82b-58d8179e6f6a req-402e75af-c326-442e-a0b6-b4f4ecbcfa7e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.421398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-df1886a1-7518-4ac6-b82b-58d8179e6f6a req-402e75af-c326-442e-a0b6-b4f4ecbcfa7e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.436837 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-df1886a1-7518-4ac6-b82b-58d8179e6f6a req-402e75af-c326-442e-a0b6-b4f4ecbcfa7e service nova] Creating event network-changed:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:04:57.444494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-df1886a1-7518-4ac6-b82b-58d8179e6f6a req-402e75af-c326-442e-a0b6-b4f4ecbcfa7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042561 Sep 16 14:04:57.449962 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1233/2476] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:57.457084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4b02f0a3-ab28-43cd-b01f-529894ef4397 req-89f45f5e-b2a4-4dfd-967a-ddf376660bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4", "tag": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:57.473182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4b02f0a3-ab28-43cd-b01f-529894ef4397 req-89f45f5e-b2a4-4dfd-967a-ddf376660bcc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.474379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4b02f0a3-ab28-43cd-b01f-529894ef4397 req-89f45f5e-b2a4-4dfd-967a-ddf376660bcc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.475109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4b02f0a3-ab28-43cd-b01f-529894ef4397 req-89f45f5e-b2a4-4dfd-967a-ddf376660bcc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.476156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:57.491031 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4b02f0a3-ab28-43cd-b01f-529894ef4397 req-89f45f5e-b2a4-4dfd-967a-ddf376660bcc service nova] Creating event network-changed:de83dc31-de7b-4d3b-8d3b-e5915c6009ba for instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 on n-h1-858129-2 Sep 16 14:04:57.496575 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-104e1344-eba2-4f9d-b5cd-fcbac04bd252 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1525 microversion: 2.1 time: 0.358182 Sep 16 14:04:57.497444 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1244/2477] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:57 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1525 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:57.498265 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4b02f0a3-ab28-43cd-b01f-529894ef4397 req-89f45f5e-b2a4-4dfd-967a-ddf376660bcc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045757 Sep 16 14:04:57.499727 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1234/2478] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:57.503056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:57.504599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:57.507726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'action', calling method: .version_select at 0x7f724f6e6af0>, body: {"removeFloatingIp": {"address": "172.25.3.184"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:57.511725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.512533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.513162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.514104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.514792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.515473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.908576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:57.922261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.923432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.924057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.924942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:57.925422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:57.925855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:57.972124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:57.985032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d13cf235-bf79-4559-a7d8-b14c8635a109 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1320 microversion: 2.1 time: 0.486089 Sep 16 14:04:57.986310 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1245/2479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:57 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:58.016795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:58.019296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: e6d42251-9a1b-4702-afa6-ef58d5b2bb96] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:58.038240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:58.039011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:58.039620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:58.040553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:58.041177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:58.041767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:58.089670 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] HTTP exception thrown: Instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 could not be found. Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Request method failure captured: Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 HTTP/1.1 Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_uUJaBDRXPsuGY_BNB2pnP8-qfrULkAoank3_mDWQEqIT8FMAPMopyC4QdGFom-3-LeezsUTpVswagmTTCnQ_mHDfipn_ArhbsQGj1NWrKmIUYqJ-mMRdfPyqTZ2-KGDGpPn7ryRO07qTm8aoMuoLpHaWIwfWEIQStF6FWgDu5F3M Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:04:58.091511 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_54dfa47e4a424466bbfb73c6864caeed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}] Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 916231d4d6114380b4e48d428d6dd843 Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 could not be found. Sep 16 14:04:58.094151 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e6d42251-9a1b-4702-afa6-ef58d5b2bb96'} Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 could not be found. Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:04:58.096018 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 could not be found. Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 could not be found. Sep 16 14:04:58.098260 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:04:58.104972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Returning 404 to user: Instance e6d42251-9a1b-4702-afa6-ef58d5b2bb96 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:04:58.104972 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35cacf17-0694-426e-889e-c197e4a09600 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96" status: 404 len: 111 microversion: 2.25 time: 0.092778 Sep 16 14:04:58.107796 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1246/2480] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:04:57 2022] GET /compute/v2.1/servers/e6d42251-9a1b-4702-afa6-ef58d5b2bb96 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:04:58.116331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:58.116844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:58.132855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:58.133288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:58.133733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:58.134504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:58.135035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:58.135497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:58.215587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:04:58.445144 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31d55036-98ec-4b07-a392-3e2fb9edb56c tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 204 len: 0 microversion: 2.1 time: 0.337628 Sep 16 14:04:58.446639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1247/2481] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:04:58 2022] DELETE /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:04:58.457290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:58.459241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:58.467966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:58.469257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:58.470702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:58.472041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:58.473096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:58.473771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:58.752528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "refresh_cache-14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:04:58.753602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquired lock "refresh_cache-14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:04:59.003086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:59.033597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:59.338023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:04:59.356535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:04:59.397221 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-512e020a-5441-458f-b8a6-a8a53d191c3b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.943946 Sep 16 14:04:59.398597 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1248/2482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:58 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:04:59.428438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-08a20cde-a10d-439c-b4bc-11a770493bbe req-16f950d1-5442-46c9-8d6a-5abd493caad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df69a17-2485-4730-8ace-ef319cdc22ee", "name": "network-vif-unplugged", "status": "completed", "tag": "b821d3b8-aca2-4796-8e65-9bd62d217b85"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:04:59.465718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-08a20cde-a10d-439c-b4bc-11a770493bbe req-16f950d1-5442-46c9-8d6a-5abd493caad9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:59.467376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-08a20cde-a10d-439c-b4bc-11a770493bbe req-16f950d1-5442-46c9-8d6a-5abd493caad9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:59.468646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-08a20cde-a10d-439c-b4bc-11a770493bbe req-16f950d1-5442-46c9-8d6a-5abd493caad9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:59.502251 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-08a20cde-a10d-439c-b4bc-11a770493bbe req-16f950d1-5442-46c9-8d6a-5abd493caad9 service nova] Creating event network-vif-unplugged:b821d3b8-aca2-4796-8e65-9bd62d217b85 for instance 9df69a17-2485-4730-8ace-ef319cdc22ee on n-h2-858129-2 Sep 16 14:04:59.518640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-08a20cde-a10d-439c-b4bc-11a770493bbe req-16f950d1-5442-46c9-8d6a-5abd493caad9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112751 Sep 16 14:04:59.521428 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1249/2483] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:04:59.533479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:04:59.534912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:04:59.546286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:59.546824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:59.547266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:04:59.548586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:04:59.549476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:04:59.549909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:00.098010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:00.117732 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7556d80a-1d50-4b9b-a2a2-32d3b25d9482 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1473 microversion: 2.1 time: 0.593512 Sep 16 14:05:00.122484 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1250/2484] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:04:59 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1473 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:00.133637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:00.136766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:00.158605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:00.159841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:00.160932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:00.162961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:00.164138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:00.165330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:00.807439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:00.862080 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5c1fc5b-0e61-4d8a-822b-460a7119f90e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 200 len: 1525 microversion: 2.1 time: 0.739359 Sep 16 14:05:00.863074 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1251/2485] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:00 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 1525 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:00.897615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:00.898755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:00.930111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:00.932262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:00.933031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:00.936800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:00.939968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:00.940641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:01.685906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:01.713059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6093ca5a-eec4-40c9-b80b-69a0ced05e47 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 200 len: 1507 microversion: 2.1 time: 0.847744 Sep 16 14:05:01.730507 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1252/2486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:00 2022] GET /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:01.730507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:01.730507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:01.750588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:01.750588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:01.750588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:01.756152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:01.756152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:01.758275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.218685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:02.240527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a75afdf-b1fc-4cdb-8af6-066a236b618f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.522426 Sep 16 14:05:02.242744 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1253/2487] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:01 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:02.254882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:02.257089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:02.269286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.271248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.272930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.275021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.276326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.278221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.368548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.369060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.369508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.369978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lazy-loading 'fault' on Instance uuid 077b0270-538b-4d3c-bb57-fc02f8ae640c {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:02.483095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:02.495731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c6ddf51-e73a-4ad6-bbae-9cafa8e8ad00 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 200 len: 1307 microversion: 2.1 time: 0.249002 Sep 16 14:05:02.506900 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1254/2488] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:02 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 1307 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:02.513074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7f17c249-3568-480f-a678-a6456c2c7189 req-418aab41-55bc-46e5-ad92-1c4209e15b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df69a17-2485-4730-8ace-ef319cdc22ee", "name": "network-vif-deleted", "tag": "b821d3b8-aca2-4796-8e65-9bd62d217b85"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:02.522628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:05:02.591694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7f17c249-3568-480f-a678-a6456c2c7189 req-418aab41-55bc-46e5-ad92-1c4209e15b43 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.592320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7f17c249-3568-480f-a678-a6456c2c7189 req-418aab41-55bc-46e5-ad92-1c4209e15b43 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.592776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7f17c249-3568-480f-a678-a6456c2c7189 req-418aab41-55bc-46e5-ad92-1c4209e15b43 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.629577 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7f17c249-3568-480f-a678-a6456c2c7189 req-418aab41-55bc-46e5-ad92-1c4209e15b43 service nova] Creating event network-vif-deleted:b821d3b8-aca2-4796-8e65-9bd62d217b85 for instance 9df69a17-2485-4730-8ace-ef319cdc22ee on n-h2-858129-2 Sep 16 14:05:02.651309 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7f17c249-3568-480f-a678-a6456c2c7189 req-418aab41-55bc-46e5-ad92-1c4209e15b43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142692 Sep 16 14:05:02.652636 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1255/2489] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:02.660431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b1b7d2ee-76cc-4883-b202-15f02962c158 req-a3855edc-29da-496a-9267-10c638a85772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077b0270-538b-4d3c-bb57-fc02f8ae640c", "name": "network-vif-deleted", "tag": "699c0d76-e03c-4a5f-a650-09e078d1aa6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:02.674030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b1b7d2ee-76cc-4883-b202-15f02962c158 req-a3855edc-29da-496a-9267-10c638a85772 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.675006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b1b7d2ee-76cc-4883-b202-15f02962c158 req-a3855edc-29da-496a-9267-10c638a85772 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.675863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b1b7d2ee-76cc-4883-b202-15f02962c158 req-a3855edc-29da-496a-9267-10c638a85772 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.692598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b1b7d2ee-76cc-4883-b202-15f02962c158 req-a3855edc-29da-496a-9267-10c638a85772 service nova] Creating event network-vif-deleted:699c0d76-e03c-4a5f-a650-09e078d1aa6e for instance 077b0270-538b-4d3c-bb57-fc02f8ae640c on n-h1-858129-2 Sep 16 14:05:02.701684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b1b7d2ee-76cc-4883-b202-15f02962c158 req-a3855edc-29da-496a-9267-10c638a85772 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047264 Sep 16 14:05:02.717543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1256/2490] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:02.741356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:02.742625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 84f8288b-89f5-4d23-88f6-9a6c6043304a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:02.775749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.776626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.777575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:02.784145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:02.785078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:02.785755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:04.395938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:04.429758 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-87286b9c-41a2-418d-85cf-223d92237949 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/84f8288b-89f5-4d23-88f6-9a6c6043304a" status: 200 len: 1508 microversion: 2.1 time: 1.703237 Sep 16 14:05:04.431243 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1257/2491] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:02 2022] GET /compute/v2.1/servers/84f8288b-89f5-4d23-88f6-9a6c6043304a => generated 1508 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:04.458737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:04.460433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:04.475021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:04.475774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:04.476391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:04.478278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:04.479077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:04.479631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:04.509188 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee HTTP/1.1 Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:04.512786 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:05:04.515040 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee'} Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:04.516303 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:05:04.518387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:04.522227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:04.524170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5044dfb2-6cc3-4464-9d91-29d7899f8a26 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 404 len: 111 microversion: 2.1 time: 0.091179 Sep 16 14:05:04.525912 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1258/2492] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:04 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:04.535128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:04.536492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:04.549024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:04.550283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:04.552376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:04.554443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:04.555651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:04.556819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.020213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:05.052407 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2363bb05-8961-4971-8f4c-791fe90d8be1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.524133 Sep 16 14:05:05.054297 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1259/2493] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:04 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:05.063625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:05.065257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: 077b0270-538b-4d3c-bb57-fc02f8ae640c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:05.077146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.079146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.080335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.082011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.083241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.084373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.123458 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] HTTP exception thrown: Instance 077b0270-538b-4d3c-bb57-fc02f8ae640c could not be found. Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Request method failure captured: Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c HTTP/1.1 Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIFiyeu8ltN_lopH3YFwnHNwocD8Jdu6XAPpgKA0yLHiBKFit0r_UByuhlIWXinfdsD9Cy_PRCUkXtjq9wTEm1gyW97BXcgtZxbRMtGuOxzqJkz5ZNeqVUZ4Evn40U7eIgM1n6_Uk0xAcWL4RuB-BSV5eC0YtAd6E1THlSo6ztlFoyA Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b830faee7b63487b9bebd2aa1722a0bb Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ListImageFiltersTestJSON-1639952163 Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:05.127963 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b830faee7b63487b9bebd2aa1722a0bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b830faee7b63487b9bebd2aa1722a0bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b830faee7b63487b9bebd2aa1722a0bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b830faee7b63487b9bebd2aa1722a0bb"}]}] Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ListImageFiltersTestJSON-1639952163 Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b830faee7b63487b9bebd2aa1722a0bb Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1639952163 Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ListImageFiltersTestJSON-1639952163-project Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 3e0ad91ea1e949ff9e44727dbd43e5c1 Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ListImageFiltersTestJSON-1639952163-project Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 077b0270-538b-4d3c-bb57-fc02f8ae640c could not be found. Sep 16 14:05:05.130177 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '077b0270-538b-4d3c-bb57-fc02f8ae640c'} Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077b0270-538b-4d3c-bb57-fc02f8ae640c could not be found. Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:05.133143 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077b0270-538b-4d3c-bb57-fc02f8ae640c could not be found. Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077b0270-538b-4d3c-bb57-fc02f8ae640c could not be found. Sep 16 14:05:05.135080 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:05.144292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Returning 404 to user: Instance 077b0270-538b-4d3c-bb57-fc02f8ae640c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:05.146307 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ed7732f-9943-4315-936f-7b17f62991cc tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c" status: 404 len: 111 microversion: 2.1 time: 0.089839 Sep 16 14:05:05.152625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1260/2494] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:05 2022] GET /compute/v2.1/servers/077b0270-538b-4d3c-bb57-fc02f8ae640c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:05.162550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:05.164306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 84f8288b-89f5-4d23-88f6-9a6c6043304a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:05.176218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.177496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.178587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.181256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.182491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.184277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.280207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 84f8288b-89f5-4d23-88f6-9a6c6043304a] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:05.465628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Updating instance_info_cache with network_info: [{"id": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba", "address": "fa:16:3e:bd:f3:9c", "network": {"id": "5437ac41-bd4e-4bea-9a86-640cb50d1db2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1493049766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "997c95646a2b40489cf53d5538786bb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapde83dc31-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:05:05.503632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Releasing lock "refresh_cache-14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:05:05.508404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c152b11-57a9-4a12-a65f-46629f8af9d5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4/action" status: 202 len: 0 microversion: 2.1 time: 8.006724 Sep 16 14:05:05.513464 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ee20866-cc44-4771-9df8-bbcc117a0245 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/84f8288b-89f5-4d23-88f6-9a6c6043304a" status: 204 len: 0 microversion: 2.1 time: 0.358231 Sep 16 14:05:05.514384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1261/2495] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:05 2022] DELETE /compute/v2.1/servers/84f8288b-89f5-4d23-88f6-9a6c6043304a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:05.520914 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1235/2496] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:04:57 2022] POST /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4/action => generated 0 bytes in 8020 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:05:05.524386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-043ea484-bbef-43e1-bceb-3d0e3f07c01a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'create', calling method: .version_select at 0x7f725179d280>, body: {"keypair": {"name": "tempest-keypair-1537655708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVS/+JF1VHikX90v0J2zIDhuP9G4Rr9wvvt5vC+AIv79zWNloLHNt3HZQgO5Lhd2TOdTm9J8p7/X65RBxPAt1+fR2cWUbRv47YPVuiPQFnT5dWpR7R1EYImzdWIZbE5Ew=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:05.540187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f2364a9b-aab4-405d-b51d-751e34e5e71b req-5257e5a4-2eb5-42fe-aeff-5faa1fffa11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4", "tag": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:05.549878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-043ea484-bbef-43e1-bceb-3d0e3f07c01a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:05.558082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-043ea484-bbef-43e1-bceb-3d0e3f07c01a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for user 8c6bcf9620664cd2a156abfa959f3c50 and project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:05.561240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f2364a9b-aab4-405d-b51d-751e34e5e71b req-5257e5a4-2eb5-42fe-aeff-5faa1fffa11a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.562532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f2364a9b-aab4-405d-b51d-751e34e5e71b req-5257e5a4-2eb5-42fe-aeff-5faa1fffa11a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.564142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f2364a9b-aab4-405d-b51d-751e34e5e71b req-5257e5a4-2eb5-42fe-aeff-5faa1fffa11a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.587081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f2364a9b-aab4-405d-b51d-751e34e5e71b req-5257e5a4-2eb5-42fe-aeff-5faa1fffa11a service nova] Creating event network-changed:de83dc31-de7b-4d3b-8d3b-e5915c6009ba for instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 on n-h1-858129-2 Sep 16 14:05:05.597890 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-043ea484-bbef-43e1-bceb-3d0e3f07c01a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081622 Sep 16 14:05:05.598587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f2364a9b-aab4-405d-b51d-751e34e5e71b req-5257e5a4-2eb5-42fe-aeff-5faa1fffa11a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074797 Sep 16 14:05:05.600327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1236/2497] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:05.614358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:05.615794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:05.622586 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1262/2498] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:05.629132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.630620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.632156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.633805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.635074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.636164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.638302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:05.641580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:05.664200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.668438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.672236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.673549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.674667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.675371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.721281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:05.723083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:05.871055 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b80d069d-6428-4af7-a5ce-c905dfad8961 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd" status: 204 len: 0 microversion: 2.1 time: 0.246407 Sep 16 14:05:05.872393 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1263/2499] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:05 2022] DELETE /compute/v2.1/servers/e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:05.888823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:05.889783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:05.898175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:05.918803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.929586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.930563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:05.931891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:05.932755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:05.933543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.003923 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa84e0f2-326e-441e-b963-74b1e10405cb tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 204 len: 0 microversion: 2.1 time: 0.400783 Sep 16 14:05:06.014635 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1237/2500] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:05 2022] DELETE /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:06.036230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:06.037586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:06.051134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:06.064760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.065248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.066059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.067086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.067893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.068527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.160119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:06.234861 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ebda1e8-97eb-43d6-9c75-de71f66ff023 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 204 len: 0 microversion: 2.1 time: 0.353855 Sep 16 14:05:06.243517 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1264/2501] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:05 2022] DELETE /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:06.248629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:06.249479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:06.258227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.258922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.259467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.260305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.260872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.261443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.559706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:06.590814 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-977166ab-41fd-4b02-92c1-7b3fcc3453f0 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 1472 microversion: 2.1 time: 0.572045 Sep 16 14:05:06.592813 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1238/2502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:06 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 1472 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:06.616820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a10f6c74-f522-475a-9b55-bdb365bfea04 req-70adf4a2-3d80-4a59-86b2-ec5ee72f2a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "name": "network-vif-plugged", "status": "completed", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:06.625119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:06.642845 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ae0423f-b101-44aa-935f-cc01e44aa836 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.404068 Sep 16 14:05:06.644368 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1265/2503] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:06 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:06.646881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a10f6c74-f522-475a-9b55-bdb365bfea04 req-70adf4a2-3d80-4a59-86b2-ec5ee72f2a11 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.648167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a10f6c74-f522-475a-9b55-bdb365bfea04 req-70adf4a2-3d80-4a59-86b2-ec5ee72f2a11 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.649018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a10f6c74-f522-475a-9b55-bdb365bfea04 req-70adf4a2-3d80-4a59-86b2-ec5ee72f2a11 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.655219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1408859832", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "763702cd-28bf-4c79-b77b-01c764a146ce"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:06.674267 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a10f6c74-f522-475a-9b55-bdb365bfea04 req-70adf4a2-3d80-4a59-86b2-ec5ee72f2a11 service nova] Creating event network-vif-plugged:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:05:06.701756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a10f6c74-f522-475a-9b55-bdb365bfea04 req-70adf4a2-3d80-4a59-86b2-ec5ee72f2a11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092990 Sep 16 14:05:06.703027 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1239/2504] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:06.713632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:06.716711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.184"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:06.733608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:06.761653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.763348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.766677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.768514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:06.769322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:06.770089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:06.851621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:05:06.852385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquired lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:05:06.876889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] validate_networks() for [('763702cd-28bf-4c79-b77b-01c764a146ce', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:05:08.073559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:05:08.074293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:05:08.074910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:05:08.075420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:05:08.075835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:05:08.087490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:08.088293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:08.088949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:08.089918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:08.090785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:08.092009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:08.118043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Getting quotas for project 311811e7ca8c4b08b2c3edf8e4192d12. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:08.125417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Getting quotas for user 0e4bfe8580f1494d81551b8293ff37d9 and project 311811e7ca8c4b08b2c3edf8e4192d12. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:08.142753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Going to run 2 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:05:08.145903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:05:08.194724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=0eed9766-b50f-4095-9e12-26ea27a00cb4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:05:08.295817 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6fc7f9ca-c698-43e7-9c87-83f7f5a87c83 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.649566 Sep 16 14:05:08.299002 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1266/2505] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:05:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 1654 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 16 14:05:08.309441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:08.310091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:08.328740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:08.328916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:08.329535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:08.330209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:08.330615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:08.331053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:09.014582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:09.042590 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c39b7787-addc-4bc7-88dc-58af9cab3b48 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 1472 microversion: 2.1 time: 0.741939 Sep 16 14:05:09.051382 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1267/2506] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:08 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 1472 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:09.061787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:09.076011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:09.092290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:09.093810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:09.095751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:09.097716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:09.098942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:09.100189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:09.880684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:09.900977 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79cf120a-48b7-464a-b4bb-cf8a0bdeaed8 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1317 microversion: 2.1 time: 0.846983 Sep 16 14:05:09.902430 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1268/2507] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:09 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:09.912432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:09.917855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:09.932225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:09.933261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:09.933911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:09.934900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:09.935480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:09.936059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:09.990050 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71566b50-26be-4cfc-b3f0-af7dc8432585 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085287 Sep 16 14:05:09.991231 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1269/2508] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:05:09 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:09.999467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:10.008890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:10.010714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Searching by: {'deleted': False, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:05:10.043970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:10.045626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:10.047297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:10.049913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:10.051116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:10.052278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:10.216398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:05:10.299296 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83391bde-212c-4b57-9161-bf4aade7267b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.306171 Sep 16 14:05:10.313786 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1270/2509] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:05:09 2022] GET /compute/v2.1/servers => generated 1337 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:10.326954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2060048299", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:10.513096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] validate_networks() for [('e3e4f01d-b338-4f02-af18-87ac221a4f19', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:05:11.763495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:05:14.788627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:05:14.789462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:05:14.789630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:05:14.791279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:05:14.792142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:05:14.815558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:14.819148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:14.819873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:14.821217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:14.824358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:14.825172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:14.868671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:14.887531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for user 8c6bcf9620664cd2a156abfa959f3c50 and project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:14.909219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:05:14.912602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:05:15.011537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c757112-e941-4c49-bfc9-1e9c5045fb3e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.696161 Sep 16 14:05:15.014814 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1271/2510] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:05:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 4700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:05:15.042387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:15.043543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:15.060853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.061787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.063424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.064767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.066295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.067139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.269306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0ad91ea1e949ff9e44727dbd43e5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830faee7b63487b9bebd2aa1722a0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:15.285189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61a40bb2-5fb8-4eb6-ab27-7b627bfdc95e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 200 len: 1430 microversion: 2.1 time: 0.265936 Sep 16 14:05:15.303161 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1272/2511] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:15 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 1430 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:15.309156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a09d4ad4-0ebc-4edc-8d91-b89a6cf61f41 req-b5c24349-c301-4d8d-9d5c-d7b26c10dc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd", "name": "network-vif-deleted", "tag": "edaa4ce3-67cc-427e-9a01-3f52b5e14f65"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:15.323428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a09d4ad4-0ebc-4edc-8d91-b89a6cf61f41 req-b5c24349-c301-4d8d-9d5c-d7b26c10dc08 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.324299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a09d4ad4-0ebc-4edc-8d91-b89a6cf61f41 req-b5c24349-c301-4d8d-9d5c-d7b26c10dc08 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.324967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a09d4ad4-0ebc-4edc-8d91-b89a6cf61f41 req-b5c24349-c301-4d8d-9d5c-d7b26c10dc08 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.347917 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a09d4ad4-0ebc-4edc-8d91-b89a6cf61f41 req-b5c24349-c301-4d8d-9d5c-d7b26c10dc08 service nova] Creating event network-vif-deleted:edaa4ce3-67cc-427e-9a01-3f52b5e14f65 for instance e2d0a1ae-85c5-4c31-afa7-56a80fe48ebd on n-h2-858129-2 Sep 16 14:05:15.361102 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a09d4ad4-0ebc-4edc-8d91-b89a6cf61f41 req-b5c24349-c301-4d8d-9d5c-d7b26c10dc08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055202 Sep 16 14:05:15.362467 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1273/2512] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:15.383988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:15.384723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:15.403430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.403785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.408800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.410840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.411530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.411978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.676128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Updating instance_info_cache with network_info: [{"id": "99cef5ac-cf6f-4042-8117-71f655fc8e9e", "address": "fa:16:3e:e5:fd:43", "network": {"id": "5437ac41-bd4e-4bea-9a86-640cb50d1db2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1493049766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "997c95646a2b40489cf53d5538786bb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99cef5ac-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:05:15.694382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:15.697671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Releasing lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:05:15.698692 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a954d984-3e42-432d-8b3f-18bab7fc4e08 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action" status: 202 len: 0 microversion: 2.1 time: 8.993093 Sep 16 14:05:15.699408 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1240/2513] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:05:06 2022] POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action => generated 0 bytes in 8996 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:05:15.705941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:15.710489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:15.725820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.726461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.727131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.728353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.729192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.729956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.734844 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b75732bd-2271-456d-9adf-5c9ca950c25b tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1276 microversion: 2.1 time: 0.366248 Sep 16 14:05:15.737547 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1274/2514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:15 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1276 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:15.753093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:15.758207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:15.772013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.774740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.777503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.779136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.782248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.784725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:15.874621 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-64a6b721-7823-47ad-b132-583a0c9e8c55 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134208 Sep 16 14:05:15.878746 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1275/2515] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:05:15 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:05:15.910623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-044faa41-978b-4484-a6bf-68ccfe22a5ae req-48176fdf-0b03-452e-94b5-7bd0909927a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f8288b-89f5-4d23-88f6-9a6c6043304a", "name": "network-vif-unplugged", "status": "completed", "tag": "2b18eb1f-294f-409c-9550-9efe682af9a5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:15.965405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-044faa41-978b-4484-a6bf-68ccfe22a5ae req-48176fdf-0b03-452e-94b5-7bd0909927a7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:15.971750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-044faa41-978b-4484-a6bf-68ccfe22a5ae req-48176fdf-0b03-452e-94b5-7bd0909927a7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:15.985712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-044faa41-978b-4484-a6bf-68ccfe22a5ae req-48176fdf-0b03-452e-94b5-7bd0909927a7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:16.063579 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-044faa41-978b-4484-a6bf-68ccfe22a5ae req-48176fdf-0b03-452e-94b5-7bd0909927a7 service nova] Creating event network-vif-unplugged:2b18eb1f-294f-409c-9550-9efe682af9a5 for instance 84f8288b-89f5-4d23-88f6-9a6c6043304a on n-h1-858129-2 Sep 16 14:05:16.088748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-044faa41-978b-4484-a6bf-68ccfe22a5ae req-48176fdf-0b03-452e-94b5-7bd0909927a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.206924 Sep 16 14:05:16.089955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1276/2516] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:16.105337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:16.122825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:16.125257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:16.157021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56497aa8-43c3-4ecf-a08f-c7ea7c016d26 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1467 microversion: 2.1 time: 0.445371 Sep 16 14:05:16.167647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:16.168448 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1241/2517] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:15 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1467 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:16.174490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:16.175649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:16.183301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:16.186287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:16.191692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:16.225582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-dcb5621a-d675-42a5-b8ca-7eb7973b5048 req-6f358d74-b3f9-4611-9b21-9f594e1f012f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f8288b-89f5-4d23-88f6-9a6c6043304a", "name": "network-vif-deleted", "tag": "2b18eb1f-294f-409c-9550-9efe682af9a5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:16.274586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dcb5621a-d675-42a5-b8ca-7eb7973b5048 req-6f358d74-b3f9-4611-9b21-9f594e1f012f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:16.275083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dcb5621a-d675-42a5-b8ca-7eb7973b5048 req-6f358d74-b3f9-4611-9b21-9f594e1f012f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:16.275527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dcb5621a-d675-42a5-b8ca-7eb7973b5048 req-6f358d74-b3f9-4611-9b21-9f594e1f012f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:16.321735 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-dcb5621a-d675-42a5-b8ca-7eb7973b5048 req-6f358d74-b3f9-4611-9b21-9f594e1f012f service nova] Creating event network-vif-deleted:2b18eb1f-294f-409c-9550-9efe682af9a5 for instance 84f8288b-89f5-4d23-88f6-9a6c6043304a on n-h1-858129-2 Sep 16 14:05:16.330090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-dcb5621a-d675-42a5-b8ca-7eb7973b5048 req-6f358d74-b3f9-4611-9b21-9f594e1f012f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151936 Sep 16 14:05:16.332419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1242/2518] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:16.337561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:16.339396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:16.341342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:16.349671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:16.350788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:16.351396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:16.352732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:16.353541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:16.354288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:16.528075 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8524c27-3be6-4d5b-9fc4-2aef69b09c30 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 204 len: 0 microversion: 2.25 time: 0.431493 Sep 16 14:05:16.528980 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1277/2519] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:05:16 2022] DELETE /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:05:16.537025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a123cda-c4d0-4c1b-b20a-8451f6ebbeb3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '.version_select at 0x7f725179d0d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:16.974451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:17.006485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a787072-9cbf-4b48-80d5-c2325904f142 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1229 microversion: 2.1 time: 0.671738 Sep 16 14:05:17.008681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1243/2520] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:16 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1229 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:17.018530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-857635715", "metadata": {"image_type": "test"}}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:17.023216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:17.036257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.037215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.038037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.039639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.040890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.041551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.136781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Getting quotas for project 3513e9bc3e7447a19e6879e8bc68d787. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:17.152049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Getting quotas for user 8f49d0bfb2a6439ba5de6b74fd7b2901 and project 3513e9bc3e7447a19e6879e8bc68d787. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:17.455591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a123cda-c4d0-4c1b-b20a-8451f6ebbeb3 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/012eb1ed-be43-408a-a00f-fdd9d59ba715" status: 200 len: 184 microversion: 2.1 time: 0.924734 Sep 16 14:05:17.463685 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1278/2521] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:05:16 2022] GET /compute/v2.1/os-floating-ips/012eb1ed-be43-408a-a00f-fdd9d59ba715 => generated 184 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:17.473778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:17.478569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:17.494821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.496028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.497802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.499395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.500951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.501766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.531942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc68e682-99f0-4789-a9c8-16a033f3f66b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "POST /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a/action" status: 202 len: 0 microversion: 2.1 time: 0.520295 Sep 16 14:05:17.533116 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1244/2522] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:05:17 2022] POST /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:05:17.572228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:17.573267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] [instance: c8775615-47c6-4e9a-8d4f-6e95ef23727f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:17.591935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.592440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.592883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.593604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.597305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.600559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.606638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfc549ce-164c-4141-8d7d-202a68174ecf tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140722 Sep 16 14:05:17.608615 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1279/2523] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:05:17 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:05:17.620380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:17.622485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:17.634067 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] HTTP exception thrown: Instance c8775615-47c6-4e9a-8d4f-6e95ef23727f could not be found. Sep 16 14:05:17.636079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.637014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.638138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.639563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.640586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.642458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Request method failure captured: Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f HTTP/1.1 Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIFiyeu8ltN_lopH3YFwnHNwocD8Jdu6XAPpgKA0yLHiBKFit0r_UByuhlIWXinfdsD9Cy_PRCUkXtjq9wTEm1gyW97BXcgtZxbRMtGuOxzqJkz5ZNeqVUZ4Evn40U7eIgM1n6_Uk0xAcWL4RuB-BSV5eC0YtAd6E1THlSo6ztlFoyA Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b830faee7b63487b9bebd2aa1722a0bb Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListImageFiltersTestJSON-1639952163 Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:17.643621 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b830faee7b63487b9bebd2aa1722a0bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b830faee7b63487b9bebd2aa1722a0bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b830faee7b63487b9bebd2aa1722a0bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b830faee7b63487b9bebd2aa1722a0bb"}]}] Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListImageFiltersTestJSON-1639952163 Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b830faee7b63487b9bebd2aa1722a0bb Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1639952163 Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListImageFiltersTestJSON-1639952163-project Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3e0ad91ea1e949ff9e44727dbd43e5c1 Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListImageFiltersTestJSON-1639952163-project Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c8775615-47c6-4e9a-8d4f-6e95ef23727f could not be found. Sep 16 14:05:17.645102 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c8775615-47c6-4e9a-8d4f-6e95ef23727f'} Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8775615-47c6-4e9a-8d4f-6e95ef23727f could not be found. Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:17.645895 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8775615-47c6-4e9a-8d4f-6e95ef23727f could not be found. Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8775615-47c6-4e9a-8d4f-6e95ef23727f could not be found. Sep 16 14:05:17.647525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:17.650786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Returning 404 to user: Instance c8775615-47c6-4e9a-8d4f-6e95ef23727f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:17.657641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-328bb200-fbc5-4d72-9a07-b58bdc36eee6 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f" status: 404 len: 111 microversion: 2.1 time: 0.112283 Sep 16 14:05:17.658815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1245/2524] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:17 2022] GET /compute/v2.1/servers/c8775615-47c6-4e9a-8d4f-6e95ef23727f => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:17.674349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:17.675818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:17.692950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.693690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.694997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:17.698679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:17.699706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:17.700386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:18.704331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:18.723483 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3490168-8b5c-4824-abe3-1f69e99688ea tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 1.062671 Sep 16 14:05:18.724830 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1246/2525] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:17 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:18.742424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:18.753103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}, {"server_uuid": "14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4", "name": "network-vif-deleted", "tag": "de83dc31-de7b-4d3b-8d3b-e5915c6009ba"}, {"server_uuid": "c8775615-47c6-4e9a-8d4f-6e95ef23727f", "name": "network-vif-deleted", "tag": "bab9bb67-4b5a-41b5-90c2-4c8c21c917e3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:18.775152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:18.780042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:18.789644 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-348a2c2f-6e43-409d-9935-e3615fb6e4ec tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 200 len: 1730 microversion: 2.25 time: 1.171083 Sep 16 14:05:18.791203 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1280/2526] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:17 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 1730 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:18.797743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:18.805232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:18.806156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:18.812096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.184"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:18.852607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Creating event network-changed:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:05:18.853729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Creating event network-vif-deleted:de83dc31-de7b-4d3b-8d3b-e5915c6009ba for instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 on n-h1-858129-2 Sep 16 14:05:18.855058 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] Creating event network-vif-deleted:bab9bb67-4b5a-41b5-90c2-4c8c21c917e3 for instance c8775615-47c6-4e9a-8d4f-6e95ef23727f on n-h1-858129-2 Sep 16 14:05:18.888037 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0e9dd555-594f-4e07-abef-e98ad63ae8e5 req-0feca6da-7387-4ea2-a5c7-cc81b3743667 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.160589 Sep 16 14:05:18.889382 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1247/2527] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:18.902577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f803e02-cdbc-4064-a0d2-200811701df3 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c5085e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:19.011202 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f803e02-cdbc-4064-a0d2-200811701df3 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.118955 Sep 16 14:05:19.012921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1248/2528] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:18 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:19.022800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8bbcd4b-a676-426b-b4df-752d64009e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce525e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:19.453625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8bbcd4b-a676-426b-b4df-752d64009e6e tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/images/96b6e964-469e-4dc6-b17b-43b3a1356914" status: 204 len: 0 microversion: 2.1 time: 0.435122 Sep 16 14:05:19.458131 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1249/2529] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:19 2022] DELETE /compute/v2.1/images/96b6e964-469e-4dc6-b17b-43b3a1356914 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:19.464080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:19.464960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:19.473193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:19.473944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:19.474622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:19.475495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:19.476114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:19.476731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:19.554131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:19.583247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:19.602359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:19.602929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:19.603499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:19.604866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:19.605653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:19.606280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:19.680621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b4a4f78-09c0-4def-99d0-f8d6252f2456 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 204 len: 0 microversion: 2.1 time: 0.220651 Sep 16 14:05:19.684757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1250/2530] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:19 2022] DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:19.689461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:19.691160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:19.697508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:19.698070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:19.698800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:19.699550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:19.700020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:19.700456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:20.227615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:20.247078 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a98af5de-77d8-4533-bb4a-0ea3976e252d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1283 microversion: 2.1 time: 0.563696 Sep 16 14:05:20.250675 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1251/2531] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:19 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1283 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:20.281818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ec1c8818-27b3-418a-806b-6e67aa8b8406 req-eae7a557-ec33-4420-ae01-747758843867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45620b-7d81-415b-8d59-3cda88cd19b5", "name": "network-vif-deleted", "tag": "95690f41-ab10-4f0f-9aa7-7e1c74615840"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:20.319821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ec1c8818-27b3-418a-806b-6e67aa8b8406 req-eae7a557-ec33-4420-ae01-747758843867 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:20.320702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ec1c8818-27b3-418a-806b-6e67aa8b8406 req-eae7a557-ec33-4420-ae01-747758843867 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:20.321500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ec1c8818-27b3-418a-806b-6e67aa8b8406 req-eae7a557-ec33-4420-ae01-747758843867 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:20.338947 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ec1c8818-27b3-418a-806b-6e67aa8b8406 req-eae7a557-ec33-4420-ae01-747758843867 service nova] Creating event network-vif-deleted:95690f41-ab10-4f0f-9aa7-7e1c74615840 for instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 on n-h2-858129-2 Sep 16 14:05:20.346897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ec1c8818-27b3-418a-806b-6e67aa8b8406 req-eae7a557-ec33-4420-ae01-747758843867 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092916 Sep 16 14:05:20.351086 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1252/2532] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:20.359832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0739780-d56d-4e42-ae86-994b72e5e3fe tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724ce5bc10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:20.704744 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0739780-d56d-4e42-ae86-994b72e5e3fe tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/images/1c6c8d66-6585-4c0c-834d-4f29e2ecb0e6" status: 204 len: 0 microversion: 2.1 time: 0.350335 Sep 16 14:05:20.706234 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1253/2533] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:20 2022] DELETE /compute/v2.1/images/1c6c8d66-6585-4c0c-834d-4f29e2ecb0e6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:20.707634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:05:20.709643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquired lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:05:20.713836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:20.713836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:20.725180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:20.725968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:20.726567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:20.727383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:20.728809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:20.729608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:21.549861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:21.561228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b0efd16-d9cc-4616-abc2-b50a345e6cd7 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1678 microversion: 2.1 time: 0.853745 Sep 16 14:05:21.574454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1254/2534] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:20 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1678 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:21.574454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:21.574454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:21.575628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:21.576140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:21.576591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:21.577313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:21.578577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:21.579152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:22.455770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:22.472481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:22.506491 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0404cced-bb61-46f5-881e-7722d234b515 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 0.939499 Sep 16 14:05:22.546223 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1255/2535] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:21 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:22.559069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:22.563941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: 1a45620b-7d81-415b-8d59-3cda88cd19b5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:22.597411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:22.598951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:22.606585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:22.608777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:22.611501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:22.612688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:22.700350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] HTTP exception thrown: Instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 could not be found. Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Request method failure captured: Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 HTTP/1.1 Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_uUJaBDRXPsuGY_BNB2pnP8-qfrULkAoank3_mDWQEqIT8FMAPMopyC4QdGFom-3-LeezsUTpVswagmTTCnQ_mHDfipn_ArhbsQGj1NWrKmIUYqJ-mMRdfPyqTZ2-KGDGpPn7ryRO07qTm8aoMuoLpHaWIwfWEIQStF6FWgDu5F3M Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:22.701955 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_54dfa47e4a424466bbfb73c6864caeed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}] Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 916231d4d6114380b4e48d428d6dd843 Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 could not be found. Sep 16 14:05:22.704523 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1a45620b-7d81-415b-8d59-3cda88cd19b5'} Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 could not be found. Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:22.705845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 could not be found. Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 could not be found. Sep 16 14:05:22.710813 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:22.717372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Returning 404 to user: Instance 1a45620b-7d81-415b-8d59-3cda88cd19b5 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:22.717372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-def80213-6398-446c-9820-09c2fac65cbe tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5" status: 404 len: 111 microversion: 2.25 time: 0.154902 Sep 16 14:05:22.717372 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1256/2536] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:22 2022] GET /compute/v2.1/servers/1a45620b-7d81-415b-8d59-3cda88cd19b5 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:05:22.717372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fef19819-ec6f-4336-bc1c-cc29a90b917d tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c51c4c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:22.807953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fef19819-ec6f-4336-bc1c-cc29a90b917d tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.100550 Sep 16 14:05:22.809485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1257/2537] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:22 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:22.833746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ebc06e74-8636-4cf9-bb49-bb7083f85815 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] Calling method '.version_select at 0x7f724d8cca60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:23.417851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ebc06e74-8636-4cf9-bb49-bb7083f85815 tempest-ListImageFiltersTestJSON-1639952163 tempest-ListImageFiltersTestJSON-1639952163-project] 10.222.0.60 "DELETE /compute/v2.1/images/fd7f812a-c146-4314-bebf-4287d2bd9ef7" status: 204 len: 0 microversion: 2.1 time: 0.603997 Sep 16 14:05:23.424673 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1258/2538] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:22 2022] DELETE /compute/v2.1/images/fd7f812a-c146-4314-bebf-4287d2bd9ef7 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:23.438717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3d262f14-c2cb-46b0-b235-66039ef530a4 req-a95c4b6e-4221-481b-a1b7-f7714bbb329c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de69f5a-f88f-493b-96f0-df1c0e433f07", "tag": "2f88fef6-d21c-402f-adaf-ba2a7d276159"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:23.461901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3d262f14-c2cb-46b0-b235-66039ef530a4 req-a95c4b6e-4221-481b-a1b7-f7714bbb329c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:23.463510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3d262f14-c2cb-46b0-b235-66039ef530a4 req-a95c4b6e-4221-481b-a1b7-f7714bbb329c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:23.464670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3d262f14-c2cb-46b0-b235-66039ef530a4 req-a95c4b6e-4221-481b-a1b7-f7714bbb329c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:23.495573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3d262f14-c2cb-46b0-b235-66039ef530a4 req-a95c4b6e-4221-481b-a1b7-f7714bbb329c service nova] Creating event network-changed:2f88fef6-d21c-402f-adaf-ba2a7d276159 for instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 on n-h2-858129-2 Sep 16 14:05:23.511061 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3d262f14-c2cb-46b0-b235-66039ef530a4 req-a95c4b6e-4221-481b-a1b7-f7714bbb329c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081332 Sep 16 14:05:23.512889 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1259/2539] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:23.527273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:23.528173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:23.538321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:23.539418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:23.540295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:23.541432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:23.542930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:23.543784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:23.880249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Building network info cache for instance {{(pid=128643) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:05:24.033129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:24.072074 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a87b02f3-dc7e-4bae-9822-a90236e0905a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 0.555567 Sep 16 14:05:24.074191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1260/2540] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:23 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:24.114446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:24.118714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:24.139450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:24.141203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:24.142591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:24.144494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:24.147669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:24.150059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:24.249123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:24.251582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:24.252224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:24.256475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lazy-loading 'fault' on Instance uuid 2a64ce67-150d-4430-805a-9cbab3489620 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:24.477865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf933142c4e74dea8707a0c0d8a53b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f0b7f48f3e4a24866ea77a8336f662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:24.518970 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f3bf082-fce1-4ee0-8b12-de322cc13775 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 200 len: 1329 microversion: 2.1 time: 0.439592 Sep 16 14:05:24.520120 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1261/2541] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:24 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 1329 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:24.549429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14d1ebbd-abfa-4dab-a3b5-355ceffaa905 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '.version_select at 0x7f724c504b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:24.590013 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14d1ebbd-abfa-4dab-a3b5-355ceffaa905 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-967937511" status: 204 len: 0 microversion: 2.25 time: 0.052696 Sep 16 14:05:24.591089 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1262/2542] 10.222.0.60 () {60 vars in 1259 bytes} [Fri Sep 16 14:05:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-967937511 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:05:24.602239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-eef9a6c9-da9a-473b-9451-1a6c9bfff338 req-9b50b221-4608-4c66-98bd-6e233c73d22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a64ce67-150d-4430-805a-9cbab3489620", "name": "network-vif-deleted", "tag": "018cdf29-f7de-4244-9662-c83de9039962"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:24.617881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eef9a6c9-da9a-473b-9451-1a6c9bfff338 req-9b50b221-4608-4c66-98bd-6e233c73d22f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:24.619222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eef9a6c9-da9a-473b-9451-1a6c9bfff338 req-9b50b221-4608-4c66-98bd-6e233c73d22f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:24.619222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eef9a6c9-da9a-473b-9451-1a6c9bfff338 req-9b50b221-4608-4c66-98bd-6e233c73d22f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:24.634994 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-eef9a6c9-da9a-473b-9451-1a6c9bfff338 req-9b50b221-4608-4c66-98bd-6e233c73d22f service nova] Creating event network-vif-deleted:018cdf29-f7de-4244-9662-c83de9039962 for instance 2a64ce67-150d-4430-805a-9cbab3489620 on n-h1-858129-2 Sep 16 14:05:24.649596 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-eef9a6c9-da9a-473b-9451-1a6c9bfff338 req-9b50b221-4608-4c66-98bd-6e233c73d22f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050709 Sep 16 14:05:24.650275 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1263/2543] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:24.661212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:24.661970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:24.679329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:24.679962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:24.680539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:24.681462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:24.681988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:24.682627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:24.849811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:24.898934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:25.938046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:25.950730 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-adcfcf70-25de-44d2-9c01-cc7a58b128bd tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 1.295456 Sep 16 14:05:25.951902 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1264/2544] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:24 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:25.976382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30f58380-daa4-4d0a-8823-1208e2d5b412 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f72516c31f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:26.076803 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30f58380-daa4-4d0a-8823-1208e2d5b412 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.123235 Sep 16 14:05:26.079026 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1265/2545] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:25 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:26.098051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b1b83540-a294-4f1c-8cba-0420489ef703 req-fcd6b39a-4f32-41bb-bef2-fdd701d927e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "name": "network-vif-plugged", "status": "completed", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:26.132449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:26.163566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b1b83540-a294-4f1c-8cba-0420489ef703 req-fcd6b39a-4f32-41bb-bef2-fdd701d927e1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.164766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b1b83540-a294-4f1c-8cba-0420489ef703 req-fcd6b39a-4f32-41bb-bef2-fdd701d927e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.165555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b1b83540-a294-4f1c-8cba-0420489ef703 req-fcd6b39a-4f32-41bb-bef2-fdd701d927e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.206596 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b1b83540-a294-4f1c-8cba-0420489ef703 req-fcd6b39a-4f32-41bb-bef2-fdd701d927e1 service nova] Creating event network-vif-plugged:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:05:26.220259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b1b83540-a294-4f1c-8cba-0420489ef703 req-fcd6b39a-4f32-41bb-bef2-fdd701d927e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139138 Sep 16 14:05:26.222030 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1266/2546] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:26.236471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:26.238180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:26.248891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.249585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.250981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.252073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.253113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.253741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.725255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:26.756698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e19bf57a-44ad-40ae-aafc-faa1e4f3e36d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 0.529296 Sep 16 14:05:26.758438 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1267/2547] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:26 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:26.771145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:26.774687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:26.788112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.789362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.792086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.793896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.795241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.796284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.833654 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] HTTP exception thrown: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Request method failure captured: Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 HTTP/1.1 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIGTSeFePVXs9GDlsB8eKJMsGv9UHPVx90R_IWuEr3-9wzi6Mb96NbXQaK3sA8-tRGgoRD32KU_WRVlMGft8AZZtRx2sN9Lk4CAU7Xdk94gBFaX5O1vD--c57W1QpnSNtRoopgSzf677SYwryju8Hfceb1KyajIWOQ6cd7GbwfZtLG8 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b0f0b7f48f3e4a24866ea77a8336f662 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:26.837450 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0f0b7f48f3e4a24866ea77a8336f662", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0f0b7f48f3e4a24866ea77a8336f662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0f0b7f48f3e4a24866ea77a8336f662"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0f0b7f48f3e4a24866ea77a8336f662"}]}] Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b0f0b7f48f3e4a24866ea77a8336f662 Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachSCSIVolumeTestJSON-565080841-project Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: bf933142c4e74dea8707a0c0d8a53b1b Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-565080841-project Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:26.840008 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '2a64ce67-150d-4430-805a-9cbab3489620'} Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:26.843997 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:26.850331 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:26.857529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Returning 404 to user: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:26.857529 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b65ecceb-96b1-48ca-94ba-d2177b1cb6fe tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 404 len: 111 microversion: 2.1 time: 0.079377 Sep 16 14:05:26.857529 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1268/2548] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:26 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:26.857529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eed9766-b50f-4095-9e12-26ea27a00cb4", "tag": "6791251b-aaed-42ce-9dae-8136702762d0"}, {"name": "network-changed", "server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:26.871334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Updating instance_info_cache with network_info: [{"id": "99cef5ac-cf6f-4042-8117-71f655fc8e9e", "address": "fa:16:3e:e5:fd:43", "network": {"id": "5437ac41-bd4e-4bea-9a86-640cb50d1db2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1493049766-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "997c95646a2b40489cf53d5538786bb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap99cef5ac-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128643) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:05:26.875607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.876812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.877727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.896547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Releasing lock "refresh_cache-e3e7730a-4bda-4ae5-9595-934cf25ea683" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:05:26.898499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86acb71c-fc63-4449-af0a-c291c4c2b7a4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action" status: 202 len: 0 microversion: 2.1 time: 8.104913 Sep 16 14:05:26.904285 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1281/2549] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:05:18 2022] POST /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683/action => generated 0 bytes in 8109 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:05:26.911241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] Creating event network-changed:6791251b-aaed-42ce-9dae-8136702762d0 for instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 on n-h1-858129-2 Sep 16 14:05:26.911657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:26.912173 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] Creating event network-changed:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:05:26.912495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:26.928586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.929157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.929965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.930117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-039f6102-09c2-4863-9f39-59e14ca9f5e3 req-5d64dae1-5841-4c5b-baa8-67e003ca4aa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085840 Sep 16 14:05:26.931075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:26.931389 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1269/2550] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:26.931762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:26.932239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:26.967986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:26.985418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:27.142584 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6def2dd7-e206-49c3-b42a-39602ab9e7c1 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 204 len: 0 microversion: 2.25 time: 0.239300 Sep 16 14:05:27.144252 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1282/2551] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:05:26 2022] DELETE /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:05:27.153702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e224a1e-67e9-49ec-8101-83e707f75307 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '.version_select at 0x7f725179d280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:27.200793 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e224a1e-67e9-49ec-8101-83e707f75307 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415261458" status: 202 len: 0 microversion: 2.1 time: 0.047936 Sep 16 14:05:27.210019 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1283/2552] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:05:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415261458 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:05:27.232524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:27.233147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad502dab-02b4-42b1-8200-2255728b7d76 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f724c4c6280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJedIhY6KW6geZeyYvrafE1OZCHpZ20nw3v8oWFa1zrIFEtHG75q8xlD+zZAcfxSqyoFl6BwzMxrRz4wkZ7C/IAuia/Z7/w2NS5s2qLSZZYpVvjwIB59qnNY+ZVYthlLA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:27.236619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:27.256507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:27.258191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:27.260303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:27.261839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:27.263071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:27.263999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad502dab-02b4-42b1-8200-2255728b7d76 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 257 Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:27.277239 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:27.279986 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJedIhY6KW6geZeyYvrafE1OZCHpZ20nw3v8oWFa1zrIFEtHG75q8xlD+zZAcfxSqyoFl6BwzMxrRz4wkZ7C/IAuia/Z7/w2NS5s2qLSZZYpVvjwIB59qnNY+ZVYthlLA=="}} Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJedIhY6KW6geZeyYvrafE1OZCHpZ20nw3v8oWFa1zrIFEtHG75q8xlD+zZAcfxSqyoFl6BwzMxrRz4wkZ7C/IAuia/Z7/w2NS5s2qLSZZYpVvjwIB59qnNY+ZVYthlLA=='}}} Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.281867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:27.284772 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:05:27.287427 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:05:27.290017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 16 14:05:27.290017 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.290017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad502dab-02b4-42b1-8200-2255728b7d76 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:27.290017 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ad502dab-02b4-42b1-8200-2255728b7d76 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.346647 Sep 16 14:05:27.290017 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1270/2553] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:26 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 350 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:05:27.301891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:27.314086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:27.327104 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] HTTP exception thrown: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Request method failure captured: Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 HTTP/1.1 Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIIz5q47Tue6lV-M-Jn4okqWHfbU4HH2OVw8FNUudeLntuiTaVLSke4f3_Y9a276xzdkK7nR_edSOEmVEd6Ft5iPgHndmf7eMNPo8CBqO6bbqiDyZwlrjV1GTx3ed6mXALV_JJcQl2wFEgceQvlzRt2YQdZ-_WKJ22LKN1nZQtwKnVA Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:27.331027 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997c95646a2b40489cf53d5538786bb3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}] Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e0441b7c0ea04bb08f871af5c2f1f46a Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:27.333468 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4'} Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:27.335426 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:27.338580 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:27.342109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Returning 404 to user: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:27.342109 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-364e659f-70ca-4db3-857d-26c62fc0e6d4 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 404 len: 111 microversion: 2.1 time: 0.122854 Sep 16 14:05:27.342109 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1284/2554] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:27 2022] DELETE /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:27.342888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:27.342888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:27.344605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:27.347019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:27.347019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:27.347019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:27.347836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-081bbfac-303c-4749-b21f-c6c689c1d7ec tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f725179dc10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:27.463750 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-081bbfac-303c-4749-b21f-c6c689c1d7ec tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.125082 Sep 16 14:05:27.464447 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1285/2555] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:27 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:27.476765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:27.478010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:27.488029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:27.488979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:27.489519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:27.490879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:27.492011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:27.492611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:27.965102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:27.992484 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b2a97b8-3967-4ef2-973e-7d8b3ec68fe1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 0.698084 Sep 16 14:05:28.021998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1271/2556] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:27 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:28.038444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f724d1d8d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-842116870", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:28.076714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:28.097059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for user 0523315f3be9435d93b138c84f93f887 and project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:28.114353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:28.144074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:28.152841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:28.163189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01c1976f-55b6-4649-9944-f5f492fb357f tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1549 microversion: 2.25 time: 0.693277 Sep 16 14:05:28.165240 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1286/2557] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:27 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1549 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:28.182046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:28.189489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:28.204186 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:28.213181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:28.213654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:28.214153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:28.214981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:28.215527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:28.216572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 2166 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-842116870", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:28.244000 n-d-858129-2 devstack@n-api.service[128642]: exception: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-842116870', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:28.246800 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.250137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:28.256931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21c039f5-d124-439a-8176-0c6f31bda740 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.232560 Sep 16 14:05:28.260426 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1272/2558] 10.222.0.60 () {60 vars in 1160 bytes} [Fri Sep 16 14:05:28 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:05:28.273757 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] HTTP exception thrown: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:28.279762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Request method failure captured: Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 HTTP/1.1 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIIz5q47Tue6lV-M-Jn4okqWHfbU4HH2OVw8FNUudeLntuiTaVLSke4f3_Y9a276xzdkK7nR_edSOEmVEd6Ft5iPgHndmf7eMNPo8CBqO6bbqiDyZwlrjV1GTx3ed6mXALV_JJcQl2wFEgceQvlzRt2YQdZ-_WKJ22LKN1nZQtwKnVA Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997c95646a2b40489cf53d5538786bb3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}] Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e0441b7c0ea04bb08f871af5c2f1f46a Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4'} Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.280110 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. Sep 16 14:05:28.288604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:28.290029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:28.294619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Returning 404 to user: Instance 14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:28.294619 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-574573cc-ed7e-43a2-9f4a-7b0b0b93af4b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4" status: 404 len: 111 microversion: 2.1 time: 0.126693 Sep 16 14:05:28.297337 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1287/2559] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:28 2022] GET /compute/v2.1/servers/14a4eb2f-6ae4-4497-bbc3-3e41c6dfcbb4 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:28.308442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc347f9e-c1d8-4d2e-bd30-70d5df13a9a6 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f724c6deee0>, body: {"keypair": {"name": "tempest-keypair-1699904675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlqr7CLRu2ISlMC4hwXQiEaEUy9n5Uv79xWVYfTxbbWWdI31VfV+e9e3/eLlicosv7Tut2XTNqooIRxV2R9fjcNsuK9jxfMqlHamTaq5GKTT20vsnFGjlL0zYG37MF7aQ=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:28.319663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:28.339705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:28.341529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:28.354078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:28.358578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:28.363757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:28.367753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dc347f9e-c1d8-4d2e-bd30-70d5df13a9a6 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:28.381954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dc347f9e-c1d8-4d2e-bd30-70d5df13a9a6 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for user 0523315f3be9435d93b138c84f93f887 and project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:28.472275 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc347f9e-c1d8-4d2e-bd30-70d5df13a9a6 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167567 Sep 16 14:05:28.477706 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1288/2560] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:28.523760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0653e61d-4e73-46bd-8c71-a4cfcbb5071a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '.version_select at 0x7f724c67a040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:29.835060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:29.865006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9546b13-3e30-4c9e-b1e7-e9e691361995 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 1.600852 Sep 16 14:05:29.867036 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1273/2561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:28 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:29.926135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6c664b0-d60e-49ee-b8a3-173e82a91a98 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c508040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:30.126492 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6c664b0-d60e-49ee-b8a3-173e82a91a98 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.251355 Sep 16 14:05:30.127787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1274/2562] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:29 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:30.144048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f724c51c790>, body: {"keypair": {"name": "tempest-keypair-1699904675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2PUiC7SyP8f4e0GiHRXlmcXN1SFXZWomjPXsllQ9/lZhImH2jctc8wdjtXOdu11XCtpGWbXF7cZSykGYiXo41al45yLT+V7jes+d8pnW5icpvWMmOQJ+byrO8grCUyag=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:30.209688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:30.221362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for user 0523315f3be9435d93b138c84f93f887 and project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:30.278570 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] HTTP exception thrown: Key pair 'tempest-keypair-1699904675' already exists. Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 273 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "tempest-keypair-1699904675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2PUiC7SyP8f4e0GiHRXlmcXN1SFXZWomjPXsllQ9/lZhImH2jctc8wdjtXOdu11XCtpGWbXF7cZSykGYiXo41al45yLT+V7jes+d8pnW5icpvWMmOQJ+byrO8grCUyag=="}} Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: exception: Key pair 'tempest-keypair-1699904675' already exists. Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1699904675', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2PUiC7SyP8f4e0GiHRXlmcXN1SFXZWomjPXsllQ9/lZhImH2jctc8wdjtXOdu11XCtpGWbXF7cZSykGYiXo41al45yLT+V7jes+d8pnW5icpvWMmOQJ+byrO8grCUyag=='}}} Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result.read() Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '0523315f3be9435d93b138c84f93f887-tempest-keypair-1699904675' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 16 14:05:30.310172 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi session.flush() Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result.read() Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 16 14:05:30.316850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '0523315f3be9435d93b138c84f93f887-tempest-keypair-1699904675' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 16, 14, 5, 30, 251145), 'updated_at': None, 'name': 'tempest-keypair-1699904675', 'user_id': '0523315f3be9435d93b138c84f93f887', 'fingerprint': '18:db:24:d1:90:37:1a:67:ef:1a:ef:45:9f:07:cc:3e', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2PUiC7SyP8f4e0GiHRXlmcXN1SFXZWomjPXsllQ9/lZhImH2jctc8wdjtXOdu11XCtpGWbXF7cZSykGYiXo41al45yLT+V7jes+d8pnW5icpvWMmOQJ+byrO8grCUyag==', 'type': 'ssh'}] Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi keypair.create() Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._create() Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1699904675' already exists. Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 16 14:05:30.323135 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1699904675' already exists. Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1699904675' already exists. Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:30.331811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 409 to user: Key pair 'tempest-keypair-1699904675' already exists. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:30.334318 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-428b097f-0748-4e8a-8600-1f6372233489 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.196069 Sep 16 14:05:30.337115 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1275/2563] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:30 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:05:30.350014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c02c4f72-71db-4319-8262-23e2f5d6efaa req-a46e2232-5a7b-4c45-84cc-cc281723087e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d", "tag": "727ee620-7f3a-425e-bc91-a76118d278db"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:30.368296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c02c4f72-71db-4319-8262-23e2f5d6efaa req-a46e2232-5a7b-4c45-84cc-cc281723087e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:30.369129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c02c4f72-71db-4319-8262-23e2f5d6efaa req-a46e2232-5a7b-4c45-84cc-cc281723087e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:30.369743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c02c4f72-71db-4319-8262-23e2f5d6efaa req-a46e2232-5a7b-4c45-84cc-cc281723087e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:30.401967 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c02c4f72-71db-4319-8262-23e2f5d6efaa req-a46e2232-5a7b-4c45-84cc-cc281723087e service nova] Creating event network-changed:727ee620-7f3a-425e-bc91-a76118d278db for instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d on n-h1-858129-2 Sep 16 14:05:30.410779 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c02c4f72-71db-4319-8262-23e2f5d6efaa req-a46e2232-5a7b-4c45-84cc-cc281723087e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070526 Sep 16 14:05:30.411887 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1276/2564] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:30.419090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:30.420257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:30.430203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:30.430965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:30.431732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:30.432711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:30.434220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:30.435777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:31.280962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:31.311172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4e8ba49-d09b-4331-9711-ba62b9db84f1 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 0.897121 Sep 16 14:05:31.323130 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1277/2565] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:30 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:31.335644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:31.336743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:31.344669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:31.345498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:31.346137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:31.347617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:31.349022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:31.349480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:31.730471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:31.751151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:31.761627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:31.763228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81f6c8ae-da16-4819-ba13-b9ecbbba92c7 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1507 microversion: 2.25 time: 0.434613 Sep 16 14:05:31.764093 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1278/2566] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:31 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:31.789722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f721cb03-c7ff-4031-ab0f-4d2bf28843c5 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Calling method '.version_select at 0x7f724c51ce50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:31.827245 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f721cb03-c7ff-4031-ab0f-4d2bf28843c5 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699904675" status: 202 len: 0 microversion: 2.1 time: 0.041077 Sep 16 14:05:31.830989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1279/2567] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699904675 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:05:31.845916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:31.846993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:31.867183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:31.868466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:31.870094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:31.872637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:31.874279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:31.876889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:32.746904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:32.785246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-73dd5d51-c7e2-4f5a-919b-6a20c74fd618 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 0.952436 Sep 16 14:05:32.802962 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1280/2568] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:31 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:32.833452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9593cec7-ce54-4d80-b469-5e9a1e3a959c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f72516915e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:32.932610 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0653e61d-4e73-46bd-8c71-a4cfcbb5071a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/012eb1ed-be43-408a-a00f-fdd9d59ba715" status: 202 len: 0 microversion: 2.1 time: 4.448576 Sep 16 14:05:32.933207 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1289/2569] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:05:28 2022] DELETE /compute/v2.1/os-floating-ips/012eb1ed-be43-408a-a00f-fdd9d59ba715 => generated 0 bytes in 4454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:05:32.941137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ad4fdec7-d25d-49bd-9b1d-4725a92f0314 req-39407eab-bcee-46fc-b83c-d46caaa9b845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de69f5a-f88f-493b-96f0-df1c0e433f07", "name": "network-vif-plugged", "status": "completed", "tag": "2f88fef6-d21c-402f-adaf-ba2a7d276159"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:32.949880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9593cec7-ce54-4d80-b469-5e9a1e3a959c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.144896 Sep 16 14:05:32.950524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1281/2570] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:32 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:32.955745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-688b53f6-07db-4ad1-a6cf-e72897c4ecc3 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f724c504790>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTuyjDayXN/6dCqGmM/AJB03OgBR5Nm1pUa443jz4wj7kaKuqI2K3iJVDS6z5yLsjh/620rok16vO/Cgq+jRper7uG3+GaVhIZNX+naAudgV/BgcZallALLL6cUcTGDDQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-688b53f6-07db-4ad1-a6cf-e72897c4ecc3 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 247 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTuyjDayXN/6dCqGmM/AJB03OgBR5Nm1pUa443jz4wj7kaKuqI2K3iJVDS6z5yLsjh/620rok16vO/Cgq+jRper7uG3+GaVhIZNX+naAudgV/BgcZallALLL6cUcTGDDQ=="}} Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTuyjDayXN/6dCqGmM/AJB03OgBR5Nm1pUa443jz4wj7kaKuqI2K3iJVDS6z5yLsjh/620rok16vO/Cgq+jRper7uG3+GaVhIZNX+naAudgV/BgcZallALLL6cUcTGDDQ=='}}} Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '' Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:05:32.961347 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-688b53f6-07db-4ad1-a6cf-e72897c4ecc3 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-688b53f6-07db-4ad1-a6cf-e72897c4ecc3 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011348 Sep 16 14:05:32.968375 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1282/2571] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:32 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:05:32.976601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:32.981202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:32.981726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ad4fdec7-d25d-49bd-9b1d-4725a92f0314 req-39407eab-bcee-46fc-b83c-d46caaa9b845 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:32.982552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ad4fdec7-d25d-49bd-9b1d-4725a92f0314 req-39407eab-bcee-46fc-b83c-d46caaa9b845 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:32.985206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ad4fdec7-d25d-49bd-9b1d-4725a92f0314 req-39407eab-bcee-46fc-b83c-d46caaa9b845 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:32.999466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.002669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.003261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.004029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.004516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.005258 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ad4fdec7-d25d-49bd-9b1d-4725a92f0314 req-39407eab-bcee-46fc-b83c-d46caaa9b845 service nova] Creating event network-vif-plugged:2f88fef6-d21c-402f-adaf-ba2a7d276159 for instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 on n-h2-858129-2 Sep 16 14:05:33.007249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.012745 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ad4fdec7-d25d-49bd-9b1d-4725a92f0314 req-39407eab-bcee-46fc-b83c-d46caaa9b845 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077710 Sep 16 14:05:33.013958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1290/2572] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:33.020896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1bab036f-407b-4fde-9eb1-a834126c99e1 req-b5409155-06c3-4131-becb-5578fc35a6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d670bb-8f4c-42da-9277-256a3d31ecca", "name": "network-vif-deleted", "tag": "2a647267-4c40-4719-85cd-866bc9adb22d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:33.027841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:33.036465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1bab036f-407b-4fde-9eb1-a834126c99e1 req-b5409155-06c3-4131-becb-5578fc35a6e7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.037632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1bab036f-407b-4fde-9eb1-a834126c99e1 req-b5409155-06c3-4131-becb-5578fc35a6e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.038380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1bab036f-407b-4fde-9eb1-a834126c99e1 req-b5409155-06c3-4131-becb-5578fc35a6e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.059288 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1bab036f-407b-4fde-9eb1-a834126c99e1 req-b5409155-06c3-4131-becb-5578fc35a6e7 service nova] Creating event network-vif-deleted:2a647267-4c40-4719-85cd-866bc9adb22d for instance a0d670bb-8f4c-42da-9277-256a3d31ecca on n-h2-858129-2 Sep 16 14:05:33.072555 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1bab036f-407b-4fde-9eb1-a834126c99e1 req-b5409155-06c3-4131-becb-5578fc35a6e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055924 Sep 16 14:05:33.080156 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1291/2573] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:33.091995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:33.095589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:33.106301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.112574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.117952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.135343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.136761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.138941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.211290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.212752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.213443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.214118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lazy-loading 'fault' on Instance uuid a0d670bb-8f4c-42da-9277-256a3d31ecca {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:33.471535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:33.493139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:33.495491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:33.501886 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7ab2b625-28e4-4ac8-8b74-c55419b6ffe9 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 200 len: 1352 microversion: 2.25 time: 0.420105 Sep 16 14:05:33.545201 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1292/2574] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:33 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 1352 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:33.601182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:33.602101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:33.615139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:33.616346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.617161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.617805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.618797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.619354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.619957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.646329 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04cc4e8c-6727-46fd-8a98-efd62d60bc29 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 0.678630 Sep 16 14:05:33.647884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1283/2575] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:32 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:33.657542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f72517691f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-995485031", "public_key": " "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:33.669847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:33.691804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:33.703806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for user 0523315f3be9435d93b138c84f93f887 and project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:33.746797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 94 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-995485031", "public_key": " "}} Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: exception: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-995485031', 'public_key': ' '}}} Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.750831 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.756685 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.759636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:33.760723 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d6aacc8-c26d-429b-aa36-92c6dba4afbc tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.111204 Sep 16 14:05:33.761840 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1284/2576] 10.222.0.60 () {60 vars in 1158 bytes} [Fri Sep 16 14:05:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:05:33.780802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-acfb2356-8643-414c-8c8f-aaf136e8b850 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f7251817040>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOysW/48MlUWHCpNjGb4FbQjYMnqKmUV/UbheK256nd2/cdjtqoEdRnd4htgFfeHUu984hg0xH+5aSoyqhr0tB/Npt+HcPuyrPQSxerv3Bbr8OjmNRcuE+KX4BKOy63CaA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-acfb2356-8643-414c-8c8f-aaf136e8b850 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 507 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOysW/48MlUWHCpNjGb4FbQjYMnqKmUV/UbheK256nd2/cdjtqoEdRnd4htgFfeHUu984hg0xH+5aSoyqhr0tB/Npt+HcPuyrPQSxerv3Bbr8OjmNRcuE+KX4BKOy63CaA=="}} Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOysW/48MlUWHCpNjGb4FbQjYMnqKmUV/UbheK256nd2/cdjtqoEdRnd4htgFfeHUu984hg0xH+5aSoyqhr0tB/Npt+HcPuyrPQSxerv3Bbr8OjmNRcuE+KX4BKOy63CaA=='}}} Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 16 14:05:33.786211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-acfb2356-8643-414c-8c8f-aaf136e8b850 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:33.792100 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-acfb2356-8643-414c-8c8f-aaf136e8b850 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013936 Sep 16 14:05:33.804956 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1285/2577] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:33 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:05:33.809621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Action: 'create', calling method: .version_select at 0x7f724c519ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1726716909", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:33.829409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:05:33.837291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Getting quotas for user 0523315f3be9435d93b138c84f93f887 and project 198d14ab30744a5e8b2e541080075947. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:05:33.861800 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 118 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1726716909", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: exception: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1726716909', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 16 14:05:33.864341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 16 14:05:33.868129 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.872218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:33.873537 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3fa03d60-4e22-4e73-b7de-5f7dee2d24d2 tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.072947 Sep 16 14:05:33.875249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1286/2578] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:05:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:05:33.880804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:33.881843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:33.889331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.890328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.891153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.892269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:33.893041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:33.893926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:33.914970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-efa8ef67-43ba-4247-a4ac-cc8e7c65164d tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 204 len: 0 microversion: 2.1 time: 0.365142 Sep 16 14:05:33.917025 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1293/2579] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:33 2022] DELETE /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:33.930418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a3369d9-e07c-40ed-8b64-a84b00269a7d tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Calling method '.version_select at 0x7f725179d0d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:33.966973 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1a3369d9-e07c-40ed-8b64-a84b00269a7d tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-292330143 not found for user 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a3369d9-e07c-40ed-8b64-a84b00269a7d tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Request method failure captured: Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-292330143 HTTP/1.1 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIKmp5__iB3DfHczXx6aCfN5NmUPZEabGtb-CFKWu_IyVAz4sFsWaiEa2UxLJ18QStQzNrEgCW9Wq7ygTiubuCsjXzmPUimPtzgzVcR4NpmADVsWhzHPtyd481iGN_SJEjwkm6tJGHLT4zdn5Ez01GgtZTnZ0t-cLsSCRdf7_5ruLIU Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d14ab30744a5e8b2e541080075947", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d14ab30744a5e8b2e541080075947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d14ab30744a5e8b2e541080075947"}]}] Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 198d14ab30744a5e8b2e541080075947 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2016593350 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2016593350-project Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: exception: Keypair tempest-keypair-non-existent-292330143 not found for user 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'tempest-keypair-non-existent-292330143'} Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise self.value Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-292330143 not found for user 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.974439 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-292330143 not found for user 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-292330143 not found for user 0523315f3be9435d93b138c84f93f887 Sep 16 14:05:33.982046 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:33.989502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a3369d9-e07c-40ed-8b64-a84b00269a7d tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] Returning 404 to user: Keypair tempest-keypair-non-existent-292330143 not found for user 0523315f3be9435d93b138c84f93f887 {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:33.992658 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a3369d9-e07c-40ed-8b64-a84b00269a7d tempest-KeyPairsNegativeTestJSON-2016593350 tempest-KeyPairsNegativeTestJSON-2016593350-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-292330143" status: 404 len: 144 microversion: 2.1 time: 0.072544 Sep 16 14:05:34.012914 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1294/2580] 10.222.0.60 () {58 vars in 1257 bytes} [Fri Sep 16 14:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-292330143 => generated 144 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:34.029692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:34.038662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:34.054751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.056439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.057565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.059434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.060145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.061092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.206382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:34.224218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b6582a2-22df-426a-b213-23f03e17acf2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 0.342842 Sep 16 14:05:34.225477 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1287/2581] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:33 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:34.230622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea2a61a3-d8e7-4817-b895-bf2bc0539b44 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c519f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:34.364727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea2a61a3-d8e7-4817-b895-bf2bc0539b44 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.137886 Sep 16 14:05:34.365458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1288/2582] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:34 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:34.567819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:34.575693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: a0d670bb-8f4c-42da-9277-256a3d31ecca] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:34.588961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.590362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.591686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.593514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.594204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.595019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.633657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] HTTP exception thrown: Instance a0d670bb-8f4c-42da-9277-256a3d31ecca could not be found. Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Request method failure captured: Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca HTTP/1.1 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJH_uUJaBDRXPsuGY_BNB2pnP8-qfrULkAoank3_mDWQEqIT8FMAPMopyC4QdGFom-3-LeezsUTpVswagmTTCnQ_mHDfipn_ArhbsQGj1NWrKmIUYqJ-mMRdfPyqTZ2-KGDGpPn7ryRO07qTm8aoMuoLpHaWIwfWEIQStF6FWgDu5F3M Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_54dfa47e4a424466bbfb73c6864caeed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}] Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 916231d4d6114380b4e48d428d6dd843 Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a0d670bb-8f4c-42da-9277-256a3d31ecca could not be found. Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a0d670bb-8f4c-42da-9277-256a3d31ecca'} Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d670bb-8f4c-42da-9277-256a3d31ecca could not be found. Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d670bb-8f4c-42da-9277-256a3d31ecca could not be found. Sep 16 14:05:34.637823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d670bb-8f4c-42da-9277-256a3d31ecca could not be found. Sep 16 14:05:34.642652 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:34.646683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Returning 404 to user: Instance a0d670bb-8f4c-42da-9277-256a3d31ecca could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:34.648928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-096a05b7-f1a6-4c83-9856-0ace5658dcb5 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca" status: 404 len: 111 microversion: 2.25 time: 0.110792 Sep 16 14:05:34.650749 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1289/2583] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:34 2022] GET /compute/v2.1/servers/a0d670bb-8f4c-42da-9277-256a3d31ecca => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:05:34.665878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:34.668795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:34.670115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:34.683254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.684643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.685752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.686363 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5cfbf0f4-b981-4f14-8bcb-8813999ef7f5 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1526 microversion: 2.1 time: 0.671586 Sep 16 14:05:34.687675 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1295/2584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:34 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1526 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:34.688027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.689218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.691313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.699810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:34.700432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:34.720236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.721810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.722516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.723472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:34.728492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:34.729337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:34.812900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:35.035241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:35.102945 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02a63f95-cac3-4b48-9c88-94acc6194ad2 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 204 len: 0 microversion: 2.25 time: 0.442520 Sep 16 14:05:35.105995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1290/2585] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:05:34 2022] DELETE /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:05:35.117190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fa066c51-1e31-4142-9d1c-79e8c680e8f4 req-af426320-37d5-4cca-a3e2-026bab4b07ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9766-b50f-4095-9e12-26ea27a00cb4", "name": "network-vif-plugged", "status": "completed", "tag": "6791251b-aaed-42ce-9dae-8136702762d0"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:35.145107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa066c51-1e31-4142-9d1c-79e8c680e8f4 req-af426320-37d5-4cca-a3e2-026bab4b07ad service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:35.146120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa066c51-1e31-4142-9d1c-79e8c680e8f4 req-af426320-37d5-4cca-a3e2-026bab4b07ad service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:35.151132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fa066c51-1e31-4142-9d1c-79e8c680e8f4 req-af426320-37d5-4cca-a3e2-026bab4b07ad service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:35.179501 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fa066c51-1e31-4142-9d1c-79e8c680e8f4 req-af426320-37d5-4cca-a3e2-026bab4b07ad service nova] Creating event network-vif-plugged:6791251b-aaed-42ce-9dae-8136702762d0 for instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 on n-h1-858129-2 Sep 16 14:05:35.193524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fa066c51-1e31-4142-9d1c-79e8c680e8f4 req-af426320-37d5-4cca-a3e2-026bab4b07ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080552 Sep 16 14:05:35.195269 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1291/2586] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:35.209658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:35.215591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:35.236581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:35.237471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:35.238501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:35.243672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:35.244499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:35.246141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:35.562389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:35.592827 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5fa311a8-d644-4641-a276-d91c68882e80 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 0.901293 Sep 16 14:05:35.597096 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1296/2587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:34 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:35.626646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:35.628504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:35.651316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:35.655681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:35.659692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:35.661471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:35.664810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:35.668209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:36.645239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:36.666449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:36.668089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:36.669347 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3b66543-b9a2-49a0-b4b2-a1e79159ef38 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1563 microversion: 2.25 time: 1.469252 Sep 16 14:05:36.670267 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1292/2588] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:35 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1563 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:36.675403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e83d76bd-b480-48ce-802f-1676408b25ee tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724d7d2f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:36.766294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e83d76bd-b480-48ce-802f-1676408b25ee tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.093746 Sep 16 14:05:36.787641 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1293/2589] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:36 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:36.795986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:36.796781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:36.809588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:36.812157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:36.814396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:36.815430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:36.816710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:36.818588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.126271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:37.127133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:37.156697 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ceda1ce-bf75-4489-b0f9-2b10a0ceafa2 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1484 microversion: 2.1 time: 0.374532 Sep 16 14:05:37.158760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1294/2590] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:36 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1484 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:37.180868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:37.182564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:37.184324 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad9860d5-c4c3-4546-912d-92c283c31245 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 1.554279 Sep 16 14:05:37.185626 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1297/2591] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:35 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:37.207207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.210840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:37.211707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:37.214660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.215791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.217382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.218646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.219953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.254690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.254690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.254690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.255268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.256278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.256735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.282381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] HTTP exception thrown: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Request method failure captured: Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 HTTP/1.1 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIGTSeFePVXs9GDlsB8eKJMsGv9UHPVx90R_IWuEr3-9wzi6Mb96NbXQaK3sA8-tRGgoRD32KU_WRVlMGft8AZZtRx2sN9Lk4CAU7Xdk94gBFaX5O1vD--c57W1QpnSNtRoopgSzf677SYwryju8Hfceb1KyajIWOQ6cd7GbwfZtLG8 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0f0b7f48f3e4a24866ea77a8336f662 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0f0b7f48f3e4a24866ea77a8336f662", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0f0b7f48f3e4a24866ea77a8336f662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0f0b7f48f3e4a24866ea77a8336f662"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0f0b7f48f3e4a24866ea77a8336f662"}]}] Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0f0b7f48f3e4a24866ea77a8336f662 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachSCSIVolumeTestJSON-565080841-project Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: bf933142c4e74dea8707a0c0d8a53b1b Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-565080841-project Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2a64ce67-150d-4430-805a-9cbab3489620'} Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:37.287104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Returning 404 to user: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:37.292646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-193485c5-5dc5-4122-a2cc-70ec0987285d tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 404 len: 111 microversion: 2.1 time: 0.101861 Sep 16 14:05:37.297599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1298/2592] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:37 2022] DELETE /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:37.303635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0a1571b4-e0e1-49b2-87c6-62c5a654ea8e req-43c4677b-0bd2-4632-915a-11028cadb45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e7730a-4bda-4ae5-9595-934cf25ea683", "name": "network-vif-deleted", "tag": "99cef5ac-cf6f-4042-8117-71f655fc8e9e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:37.334528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0a1571b4-e0e1-49b2-87c6-62c5a654ea8e req-43c4677b-0bd2-4632-915a-11028cadb45b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.337351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0a1571b4-e0e1-49b2-87c6-62c5a654ea8e req-43c4677b-0bd2-4632-915a-11028cadb45b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.337806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0a1571b4-e0e1-49b2-87c6-62c5a654ea8e req-43c4677b-0bd2-4632-915a-11028cadb45b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.386210 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0a1571b4-e0e1-49b2-87c6-62c5a654ea8e req-43c4677b-0bd2-4632-915a-11028cadb45b service nova] Creating event network-vif-deleted:99cef5ac-cf6f-4042-8117-71f655fc8e9e for instance e3e7730a-4bda-4ae5-9595-934cf25ea683 on n-h1-858129-2 Sep 16 14:05:37.399995 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0a1571b4-e0e1-49b2-87c6-62c5a654ea8e req-43c4677b-0bd2-4632-915a-11028cadb45b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100133 Sep 16 14:05:37.409892 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1299/2593] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:37.425393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:37.429229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] [instance: 2a64ce67-150d-4430-805a-9cbab3489620] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:37.444136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.444647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.445089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.445834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.446305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.451028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.486841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] HTTP exception thrown: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Request method failure captured: Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 HTTP/1.1 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIGTSeFePVXs9GDlsB8eKJMsGv9UHPVx90R_IWuEr3-9wzi6Mb96NbXQaK3sA8-tRGgoRD32KU_WRVlMGft8AZZtRx2sN9Lk4CAU7Xdk94gBFaX5O1vD--c57W1QpnSNtRoopgSzf677SYwryju8Hfceb1KyajIWOQ6cd7GbwfZtLG8 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b0f0b7f48f3e4a24866ea77a8336f662 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0f0b7f48f3e4a24866ea77a8336f662", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0f0b7f48f3e4a24866ea77a8336f662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0f0b7f48f3e4a24866ea77a8336f662"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0f0b7f48f3e4a24866ea77a8336f662"}]}] Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b0f0b7f48f3e4a24866ea77a8336f662 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-565080841 Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachSCSIVolumeTestJSON-565080841-project Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: bf933142c4e74dea8707a0c0d8a53b1b Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-565080841-project Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2a64ce67-150d-4430-805a-9cbab3489620'} Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:37.493956 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] Returning 404 to user: Instance 2a64ce67-150d-4430-805a-9cbab3489620 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:37.497704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cdd24182-696e-4fd5-8096-95bafe03bf60 tempest-AttachSCSIVolumeTestJSON-565080841 tempest-AttachSCSIVolumeTestJSON-565080841-project] 10.222.0.60 "GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620" status: 404 len: 111 microversion: 2.1 time: 0.084419 Sep 16 14:05:37.516973 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1300/2594] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:37 2022] GET /compute/v2.1/servers/2a64ce67-150d-4430-805a-9cbab3489620 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:37.654878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-71dcbd59-a189-4497-ab75-3190c5471b71 req-e027f968-d741-49ac-bd93-86a0ef9a3e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d", "name": "network-vif-plugged", "status": "completed", "tag": "727ee620-7f3a-425e-bc91-a76118d278db"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:37.674761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-71dcbd59-a189-4497-ab75-3190c5471b71 req-e027f968-d741-49ac-bd93-86a0ef9a3e6c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.677500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-71dcbd59-a189-4497-ab75-3190c5471b71 req-e027f968-d741-49ac-bd93-86a0ef9a3e6c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.679785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-71dcbd59-a189-4497-ab75-3190c5471b71 req-e027f968-d741-49ac-bd93-86a0ef9a3e6c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.721240 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-71dcbd59-a189-4497-ab75-3190c5471b71 req-e027f968-d741-49ac-bd93-86a0ef9a3e6c service nova] Creating event network-vif-plugged:727ee620-7f3a-425e-bc91-a76118d278db for instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d on n-h1-858129-2 Sep 16 14:05:37.734927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-71dcbd59-a189-4497-ab75-3190c5471b71 req-e027f968-d741-49ac-bd93-86a0ef9a3e6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082734 Sep 16 14:05:37.736970 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1301/2595] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:05:37.753735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:37.755231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:37.771187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.773226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.775327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.776388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:37.779574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:37.782240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:37.907878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:37.921627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9dca24e4-2113-4ec2-85a9-0d5597e09e3d tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1318 microversion: 2.1 time: 0.759879 Sep 16 14:05:37.923007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1295/2596] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:37 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:37.932474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-115afe3e-ca05-4fe1-a61a-8d9ea5b370a5 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4dc0d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:38.034772 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-115afe3e-ca05-4fe1-a61a-8d9ea5b370a5 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.107959 Sep 16 14:05:38.035695 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1296/2597] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:37 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:38.212013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:38.217393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:38.244123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:38.249354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:38.251417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:38.257362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:38.259619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:38.260855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:38.381925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:38.384996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:38.389304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:38.390317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lazy-loading 'fault' on Instance uuid e3e7730a-4bda-4ae5-9595-934cf25ea683 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:38.418070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:38.864076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:38.918226 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf73933e-f6b8-459f-8f1e-b2d1d516a54a tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1314 microversion: 2.1 time: 0.713622 Sep 16 14:05:38.923326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1297/2598] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:38 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:38.992156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:38.994674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:39.048250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:39.049348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:39.050149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:39.067288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:39.074345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:39.076668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:39.173872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:39.228132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:39.237942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:39.252965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4557133a-6d8a-42e3-8371-4af2aab78235 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1563 microversion: 2.25 time: 1.511284 Sep 16 14:05:39.254853 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1302/2599] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:37 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1563 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:39.278348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:39.279888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:39.311248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:39.313119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:39.314648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:39.316307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:39.317411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:39.319064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:40.735183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:40.757289 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-856e187f-c2f1-4f54-ad74-4f4234b8ffde tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1506 microversion: 2.1 time: 1.495063 Sep 16 14:05:40.778896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1303/2600] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:39 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1506 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:40.788041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4283238a-63ab-4764-bf59-9a2abb01e757 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724d54f670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:40.912585 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4283238a-63ab-4764-bf59-9a2abb01e757 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.131291 Sep 16 14:05:40.922429 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1304/2601] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:40 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:40.929051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8c1622c4-ffcc-414d-aca7-ac6118dd4973 req-54d57875-b493-420c-a28a-8573b44b64ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b983bc33-1516-4759-a425-b6aea92b77d1", "name": "network-vif-deleted", "tag": "03b52866-a109-4c4b-8a4b-d69af987c2b5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:40.955014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:40.967591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8c1622c4-ffcc-414d-aca7-ac6118dd4973 req-54d57875-b493-420c-a28a-8573b44b64ad service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:40.969124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8c1622c4-ffcc-414d-aca7-ac6118dd4973 req-54d57875-b493-420c-a28a-8573b44b64ad service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:40.969864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8c1622c4-ffcc-414d-aca7-ac6118dd4973 req-54d57875-b493-420c-a28a-8573b44b64ad service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:40.994860 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8c1622c4-ffcc-414d-aca7-ac6118dd4973 req-54d57875-b493-420c-a28a-8573b44b64ad service nova] Creating event network-vif-deleted:03b52866-a109-4c4b-8a4b-d69af987c2b5 for instance b983bc33-1516-4759-a425-b6aea92b77d1 on n-h2-858129-2 Sep 16 14:05:41.009469 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8c1622c4-ffcc-414d-aca7-ac6118dd4973 req-54d57875-b493-420c-a28a-8573b44b64ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083715 Sep 16 14:05:41.015949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1305/2602] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:41.020635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c428e93e-274f-4d29-9a67-555b256bd5dc tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1325 microversion: 2.1 time: 2.073697 Sep 16 14:05:41.029065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:41.031041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:41.049491 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1298/2603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:38 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1325 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:41.052006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.053766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.059765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.064668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.071510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.078174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.081433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:41.082970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:41.099291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.101683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.102968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.105898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.107225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.108277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.167234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.168152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.169632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.171788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lazy-loading 'fault' on Instance uuid e3e7730a-4bda-4ae5-9595-934cf25ea683 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:41.279893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0441b7c0ea04bb08f871af5c2f1f46a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997c95646a2b40489cf53d5538786bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:41.280166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.281856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.283029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.283873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lazy-loading 'fault' on Instance uuid b983bc33-1516-4759-a425-b6aea92b77d1 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:41.285059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:41.334499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-880858c9-d5c3-435e-bd23-5cdd9717b822 tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 200 len: 1314 microversion: 2.1 time: 0.314748 Sep 16 14:05:41.346432 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1306/2604] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:41 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:41.373439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:41.391587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:41.425046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.433468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.434979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.436009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.437428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.438229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.472372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:41.489828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:41.492282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '916231d4d6114380b4e48d428d6dd843', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dfa47e4a424466bbfb73c6864caeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:41.493555 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b69a2e54-4555-4139-8648-7a8aa26cf95c tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 200 len: 1352 microversion: 2.25 time: 0.437974 Sep 16 14:05:41.494768 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1299/2605] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:41 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 1352 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:05:41.683711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:41.694266 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9546b6a7-0090-4b19-925a-dc9b3553de35 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07" status: 200 len: 1506 microversion: 2.1 time: 0.338013 Sep 16 14:05:41.711407 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1307/2606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:41 2022] GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:41.725519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:41.726462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:41.735318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.736181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.736839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.737749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.738765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.739363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.776949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:41.889563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:41.919342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a012058-05df-413a-ab97-667720eb5918 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07" status: 204 len: 0 microversion: 2.1 time: 0.197933 Sep 16 14:05:41.930920 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1300/2607] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:41 2022] DELETE /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:05:41.947114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8d749a3-4c66-42f7-961d-1b7c6f7e1fd0 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c6dedc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:41.951013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:41.952170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:41.973900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.975023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.975622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:41.976997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:41.980876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:41.981777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.084213 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8d749a3-4c66-42f7-961d-1b7c6f7e1fd0 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.147349 Sep 16 14:05:42.087607 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1308/2608] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:41 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:42.098827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:42.101937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:42.103844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:42.124863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.126517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.129313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.131926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.133317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.134807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.326668 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-78af815d-fd01-4cff-9d85-ef238f8b0570 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 204 len: 0 microversion: 2.1 time: 0.386978 Sep 16 14:05:42.329545 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1301/2609] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:41 2022] DELETE /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:42.399010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:42.406580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:42.436562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.437634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.438600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.439857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.440662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.441500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.535659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:42.564422 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53b3161a-4ed6-454d-a878-05e1f06b3fab tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1521 microversion: 2.1 time: 0.473599 Sep 16 14:05:42.565045 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1309/2610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:42 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:42.583690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:42.584363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] [instance: e3e7730a-4bda-4ae5-9595-934cf25ea683] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:42.591109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.591617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.592063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.593054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.593701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.594144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.622211 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] HTTP exception thrown: Instance e3e7730a-4bda-4ae5-9595-934cf25ea683 could not be found. Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Request method failure captured: Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 HTTP/1.1 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIIz5q47Tue6lV-M-Jn4okqWHfbU4HH2OVw8FNUudeLntuiTaVLSke4f3_Y9a276xzdkK7nR_edSOEmVEd6Ft5iPgHndmf7eMNPo8CBqO6bbqiDyZwlrjV1GTx3ed6mXALV_JJcQl2wFEgceQvlzRt2YQdZ-_WKJ22LKN1nZQtwKnVA Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_997c95646a2b40489cf53d5538786bb3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/997c95646a2b40489cf53d5538786bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/997c95646a2b40489cf53d5538786bb3"}]}] Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 997c95646a2b40489cf53d5538786bb3 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-406696602 Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e0441b7c0ea04bb08f871af5c2f1f46a Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-406696602-project Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e3e7730a-4bda-4ae5-9595-934cf25ea683 could not be found. Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e3e7730a-4bda-4ae5-9595-934cf25ea683'} Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e7730a-4bda-4ae5-9595-934cf25ea683 could not be found. Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e7730a-4bda-4ae5-9595-934cf25ea683 could not be found. Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.626321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e7730a-4bda-4ae5-9595-934cf25ea683 could not be found. Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] Returning 404 to user: Instance e3e7730a-4bda-4ae5-9595-934cf25ea683 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:42.629871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae5f81d9-31ec-49d7-a151-8afcc3bb670b tempest-FloatingIPsAssociationTestJSON-406696602 tempest-FloatingIPsAssociationTestJSON-406696602-project] 10.222.0.60 "GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683" status: 404 len: 111 microversion: 2.1 time: 0.061890 Sep 16 14:05:42.632749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1310/2611] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:42 2022] GET /compute/v2.1/servers/e3e7730a-4bda-4ae5-9595-934cf25ea683 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:42.638138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:42.638809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] [instance: b983bc33-1516-4759-a425-b6aea92b77d1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:42.645869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.646378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.646870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.647620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.648091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.648527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.676944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] HTTP exception thrown: Instance b983bc33-1516-4759-a425-b6aea92b77d1 could not be found. Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Request method failure captured: Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 HTTP/1.1 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJH_uUJaBDRXPsuGY_BNB2pnP8-qfrULkAoank3_mDWQEqIT8FMAPMopyC4QdGFom-3-LeezsUTpVswagmTTCnQ_mHDfipn_ArhbsQGj1NWrKmIUYqJ-mMRdfPyqTZ2-KGDGpPn7ryRO07qTm8aoMuoLpHaWIwfWEIQStF6FWgDu5F3M Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.25 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_54dfa47e4a424466bbfb73c6864caeed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/54dfa47e4a424466bbfb73c6864caeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/54dfa47e4a424466bbfb73c6864caeed"}]}] Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 54dfa47e4a424466bbfb73c6864caeed Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-456753983 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 916231d4d6114380b4e48d428d6dd843 Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-456753983-project Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b983bc33-1516-4759-a425-b6aea92b77d1 could not be found. Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b983bc33-1516-4759-a425-b6aea92b77d1'} Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b983bc33-1516-4759-a425-b6aea92b77d1 could not be found. Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b983bc33-1516-4759-a425-b6aea92b77d1 could not be found. Sep 16 14:05:42.679106 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b983bc33-1516-4759-a425-b6aea92b77d1 could not be found. Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] Returning 404 to user: Instance b983bc33-1516-4759-a425-b6aea92b77d1 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:42.682823 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-482688ed-6ced-4f71-854b-9e900291ab69 tempest-LiveAutoBlockMigrationV225Test-456753983 tempest-LiveAutoBlockMigrationV225Test-456753983-project] 10.222.0.60 "GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1" status: 404 len: 111 microversion: 2.25 time: 0.046801 Sep 16 14:05:42.685118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1311/2612] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:05:42 2022] GET /compute/v2.1/servers/b983bc33-1516-4759-a425-b6aea92b77d1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:05:42.691016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:42.691660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:42.708474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.708981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.709428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.710178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:42.710712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:42.711103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:42.969591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:42.989207 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40022a6e-c9e9-4e0e-b769-d8ef8155d62a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07" status: 200 len: 1512 microversion: 2.1 time: 0.647353 Sep 16 14:05:42.990226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1302/2613] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:42 2022] GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:43.090274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:43.102818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb974854-bc29-47d3-87bb-189f95070f15 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724d1d8d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:43.109755 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf32e2fd-60e5-44b6-b17f-6ac795867101 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1521 microversion: 2.1 time: 0.417863 Sep 16 14:05:43.110797 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1312/2614] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:42 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:43.167906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-648392081"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:43.174196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:43.187494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:43.189052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:43.190918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:43.194012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:43.196717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:43.197895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:43.213205 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb974854-bc29-47d3-87bb-189f95070f15 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.114409 Sep 16 14:05:43.214148 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1303/2615] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:43 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:43.540395 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e59424bb-5fd9-41e5-bdbc-7618f81042ca tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.379200 Sep 16 14:05:43.541886 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1313/2616] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:05:43 2022] POST /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:05:43.562804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-656e2bb5-95e8-4fc0-8c75-c9c5a9bb62e2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '.version_select at 0x7f724c4ecf70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:43.849219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:43.938243 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-656e2bb5-95e8-4fc0-8c75-c9c5a9bb62e2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c" status: 204 len: 0 microversion: 2.1 time: 0.383039 Sep 16 14:05:43.944922 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1304/2617] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:43 2022] DELETE /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:43.968370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1f89dad-d07b-4946-aac3-a257bf6af5ee tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '.version_select at 0x7f724cff3e50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:44.041797 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d1f89dad-d07b-4946-aac3-a257bf6af5ee tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Image not found. Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1f89dad-d07b-4946-aac3-a257bf6af5ee tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c HTTP/1.1 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1b9e246c-75d3-4740-a269-3d04e50acd6c'} Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1b9e246c-75d3-4740-a269-3d04e50acd6c Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:05:44.048128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b9e246c-75d3-4740-a269-3d04e50acd6c could not be found. Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:05:44.059392 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:05:44.075388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:44.075388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:44.076470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1f89dad-d07b-4946-aac3-a257bf6af5ee tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:44.076470 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1f89dad-d07b-4946-aac3-a257bf6af5ee tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c" status: 404 len: 62 microversion: 2.1 time: 0.125281 Sep 16 14:05:44.084581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1314/2618] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:43 2022] GET /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:05:44.101756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:44.102789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:44.103864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:44.104752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:44.106058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:44.107579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:44.112329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:44.113392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:44.124045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:44.126004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:44.127189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:44.129254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:44.130496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:44.132511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:44.709132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:44.717753 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23d418de-72c5-47d9-83d6-86bbe247039d tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1533 microversion: 2.1 time: 0.631053 Sep 16 14:05:44.734886 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1315/2619] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:44 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1533 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:44.795496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b556f6d7-2047-47f0-9700-4f4748ba1cfa tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c6de280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:44.798366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:44.814955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-069969b9-e2e0-4cfb-9a12-b1bdb75e286f tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07" status: 200 len: 1512 microversion: 2.1 time: 0.765997 Sep 16 14:05:44.815587 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1305/2620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:44 2022] GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 => generated 1512 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:44.984182 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b556f6d7-2047-47f0-9700-4f4748ba1cfa tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.241786 Sep 16 14:05:44.987131 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1316/2621] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:44 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:45.653676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6089d435-fc1a-47a7-8d80-654d63c6579e req-569b60b7-4c33-4887-9848-31c8a19fd06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de69f5a-f88f-493b-96f0-df1c0e433f07", "name": "network-vif-deleted", "tag": "2f88fef6-d21c-402f-adaf-ba2a7d276159"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:45.687905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6089d435-fc1a-47a7-8d80-654d63c6579e req-569b60b7-4c33-4887-9848-31c8a19fd06c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:45.691882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6089d435-fc1a-47a7-8d80-654d63c6579e req-569b60b7-4c33-4887-9848-31c8a19fd06c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:45.695035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6089d435-fc1a-47a7-8d80-654d63c6579e req-569b60b7-4c33-4887-9848-31c8a19fd06c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:45.734849 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6089d435-fc1a-47a7-8d80-654d63c6579e req-569b60b7-4c33-4887-9848-31c8a19fd06c service nova] Creating event network-vif-deleted:2f88fef6-d21c-402f-adaf-ba2a7d276159 for instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 on n-h2-858129-2 Sep 16 14:05:45.747815 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6089d435-fc1a-47a7-8d80-654d63c6579e req-569b60b7-4c33-4887-9848-31c8a19fd06c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098065 Sep 16 14:05:45.752247 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1306/2622] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:45.780067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:45.781321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:45.805833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:45.806387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:45.808647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:45.813369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:45.813899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:45.814351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:45.864162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:45.864888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:45.895238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:45.898884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:45.899438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:45.904548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:45.911554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:45.917674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:45.984794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:45.985695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:45.986357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:45.987008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lazy-loading 'fault' on Instance uuid 5de69f5a-f88f-493b-96f0-df1c0e433f07 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:46.548676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:46.600683 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1ff670e-97fa-4f1e-9ea5-4701389a9b40 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07" status: 200 len: 1308 microversion: 2.1 time: 0.738455 Sep 16 14:05:46.646715 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1307/2623] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:45 2022] GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:46.676255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a3f779b-ddd3-4576-82f6-dc9cb88c3e4f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4f1430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:46.789113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a3f779b-ddd3-4576-82f6-dc9cb88c3e4f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.139324 Sep 16 14:05:46.810102 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1308/2624] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:46 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:47.078145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:47.120507 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e190df2-e501-4457-9335-09617215f8ed tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1533 microversion: 2.1 time: 1.353972 Sep 16 14:05:47.135139 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1317/2625] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:45 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1533 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:47.670311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:47.672050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 5de69f5a-f88f-493b-96f0-df1c0e433f07] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:47.697030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:47.699656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:47.702726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:47.705921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:47.706789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:47.709346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:47.751057 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] HTTP exception thrown: Instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 could not be found. Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Request method failure captured: Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 HTTP/1.1 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJmn-71CWSsZ8W5zsrs8vRef9LRjaE-I0qVWrbECQBWFsKqkkcuFL2QTnXy-p90wFXx7iTdFAudBCF9cLZsaavF7muJVtq-8-pKIQwQIGqSMsfjn1Q1vzMlH-po0zaQZMu6L7WeXa1o6KwXqL4Pftw_W0AbBwHd6XQZpemcV8EDH4U Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 311811e7ca8c4b08b2c3edf8e4192d12 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MultipleCreateTestJSON-1545145890 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_311811e7ca8c4b08b2c3edf8e4192d12", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/311811e7ca8c4b08b2c3edf8e4192d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/311811e7ca8c4b08b2c3edf8e4192d12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/311811e7ca8c4b08b2c3edf8e4192d12"}]}] Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MultipleCreateTestJSON-1545145890 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 311811e7ca8c4b08b2c3edf8e4192d12 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1545145890 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MultipleCreateTestJSON-1545145890-project Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0e4bfe8580f1494d81551b8293ff37d9 Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MultipleCreateTestJSON-1545145890-project Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 could not be found. Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5de69f5a-f88f-493b-96f0-df1c0e433f07'} Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 could not be found. Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 could not be found. Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:47.754450 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 could not be found. Sep 16 14:05:47.758514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:47.760798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Returning 404 to user: Instance 5de69f5a-f88f-493b-96f0-df1c0e433f07 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:47.762104 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39bfbe32-4665-4bf6-8050-dacf6c70e6b7 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07" status: 404 len: 111 microversion: 2.1 time: 0.096881 Sep 16 14:05:47.763330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1309/2626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:47 2022] GET /compute/v2.1/servers/5de69f5a-f88f-493b-96f0-df1c0e433f07 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:05:47.779431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:47.780984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:47.793182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:47.794108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:47.794745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:47.797503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:47.800934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:47.802650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:47.821159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1e139b8-6589-414b-8e42-bc9225fe3a87 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4c60d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:47.921618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:47.922488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:47.923146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:47.923770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lazy-loading 'fault' on Instance uuid 0eed9766-b50f-4095-9e12-26ea27a00cb4 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:47.936553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1e139b8-6589-414b-8e42-bc9225fe3a87 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.120906 Sep 16 14:05:47.938308 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1310/2627] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:47 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:47.945439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8c45c7e2-a816-4244-b9ec-c2190998a373 req-9bd4829c-3e56-4c41-9321-8ffa575517f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9766-b50f-4095-9e12-26ea27a00cb4", "name": "network-vif-deleted", "tag": "6791251b-aaed-42ce-9dae-8136702762d0"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:47.988594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8c45c7e2-a816-4244-b9ec-c2190998a373 req-9bd4829c-3e56-4c41-9321-8ffa575517f0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:47.989984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8c45c7e2-a816-4244-b9ec-c2190998a373 req-9bd4829c-3e56-4c41-9321-8ffa575517f0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:47.990911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8c45c7e2-a816-4244-b9ec-c2190998a373 req-9bd4829c-3e56-4c41-9321-8ffa575517f0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:48.005414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:05:48.028002 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8c45c7e2-a816-4244-b9ec-c2190998a373 req-9bd4829c-3e56-4c41-9321-8ffa575517f0 service nova] Creating event network-vif-deleted:6791251b-aaed-42ce-9dae-8136702762d0 for instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 on n-h1-858129-2 Sep 16 14:05:48.055636 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8c45c7e2-a816-4244-b9ec-c2190998a373 req-9bd4829c-3e56-4c41-9321-8ffa575517f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114202 Sep 16 14:05:48.062128 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1311/2628] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:05:48.169131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:48.171767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:48.190645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:48.203499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:48.205576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:48.209832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:48.213339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:48.220848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:48.698804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4bfe8580f1494d81551b8293ff37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311811e7ca8c4b08b2c3edf8e4192d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:48.720013 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba3e00b3-5fbc-4ef0-a5f1-f3c93624c716 tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 200 len: 1308 microversion: 2.1 time: 0.945871 Sep 16 14:05:48.722104 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1318/2629] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:47 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 1308 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:48.888093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:48.902276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5a8e580a-cbb6-4fb5-a5a5-a51b4cd2d2bb tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1539 microversion: 2.1 time: 0.740215 Sep 16 14:05:48.906362 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1312/2630] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:48 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1539 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:48.958017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-88c97938-63af-4d65-a869-2bfe197550a6 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c67b940>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:49.030654 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-88c97938-63af-4d65-a869-2bfe197550a6 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.081738 Sep 16 14:05:49.031544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1319/2631] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:48 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:49.760825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:49.762797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] [instance: 0eed9766-b50f-4095-9e12-26ea27a00cb4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:49.781878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:49.783927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:49.785048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:49.788046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:49.789157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:49.792617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:49.842231 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] HTTP exception thrown: Instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 could not be found. Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Request method failure captured: Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 HTTP/1.1 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJmn-71CWSsZ8W5zsrs8vRef9LRjaE-I0qVWrbECQBWFsKqkkcuFL2QTnXy-p90wFXx7iTdFAudBCF9cLZsaavF7muJVtq-8-pKIQwQIGqSMsfjn1Q1vzMlH-po0zaQZMu6L7WeXa1o6KwXqL4Pftw_W0AbBwHd6XQZpemcV8EDH4U Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 311811e7ca8c4b08b2c3edf8e4192d12 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MultipleCreateTestJSON-1545145890 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_311811e7ca8c4b08b2c3edf8e4192d12", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/311811e7ca8c4b08b2c3edf8e4192d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/311811e7ca8c4b08b2c3edf8e4192d12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/311811e7ca8c4b08b2c3edf8e4192d12"}]}] Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MultipleCreateTestJSON-1545145890 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 311811e7ca8c4b08b2c3edf8e4192d12 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1545145890 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MultipleCreateTestJSON-1545145890-project Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 0e4bfe8580f1494d81551b8293ff37d9 Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MultipleCreateTestJSON-1545145890-project Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 could not be found. Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0eed9766-b50f-4095-9e12-26ea27a00cb4'} Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 could not be found. Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 could not be found. Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:49.845043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 could not be found. Sep 16 14:05:49.849432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:49.850853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] Returning 404 to user: Instance 0eed9766-b50f-4095-9e12-26ea27a00cb4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:49.851743 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fcc0e6b1-0ce4-4a92-9bdd-8ddb8a08bf7a tempest-MultipleCreateTestJSON-1545145890 tempest-MultipleCreateTestJSON-1545145890-project] 10.222.0.60 "GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4" status: 404 len: 111 microversion: 2.1 time: 0.110907 Sep 16 14:05:49.852339 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1313/2632] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:49 2022] GET /compute/v2.1/servers/0eed9766-b50f-4095-9e12-26ea27a00cb4 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:05:49.953977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:49.959984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:49.984763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:49.986966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:49.989287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:49.991771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:49.993567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:49.995459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:50.054444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db17143b-d7b8-42b9-bee9-15dfd7574aac tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f7251795700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:50.204511 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db17143b-d7b8-42b9-bee9-15dfd7574aac tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.155602 Sep 16 14:05:50.206977 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1314/2633] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:50 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:50.654096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:50.666787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5585122b-9879-4c17-8e18-a7f91da80cd0 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1539 microversion: 2.1 time: 0.720739 Sep 16 14:05:50.674290 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1320/2634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:49 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1539 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:51.231308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08372bb0-f7ca-4855-b7f3-46174aa51d11 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4c6280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:51.385696 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08372bb0-f7ca-4855-b7f3-46174aa51d11 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1419 microversion: 2.1 time: 0.165518 Sep 16 14:05:51.387856 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1315/2635] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:51 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1419 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:51.710860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:51.712124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:51.727573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:51.731194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:51.731641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:51.732592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:51.733269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:51.735033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.081145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:52.111258 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f6e3071-ad68-44e4-8061-17d50dbf7381 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1521 microversion: 2.1 time: 0.403984 Sep 16 14:05:52.126430 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1321/2636] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:51 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:52.171111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:52.171996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:52.193306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.194191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.207328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.208751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.209607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.210706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.310632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:05:52.336587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5834d5f0-1256-4bd0-bc70-eda4964f6556 req-b37a25b1-3829-4ce3-95e6-eeb5f9b55c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d", "name": "network-vif-plugged", "status": "completed", "tag": "727ee620-7f3a-425e-bc91-a76118d278db"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:52.383349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5834d5f0-1256-4bd0-bc70-eda4964f6556 req-b37a25b1-3829-4ce3-95e6-eeb5f9b55c45 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.385155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5834d5f0-1256-4bd0-bc70-eda4964f6556 req-b37a25b1-3829-4ce3-95e6-eeb5f9b55c45 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.385764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5834d5f0-1256-4bd0-bc70-eda4964f6556 req-b37a25b1-3829-4ce3-95e6-eeb5f9b55c45 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.434299 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5834d5f0-1256-4bd0-bc70-eda4964f6556 req-b37a25b1-3829-4ce3-95e6-eeb5f9b55c45 service nova] Creating event network-vif-plugged:727ee620-7f3a-425e-bc91-a76118d278db for instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d on n-h1-858129-2 Sep 16 14:05:52.442483 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5834d5f0-1256-4bd0-bc70-eda4964f6556 req-b37a25b1-3829-4ce3-95e6-eeb5f9b55c45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111078 Sep 16 14:05:52.443882 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1322/2637] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:05:52.449918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a9066ca-f368-4123-be4a-994f3a4a423b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724d308ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:52.551694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dd5173d2-bc75-40fe-894f-8229a346b158 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 204 len: 0 microversion: 2.1 time: 0.376478 Sep 16 14:05:52.553365 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1316/2638] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:05:52 2022] DELETE /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:05:52.563154 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a9066ca-f368-4123-be4a-994f3a4a423b tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1428 microversion: 2.1 time: 0.112438 Sep 16 14:05:52.565892 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1323/2639] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:52 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:52.573502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:52.575418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:52.583962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f133ddf-ac4f-476e-af87-f77799cf2ec7 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c69c280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:52.599624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.600528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.601291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.603760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.604254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.605174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.776486 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f133ddf-ac4f-476e-af87-f77799cf2ec7 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 200 len: 1428 microversion: 2.1 time: 0.198949 Sep 16 14:05:52.781103 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1324/2640] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:52 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 1428 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:52.803909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:52.807096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:52.831345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.832560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.833600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:52.834932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:52.836020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:52.837351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:53.300883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:53.315160 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41c8daa8-e5b5-4cef-922e-b45d84c8a273 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1527 microversion: 2.1 time: 0.756446 Sep 16 14:05:53.317565 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1317/2641] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:52 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1527 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:53.366307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:53.379633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23b3f6da-3755-4630-9fed-d04f5b54cd35 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1467 microversion: 2.1 time: 0.587368 Sep 16 14:05:53.394924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1325/2642] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:52 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1467 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:53.406002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74a0be78-f112-4bc8-a563-a9a7019f2235 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724ce3a9d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:53.456829 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74a0be78-f112-4bc8-a563-a9a7019f2235 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/b0b65f17-d770-469f-9ae4-7c7011730f1b" status: 200 len: 784 microversion: 2.1 time: 0.055208 Sep 16 14:05:53.457440 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1318/2643] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:53 2022] GET /compute/v2.1/images/b0b65f17-d770-469f-9ae4-7c7011730f1b => generated 784 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:05:53.471824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26b15878-d950-4f4d-944c-f0fe385b262e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:53.480776 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26b15878-d950-4f4d-944c-f0fe385b262e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012996 Sep 16 14:05:53.481695 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1326/2644] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:05:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:05:53.499795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0840ca65-d680-41ff-869b-c0513f7c6616 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f7251691c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:54.348992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:54.352015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:54.373998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:54.376663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:54.377798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:54.379465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:54.380538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:54.382174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:54.683629 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0840ca65-d680-41ff-869b-c0513f7c6616 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "DELETE /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 204 len: 0 microversion: 2.1 time: 1.190590 Sep 16 14:05:54.684940 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1319/2645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:53 2022] DELETE /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:05:54.701423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-682fde96-8653-44d5-9b85-f5a5e5939455 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4a40d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:54.766180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-682fde96-8653-44d5-9b85-f5a5e5939455 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] HTTP exception thrown: Image not found. Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-682fde96-8653-44d5-9b85-f5a5e5939455 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Request method failure captured: Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 HTTP/1.1 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJ-OnneC3nUiQE31nc3R_zmJIrBUAc_ntpK6Gzon5b8EAgvWQk1Z3Ajlch_wt__zX_sneurjRvhvYbnC7ynqjQW19ziFEoSyDgQK7Zb3xqQGU4lnWc-tx52BOxjAET5w_lWz2WMwUNS8Y4SCTVexCcNYs1MwF94Sic4Va9tbErLOhE Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3513e9bc3e7447a19e6879e8bc68d787 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3513e9bc3e7447a19e6879e8bc68d787", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3513e9bc3e7447a19e6879e8bc68d787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3513e9bc3e7447a19e6879e8bc68d787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3513e9bc3e7447a19e6879e8bc68d787"}]}] Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3513e9bc3e7447a19e6879e8bc68d787 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerTestJSON-48866392-project Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8f49d0bfb2a6439ba5de6b74fd7b2901 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerTestJSON-48866392-project Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f1d40133-90c5-40fe-b0f3-5d674a879868'} Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f1d40133-90c5-40fe-b0f3-5d674a879868 Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:05:54.772021 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1d40133-90c5-40fe-b0f3-5d674a879868 could not be found. Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:05:54.780279 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:54.787644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-682fde96-8653-44d5-9b85-f5a5e5939455 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:54.793547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-682fde96-8653-44d5-9b85-f5a5e5939455 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 404 len: 62 microversion: 2.1 time: 0.098322 Sep 16 14:05:54.807774 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1320/2646] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:54 2022] GET /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:05:54.822177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1576561420"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:54.826300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:54.839271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:54.840562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:54.841322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:54.843306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:54.844018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:54.844751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:54.872044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:54.903124 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1655d4c1-f377-449d-bb85-3692039feb70 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1527 microversion: 2.1 time: 0.563175 Sep 16 14:05:54.904416 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1327/2647] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:54 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1527 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:55.335027 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-727cdf07-6ff8-4ef8-8df4-d08cba443833 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "POST /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a/action" status: 202 len: 0 microversion: 2.1 time: 0.523294 Sep 16 14:05:55.338443 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1321/2648] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:05:54 2022] POST /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:05:55.366786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-308c3601-bd9b-4e9e-aede-8ffcbf8dc346 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c722550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:55.531471 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-308c3601-bd9b-4e9e-aede-8ffcbf8dc346 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.176596 Sep 16 14:05:55.539822 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1328/2649] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:55 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:55.936457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:55.937723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:55.969922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:55.971182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:55.972043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:55.974625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:55.976143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:55.976951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:56.565375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74a1143d-ab27-4289-8e0a-2849de70ebea tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c67bf70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:56.645843 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-74a1143d-ab27-4289-8e0a-2849de70ebea tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.085725 Sep 16 14:05:56.647107 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1329/2650] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:56 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:56.661867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:56.681806 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-103b21c6-f1ce-40d9-a414-5d07b411fae2 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1485 microversion: 2.1 time: 0.755148 Sep 16 14:05:56.683756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1322/2651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:55 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1485 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:56.857048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0b66555a-452f-4bf4-836f-c06300f0ea7e req-5aa46f70-c99d-4612-a3c3-18ea4b8208fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d", "name": "network-vif-deleted", "tag": "727ee620-7f3a-425e-bc91-a76118d278db"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:56.877063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0b66555a-452f-4bf4-836f-c06300f0ea7e req-5aa46f70-c99d-4612-a3c3-18ea4b8208fc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:56.887264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0b66555a-452f-4bf4-836f-c06300f0ea7e req-5aa46f70-c99d-4612-a3c3-18ea4b8208fc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:56.888008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0b66555a-452f-4bf4-836f-c06300f0ea7e req-5aa46f70-c99d-4612-a3c3-18ea4b8208fc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:56.950708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0b66555a-452f-4bf4-836f-c06300f0ea7e req-5aa46f70-c99d-4612-a3c3-18ea4b8208fc service nova] Creating event network-vif-deleted:727ee620-7f3a-425e-bc91-a76118d278db for instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d on n-h1-858129-2 Sep 16 14:05:56.971233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0b66555a-452f-4bf4-836f-c06300f0ea7e req-5aa46f70-c99d-4612-a3c3-18ea4b8208fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117919 Sep 16 14:05:56.974195 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1330/2652] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:05:57.442787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-41ae8e72-3820-4535-af09-2a1c9f136140 req-466f80ae-e64b-4d96-b4c9-489c5cf7598c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "name": "network-vif-unplugged", "status": "completed", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:05:57.473627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-41ae8e72-3820-4535-af09-2a1c9f136140 req-466f80ae-e64b-4d96-b4c9-489c5cf7598c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:57.474142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-41ae8e72-3820-4535-af09-2a1c9f136140 req-466f80ae-e64b-4d96-b4c9-489c5cf7598c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:57.474635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-41ae8e72-3820-4535-af09-2a1c9f136140 req-466f80ae-e64b-4d96-b4c9-489c5cf7598c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:57.504372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-41ae8e72-3820-4535-af09-2a1c9f136140 req-466f80ae-e64b-4d96-b4c9-489c5cf7598c service nova] Creating event network-vif-unplugged:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:05:57.521955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-41ae8e72-3820-4535-af09-2a1c9f136140 req-466f80ae-e64b-4d96-b4c9-489c5cf7598c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083898 Sep 16 14:05:57.524831 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1323/2653] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:05:57.673278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d552465-9ac1-4004-94eb-c400c6f722d1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f72517dc160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:57.728666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:57.729393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:57.742162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:57.744272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:57.747943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:57.749586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:57.751028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:57.754706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:57.841544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d552465-9ac1-4004-94eb-c400c6f722d1 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.172571 Sep 16 14:05:57.854994 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1331/2654] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:57 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:05:57.955242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:57.956710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:57.957724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:57.959056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lazy-loading 'fault' on Instance uuid ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:05:58.407790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:05:58.419414 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2eca30b5-58a2-4eba-a450-434ff079ad4b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 200 len: 1315 microversion: 2.1 time: 0.695501 Sep 16 14:05:58.435953 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1324/2655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:57 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:58.872770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b5c1bd8-1169-4129-bb71-453b1dabb4a4 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c683ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:58.990599 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b5c1bd8-1169-4129-bb71-453b1dabb4a4 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.125884 Sep 16 14:05:59.006448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1332/2656] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:05:58 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:05:59.465678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:05:59.491633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:05:59.536962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:59.538158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:59.539503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:59.545124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:05:59.549752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:05:59.550971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d HTTP/1.1 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d'} Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:05:59.622323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:05:59.629979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e323dd1-856c-40d6-9234-18b67ebf1851 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 404 len: 111 microversion: 2.1 time: 0.178314 Sep 16 14:05:59.637167 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1325/2657] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:05:59 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:06:00.017375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d30bf1a3-f1fb-46af-86f4-cb4e117336db tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4dd430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:00.020219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2042603917", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:00.150499 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d30bf1a3-f1fb-46af-86f4-cb4e117336db tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.136850 Sep 16 14:06:00.151212 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1326/2658] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:00 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:00.175415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] validate_networks() for [('e3e4f01d-b338-4f02-af18-87ac221a4f19', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:06:01.177125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17bc9bb4-130c-495c-b67a-2dc1714a5a78 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4c6f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:01.319485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17bc9bb4-130c-495c-b67a-2dc1714a5a78 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.147940 Sep 16 14:06:01.324207 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1327/2659] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:01 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:02.346438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9768191f-4e00-4dd4-9d7c-f0f9affbe055 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4dd700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:02.533662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9768191f-4e00-4dd4-9d7c-f0f9affbe055 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.190873 Sep 16 14:06:02.535838 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1328/2660] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:02 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:02.666202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:06:02.667231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:06:02.667231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:06:02.667573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:06:02.668503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:06:02.690953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:02.691710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:02.692350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:02.693299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:02.693968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:02.696395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:02.742922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:02.757602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Getting quotas for user 8c6bcf9620664cd2a156abfa959f3c50 and project 6ba9c4a7d37044bdb392a353a44fb42a. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:02.802889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:06:02.809062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:06:02.883980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fab947d6-0c6f-4b5f-8bd4-faf68ea61a50 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.880909 Sep 16 14:06:02.885389 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1333/2661] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:06:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:06:02.912705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80576554-91b4-4ca1-b998-1123dff895af tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:02.915334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-80576554-91b4-4ca1-b998-1123dff895af tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:03.242185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80576554-91b4-4ca1-b998-1123dff895af tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:03.284563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-80576554-91b4-4ca1-b998-1123dff895af tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1225 microversion: 2.1 time: 0.384862 Sep 16 14:06:03.290556 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1329/2662] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:02 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1225 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:03.584177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d852749f-a478-45de-ae9e-eb5bf6ab7425 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c67b040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:03.857179 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d852749f-a478-45de-ae9e-eb5bf6ab7425 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.300919 Sep 16 14:06:03.863498 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1334/2663] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:03 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:04.336465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65ca76ae-f732-4a16-af1e-9b410ed8c799 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:04.337723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65ca76ae-f732-4a16-af1e-9b410ed8c799 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:04.543374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65ca76ae-f732-4a16-af1e-9b410ed8c799 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:04.560517 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65ca76ae-f732-4a16-af1e-9b410ed8c799 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1225 microversion: 2.1 time: 0.233048 Sep 16 14:06:04.562559 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1330/2664] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:04 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1225 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:04.814028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-91d5c9e7-49c3-479f-a102-a19ecbac91f9 req-0b95ebe6-05c3-40e7-a83d-cba487e33df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "name": "network-vif-plugged", "status": "completed", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:04.854711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:04.858189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-91d5c9e7-49c3-479f-a102-a19ecbac91f9 req-0b95ebe6-05c3-40e7-a83d-cba487e33df2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:04.859986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-91d5c9e7-49c3-479f-a102-a19ecbac91f9 req-0b95ebe6-05c3-40e7-a83d-cba487e33df2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:04.863407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-91d5c9e7-49c3-479f-a102-a19ecbac91f9 req-0b95ebe6-05c3-40e7-a83d-cba487e33df2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:04.885704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55ba0b6b-9329-460f-8946-6353e748791f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49caf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:04.897885 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-91d5c9e7-49c3-479f-a102-a19ecbac91f9 req-0b95ebe6-05c3-40e7-a83d-cba487e33df2 service nova] Creating event network-vif-plugged:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:06:04.919267 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-91d5c9e7-49c3-479f-a102-a19ecbac91f9 req-0b95ebe6-05c3-40e7-a83d-cba487e33df2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108223 Sep 16 14:06:04.920681 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1335/2665] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:06:05.055821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55ba0b6b-9329-460f-8946-6353e748791f tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.178902 Sep 16 14:06:05.058050 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1331/2666] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:04 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:05.608733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:05.612878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:05.628224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:05.629834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:05.630730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:05.635204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:05.636019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:05.636594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:06.083360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a38605a5-2b90-47f1-9250-03afacbd2608 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49cdc0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:06.166131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:06.193094 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7b905ef-fdb3-4985-87d4-09bf2973b83e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1277 microversion: 2.1 time: 0.584105 Sep 16 14:06:06.196875 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1336/2667] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:05 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1277 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:06.297504 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a38605a5-2b90-47f1-9250-03afacbd2608 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.212477 Sep 16 14:06:06.300293 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1332/2668] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:06 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:07.079750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-633919d0-2cc4-4e42-a281-b7f213635bb4 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Calling method '.version_select at 0x7f724c6f6c10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:07.169057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-633919d0-2cc4-4e42-a281-b7f213635bb4 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] HTTP exception thrown: Image not found. Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-633919d0-2cc4-4e42-a281-b7f213635bb4 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Request method failure captured: Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/images/dccf8f65-fb54-47fc-8324-7f7eb28e1505/metadata/os_distro HTTP/1.1 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJILNdlyVXnrytwVFi-mKjETlloHRsc5sE32MsyoJV_471wnfZNkT6mAXTtUzDPcgfHzJZDGNDz_12kBOSFmgbFxarCo5Kb3amDedf1Yszfni67pKxlMw1PX0FscN0Cm2WmvuYQ3GtUStQETmVZ8PSdg970ie7tGSys2hjSv3BvnWcD8 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79f10ce79e614f7b8f70cecb00974382", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}] Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 75564eda4006421fb682f206ac25739c Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'image_id': 'dccf8f65-fb54-47fc-8324-7f7eb28e1505', 'id': 'os_distro'} Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dccf8f65-fb54-47fc-8324-7f7eb28e1505 Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:07.176980 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dccf8f65-fb54-47fc-8324-7f7eb28e1505 could not be found. Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-633919d0-2cc4-4e42-a281-b7f213635bb4 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-633919d0-2cc4-4e42-a281-b7f213635bb4 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] 10.222.0.60 "DELETE /compute/v2.1/images/dccf8f65-fb54-47fc-8324-7f7eb28e1505/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.980760 Sep 16 14:06:07.184595 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1337/2669] 10.222.0.60 () {58 vars in 1293 bytes} [Fri Sep 16 14:06:06 2022] DELETE /compute/v2.1/images/dccf8f65-fb54-47fc-8324-7f7eb28e1505/metadata/os_distro => generated 62 bytes in 982 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:07.204770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea2630bb-92db-41d9-a94b-32ae5bbeb984 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Calling method '.version_select at 0x7f724c4ab550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:07.249695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:07.250721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:07.275909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:07.279163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:07.281486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:07.284389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:07.286301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:07.288743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:07.295780 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ea2630bb-92db-41d9-a94b-32ae5bbeb984 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] HTTP exception thrown: Image not found. Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea2630bb-92db-41d9-a94b-32ae5bbeb984 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Request method failure captured: Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/images/965b801a-20bd-47d2-b1ce-ad07d1afb169/metadata/os_version HTTP/1.1 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILNdlyVXnrytwVFi-mKjETlloHRsc5sE32MsyoJV_471wnfZNkT6mAXTtUzDPcgfHzJZDGNDz_12kBOSFmgbFxarCo5Kb3amDedf1Yszfni67pKxlMw1PX0FscN0Cm2WmvuYQ3GtUStQETmVZ8PSdg970ie7tGSys2hjSv3BvnWcD8 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79f10ce79e614f7b8f70cecb00974382", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}] Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 75564eda4006421fb682f206ac25739c Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'image_id': '965b801a-20bd-47d2-b1ce-ad07d1afb169', 'id': 'os_version'} Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 965b801a-20bd-47d2-b1ce-ad07d1afb169 Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:07.301686 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 965b801a-20bd-47d2-b1ce-ad07d1afb169 could not be found. Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:07.308433 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.327262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea2630bb-92db-41d9-a94b-32ae5bbeb984 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:07.329375 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea2630bb-92db-41d9-a94b-32ae5bbeb984 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] 10.222.0.60 "GET /compute/v2.1/images/965b801a-20bd-47d2-b1ce-ad07d1afb169/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.134773 Sep 16 14:06:07.342500 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1333/2670] 10.222.0.60 () {58 vars in 1293 bytes} [Fri Sep 16 14:06:07 2022] GET /compute/v2.1/images/965b801a-20bd-47d2-b1ce-ad07d1afb169/metadata/os_version => generated 62 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:07.375980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ea9d4c0-f355-4deb-9d68-04720f8eb873 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49cd30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:07.522659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ea9d4c0-f355-4deb-9d68-04720f8eb873 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.177600 Sep 16 14:06:07.524393 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1334/2671] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:07 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:07.531952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:07.536130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:07.541793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1836c812-3a88-4e79-82ed-18918ba02787 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Calling method '.version_select at 0x7f724c49c1f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:07.587615 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aea0690c-a72a-4a17-9da5-796b65719fc8 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1283 microversion: 2.1 time: 0.334740 Sep 16 14:06:07.589444 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1338/2672] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:07 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1283 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:07.625335 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1836c812-3a88-4e79-82ed-18918ba02787 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] HTTP exception thrown: Image not found. Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1836c812-3a88-4e79-82ed-18918ba02787 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Request method failure captured: Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/images/826b37eb-fcda-4e19-b11d-7645d8d16818/metadata HTTP/1.1 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILNdlyVXnrytwVFi-mKjETlloHRsc5sE32MsyoJV_471wnfZNkT6mAXTtUzDPcgfHzJZDGNDz_12kBOSFmgbFxarCo5Kb3amDedf1Yszfni67pKxlMw1PX0FscN0Cm2WmvuYQ3GtUStQETmVZ8PSdg970ie7tGSys2hjSv3BvnWcD8 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79f10ce79e614f7b8f70cecb00974382", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}] Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 75564eda4006421fb682f206ac25739c Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'image_id': '826b37eb-fcda-4e19-b11d-7645d8d16818'} Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 826b37eb-fcda-4e19-b11d-7645d8d16818 Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:07.628094 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 826b37eb-fcda-4e19-b11d-7645d8d16818 could not be found. Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1836c812-3a88-4e79-82ed-18918ba02787 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1836c812-3a88-4e79-82ed-18918ba02787 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] 10.222.0.60 "GET /compute/v2.1/images/826b37eb-fcda-4e19-b11d-7645d8d16818/metadata" status: 404 len: 62 microversion: 2.1 time: 0.103406 Sep 16 14:06:07.635873 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1335/2673] 10.222.0.60 () {58 vars in 1260 bytes} [Fri Sep 16 14:06:07 2022] GET /compute/v2.1/images/826b37eb-fcda-4e19-b11d-7645d8d16818/metadata => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:07.658336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29251cdd-21af-4435-b59c-f95fc0845e52 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Action: 'update_all', calling method: .version_select at 0x7f724c67a3a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:07.716304 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-29251cdd-21af-4435-b59c-f95fc0845e52 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] HTTP exception thrown: Image not found. Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29251cdd-21af-4435-b59c-f95fc0845e52 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Request method failure captured: Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/images/0e4c9608-8bfa-4377-915f-51dc9ea24762/metadata HTTP/1.1 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 57 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJILNdlyVXnrytwVFi-mKjETlloHRsc5sE32MsyoJV_471wnfZNkT6mAXTtUzDPcgfHzJZDGNDz_12kBOSFmgbFxarCo5Kb3amDedf1Yszfni67pKxlMw1PX0FscN0Cm2WmvuYQ3GtUStQETmVZ8PSdg970ie7tGSys2hjSv3BvnWcD8 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79f10ce79e614f7b8f70cecb00974382", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}] Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 75564eda4006421fb682f206ac25739c Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'image_id': '0e4c9608-8bfa-4377-915f-51dc9ea24762', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0e4c9608-8bfa-4377-915f-51dc9ea24762 Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:07.723254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0e4c9608-8bfa-4377-915f-51dc9ea24762 could not be found. Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:07.727570 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.731533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29251cdd-21af-4435-b59c-f95fc0845e52 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:07.733177 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29251cdd-21af-4435-b59c-f95fc0845e52 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] 10.222.0.60 "PUT /compute/v2.1/images/0e4c9608-8bfa-4377-915f-51dc9ea24762/metadata" status: 404 len: 62 microversion: 2.1 time: 0.091739 Sep 16 14:06:07.733930 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1339/2674] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:06:07 2022] PUT /compute/v2.1/images/0e4c9608-8bfa-4377-915f-51dc9ea24762/metadata => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:07.748893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1987d32-a3c2-4497-8853-0101460f5f60 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Action: 'update', calling method: .version_select at 0x7f724c4a1040>, body: {"meta": {"os_distro": "alt"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:07.793898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d1987d32-a3c2-4497-8853-0101460f5f60 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] HTTP exception thrown: Image not found. Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1987d32-a3c2-4497-8853-0101460f5f60 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Request method failure captured: Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: request: PUT /compute/v2.1/images/fded0cfe-ac5b-4ef1-989c-6e3e8ff30d02/metadata/os_distro HTTP/1.1 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 30 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILNdlyVXnrytwVFi-mKjETlloHRsc5sE32MsyoJV_471wnfZNkT6mAXTtUzDPcgfHzJZDGNDz_12kBOSFmgbFxarCo5Kb3amDedf1Yszfni67pKxlMw1PX0FscN0Cm2WmvuYQ3GtUStQETmVZ8PSdg970ie7tGSys2hjSv3BvnWcD8 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79f10ce79e614f7b8f70cecb00974382", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}] Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 75564eda4006421fb682f206ac25739c Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: {"meta": {"os_distro": "alt"}} Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'image_id': 'fded0cfe-ac5b-4ef1-989c-6e3e8ff30d02', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fded0cfe-ac5b-4ef1-989c-6e3e8ff30d02 Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:07.800731 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fded0cfe-ac5b-4ef1-989c-6e3e8ff30d02 could not be found. Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1987d32-a3c2-4497-8853-0101460f5f60 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:07.806125 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1987d32-a3c2-4497-8853-0101460f5f60 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] 10.222.0.60 "PUT /compute/v2.1/images/fded0cfe-ac5b-4ef1-989c-6e3e8ff30d02/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.061624 Sep 16 14:06:07.820874 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1336/2675] 10.222.0.60 () {60 vars in 1310 bytes} [Fri Sep 16 14:06:07 2022] PUT /compute/v2.1/images/fded0cfe-ac5b-4ef1-989c-6e3e8ff30d02/metadata/os_distro => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:06:07.837657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-419f1b59-24f3-41d2-b900-693709262897 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Action: 'create', calling method: .version_select at 0x7f724c6f6700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:07.945908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-419f1b59-24f3-41d2-b900-693709262897 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] HTTP exception thrown: Image not found. Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-419f1b59-24f3-41d2-b900-693709262897 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Request method failure captured: Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/images/f043024c-982f-4a65-9766-6e20c0d0f62f/metadata HTTP/1.1 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 57 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJILNdlyVXnrytwVFi-mKjETlloHRsc5sE32MsyoJV_471wnfZNkT6mAXTtUzDPcgfHzJZDGNDz_12kBOSFmgbFxarCo5Kb3amDedf1Yszfni67pKxlMw1PX0FscN0Cm2WmvuYQ3GtUStQETmVZ8PSdg970ie7tGSys2hjSv3BvnWcD8 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79f10ce79e614f7b8f70cecb00974382", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79f10ce79e614f7b8f70cecb00974382"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79f10ce79e614f7b8f70cecb00974382"}]}] Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 79f10ce79e614f7b8f70cecb00974382 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827 Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 75564eda4006421fb682f206ac25739c Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1975246827-project Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'image_id': 'f043024c-982f-4a65-9766-6e20c0d0f62f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f043024c-982f-4a65-9766-6e20c0d0f62f Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:07.955598 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f043024c-982f-4a65-9766-6e20c0d0f62f could not be found. Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:07.968169 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:07.980166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-419f1b59-24f3-41d2-b900-693709262897 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:07.988379 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-419f1b59-24f3-41d2-b900-693709262897 tempest-ImagesMetadataNegativeTestJSON-1975246827 tempest-ImagesMetadataNegativeTestJSON-1975246827-project] 10.222.0.60 "POST /compute/v2.1/images/f043024c-982f-4a65-9766-6e20c0d0f62f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.166915 Sep 16 14:06:08.006837 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1340/2676] 10.222.0.60 () {60 vars in 1281 bytes} [Fri Sep 16 14:06:07 2022] POST /compute/v2.1/images/f043024c-982f-4a65-9766-6e20c0d0f62f/metadata => generated 62 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:08.562609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7245966f-d21a-4508-b134-30e41438f47a tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49c940>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:08.640621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:08.646244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:08.677042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:08.678694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:08.679796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:08.681322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:08.682359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:08.683435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:08.787105 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7245966f-d21a-4508-b134-30e41438f47a tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.236200 Sep 16 14:06:08.790445 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1337/2677] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:08 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:09.109087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:09.151532 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d714dd7a-1189-44e1-bf78-a8f2f886da96 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 0.514457 Sep 16 14:06:09.153644 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1341/2678] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:08 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:09.577643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:09.812149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f64d3376-5dfc-410a-8f48-eeb6acdefb61 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c722790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:09.963021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f64d3376-5dfc-410a-8f48-eeb6acdefb61 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.155180 Sep 16 14:06:09.969159 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1342/2679] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:09 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:10.065726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39b03e2b-5745-4507-b2cc-60b8433a3a22 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Action: 'create', calling method: .version_select at 0x7f724c4a4e50>, body: {"keypair": {"name": "tempest-keypair-1984629720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/p06sxaoCrjCPevjVC4/kAKX1tMTyb3YPWzYmd2T3ujrMddhhPj3GdkxVYl9fcqUXOTl4yJ5Uak7zW4Livq+CUOdtI7IBkkNITrjKnYNL+vUF0KHfJLcvynFA+wAsKeQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:10.140645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-39b03e2b-5745-4507-b2cc-60b8433a3a22 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Getting quotas for project e5dc35d3935447f1925d80a58b1a3b2e. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:10.156016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-39b03e2b-5745-4507-b2cc-60b8433a3a22 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Getting quotas for user 6f4d7b4b367d434582d7fc24a007c7e1 and project e5dc35d3935447f1925d80a58b1a3b2e. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:10.199035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:10.200722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:10.218257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:10.219366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:10.220031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:10.220962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:10.221845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:10.227658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:10.233392 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39b03e2b-5745-4507-b2cc-60b8433a3a22 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.866942 Sep 16 14:06:10.248583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1338/2680] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:06:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:10.989014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-269fee7f-e76e-4621-b3ca-b1a38c1fcc2c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724d0c3a60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:11.172404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-269fee7f-e76e-4621-b3ca-b1a38c1fcc2c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.189048 Sep 16 14:06:11.188290 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1339/2681] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:10 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:11.609890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:11.620101 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6dc9c1ba-11a9-42be-aed1-d508cf22fbb6 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 1.426308 Sep 16 14:06:11.627305 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1343/2682] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:10 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:12.139967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-769e53e4-d36c-4ef2-af76-42a6878b967d req-b599061e-9307-4c05-adfc-05888b588582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34cc836-1d3e-4e08-8ff2-262dcb32d5cf", "tag": "53301330-b487-4429-99ea-061623d9d18c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:12.146728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:12.177423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-769e53e4-d36c-4ef2-af76-42a6878b967d req-b599061e-9307-4c05-adfc-05888b588582 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:12.179882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-769e53e4-d36c-4ef2-af76-42a6878b967d req-b599061e-9307-4c05-adfc-05888b588582 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:12.180692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-769e53e4-d36c-4ef2-af76-42a6878b967d req-b599061e-9307-4c05-adfc-05888b588582 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:12.210083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfa3c6d3-fc1a-4d69-8ab5-a33b272d06a9 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724d17e8b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:12.220362 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-769e53e4-d36c-4ef2-af76-42a6878b967d req-b599061e-9307-4c05-adfc-05888b588582 service nova] Creating event network-changed:53301330-b487-4429-99ea-061623d9d18c for instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf on n-h1-858129-2 Sep 16 14:06:12.230170 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-769e53e4-d36c-4ef2-af76-42a6878b967d req-b599061e-9307-4c05-adfc-05888b588582 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095999 Sep 16 14:06:12.231264 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1340/2683] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:06:12.313861 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfa3c6d3-fc1a-4d69-8ab5-a33b272d06a9 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.107245 Sep 16 14:06:12.314076 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1344/2684] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:12 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:12.653497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:12.655693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:12.665773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:12.667984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:12.672748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:12.674151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:12.674912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:12.675847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:12.719521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:12.786434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-513d048d-cb5a-44c5-bf8d-d9ff53efaac3 tempest-ListImageFiltersNegativeTestJSON-1867771399 tempest-ListImageFiltersNegativeTestJSON-1867771399-project] Calling method '.version_select at 0x7f724ce3aa60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:12.800401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:12.823620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-513d048d-cb5a-44c5-bf8d-d9ff53efaac3 tempest-ListImageFiltersNegativeTestJSON-1867771399 tempest-ListImageFiltersNegativeTestJSON-1867771399-project] HTTP exception thrown: Image not found. Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-513d048d-cb5a-44c5-bf8d-d9ff53efaac3 tempest-ListImageFiltersNegativeTestJSON-1867771399 tempest-ListImageFiltersNegativeTestJSON-1867771399-project] Request method failure captured: Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/images/1e135b5a-a88c-4d8c-9e5c-f3e9a184d5b2 HTTP/1.1 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILUOO_V_u1TXd0HNqy5US8zJB6OTAbGqB4ITAjEnMu6St_nHLbZBUkju2M1E_lnu9RaOEGE23JRCw1lpmJ6deXZp7rCAAz-UTXmmvNILU29scnm0w2-eW6XsC1CH4ZCCDVbyOpQg_z4OlAtBx-2cl2gjMxlDPIgsz0qrIGhYbSd2X0 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1d19f236b4624cd3867e1ece55fba18c Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1867771399 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1d19f236b4624cd3867e1ece55fba18c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1d19f236b4624cd3867e1ece55fba18c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1d19f236b4624cd3867e1ece55fba18c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1d19f236b4624cd3867e1ece55fba18c"}]}] Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1867771399 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1d19f236b4624cd3867e1ece55fba18c Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1867771399 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListImageFiltersNegativeTestJSON-1867771399-project Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7c87be58dd2c4387ac3aaa711aa383d1 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1867771399-project Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1e135b5a-a88c-4d8c-9e5c-f3e9a184d5b2'} Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1e135b5a-a88c-4d8c-9e5c-f3e9a184d5b2 Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 16 14:06:12.826045 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e135b5a-a88c-4d8c-9e5c-f3e9a184d5b2 could not be found. Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:12.831370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-513d048d-cb5a-44c5-bf8d-d9ff53efaac3 tempest-ListImageFiltersNegativeTestJSON-1867771399 tempest-ListImageFiltersNegativeTestJSON-1867771399-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:12.835503 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-513d048d-cb5a-44c5-bf8d-d9ff53efaac3 tempest-ListImageFiltersNegativeTestJSON-1867771399 tempest-ListImageFiltersNegativeTestJSON-1867771399-project] 10.222.0.60 "GET /compute/v2.1/images/1e135b5a-a88c-4d8c-9e5c-f3e9a184d5b2" status: 404 len: 62 microversion: 2.1 time: 0.355385 Sep 16 14:06:12.835503 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1341/2685] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:12 2022] GET /compute/v2.1/images/1e135b5a-a88c-4d8c-9e5c-f3e9a184d5b2 => generated 62 bytes in 359 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:13.346730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00605538-6eaa-4d01-920a-0ee942ac215c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4dcaf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:13.474382 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00605538-6eaa-4d01-920a-0ee942ac215c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.134225 Sep 16 14:06:13.480377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1342/2686] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:13 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:14.167450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:14.184657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4527c2b-824f-429c-a4b4-0aba7ea5f85b tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 1.529022 Sep 16 14:06:14.187006 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1345/2687] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:12 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:14.519062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9d80eda-38e1-4bd3-aabb-793fe6ce69e9 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49c8b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:14.658928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9d80eda-38e1-4bd3-aabb-793fe6ce69e9 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.159500 Sep 16 14:06:14.660906 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1343/2688] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:14 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:15.213860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:15.215063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:15.241834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:15.246558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:15.251662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:15.252655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:15.253149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:15.257982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:15.699369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d74ee3e2-6a0a-463f-aae5-5db913288a78 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f725175b670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:15.870133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:15.879423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d74ee3e2-6a0a-463f-aae5-5db913288a78 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.198515 Sep 16 14:06:15.895551 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1344/2689] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:15 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:15.896057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f99a6e02-8ae3-4241-b69f-f7b4558da71f tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 0.680531 Sep 16 14:06:15.896057 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1346/2690] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:15 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:16.907144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c71da035-5ab7-44de-9c5a-9a5405fbeb86 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4a1040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:16.950524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:16.953732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:16.976275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:16.977631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:16.979022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:16.986607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:16.988935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:16.991321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:17.034879 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c71da035-5ab7-44de-9c5a-9a5405fbeb86 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.134635 Sep 16 14:06:17.045347 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1345/2691] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:16 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:17.415344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:17.457276 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-07de2f5b-d98b-4b70-b320-fa860b6ccdc9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 0.516526 Sep 16 14:06:17.458354 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1347/2692] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:16 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:18.055900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fdd1b60-b7e7-41a7-a2ad-4d8b6bc18ce3 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f72516918b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:18.150737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fdd1b60-b7e7-41a7-a2ad-4d8b6bc18ce3 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.101182 Sep 16 14:06:18.156552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1346/2693] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:18 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:18.485280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:18.485821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:18.553662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:18.559669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:18.565311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:18.567404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:18.568287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:18.568895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:19.193167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fdec8fc-7503-4fa0-846d-b28a658e9397 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49c040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:19.209552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:19.241878 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01f657c2-d902-473f-bdc2-99f61f92009c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 0.760278 Sep 16 14:06:19.281662 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1348/2694] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:18 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:19.336657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fdec8fc-7503-4fa0-846d-b28a658e9397 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.164921 Sep 16 14:06:19.339900 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1347/2695] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:19 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:20.296326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:20.301157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:20.359615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:20.362342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:20.364082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:20.365257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:20.371351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:20.375107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:20.377185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:20.384744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c156e9f-73a1-4c4f-86ca-15d40fc02400 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4ec790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:20.522001 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c156e9f-73a1-4c4f-86ca-15d40fc02400 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.163542 Sep 16 14:06:20.522745 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1348/2696] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:20 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:21.506305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:21.524916 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c9a8358-332e-4583-bd22-792f7789c5bf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 1.236011 Sep 16 14:06:21.527074 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1349/2697] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:20 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:21.559812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e3dc540-a950-4e34-b7a0-f396691392c2 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49c790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:21.661085 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e3dc540-a950-4e34-b7a0-f396691392c2 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.110023 Sep 16 14:06:21.662425 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1349/2698] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:21 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:22.558579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:22.559445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:22.573294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:22.573802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:22.574248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:22.575046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:22.575521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:22.576492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:22.685717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:22.687878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:22.695140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-589535b2-dacb-4713-b469-a187fd4d14ed tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4abca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:22.879506 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-589535b2-dacb-4713-b469-a187fd4d14ed tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1425 microversion: 2.1 time: 0.195005 Sep 16 14:06:22.880136 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1350/2699] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:22 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1425 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:23.432226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:23.451697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-85db4af6-787b-4843-8bf3-d045f018f9d7 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 0.896297 Sep 16 14:06:23.455656 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1350/2700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:22 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:23.926608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b79e380-7376-4576-bdca-eded6da4d4d2 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c49ca60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:24.482946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:24.484230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:24.518316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:24.526591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:24.528063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:24.529630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:24.533927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:24.534387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:25.622669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:25.670933 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8734a494-3189-4dbe-98b6-14b2bda2bc8c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 1.180171 Sep 16 14:06:25.686433 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1351/2701] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:24 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:25.701506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ef8c1524-054b-46b3-bc0d-6e775ad46f17 req-6b245152-46d3-4202-b3f7-1fed0e58d629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34cc836-1d3e-4e08-8ff2-262dcb32d5cf", "name": "network-vif-plugged", "status": "completed", "tag": "53301330-b487-4429-99ea-061623d9d18c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:25.784160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ef8c1524-054b-46b3-bc0d-6e775ad46f17 req-6b245152-46d3-4202-b3f7-1fed0e58d629 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:25.787212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ef8c1524-054b-46b3-bc0d-6e775ad46f17 req-6b245152-46d3-4202-b3f7-1fed0e58d629 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:25.801468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ef8c1524-054b-46b3-bc0d-6e775ad46f17 req-6b245152-46d3-4202-b3f7-1fed0e58d629 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:25.867622 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ef8c1524-054b-46b3-bc0d-6e775ad46f17 req-6b245152-46d3-4202-b3f7-1fed0e58d629 service nova] Creating event network-vif-plugged:53301330-b487-4429-99ea-061623d9d18c for instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf on n-h1-858129-2 Sep 16 14:06:25.888936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ef8c1524-054b-46b3-bc0d-6e775ad46f17 req-6b245152-46d3-4202-b3f7-1fed0e58d629 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207079 Sep 16 14:06:25.893896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1352/2702] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:26.706362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:26.707142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:26.748370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:26.749131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:26.749844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:26.752639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:26.753201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:26.753657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:28.466532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:28.521373 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f97dbc5-6d00-40aa-af0b-2c88c4e8847c tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1325 microversion: 2.1 time: 1.821274 Sep 16 14:06:28.535691 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1353/2703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:26 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1325 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:29.585966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:29.589031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:29.610133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:29.611733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:29.614064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:29.615837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:29.617318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:29.623560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:30.518932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:30.573597 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec7a2959-0fd2-491c-8f89-62fa0dc71bd1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1521 microversion: 2.1 time: 0.992712 Sep 16 14:06:30.594957 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1354/2704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:29 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1521 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:30.666235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:30.683429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:30.734368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:30.735304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:30.736097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:30.760008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:30.761090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:30.761909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:30.963196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:06:31.464762 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c294736-17fe-4a5a-a0db-33a5731b127e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 204 len: 0 microversion: 2.1 time: 0.816665 Sep 16 14:06:31.476820 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1355/2705] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:06:30 2022] DELETE /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:06:31.521965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:31.541696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:31.595644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:31.607281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:31.609677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:31.613623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:31.617791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:31.621510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:32.470800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:32.508773 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d12bbd2-5b23-4a54-a0c5-1f9f127a628a tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1527 microversion: 2.1 time: 1.023434 Sep 16 14:06:32.509907 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1356/2706] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:31 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1527 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:33.546305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:33.547331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:33.622995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:33.623805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:33.637505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:33.638884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:33.639765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:33.640528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:37.670024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:37.705129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0a9e570-e38a-47f8-9387-96ef7d0f180e tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1527 microversion: 2.1 time: 4.169043 Sep 16 14:06:37.708859 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1357/2707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:33 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1527 bytes in 4174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:38.213366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f0a39cf9-18e9-427c-9469-f72c4e158466 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Action: 'create', calling method: .version_select at 0x7f724d38cd30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1521219610", "policies": ["affinity"]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:38.222818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:38.284315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f0a39cf9-18e9-427c-9469-f72c4e158466 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:38.308460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f0a39cf9-18e9-427c-9469-f72c4e158466 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:38.490387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f0a39cf9-18e9-427c-9469-f72c4e158466 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:38.513706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f0a39cf9-18e9-427c-9469-f72c4e158466 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:38.556172 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f0a39cf9-18e9-427c-9469-f72c4e158466 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.835472 Sep 16 14:06:38.563328 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1358/2708] 10.222.0.60 () {60 vars in 1174 bytes} [Fri Sep 16 14:06:37 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:38.592716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-14c5e389-0205-4b0b-9dfa-a2de87ecbf45 req-eb9400c1-6df0-4173-a964-79d729649a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34cc836-1d3e-4e08-8ff2-262dcb32d5cf", "name": "network-vif-unplugged", "status": "completed", "tag": "53301330-b487-4429-99ea-061623d9d18c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:38.637199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-14c5e389-0205-4b0b-9dfa-a2de87ecbf45 req-eb9400c1-6df0-4173-a964-79d729649a1e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:38.638783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-14c5e389-0205-4b0b-9dfa-a2de87ecbf45 req-eb9400c1-6df0-4173-a964-79d729649a1e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:38.639753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-14c5e389-0205-4b0b-9dfa-a2de87ecbf45 req-eb9400c1-6df0-4173-a964-79d729649a1e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:38.650123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:38.695814 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-14c5e389-0205-4b0b-9dfa-a2de87ecbf45 req-eb9400c1-6df0-4173-a964-79d729649a1e service nova] Creating event network-vif-unplugged:53301330-b487-4429-99ea-061623d9d18c for instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf on n-h1-858129-2 Sep 16 14:06:38.728275 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-14c5e389-0205-4b0b-9dfa-a2de87ecbf45 req-eb9400c1-6df0-4173-a964-79d729649a1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163251 Sep 16 14:06:38.735619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1359/2709] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:38.744307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a845f69-54c8-4234-bf37-cbb44ba170a3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Action: 'create', calling method: .version_select at 0x7f724c67b700>, body: {"server_group": {"name": "tempest-server-group-1151872407", "policies": ["affinity"]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:38.858819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4a845f69-54c8-4234-bf37-cbb44ba170a3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:38.896399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4a845f69-54c8-4234-bf37-cbb44ba170a3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:39.140579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4a845f69-54c8-4234-bf37-cbb44ba170a3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:39.156522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-4a845f69-54c8-4234-bf37-cbb44ba170a3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:39.223918 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4a845f69-54c8-4234-bf37-cbb44ba170a3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.481769 Sep 16 14:06:39.235896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1360/2710] 10.222.0.60 () {60 vars in 1173 bytes} [Fri Sep 16 14:06:38 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:39.249018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:39.251090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:39.265713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:39.267818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:39.269609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:39.271836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:39.273640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:39.274868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:39.956122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6bcf9620664cd2a156abfa959f3c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9c4a7d37044bdb392a353a44fb42a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:39.986634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0dec6c02-0759-4faf-8ff9-f51054fee8a9 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 200 len: 1485 microversion: 2.1 time: 0.746655 Sep 16 14:06:39.987593 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1361/2711] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:39 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 1485 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:40.009034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9ece4d18-c1b6-4cf3-88cf-9d6aad45b0b4 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Action: 'create', calling method: .version_select at 0x7f724c683b80>, body: {"server_group": {"name": "tempest-server-group-1151872407", "policies": ["affinity"]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:40.204523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9ece4d18-c1b6-4cf3-88cf-9d6aad45b0b4 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:40.235987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9ece4d18-c1b6-4cf3-88cf-9d6aad45b0b4 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:40.404563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9ece4d18-c1b6-4cf3-88cf-9d6aad45b0b4 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:40.435988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9ece4d18-c1b6-4cf3-88cf-9d6aad45b0b4 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:40.459084 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9ece4d18-c1b6-4cf3-88cf-9d6aad45b0b4 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.458504 Sep 16 14:06:40.459600 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1362/2712] 10.222.0.60 () {60 vars in 1173 bytes} [Fri Sep 16 14:06:39 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:40.475267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-551636f1-6fd5-4524-82b0-8a9f8d2707c3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:40.578659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-551636f1-6fd5-4524-82b0-8a9f8d2707c3 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/3b7ed35f-b278-432f-baa8-26f1e3fe6182" status: 204 len: 0 microversion: 2.1 time: 0.107151 Sep 16 14:06:40.579138 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1363/2713] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:06:40 2022] DELETE /compute/v2.1/os-server-groups/3b7ed35f-b278-432f-baa8-26f1e3fe6182 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:06:40.592557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1753cb72-c511-4bc4-a165-a1a7e820e5f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:40.669492 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1753cb72-c511-4bc4-a165-a1a7e820e5f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.082110 Sep 16 14:06:40.685691 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1364/2714] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:06:40 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:40.690903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce01778c-87ec-4622-8833-cb343faf510b tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:40.774263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:40.820904 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce01778c-87ec-4622-8833-cb343faf510b tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/611cb122-a07f-458a-873c-4eb1d17724ef" status: 204 len: 0 microversion: 2.1 time: 0.133858 Sep 16 14:06:40.823102 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1365/2715] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:06:40 2022] DELETE /compute/v2.1/os-server-groups/611cb122-a07f-458a-873c-4eb1d17724ef => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:06:40.849773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a83760c-e223-448f-a6d1-e22ab2c02933 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:40.889578 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a83760c-e223-448f-a6d1-e22ab2c02933 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.059498 Sep 16 14:06:40.890591 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1366/2716] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:06:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:40.921122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b49228c-ec4b-4053-a693-d051b47d8d72 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Action: 'create', calling method: .version_select at 0x7f724d38cd30>, body: {"server_group": {"name": "tempest-server-group-976301993", "policies": ["affinity"]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:41.008576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5b49228c-ec4b-4053-a693-d051b47d8d72 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:41.033054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5b49228c-ec4b-4053-a693-d051b47d8d72 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:41.255620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5b49228c-ec4b-4053-a693-d051b47d8d72 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:41.277134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5b49228c-ec4b-4053-a693-d051b47d8d72 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:41.341842 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b49228c-ec4b-4053-a693-d051b47d8d72 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.430454 Sep 16 14:06:41.344687 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1367/2717] 10.222.0.60 () {60 vars in 1173 bytes} [Fri Sep 16 14:06:40 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:41.359392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a706739b-bea7-4f36-8878-312d6b2a917e req-6c2b9bbf-3a70-45eb-a256-bf37f4a6605d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34cc836-1d3e-4e08-8ff2-262dcb32d5cf", "name": "network-vif-deleted", "tag": "53301330-b487-4429-99ea-061623d9d18c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:41.456581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a706739b-bea7-4f36-8878-312d6b2a917e req-6c2b9bbf-3a70-45eb-a256-bf37f4a6605d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:41.464581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a706739b-bea7-4f36-8878-312d6b2a917e req-6c2b9bbf-3a70-45eb-a256-bf37f4a6605d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:41.466737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a706739b-bea7-4f36-8878-312d6b2a917e req-6c2b9bbf-3a70-45eb-a256-bf37f4a6605d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:41.540137 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a706739b-bea7-4f36-8878-312d6b2a917e req-6c2b9bbf-3a70-45eb-a256-bf37f4a6605d service nova] Creating event network-vif-deleted:53301330-b487-4429-99ea-061623d9d18c for instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf on n-h1-858129-2 Sep 16 14:06:41.558690 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a706739b-bea7-4f36-8878-312d6b2a917e req-6c2b9bbf-3a70-45eb-a256-bf37f4a6605d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211802 Sep 16 14:06:41.570864 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1368/2718] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:42.249367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:42.250970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:42.272862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:42.296391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:42.297122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:42.298117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:42.298891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:42.305172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:42.426958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:06:42.805787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5c90faa-acef-4bd9-b07f-2568c86e1417 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 204 len: 0 microversion: 2.32 time: 1.232389 Sep 16 14:06:42.808156 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1369/2719] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:06:41 2022] DELETE /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 0 bytes in 1237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:06:42.825972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:42.828733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: c34cc836-1d3e-4e08-8ff2-262dcb32d5cf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:42.854890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:42.857051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:42.859222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:42.861325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:42.866586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:42.868642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:42.924049 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf could not be found. Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf HTTP/1.1 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf could not be found. Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'c34cc836-1d3e-4e08-8ff2-262dcb32d5cf'} Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf could not be found. Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf could not be found. Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:42.932502 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf could not be found. Sep 16 14:06:42.936634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:42.944342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance c34cc836-1d3e-4e08-8ff2-262dcb32d5cf could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:42.953628 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61f32bfe-c641-4670-b6f4-80a0486d8632 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf" status: 404 len: 111 microversion: 2.1 time: 0.133604 Sep 16 14:06:42.956309 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1370/2720] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:42 2022] GET /compute/v2.1/servers/c34cc836-1d3e-4e08-8ff2-262dcb32d5cf => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:06:42.968483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4418e9a-b9f1-4caf-9b81-dfa517951225 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:43.059961 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4418e9a-b9f1-4caf-9b81-dfa517951225 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/da81751d-cf4f-4959-a4ba-933f70a45ff0" status: 204 len: 0 microversion: 2.1 time: 0.090659 Sep 16 14:06:43.060921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1371/2721] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:06:42 2022] DELETE /compute/v2.1/os-server-groups/da81751d-cf4f-4959-a4ba-933f70a45ff0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:06:43.072804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:43.079542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:43.097388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:43.100357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:43.102730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:43.107390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:43.108503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:43.112408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:44.199510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:44.223109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:44.225632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:44.228348 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc0077f2-7dca-4f08-acea-86d3aaa6cef1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2955 microversion: 2.32 time: 1.165308 Sep 16 14:06:44.256805 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1372/2722] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:06:43 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2955 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:06:44.264870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abe38268-5e2c-4f16-aae3-78f6f66ddcbf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '.version_select at 0x7f724c636c10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:46.338243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-abe38268-5e2c-4f16-aae3-78f6f66ddcbf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Image not found. Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abe38268-5e2c-4f16-aae3-78f6f66ddcbf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c HTTP/1.1 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1b9e246c-75d3-4740-a269-3d04e50acd6c'} Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b9e246c-75d3-4740-a269-3d04e50acd6c to delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b9e246c-75d3-4740-a269-3d04e50acd6c could not be found. Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:46.341174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:46.345803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.348273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abe38268-5e2c-4f16-aae3-78f6f66ddcbf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:46.349505 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abe38268-5e2c-4f16-aae3-78f6f66ddcbf tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c" status: 404 len: 62 microversion: 2.1 time: 2.090760 Sep 16 14:06:46.350256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1373/2723] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:44 2022] DELETE /compute/v2.1/images/1b9e246c-75d3-4740-a269-3d04e50acd6c => generated 62 bytes in 2092 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:46.363358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c5d3213-a924-48b0-8ae1-b487793c46ee tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:46.391459 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c5d3213-a924-48b0-8ae1-b487793c46ee tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.039758 Sep 16 14:06:46.404944 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1374/2724] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:06:46 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:46.422351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:46.425192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:46.469557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b79e380-7376-4576-bdca-eded6da4d4d2 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1434 microversion: 2.1 time: 22.561384 Sep 16 14:06:46.472027 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1351/2725] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:23 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1434 bytes in 22571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:06:46.480286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:46.488597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:46.490900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:46.495847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:46.500459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:46.506969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:46.514974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:46.520654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:46.542149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:46.544892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:46.546340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:46.548224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:46.549898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:46.553017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:46.616468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d HTTP/1.1 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d'} Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:06:46.626779 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:46.630883 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:46.635289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:46.638189 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e765f92-0565-483d-b5fb-eb8297fdb1ec tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 404 len: 111 microversion: 2.1 time: 0.162949 Sep 16 14:06:46.644708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1352/2726] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:06:46 2022] DELETE /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:06:46.662101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e72b4415-6cb6-406e-af94-b3ca62e73321 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Action: 'create', calling method: .version_select at 0x7f724c447160>, body: {"server_group": {"name": "tempest-server-group-1727511706", "policies": ["anti-affinity"]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:46.746254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e72b4415-6cb6-406e-af94-b3ca62e73321 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:46.766474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e72b4415-6cb6-406e-af94-b3ca62e73321 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:46.907810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e72b4415-6cb6-406e-af94-b3ca62e73321 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:46.923359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e72b4415-6cb6-406e-af94-b3ca62e73321 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_groups'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:46.984804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e72b4415-6cb6-406e-af94-b3ca62e73321 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.338144 Sep 16 14:06:46.985651 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1353/2727] 10.222.0.60 () {60 vars in 1173 bytes} [Fri Sep 16 14:06:46 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:47.004032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce955d3f-3912-4021-9dac-27e5c20c0117 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4a1160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:47.201303 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce955d3f-3912-4021-9dac-27e5c20c0117 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 200 len: 1434 microversion: 2.1 time: 0.205453 Sep 16 14:06:47.207131 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1354/2728] 10.222.0.60 () {58 vars in 1233 bytes} [Fri Sep 16 14:06:46 2022] GET /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 1434 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:47.311865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:47.337955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:47.371406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:47.386914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-84bdc5ab-ac7a-46f8-a22b-def5e2b62d64 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2955 microversion: 2.32 time: 0.976067 Sep 16 14:06:47.388393 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1375/2729] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:06:46 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2955 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:06:47.394106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:47.398269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:47.430592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:47.431617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:47.433318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:47.439345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:47.440193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:47.445361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:47.517914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d HTTP/1.1 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d'} Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:47.526332 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:47.530482 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f648d02f-acf7-43f3-b78f-7dfc93ef8c05 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d" status: 404 len: 111 microversion: 2.1 time: 0.139663 Sep 16 14:06:47.544735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8dc0620-f6e5-4230-89f0-60537a01db3e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c4acee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-506693386", "description": "tempest-description-1301674524"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:47.557578 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1376/2730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:47 2022] GET /compute/v2.1/servers/ce2bbadd-6d65-48b6-b0a7-151ccb74dd4d => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:06:47.591060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b1166e0-6ff0-43ba-b56b-9e820dc7c51d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:47.742394 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b1166e0-6ff0-43ba-b56b-9e820dc7c51d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ecdea081-4788-4e85-ad46-60c63b728d10" status: 204 len: 0 microversion: 2.1 time: 0.183099 Sep 16 14:06:47.743043 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1377/2731] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:06:47 2022] DELETE /compute/v2.1/os-server-groups/ecdea081-4788-4e85-ad46-60c63b728d10 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:06:47.767808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:47.772540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:47.804690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:47.808943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:47.809487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:47.814698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:47.815677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:47.817362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:48.463089 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8dc0620-f6e5-4230-89f0-60537a01db3e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.233616 Sep 16 14:06:48.463502 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1355/2732] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:06:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:48.469822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48e33a58-fcf2-44f2-af84-3fc821352275 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '.version_select at 0x7f724c4ac430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:48.540189 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48e33a58-fcf2-44f2-af84-3fc821352275 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537655708" status: 202 len: 0 microversion: 2.1 time: 0.073922 Sep 16 14:06:48.542101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1356/2733] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537655708 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:06:48.553900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9407da7e-3068-4664-a988-a3179acaae57 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:48.615202 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9407da7e-3068-4664-a988-a3179acaae57 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.067753 Sep 16 14:06:48.620657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1357/2734] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:06:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:48.628605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:48.629586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:48.639124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:48.640175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:48.640950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:48.652509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:48.654574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:48.659703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:48.793000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:48.813643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc166228-0691-4935-a9e8-90b693d2712e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1467 microversion: 2.1 time: 1.061883 Sep 16 14:06:48.814247 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1378/2735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:47 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1467 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:48.849819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-95bc0119-1f13-4dfb-9af5-b249a681416c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c683790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2068551574", "description": "tempest-description-1513664015"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:49.676184 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-95bc0119-1f13-4dfb-9af5-b249a681416c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.847448 Sep 16 14:06:49.677220 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1379/2736] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:06:48 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:49.682895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55cf8cc1-01d0-45e4-be75-9fc50fa364d0 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c69c160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:49.892395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:49.940007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:49.941904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:49.949083 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-848ebf6d-9f82-4b48-983c-e5f2916238cd tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2955 microversion: 2.32 time: 1.325053 Sep 16 14:06:49.951701 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1358/2737] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:06:48 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2955 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:06:49.961999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1175750523", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "97e514b2-faa9-48b8-afaa-37d5037a5993"}]}, "os:scheduler_hints": {"group": "d080e2c2-c4e2-40d9-96aa-c3bd57fff42e"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:50.170913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] validate_networks() for [('97e514b2-faa9-48b8-afaa-37d5037a5993', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:06:51.253979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55cf8cc1-01d0-45e4-be75-9fc50fa364d0 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "DELETE /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e" status: 204 len: 0 microversion: 2.1 time: 1.574038 Sep 16 14:06:51.255322 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1380/2738] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:49 2022] DELETE /compute/v2.1/images/aa74bf1f-c13a-418c-bbad-c2f517a7750e => generated 0 bytes in 1577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:06:51.261891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1549593884", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "e1731765-d189-4d10-b135-50f525e73f37"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:51.335258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=32 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:06:51.466869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] validate_networks() for [('e1731765-d189-4d10-b135-50f525e73f37', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:06:53.204013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:06:53.206216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:06:53.207033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:06:53.207644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:06:53.208240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:06:53.239626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:53.240808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:53.243346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:53.247869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:53.248777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:53.249433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:53.331171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Getting quotas for project a9d47597cbd942ea88af1b5c7e70c365. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:53.344404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Getting quotas for user 15a665ee509e48a9b2e3b6a1d173081b and project a9d47597cbd942ea88af1b5c7e70c365. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:53.366638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:06:53.367461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:06:53.368282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:06:53.368994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:06:53.369724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:06:53.385418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:06:53.395169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:06:53.430425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:53.435609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:53.442773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:53.444755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:53.445852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:53.446976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:53.544045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:53.569016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:53.585080 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fdd2fdc6-321e-49c6-ba95-7bbdfdde5bee tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.327980 Sep 16 14:06:53.597995 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1381/2739] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:06:53.611537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:53.614259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:53.629381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:53.635227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:06:53.636453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:53.637300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:53.639085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:53.640036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:53.640643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:53.644236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:06:53.809782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:53.845796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:54.009793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:06:54.028530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Getting quotas for user 8188562af9e84f929aef6a8f852660e8 and project 1b65fa3fcf2243b285012ef6fdda1034. Resources: {'server_group_members'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:06:54.171661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71a3bdf1-4cb8-4bd1-adfc-9a841c73e400 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.218560 Sep 16 14:06:54.183141 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1359/2740] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:06:54.215640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a9579ed-f5ad-4796-bdf4-c4c8a4db0ded tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '.version_select at 0x7f724c4a14c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:54.328695 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8a9579ed-f5ad-4796-bdf4-c4c8a4db0ded tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] HTTP exception thrown: Image not found. Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a9579ed-f5ad-4796-bdf4-c4c8a4db0ded tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Request method failure captured: Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 HTTP/1.1 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJ-OnneC3nUiQE31nc3R_zmJIrBUAc_ntpK6Gzon5b8EAgvWQk1Z3Ajlch_wt__zX_sneurjRvhvYbnC7ynqjQW19ziFEoSyDgQK7Zb3xqQGU4lnWc-tx52BOxjAET5w_lWz2WMwUNS8Y4SCTVexCcNYs1MwF94Sic4Va9tbErLOhE Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3513e9bc3e7447a19e6879e8bc68d787 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3513e9bc3e7447a19e6879e8bc68d787", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3513e9bc3e7447a19e6879e8bc68d787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3513e9bc3e7447a19e6879e8bc68d787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3513e9bc3e7447a19e6879e8bc68d787"}]}] Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3513e9bc3e7447a19e6879e8bc68d787 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerTestJSON-48866392-project Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8f49d0bfb2a6439ba5de6b74fd7b2901 Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerTestJSON-48866392-project Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f1d40133-90c5-40fe-b0f3-5d674a879868'} Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1d40133-90c5-40fe-b0f3-5d674a879868 to delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1d40133-90c5-40fe-b0f3-5d674a879868 could not be found. Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.331768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a9579ed-f5ad-4796-bdf4-c4c8a4db0ded tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a9579ed-f5ad-4796-bdf4-c4c8a4db0ded tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "DELETE /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868" status: 404 len: 62 microversion: 2.1 time: 0.140645 Sep 16 14:06:54.341616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1360/2741] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:54 2022] DELETE /compute/v2.1/images/f1d40133-90c5-40fe-b0f3-5d674a879868 => generated 62 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:54.348799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ea6fe5d3-d3f5-4231-8c6a-5e0d12dbd9c9 req-f43faa5f-6e1b-4dd8-b6ea-c844c90e72ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "484d374c-86ba-4273-b72f-ac0fe7b5ce96"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:54.401224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea6fe5d3-d3f5-4231-8c6a-5e0d12dbd9c9 req-f43faa5f-6e1b-4dd8-b6ea-c844c90e72ef service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:54.402035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea6fe5d3-d3f5-4231-8c6a-5e0d12dbd9c9 req-f43faa5f-6e1b-4dd8-b6ea-c844c90e72ef service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:54.403351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea6fe5d3-d3f5-4231-8c6a-5e0d12dbd9c9 req-f43faa5f-6e1b-4dd8-b6ea-c844c90e72ef service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:54.428560 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ea6fe5d3-d3f5-4231-8c6a-5e0d12dbd9c9 req-f43faa5f-6e1b-4dd8-b6ea-c844c90e72ef service nova] Creating event network-vif-unplugged:484d374c-86ba-4273-b72f-ac0fe7b5ce96 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:06:54.441597 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ea6fe5d3-d3f5-4231-8c6a-5e0d12dbd9c9 req-f43faa5f-6e1b-4dd8-b6ea-c844c90e72ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105313 Sep 16 14:06:54.453943 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1361/2742] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:06:54.469462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bc75aea-e630-4cf8-82f2-13cbdcbee5fe tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '.version_select at 0x7f724c4473a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:54.646810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-5bc75aea-e630-4cf8-82f2-13cbdcbee5fe tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Image not found. Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bc75aea-e630-4cf8-82f2-13cbdcbee5fe tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/26a08c49-df66-45b6-a7d9-e1cb3d2970fc HTTP/1.1 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '26a08c49-df66-45b6-a7d9-e1cb3d2970fc'} Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 26a08c49-df66-45b6-a7d9-e1cb3d2970fc to delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26a08c49-df66-45b6-a7d9-e1cb3d2970fc could not be found. Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:54.650519 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:06:54.656194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:54.659116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bc75aea-e630-4cf8-82f2-13cbdcbee5fe tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:54.660864 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5bc75aea-e630-4cf8-82f2-13cbdcbee5fe tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/images/26a08c49-df66-45b6-a7d9-e1cb3d2970fc" status: 404 len: 62 microversion: 2.1 time: 0.204869 Sep 16 14:06:54.662729 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1362/2743] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:54 2022] DELETE /compute/v2.1/images/26a08c49-df66-45b6-a7d9-e1cb3d2970fc => generated 62 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:06:54.685265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d52e8882-3142-4764-a535-471cd366b57e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:54.687386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d52e8882-3142-4764-a535-471cd366b57e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:54.797576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:54.822375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:54.826808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:54.828566 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7872026e-56c9-4fb9-807d-d1874bac97e1 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2934 microversion: 2.32 time: 1.228542 Sep 16 14:06:54.835185 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1382/2744] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:06:53 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2934 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:06:54.850734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70e70c33-c1fa-4a93-b99f-15f202ee51ac tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:54.852260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70e70c33-c1fa-4a93-b99f-15f202ee51ac tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:54.980271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d52e8882-3142-4764-a535-471cd366b57e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:55.040187 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d52e8882-3142-4764-a535-471cd366b57e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1216 microversion: 2.1 time: 0.375203 Sep 16 14:06:55.041193 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1363/2745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:54 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1216 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:55.059871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:55.079128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:55.114754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:55.115681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:55.116439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:55.129765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:55.137679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:55.143397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:55.359604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:06:55.848986 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f067183a-6bf2-4028-9ed1-52983eda4236 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 204 len: 0 microversion: 2.1 time: 0.805522 Sep 16 14:06:55.849974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1364/2746] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:06:55 2022] DELETE /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:06:55.902516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:55.903496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:55.925785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:55.926680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:55.927488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:55.928853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:55.929725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:55.948152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:56.007798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee HTTP/1.1 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee'} Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:06:56.010821 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:06:56.015276 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:06:56.020715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:06:56.022273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88f5506a-0428-4238-ac19-0c904706c209 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 404 len: 111 microversion: 2.1 time: 0.136036 Sep 16 14:06:56.030141 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1365/2747] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:06:55 2022] DELETE /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:06:56.657869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70e70c33-c1fa-4a93-b99f-15f202ee51ac tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:56.670680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70e70c33-c1fa-4a93-b99f-15f202ee51ac tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1213 microversion: 2.1 time: 1.833533 Sep 16 14:06:56.685250 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1383/2748] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:54 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1213 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:56.712396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:56.713224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:56.727077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:56.738201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:56.741032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:56.742160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:56.744580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:56.749641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:57.232975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-383345313", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "7f2e04b7-fc6e-4a4b-a083-0345699a23f6"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:06:57.376075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] validate_networks() for [('7f2e04b7-fc6e-4a4b-a083-0345699a23f6', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:06:58.481056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:06:58.506522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d24ec8d-3fe3-49aa-aae6-aa495bef7212 tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1473 microversion: 2.1 time: 1.818419 Sep 16 14:06:58.510054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1384/2749] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:06:56 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1473 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:06:58.545989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:06:58.551645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:06:58.582564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:58.584723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:58.592745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:06:58.593938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:06:58.596349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:06:58.596806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:00.677348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:07:00.678484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:07:00.681028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:07:00.681742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:07:00.682333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:07:00.709731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:00.710572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:00.711201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:00.712914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:00.713732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:00.714350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:00.750757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:00.779150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Getting quotas for project dd8ba9eb6c6a490b87715fb84d70af01. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:00.801735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Getting quotas for user 07787fdb99a6449a8f9fd6095ecb73fc and project dd8ba9eb6c6a490b87715fb84d70af01. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:00.853780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:07:00.860271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:07:01.002863 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dde96759-3ce4-4eeb-92b6-a3e0516ab9c5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.970091 Sep 16 14:07:01.007549 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1366/2750] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:07:01.015774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:01.023367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:01.027785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:01.028185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] [instance: 9df69a17-2485-4730-8ace-ef319cdc22ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:01.037327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:01.044679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.045448 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4e865bb-197b-4d1e-a822-46b3665dbf4c tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2913 microversion: 2.32 time: 2.522876 Sep 16 14:07:01.045729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.046517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.050279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.050795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1385/2751] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:06:58 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2913 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:01.053321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.055255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.059086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:01.059981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:01.077418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.078229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.078893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.079840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.080513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.081168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.107338 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] HTTP exception thrown: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Request method failure captured: Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee HTTP/1.1 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIJIRhsDDPZZchC-8lvZujGwMRJUq1KGCzG8djNpJ_a-vew2BOALwVexSSm9KRqt1tccmPkQDTFJDkHdnuP68dYzNbTzyJGtr84Zpmmlm2JpAEdBHBBFBwmassCsRN9ul3cHetx_KO4GG8nmof2KQdYIpauZFVUAnmW-SsUbOb6_QQ0 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6ba9c4a7d37044bdb392a353a44fb42a", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6ba9c4a7d37044bdb392a353a44fb42a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6ba9c4a7d37044bdb392a353a44fb42a"}]}] Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6ba9c4a7d37044bdb392a353a44fb42a Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-708184022 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8c6bcf9620664cd2a156abfa959f3c50 Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-708184022-project Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9df69a17-2485-4730-8ace-ef319cdc22ee'} Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:01.111372 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. Sep 16 14:07:01.115809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:01.122847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] Returning 404 to user: Instance 9df69a17-2485-4730-8ace-ef319cdc22ee could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:01.129790 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9375f487-d843-4305-bd9f-18e1a9dc9fc1 tempest-ImagesOneServerNegativeTestJSON-708184022 tempest-ImagesOneServerNegativeTestJSON-708184022-project] 10.222.0.60 "GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee" status: 404 len: 111 microversion: 2.1 time: 0.117612 Sep 16 14:07:01.136877 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1367/2752] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:01 2022] GET /compute/v2.1/servers/9df69a17-2485-4730-8ace-ef319cdc22ee => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:01.164298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-dcc94344-61fa-4d39-93cb-9489ba3b2e88 req-adf75f4a-04b9-49e5-8a41-b6ffe32f9117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "a0b047d1-6918-4557-a37e-fbe607080f35"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:01.194177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dcc94344-61fa-4d39-93cb-9489ba3b2e88 req-adf75f4a-04b9-49e5-8a41-b6ffe32f9117 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.195154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dcc94344-61fa-4d39-93cb-9489ba3b2e88 req-adf75f4a-04b9-49e5-8a41-b6ffe32f9117 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.195837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dcc94344-61fa-4d39-93cb-9489ba3b2e88 req-adf75f4a-04b9-49e5-8a41-b6ffe32f9117 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.238435 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-dcc94344-61fa-4d39-93cb-9489ba3b2e88 req-adf75f4a-04b9-49e5-8a41-b6ffe32f9117 service nova] Creating event network-vif-unplugged:a0b047d1-6918-4557-a37e-fbe607080f35 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:01.259594 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-dcc94344-61fa-4d39-93cb-9489ba3b2e88 req-adf75f4a-04b9-49e5-8a41-b6ffe32f9117 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120164 Sep 16 14:07:01.261006 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1368/2753] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:01.279928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:01.287003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:01.312826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.320194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.320921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.326278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.328151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.328723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.817955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:01.857490 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-154b8b8c-01f5-4ea8-8b8d-5bfacee214e4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1274 microversion: 2.1 time: 0.801860 Sep 16 14:07:01.858661 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1386/2754] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:01 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1274 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:01.878939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:01.885290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:01.922011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.949809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.956382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.959789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:01.962926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:01.969345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:01.970366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:01.982820 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f5b94e11-b61d-4fe2-a6a7-cc2204e7f0b1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1271 microversion: 2.1 time: 0.717116 Sep 16 14:07:01.993101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1369/2755] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:01 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1271 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:02.010728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2be5fb1b-52f5-4b9f-b057-bb413eb54773 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:02.011916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2be5fb1b-52f5-4b9f-b057-bb413eb54773 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:02.435201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f49d0bfb2a6439ba5de6b74fd7b2901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513e9bc3e7447a19e6879e8bc68d787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:02.452955 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b5e0e5a-0268-488f-be3f-00351561a12e tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 200 len: 1431 microversion: 2.1 time: 0.591246 Sep 16 14:07:02.455414 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1387/2756] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:01 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 1431 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:02.508025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:02.509433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:02.515975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:02.580128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:02.591336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:02.596577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:02.598917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:02.599651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:02.600356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:03.201262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2be5fb1b-52f5-4b9f-b057-bb413eb54773 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:03.215214 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2be5fb1b-52f5-4b9f-b057-bb413eb54773 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1231 microversion: 2.1 time: 1.219260 Sep 16 14:07:03.216051 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1370/2757] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:01 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1231 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:03.266134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a1902f4c-8094-4fac-99a8-43c3105a9f57 req-d5629925-89db-4927-9566-4ba7156d7c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "name": "network-vif-deleted", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:03.282341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:03.300173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a1902f4c-8094-4fac-99a8-43c3105a9f57 req-d5629925-89db-4927-9566-4ba7156d7c38 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:03.300913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a1902f4c-8094-4fac-99a8-43c3105a9f57 req-d5629925-89db-4927-9566-4ba7156d7c38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:03.301523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a1902f4c-8094-4fac-99a8-43c3105a9f57 req-d5629925-89db-4927-9566-4ba7156d7c38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:03.324070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a1902f4c-8094-4fac-99a8-43c3105a9f57 req-d5629925-89db-4927-9566-4ba7156d7c38 service nova] Creating event network-vif-deleted:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:07:03.347028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a1902f4c-8094-4fac-99a8-43c3105a9f57 req-d5629925-89db-4927-9566-4ba7156d7c38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097076 Sep 16 14:07:03.351336 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1371/2758] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:03.368249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:03.372001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:03.394634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:03.396816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:03.399329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:03.403459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:03.404215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:03.409294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:04.181480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:04.194686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4158c19c-27b0-4aae-866d-1feb98241f46 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1274 microversion: 2.1 time: 0.841256 Sep 16 14:07:04.195877 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1372/2759] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:03 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1274 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:04.206912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:04.208977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:04.226211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:04.227348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:04.228304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:04.229812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:04.231441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:04.233034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:04.814608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:04.861626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:04.868118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:04.876581 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf312e66-1d76-4ae8-b59b-1aa18f56d310 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2866 microversion: 2.32 time: 2.389891 Sep 16 14:07:04.886105 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1388/2760] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:02 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2866 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:04.897795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-41a94cfd-4865-49ca-b3e9-adf9a3c0f69e req-add34ba6-ea3c-4ebd-bf55-1d69b264e5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-deleted", "tag": "e7bd9cbb-3d6a-4456-be7c-87dc15b9bccf"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:04.922039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-41a94cfd-4865-49ca-b3e9-adf9a3c0f69e req-add34ba6-ea3c-4ebd-bf55-1d69b264e5f3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:04.924167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-41a94cfd-4865-49ca-b3e9-adf9a3c0f69e req-add34ba6-ea3c-4ebd-bf55-1d69b264e5f3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:04.924932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-41a94cfd-4865-49ca-b3e9-adf9a3c0f69e req-add34ba6-ea3c-4ebd-bf55-1d69b264e5f3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:04.958170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-41a94cfd-4865-49ca-b3e9-adf9a3c0f69e req-add34ba6-ea3c-4ebd-bf55-1d69b264e5f3 service nova] Creating event network-vif-deleted:e7bd9cbb-3d6a-4456-be7c-87dc15b9bccf for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:04.975914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-41a94cfd-4865-49ca-b3e9-adf9a3c0f69e req-add34ba6-ea3c-4ebd-bf55-1d69b264e5f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081758 Sep 16 14:07:04.977289 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1389/2761] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:04.990717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e6cb4254-4f82-4c9d-beab-758941152e7a req-7c4fcd11-8e75-499e-af83-3261f8fff4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58aeb9be-443a-45c9-8419-b2cf26ac6d8a", "name": "network-vif-unplugged", "status": "completed", "tag": "17e8359c-191a-420c-bab1-2bf38155eb21"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:05.017680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e6cb4254-4f82-4c9d-beab-758941152e7a req-7c4fcd11-8e75-499e-af83-3261f8fff4a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:05.021094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e6cb4254-4f82-4c9d-beab-758941152e7a req-7c4fcd11-8e75-499e-af83-3261f8fff4a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:05.021816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e6cb4254-4f82-4c9d-beab-758941152e7a req-7c4fcd11-8e75-499e-af83-3261f8fff4a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:05.048289 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e6cb4254-4f82-4c9d-beab-758941152e7a req-7c4fcd11-8e75-499e-af83-3261f8fff4a4 service nova] Creating event network-vif-unplugged:17e8359c-191a-420c-bab1-2bf38155eb21 for instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a on n-h2-858129-2 Sep 16 14:07:05.065056 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e6cb4254-4f82-4c9d-beab-758941152e7a req-7c4fcd11-8e75-499e-af83-3261f8fff4a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086056 Sep 16 14:07:05.068662 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1390/2762] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:05.091568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:05.093263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] [instance: 58aeb9be-443a-45c9-8419-b2cf26ac6d8a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:05.110962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:05.115592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:05.116321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:05.117535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:05.118447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:05.120218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:05.160387 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] HTTP exception thrown: Instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a could not be found. Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Request method failure captured: Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a HTTP/1.1 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIJ-OnneC3nUiQE31nc3R_zmJIrBUAc_ntpK6Gzon5b8EAgvWQk1Z3Ajlch_wt__zX_sneurjRvhvYbnC7ynqjQW19ziFEoSyDgQK7Zb3xqQGU4lnWc-tx52BOxjAET5w_lWz2WMwUNS8Y4SCTVexCcNYs1MwF94Sic4Va9tbErLOhE Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 3513e9bc3e7447a19e6879e8bc68d787 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3513e9bc3e7447a19e6879e8bc68d787", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3513e9bc3e7447a19e6879e8bc68d787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3513e9bc3e7447a19e6879e8bc68d787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3513e9bc3e7447a19e6879e8bc68d787"}]}] Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 3513e9bc3e7447a19e6879e8bc68d787 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-48866392 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesOneServerTestJSON-48866392-project Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8f49d0bfb2a6439ba5de6b74fd7b2901 Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesOneServerTestJSON-48866392-project Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a could not be found. Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '58aeb9be-443a-45c9-8419-b2cf26ac6d8a'} Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a could not be found. Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a could not be found. Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:05.165780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a could not be found. Sep 16 14:07:05.170699 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:05.172352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] Returning 404 to user: Instance 58aeb9be-443a-45c9-8419-b2cf26ac6d8a could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:05.177834 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-760120a1-4ffb-445d-a4c9-3687b8a9280c tempest-ImagesOneServerTestJSON-48866392 tempest-ImagesOneServerTestJSON-48866392-project] 10.222.0.60 "GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a" status: 404 len: 111 microversion: 2.1 time: 0.104187 Sep 16 14:07:05.182549 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1391/2763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:05 2022] GET /compute/v2.1/servers/58aeb9be-443a-45c9-8419-b2cf26ac6d8a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:05.195837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:05.196836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:05.214186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:05.217033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:05.217740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:05.219386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:05.222913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:05.223675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:06.182141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:06.204149 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40d8ff6e-09a4-4984-900d-00ff976e4da8 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1289 microversion: 2.1 time: 1.019930 Sep 16 14:07:06.235598 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1392/2764] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:05 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1289 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:06.242069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:06.242985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:06.266267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:06.267218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:06.267842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:06.268791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:06.269458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:06.270097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:06.327949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:06.665682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:07.322036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:07.383628 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9db067c1-bc4e-454c-b6ba-cd610c96a5aa tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 3.185642 Sep 16 14:07:07.385125 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1373/2765] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:04 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 3188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:07.410610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:07.412253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:07.448054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:07.481720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:07.483181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:07.484794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:07.485908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:07.487176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:09.787787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:09.814531 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c3194249-41c1-434d-9251-0fe8f4dff556 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 3.576905 Sep 16 14:07:09.820526 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1393/2766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:06 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 3584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:09.847554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "f958f626-5770-476e-ba66-3f86c7c6d242"}, {"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "66d9e776-025b-45b3-9ba2-ecd62c2b3ffc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:09.911909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:09.920634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:09.921901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:09.981665 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] Creating event network-vif-unplugged:f958f626-5770-476e-ba66-3f86c7c6d242 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:09.983274 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] Creating event network-vif-unplugged:66d9e776-025b-45b3-9ba2-ecd62c2b3ffc for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:09.991829 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7ee8de08-f9f0-4e9e-930f-d43b03718307 req-a99fc575-6b1a-45a4-bf56-4d0a3d3580b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.167562 Sep 16 14:07:09.993079 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1394/2767] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:10.002621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:10.003651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:10.015298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:10.018194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:10.019299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:10.020753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:10.023280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:10.024065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:10.734696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:10.830117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:10.888588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:10.890845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:10.910729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-830b580c-4c28-42b3-976d-1ef7c7f04b8b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2705 microversion: 2.32 time: 3.505879 Sep 16 14:07:10.912089 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1374/2768] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:07 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2705 bytes in 3526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:10.922713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:10.931550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:10.951916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:10.957721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:10.958775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:10.959807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:10.960513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:10.961160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:11.475119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:11.484657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4ac2744c-6c32-43b3-b87e-77de796c30ff tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1331 microversion: 2.1 time: 1.489738 Sep 16 14:07:11.508608 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1395/2769] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:09 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1331 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:11.527984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2053738412", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fa833a87-91e5-455e-97e2-bada30826503"}], "security_groups": [{"name": "tempest-securitygroup--1076064670"}], "key_name": "tempest-keypair-1984629720", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "60de89ab-a21f-460b-8fe3-e2214b4ffad8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:12.568837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] validate_networks() for [('fa833a87-91e5-455e-97e2-bada30826503', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:07:12.669209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:12.699736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c674b0da-9251-4e0a-ae3f-b27800f9bfb8 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 1.785389 Sep 16 14:07:12.701788 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1375/2770] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:10 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:12.720073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:12.721691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:12.747964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:12.752783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:12.757648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:12.759238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:12.760279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:12.767206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:12.859085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:13.214140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=32 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:15.422242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:15.455140 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77297f72-a64e-4800-b649-408056668ee4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 2.750546 Sep 16 14:07:15.456476 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1376/2771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:12 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:15.528892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:15.530074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:15.563002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:15.563953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:15.564784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:15.585045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:15.586074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:15.587127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:17.470069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Getting quotas for project e5dc35d3935447f1925d80a58b1a3b2e. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:17.485640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Getting quotas for user 6f4d7b4b367d434582d7fc24a007c7e1 and project e5dc35d3935447f1925d80a58b1a3b2e. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:17.508002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:17.525521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:17.526149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:07:17.527112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:07:17.527794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:07:17.529254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:07:17.529933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:07:17.538648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:17.540019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-893c6023-51df-43a6-b342-05aa4a4fee2e tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2658 microversion: 2.32 time: 2.039891 Sep 16 14:07:17.551197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:17.557095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:17.557841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:17.561060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:17.562044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:17.563274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:17.566302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1377/2772] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:15 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2658 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:17.571488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:17.572091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:17.594059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:17.595097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:17.598914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:17.600038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:17.600709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:17.600987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Getting quotas for project e5dc35d3935447f1925d80a58b1a3b2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:17.601531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:17.615871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Getting quotas for user 6f4d7b4b367d434582d7fc24a007c7e1 and project e5dc35d3935447f1925d80a58b1a3b2e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:17.747749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:07:17.750859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60de89ab-a21f-460b-8fe3-e2214b4ffad8',volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:07:18.146422 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-608ec305-88dd-48f9-be47-b43f8b70762b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 6.631577 Sep 16 14:07:18.151379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1396/2773] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:07:11 2022] POST /compute/v2.1/servers => generated 407 bytes in 6642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:07:18.168959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a68af3b2-0777-4f74-9f4f-c9cd4b51b293 req-da7e597c-ad8e-4623-8538-be43e9c058f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-deleted", "tag": "484d374c-86ba-4273-b72f-ac0fe7b5ce96"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:18.205894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a68af3b2-0777-4f74-9f4f-c9cd4b51b293 req-da7e597c-ad8e-4623-8538-be43e9c058f6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:18.206574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a68af3b2-0777-4f74-9f4f-c9cd4b51b293 req-da7e597c-ad8e-4623-8538-be43e9c058f6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:18.207038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a68af3b2-0777-4f74-9f4f-c9cd4b51b293 req-da7e597c-ad8e-4623-8538-be43e9c058f6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:18.248456 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a68af3b2-0777-4f74-9f4f-c9cd4b51b293 req-da7e597c-ad8e-4623-8538-be43e9c058f6 service nova] Creating event network-vif-deleted:484d374c-86ba-4273-b72f-ac0fe7b5ce96 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:18.260778 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a68af3b2-0777-4f74-9f4f-c9cd4b51b293 req-da7e597c-ad8e-4623-8538-be43e9c058f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108285 Sep 16 14:07:18.267955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1397/2774] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:18.292900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:18.295700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:18.319605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:18.320256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:18.320721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:18.321510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:18.321987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:18.325218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:18.460143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:18.480494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57507f96-249d-4770-9dac-b0ba92ae521b tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1331 microversion: 2.1 time: 0.912119 Sep 16 14:07:18.486678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1378/2775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:17 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1331 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:18.524537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-22410327-e631-465b-9649-dd26f3926df7 req-4cb88bfb-3eab-4966-866f-6bd07856acf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43037068-4003-4085-ba94-3cc0b027c722", "tag": "29d757e4-3e71-4eaa-bcc8-319ef877a467"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:18.540853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-22410327-e631-465b-9649-dd26f3926df7 req-4cb88bfb-3eab-4966-866f-6bd07856acf2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:18.550857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-22410327-e631-465b-9649-dd26f3926df7 req-4cb88bfb-3eab-4966-866f-6bd07856acf2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:18.551441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-22410327-e631-465b-9649-dd26f3926df7 req-4cb88bfb-3eab-4966-866f-6bd07856acf2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:18.570615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-22410327-e631-465b-9649-dd26f3926df7 req-4cb88bfb-3eab-4966-866f-6bd07856acf2 service nova] Creating event network-changed:29d757e4-3e71-4eaa-bcc8-319ef877a467 for instance 43037068-4003-4085-ba94-3cc0b027c722 on n-h2-858129-2 Sep 16 14:07:18.590497 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-22410327-e631-465b-9649-dd26f3926df7 req-4cb88bfb-3eab-4966-866f-6bd07856acf2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082068 Sep 16 14:07:18.591753 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1379/2776] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:18.598668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:18.599399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:18.616710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:18.617225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:18.617676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:18.618494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:18.618929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:18.619475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:20.609693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:20.634156 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32b3fb3d-af26-4f8d-98d8-1cb957ad6362 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 2.361908 Sep 16 14:07:20.657819 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1398/2777] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:18 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:20.680033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:20.681350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:20.713967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:20.719758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:20.721661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:20.722883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:20.723941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:20.726800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:20.798307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:20.809326 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3be2ce9-d005-4b2a-9ffc-a79aa2d504fe tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 2.213639 Sep 16 14:07:20.810000 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1380/2778] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:18 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:20.834750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:20.837210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:20.851364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:20.852326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:20.853875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:20.855508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:20.856200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:20.856838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:21.717330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:21.750739 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dded7bc9-88bc-4202-ad49-4c3277ee03a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1220 microversion: 2.1 time: 1.084097 Sep 16 14:07:21.753194 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1399/2779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:20 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1220 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:21.784547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:21.785189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:21.802368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:21.808812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:21.809354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:21.810150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:21.810900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:21.811111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:22.320466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:22.342218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:22.345982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:22.353535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa1e18bd-d255-41da-837a-38bb1e4d1541 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 2327 microversion: 2.32 time: 1.529314 Sep 16 14:07:22.357763 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1381/2780] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:20 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 2327 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:22.376984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5806d198-3978-4ea2-887b-c07a054c6d73", "tag": "2df52a7a-0cf3-446b-bf79-d62359edca2d"}, {"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-deleted", "tag": "66d9e776-025b-45b3-9ba2-ecd62c2b3ffc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:22.409765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:22.414703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:22.414703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:22.456416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] Creating event network-changed:2df52a7a-0cf3-446b-bf79-d62359edca2d for instance 5806d198-3978-4ea2-887b-c07a054c6d73 on n-h1-858129-2 Sep 16 14:07:22.459787 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] Creating event network-vif-deleted:66d9e776-025b-45b3-9ba2-ecd62c2b3ffc for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:22.488016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0308cd10-d2e0-4d6d-aca4-1b9117163179 req-9f2db8f0-bd52-4aba-9ad9-5dfb20c1016e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.127452 Sep 16 14:07:22.492585 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1382/2781] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:22.539604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:22.541099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:22.568453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:22.569232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:22.569992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:22.576345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:22.577214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:22.577938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:22.624722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:22.652638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad1501de-907f-4410-b9eb-d9ad5aac2953 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1331 microversion: 2.1 time: 0.877562 Sep 16 14:07:22.660118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1400/2782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:21 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1331 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:22.669283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:22.678306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:22.702607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:22.703555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:22.704316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:22.705568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:22.706356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:22.715550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:23.949105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:23.986132 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d96e27e1-a788-4234-8d41-1ccb010238f0 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 1.491414 Sep 16 14:07:23.987212 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1383/2783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:22 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:23.999772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:24.009529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:24.039181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:24.039695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:24.040163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:24.040950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:24.046024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:24.046911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:24.268527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:24.311837 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cfcd242b-027e-4881-869d-830ee3d8c645 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 1.648897 Sep 16 14:07:24.327112 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1401/2784] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:22 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:24.347905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:24.355399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:24.369805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:24.376614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:24.377569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:24.379214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:24.381242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:24.382247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:25.272649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:25.285766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8434cb5-1276-435a-8f04-16bcfec397fe tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1238 microversion: 2.1 time: 1.295200 Sep 16 14:07:25.289639 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1384/2785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:23 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1238 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:25.327025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:25.327953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:25.328723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:25.345526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:25.346384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:25.347296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:25.350051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:25.351636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:25.355242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:25.371000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:25.375594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:25.396255 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b3aaca41-3cd8-4a00-a119-2db95454fa77 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 1.057680 Sep 16 14:07:25.397879 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1402/2786] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:24 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:25.413548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a043bbd2-f3e3-49f1-8c2a-3ea8807e9e7c req-684f655f-a3a7-4cfe-b5fa-1042c7543d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43037068-4003-4085-ba94-3cc0b027c722", "name": "network-vif-plugged", "status": "completed", "tag": "29d757e4-3e71-4eaa-bcc8-319ef877a467"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:25.457329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a043bbd2-f3e3-49f1-8c2a-3ea8807e9e7c req-684f655f-a3a7-4cfe-b5fa-1042c7543d16 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:25.458644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a043bbd2-f3e3-49f1-8c2a-3ea8807e9e7c req-684f655f-a3a7-4cfe-b5fa-1042c7543d16 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:25.459986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a043bbd2-f3e3-49f1-8c2a-3ea8807e9e7c req-684f655f-a3a7-4cfe-b5fa-1042c7543d16 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:25.486440 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a043bbd2-f3e3-49f1-8c2a-3ea8807e9e7c req-684f655f-a3a7-4cfe-b5fa-1042c7543d16 service nova] Creating event network-vif-plugged:29d757e4-3e71-4eaa-bcc8-319ef877a467 for instance 43037068-4003-4085-ba94-3cc0b027c722 on n-h2-858129-2 Sep 16 14:07:25.497760 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a043bbd2-f3e3-49f1-8c2a-3ea8807e9e7c req-684f655f-a3a7-4cfe-b5fa-1042c7543d16 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097361 Sep 16 14:07:25.499350 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1403/2787] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:25.529752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-deleted", "tag": "f958f626-5770-476e-ba66-3f86c7c6d242"}, {"name": "network-changed", "server_uuid": "3a7ae519-0081-4bc0-aeab-9729b5cd5f3d", "tag": "550ae592-f15b-4702-a8eb-56a6eabe3b3b"}, {"server_uuid": "0ac2334e-4371-4b54-8482-752a508e6d9d", "name": "network-vif-deleted", "tag": "a0b047d1-6918-4557-a37e-fbe607080f35"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:25.564215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:25.564673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:25.565132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:25.614675 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Creating event network-vif-deleted:f958f626-5770-476e-ba66-3f86c7c6d242 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:25.615426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Creating event network-changed:550ae592-f15b-4702-a8eb-56a6eabe3b3b for instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d on n-h1-858129-2 Sep 16 14:07:25.623513 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] Creating event network-vif-deleted:a0b047d1-6918-4557-a37e-fbe607080f35 for instance 0ac2334e-4371-4b54-8482-752a508e6d9d on n-h2-858129-2 Sep 16 14:07:25.649574 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-228f9990-225b-4c4a-8c9e-8375c8283286 req-950fda04-dac2-41a7-8a4c-f479dd4c6382 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.143976 Sep 16 14:07:25.654457 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1404/2788] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:25.675738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:25.677129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:25.691369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:25.692486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:25.692486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:25.693212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:25.693759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:25.695409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:26.688386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:26.703120 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a73cdb37-dac0-4a87-9f00-d4d50c74b51f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 1.044751 Sep 16 14:07:26.703788 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1405/2789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:25 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:26.744416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:26.745111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:26.760555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:26.761923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:26.762577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:26.763674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:26.764550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:26.765811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:26.783855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:26.811303 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae7605e1-d74b-4aa5-9bde-40645f75927c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1331 microversion: 2.1 time: 1.501995 Sep 16 14:07:26.812391 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1385/2790] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:25 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1331 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:26.838287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:26.846377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:26.870056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:26.871566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:26.872378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:26.873722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:26.874623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:26.875492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.259646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:27.279763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-701881d5-8770-43d6-8728-5763fce65aae tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 0.556434 Sep 16 14:07:27.280385 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1406/2791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:26 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:27.286106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:27.303418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:27.315030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.327336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.328108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.335541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.336307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.336969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.517168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:27.532784 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-388d5271-0b68-4723-b02e-61054079bef3 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1306 microversion: 2.1 time: 0.713269 Sep 16 14:07:27.537186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1386/2792] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:26 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1306 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:27.568979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-13263fc3-b135-4400-bdf0-ac559fe49481 req-1a5d796b-3fba-4064-a868-f888681d56b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5806d198-3978-4ea2-887b-c07a054c6d73", "name": "network-vif-plugged", "status": "completed", "tag": "2df52a7a-0cf3-446b-bf79-d62359edca2d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:27.581606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-13263fc3-b135-4400-bdf0-ac559fe49481 req-1a5d796b-3fba-4064-a868-f888681d56b1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.582470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-13263fc3-b135-4400-bdf0-ac559fe49481 req-1a5d796b-3fba-4064-a868-f888681d56b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.583128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-13263fc3-b135-4400-bdf0-ac559fe49481 req-1a5d796b-3fba-4064-a868-f888681d56b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.589853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:27.603173 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-13263fc3-b135-4400-bdf0-ac559fe49481 req-1a5d796b-3fba-4064-a868-f888681d56b1 service nova] Creating event network-vif-plugged:2df52a7a-0cf3-446b-bf79-d62359edca2d for instance 5806d198-3978-4ea2-887b-c07a054c6d73 on n-h1-858129-2 Sep 16 14:07:27.610100 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-13263fc3-b135-4400-bdf0-ac559fe49481 req-1a5d796b-3fba-4064-a868-f888681d56b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071259 Sep 16 14:07:27.611404 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1387/2793] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:27.643490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:27.661332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:27.700990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:27.705556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:27.706894 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f9ec844-f268-454c-aacc-8a7386fac1f7 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.424700 Sep 16 14:07:27.713953 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1407/2794] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:27 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:27.730365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:27.732152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:27.749177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.751962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.753428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.756517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.758044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.759754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.837385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:27.838340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:27.853101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.853912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.857179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:27.859322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:27.860100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:27.865219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:29.315512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:29.336584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71dbb9c1-5afc-49ac-af51-52fd3fc7d5cd tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 1.609587 Sep 16 14:07:29.340472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1388/2795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:27 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:07:29.353603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:29.354797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:29.375133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:29.375528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:29.375973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:29.376723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:29.377189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:29.377619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:29.443785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:29.485612 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ef84af86-ed71-4c96-bbd4-192da503f853 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1331 microversion: 2.1 time: 1.642079 Sep 16 14:07:29.492495 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1408/2796] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:27 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1331 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:07:29.533650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:29.543050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:29.590944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:29.591550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:29.594889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:29.595752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:29.596263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:29.596719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.032924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:30.045618 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f31388f9-5b0f-4112-a36e-33cea1687313 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1306 microversion: 2.1 time: 0.549373 Sep 16 14:07:30.048229 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1409/2797] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:29 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1306 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:30.056666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:30.062051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:30.077016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.080808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.083092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.084750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.091976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.095768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.203638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:30.220280 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d56a847c-e1cd-4e6f-a315-fa90b095794e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 0.877921 Sep 16 14:07:30.221850 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1389/2798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:29 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:30.241383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5b693b1b-01f2-4193-bc3e-4061c8137c50 req-d8d99d90-7359-4ce4-9c14-3d6b14aa31ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd2365b-d9b7-4953-a237-a3d85f200de2", "tag": "94aad940-9b36-4476-b421-e2cfdb77136d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:30.330638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5b693b1b-01f2-4193-bc3e-4061c8137c50 req-d8d99d90-7359-4ce4-9c14-3d6b14aa31ce service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.332752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5b693b1b-01f2-4193-bc3e-4061c8137c50 req-d8d99d90-7359-4ce4-9c14-3d6b14aa31ce service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.333783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5b693b1b-01f2-4193-bc3e-4061c8137c50 req-d8d99d90-7359-4ce4-9c14-3d6b14aa31ce service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.376141 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5b693b1b-01f2-4193-bc3e-4061c8137c50 req-d8d99d90-7359-4ce4-9c14-3d6b14aa31ce service nova] Creating event network-changed:94aad940-9b36-4476-b421-e2cfdb77136d for instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 on n-h2-858129-2 Sep 16 14:07:30.390257 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5b693b1b-01f2-4193-bc3e-4061c8137c50 req-d8d99d90-7359-4ce4-9c14-3d6b14aa31ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165504 Sep 16 14:07:30.392607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1390/2799] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:30.417847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:30.419584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:30.440001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.441597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.445646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.447628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.449332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.450656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.481333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:30.529342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:30.548981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:30.552234 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d4ddef57-a076-4de8-aa09-df98624fea85 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.502142 Sep 16 14:07:30.554175 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1410/2800] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:30 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:30.567668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:30.569068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:30.581801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.583333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.584659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:30.586597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:30.588587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:30.590757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:31.399372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:31.429211 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56bd711f-8b8c-451e-88d3-5a3e50a0d335 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1534 microversion: 2.1 time: 0.872144 Sep 16 14:07:31.431528 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1411/2801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:30 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1534 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:31.459054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:31.472026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:31.493298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:31.512562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:31.514258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:31.520093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:31.524452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:31.528872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:31.692529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:31.716013 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf37b5ef-0e17-443e-8244-ab518cfe7ebb tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1313 microversion: 2.1 time: 1.320843 Sep 16 14:07:31.725187 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1391/2802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:30 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1313 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:31.755405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:31.756830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:31.780308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:31.803444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:31.803879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:31.804699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:31.806232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:31.806991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:31.808514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:32.445047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:32.459238 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90a60116-ce93-45ba-8835-8068afeb882d tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1306 microversion: 2.1 time: 1.021608 Sep 16 14:07:32.472133 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1412/2803] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:31 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1306 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:32.472133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b2506f83-4dbf-4d75-bb5a-219776908e81 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'create', calling method: .version_select at 0x7f724cfd4c10>, body: {"pool": "e94f8ce7-f79e-45b6-8df0-31adffa70cd7"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:32.690271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:32.706226 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b19e4330-1f40-4b6f-b874-17a306174ec3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 0.977308 Sep 16 14:07:32.707974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1392/2804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:31 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:32.718444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:32.719358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:32.741024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:32.741863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:32.742531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:32.743475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:32.744141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:32.744751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:32.933677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:32.967233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:32.970593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:32.973297 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7f38fbfb-10e2-4735-a129-7066b3679887 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.263563 Sep 16 14:07:32.986683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1393/2805] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:32 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:33.018796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:33.019910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:33.033560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:33.035384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:33.036508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:33.038420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:33.039598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:33.040707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:33.897899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:33.926925 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42b8c0c2-d722-477e-85e3-fe6f0ff368f1 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1497 microversion: 2.1 time: 0.937899 Sep 16 14:07:33.938513 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1394/2806] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:32 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1497 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:33.953199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:33.954748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:33.982533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:33.983766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:33.995596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:33.998104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:33.999290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:34.000358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:34.092073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:34.484736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:34.507039 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-847bb9dc-471e-40e5-be9b-b2b58e666725 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1306 microversion: 2.1 time: 0.574473 Sep 16 14:07:34.527436 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1395/2807] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:33 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1306 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:34.533753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:34.535234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:34.544481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:34.545815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:34.546524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:34.547619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:34.548684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:34.549321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:34.907494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:34.927471 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6455ce48-2331-41aa-a36c-5eabe3e93798 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 0.398341 Sep 16 14:07:34.942159 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1396/2808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:34 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:34.951505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ab102d74-d6ef-43f1-b224-5922fb7a612c req-234946ef-07cd-4d64-9925-6ba5e68816e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7ae519-0081-4bc0-aeab-9729b5cd5f3d", "name": "network-vif-plugged", "status": "completed", "tag": "550ae592-f15b-4702-a8eb-56a6eabe3b3b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:34.986261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ab102d74-d6ef-43f1-b224-5922fb7a612c req-234946ef-07cd-4d64-9925-6ba5e68816e1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:34.987391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ab102d74-d6ef-43f1-b224-5922fb7a612c req-234946ef-07cd-4d64-9925-6ba5e68816e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:34.988185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ab102d74-d6ef-43f1-b224-5922fb7a612c req-234946ef-07cd-4d64-9925-6ba5e68816e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.015532 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ab102d74-d6ef-43f1-b224-5922fb7a612c req-234946ef-07cd-4d64-9925-6ba5e68816e1 service nova] Creating event network-vif-plugged:550ae592-f15b-4702-a8eb-56a6eabe3b3b for instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d on n-h1-858129-2 Sep 16 14:07:35.025510 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ab102d74-d6ef-43f1-b224-5922fb7a612c req-234946ef-07cd-4d64-9925-6ba5e68816e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093665 Sep 16 14:07:35.027138 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1397/2809] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:35.034803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e19485d-8e00-4e6a-966f-f6c7c9c01868 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:35.055572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.compute.server_groups [None req-1e19485d-8e00-4e6a-966f-f6c7c9c01868 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Querying cell 08ea4950-b373-4785-aced-301964963f98(cell1) for 1 instances {{(pid=128642) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 14:07:35.056413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e19485d-8e00-4e6a-966f-f6c7c9c01868 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.056912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e19485d-8e00-4e6a-966f-f6c7c9c01868 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.058599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e19485d-8e00-4e6a-966f-f6c7c9c01868 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.106224 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e19485d-8e00-4e6a-966f-f6c7c9c01868 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/d080e2c2-c4e2-40d9-96aa-c3bd57fff42e" status: 200 len: 222 microversion: 2.1 time: 0.076986 Sep 16 14:07:35.107308 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1398/2810] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:07:35 2022] GET /compute/v2.1/os-server-groups/d080e2c2-c4e2-40d9-96aa-c3bd57fff42e => generated 222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:35.114594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:35.116013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:35.126620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.129050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.129750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.131337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.134239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.134951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.413881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:35.457346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:35.460741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:35.475556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea3c399e-8b82-4fc2-af20-00e6db7d96b2 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.366802 Sep 16 14:07:35.477208 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1399/2811] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:35 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:35.487861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:35.494050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:35.516936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.519844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.525051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.530120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.531120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.532228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.616109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:07:35.835321 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a8e0d06-4bc7-4cde-82da-4c93fff3118e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 204 len: 0 microversion: 2.1 time: 0.355242 Sep 16 14:07:35.843199 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1400/2812] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:07:35 2022] DELETE /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:07:35.856057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:35.857692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:35.872571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.873788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.875168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:35.876848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:35.878506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:35.878919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:36.165144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:36.174927 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ca7f21c-ae68-488d-8108-aaa3a1ef61af tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1306 microversion: 2.1 time: 0.329221 Sep 16 14:07:36.188267 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1401/2813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:35 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1306 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:36.379208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-50d5cc64-16e6-4969-8ff4-a6f159460975 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Action: 'create', calling method: .version_select at 0x7f724c4ec3a0>, body: {"keypair": {"name": "tempest-keypair-1582937027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ3z91LTqW5NygIvwhxolk37vWAAzSF1mfXwOLEYe/kqXZmyOjttkO1Vikm5aKl1+QSKrPtP3UPwBPHHO9LWtTCv3wug58OpaewEnUjgSMbyUCh2W1bbkbGfACybYeOVg=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:36.433211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-50d5cc64-16e6-4969-8ff4-a6f159460975 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:36.447630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-50d5cc64-16e6-4969-8ff4-a6f159460975 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for user d6260fd20e2c4f8fa1b741a4b774ba00 and project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:36.514169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-50d5cc64-16e6-4969-8ff4-a6f159460975 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324188 Sep 16 14:07:36.514852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1402/2814] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:07:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:36.532583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:36.533725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:36.551162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:36.552159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:36.553026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:36.555710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:36.556682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:36.557520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:36.792234 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b2506f83-4dbf-4d75-bb5a-219776908e81 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.329570 Sep 16 14:07:36.795005 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1413/2815] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:07:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:36.808650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:36.809937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:36.824063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:36.844166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:36.846206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:36.847057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:36.851088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:36.851972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:36.853446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:36.861112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:36.888546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:36.898687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3bbb9cf4-fbb3-48e7-8230-47ec1aa45b0f tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1503 microversion: 2.1 time: 0.376233 Sep 16 14:07:36.912468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1403/2816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:36 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:36.935288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-84be58d0-8605-4673-89d6-002349a1a83d tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724c43e700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:36.946367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-84be58d0-8605-4673-89d6-002349a1a83d tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1582937027" status: 200 len: 498 microversion: 2.1 time: 0.022272 Sep 16 14:07:36.947291 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1404/2817] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:07:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1582937027 => generated 498 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:36.960997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:36.961947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:36.971255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:36.972011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:36.972628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:36.973568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:36.974274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:36.974980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:37.083393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:37.096069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:37.098685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:37.100573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8219681d-acf6-4151-b8ad-e66fefb6a36b tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.143660 Sep 16 14:07:37.101511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1405/2818] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:36 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:37.107380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.242"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:37.110543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:37.127563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:37.131077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:37.131807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:37.136194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:37.136954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:37.138730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:37.157853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:37.169643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed238fec-4ab4-492a-ae45-4c22613a325d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1316 microversion: 2.1 time: 0.371937 Sep 16 14:07:37.170924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1414/2819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:36 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:37.180656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcd06b26-6d4c-4c16-880a-8e44dae11dee tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f72517dcd30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:37.204394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:07:37.205559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquired lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:07:37.236695 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bcd06b26-6d4c-4c16-880a-8e44dae11dee tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1582937027" status: 202 len: 0 microversion: 2.1 time: 0.063631 Sep 16 14:07:37.237399 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1415/2820] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:07:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1582937027 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:37.253108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:37.253745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:37.264297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:37.264788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:37.265236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:37.266083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:37.266732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:37.267632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:37.652789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:37.668787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-777b9078-c518-49e9-8e3e-ade1d1f887a4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1306 microversion: 2.1 time: 0.421560 Sep 16 14:07:37.670387 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1416/2821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:37 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1306 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:37.675799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d00f74cf-971a-4a8a-aeb9-73c91223f357 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Action: 'create', calling method: .version_select at 0x7f72517cc040>, body: {"keypair": {"name": "tempest-keypair-929105067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjr2XIe3WdX8CgNBi3QJKYvvYDeCMsf6dOrb6PUYTnD/FGSQdC0KVi6ETV5HyHMdbdwqQTyBRI159U7QNElsqhCdU3coJJp8gD53ghX6I/1b3K6+e0YDdt6uW7ke+1SyA=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:37.696428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d00f74cf-971a-4a8a-aeb9-73c91223f357 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:37.706859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d00f74cf-971a-4a8a-aeb9-73c91223f357 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for user d6260fd20e2c4f8fa1b741a4b774ba00 and project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:37.743921 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d00f74cf-971a-4a8a-aeb9-73c91223f357 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071978 Sep 16 14:07:37.745723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1417/2822] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:07:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:37.758710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b78ca9e7-6713-419b-996b-a8d7970d7b7f tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724c5fbdc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:37.789621 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b78ca9e7-6713-419b-996b-a8d7970d7b7f tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-929105067" status: 202 len: 0 microversion: 2.1 time: 0.035432 Sep 16 14:07:37.799375 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1418/2823] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:07:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-929105067 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:37.809011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9411d345-dd79-445c-871a-7163dc3a5b54 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Action: 'create', calling method: .version_select at 0x7f724d1b78b0>, body: {"keypair": {"name": "tempest-keypair-59384434", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:37.855271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9411d345-dd79-445c-871a-7163dc3a5b54 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:37.870602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9411d345-dd79-445c-871a-7163dc3a5b54 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for user d6260fd20e2c4f8fa1b741a4b774ba00 and project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:37.974247 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9411d345-dd79-445c-871a-7163dc3a5b54 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.171422 Sep 16 14:07:37.976673 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1419/2824] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:07:37 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:37.993414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:37.995176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:38.009962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:38.011459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:38.012487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:38.013990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:38.015348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:38.016372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:38.562831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8188562af9e84f929aef6a8f852660e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b65fa3fcf2243b285012ef6fdda1034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:38.576209 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2cf20bf4-f577-46de-8d08-8dc31652956e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 200 len: 1503 microversion: 2.1 time: 0.597593 Sep 16 14:07:38.577019 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1420/2825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:37 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:38.592667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40b02776-38b3-44d3-b3d9-36b299df5f7e tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724d23d310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:38.629640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40b02776-38b3-44d3-b3d9-36b299df5f7e tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59384434" status: 202 len: 0 microversion: 2.1 time: 0.041890 Sep 16 14:07:38.638537 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1421/2826] 10.222.0.60 () {58 vars in 1215 bytes} [Fri Sep 16 14:07:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59384434 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:38.643296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:38.644156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:38.654227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:38.667624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:38.668272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:38.669125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:38.669685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:38.670195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:38.999565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:39.018376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:39.020219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:39.021720 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b3dc8e1-bd06-43d5-810e-9b0b85ef5c34 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.389855 Sep 16 14:07:39.035252 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1422/2827] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:38 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:39.150581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1baa58c7-e74a-427a-a7d4-2e2543915634 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c646e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-784221636", "description": "tempest-description-863287660"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:40.333673 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1baa58c7-e74a-427a-a7d4-2e2543915634 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.296445 Sep 16 14:07:40.338646 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1423/2828] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:39 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:40.351448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:40.352927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:40.370549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:40.371858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:40.373057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:40.374810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:40.376739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:40.378395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:40.726891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:40.739399 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3e4a36f-12b4-4890-a23e-494baab99604 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1503 microversion: 2.1 time: 0.395471 Sep 16 14:07:40.761022 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1424/2829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:40 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:40.766190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ea244f14-fbf0-454d-992f-e0bfd4a604cd tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Action: 'create', calling method: .version_select at 0x7f724c6469d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1724874903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTzhL5a8QG8a0oQ9AXbQZRnp3SEMjW+R4Niji90ZwWRbIRqvbzIFppPlWOz9Gb3HFZpeDgvzGJ409eBduat4JoiFmME5iSEzNH0M4GDAUmAFZaSOQNR1i6/tsUDL1e2+w=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:40.816747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ea244f14-fbf0-454d-992f-e0bfd4a604cd tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:40.833263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ea244f14-fbf0-454d-992f-e0bfd4a604cd tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for user d6260fd20e2c4f8fa1b741a4b774ba00 and project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:40.848701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:07:40.898195 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ea244f14-fbf0-454d-992f-e0bfd4a604cd tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.135489 Sep 16 14:07:40.902962 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1425/2830] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:07:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:40.931670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:40.932738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:40.952471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:40.953317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:40.955055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:40.956595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:40.961157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:40.961932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:41.483502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:41.499998 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e5ebd998-98a9-45ed-8d32-d1a696e465b1 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1294 microversion: 2.1 time: 0.592270 Sep 16 14:07:41.500618 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1426/2831] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:40 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1294 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:41.509621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:41.513741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:41.530902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:41.535856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:41.536566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:41.537499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:41.538138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:41.542907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:41.585295 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 HTTP/1.1 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '5806d198-3978-4ea2-887b-c07a054c6d73'} Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:41.589274 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:41.594129 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:41.598522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:41.600840 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bbd978e2-3df8-4cc0-b651-b61cb1db0680 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 404 len: 111 microversion: 2.1 time: 0.097916 Sep 16 14:07:41.601737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1427/2832] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:41 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:41.613852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:41.618880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:41.633231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:41.636915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:41.638311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:41.644891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:41.652813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:41.653292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:41.901832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:41.918385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:41.920672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:41.922923 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d6483b7-dae3-4398-9b48-ede9710e2504 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.313613 Sep 16 14:07:41.924375 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1428/2833] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:41 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:41.929959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-29303966-6d14-4a48-ac05-3513b9a14e5a req-f5761d48-65c0-4d9c-b11d-786b7b242ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5806d198-3978-4ea2-887b-c07a054c6d73", "name": "network-vif-deleted", "tag": "2df52a7a-0cf3-446b-bf79-d62359edca2d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:41.946852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-29303966-6d14-4a48-ac05-3513b9a14e5a req-f5761d48-65c0-4d9c-b11d-786b7b242ae7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:41.948421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-29303966-6d14-4a48-ac05-3513b9a14e5a req-f5761d48-65c0-4d9c-b11d-786b7b242ae7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:41.949140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-29303966-6d14-4a48-ac05-3513b9a14e5a req-f5761d48-65c0-4d9c-b11d-786b7b242ae7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:41.962746 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-29303966-6d14-4a48-ac05-3513b9a14e5a req-f5761d48-65c0-4d9c-b11d-786b7b242ae7 service nova] Creating event network-vif-deleted:2df52a7a-0cf3-446b-bf79-d62359edca2d for instance 5806d198-3978-4ea2-887b-c07a054c6d73 on n-h1-858129-2 Sep 16 14:07:41.974874 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-29303966-6d14-4a48-ac05-3513b9a14e5a req-f5761d48-65c0-4d9c-b11d-786b7b242ae7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047474 Sep 16 14:07:41.976488 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1429/2834] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:41.988578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c615cd2-eb12-43b0-94c4-95fd9dd5a729 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c5fb280>, body: {"security_group_rule": {"parent_group_id": "4f9117d6-53a6-4978-94e7-37724d7b5c72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:42.679613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Updating instance_info_cache with network_info: [{"id": "29d757e4-3e71-4eaa-bcc8-319ef877a467", "address": "fa:16:3e:cd:eb:a0", "network": {"id": "7f2e04b7-fc6e-4a4b-a083-0345699a23f6", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-711628865-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dd8ba9eb6c6a490b87715fb84d70af01", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap29d757e4-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:07:42.703429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Releasing lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:07:42.705111 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e0d2370-bf46-4682-b1bf-795ede390705 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action" status: 202 len: 0 microversion: 2.1 time: 5.602359 Sep 16 14:07:42.708524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1406/2835] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:07:37 2022] POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action => generated 0 bytes in 5606 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:07:42.725476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-506693386"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:42.727012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:42.744265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:42.747497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:42.749387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:42.750972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:42.752884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:42.754905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:42.798076 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c615cd2-eb12-43b0-94c4-95fd9dd5a729 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.819708 Sep 16 14:07:42.798899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1430/2836] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:07:41 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:42.811381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1834f69b-370e-44f3-9395-64c4733c2154 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Action: 'create', calling method: .version_select at 0x7f72517cc940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-303919218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKQaeH2sMV3ZHlkelNSf9Vu52OQeCAqzvPWYqgxQuAWJ6v+0/wX7oJ4P4yJGDHzeBvjIyDV/xqLpUcoZ5CgLAw6HGtSElpQFnfw6jg4dj2YU4o7hxKqq3ww1eTXaNj17g=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:42.873365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-1834f69b-370e-44f3-9395-64c4733c2154 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:42.910183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-1834f69b-370e-44f3-9395-64c4733c2154 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for user d6260fd20e2c4f8fa1b741a4b774ba00 and project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:42.974819 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1834f69b-370e-44f3-9395-64c4733c2154 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.167908 Sep 16 14:07:42.978950 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1431/2837] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:07:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:42.991082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1f4be31-154a-4548-9886-4f35292a405e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:43.036543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.server_groups [None req-d1f4be31-154a-4548-9886-4f35292a405e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Querying cell 08ea4950-b373-4785-aced-301964963f98(cell1) for 1 instances {{(pid=128643) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 14:07:43.037288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1f4be31-154a-4548-9886-4f35292a405e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:43.042605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1f4be31-154a-4548-9886-4f35292a405e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:43.043610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1f4be31-154a-4548-9886-4f35292a405e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:43.064556 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1f4be31-154a-4548-9886-4f35292a405e tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.087610 Sep 16 14:07:43.074748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1432/2838] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:07:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:43.089920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:43.090904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:43.097948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.security_group_api [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Adding security group fea3e961-8b95-4689-a2a3-d6d6d863ad3e to port 550ae592-f15b-4702-a8eb-56a6eabe3b3b Sep 16 14:07:43.103216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:43.106984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:43.107729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:43.109227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:43.112252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:43.113624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:43.680163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:43.693014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e068067-ac38-4711-9a94-c63d821e1ec9 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1294 microversion: 2.1 time: 0.616950 Sep 16 14:07:43.702766 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1433/2839] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:43 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1294 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:43.708763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee7eb427-1d7d-4595-abdf-0446fca74327 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'create', calling method: .version_select at 0x7f724d23dd30>, body: {"pool": "e94f8ce7-f79e-45b6-8df0-31adffa70cd7"} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:44.555222 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62a64ad3-c174-4dc2-ac8f-5e933e2756f3 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d/action" status: 202 len: 0 microversion: 2.1 time: 1.842807 Sep 16 14:07:44.558063 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1407/2840] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:07:42 2022] POST /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d/action => generated 0 bytes in 1848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:44.599940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1579f239-1859-4480-8fdc-78c5797766cd tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c4dc3a0>, body: {"security_group_rule": {"parent_group_id": "4f9117d6-53a6-4978-94e7-37724d7b5c72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:45.091639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1579f239-1859-4480-8fdc-78c5797766cd tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: This rule already exists in group 4f9117d6-53a6-4978-94e7-37724d7b5c72 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1579f239-1859-4480-8fdc-78c5797766cd tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 138 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: {"security_group_rule": {"parent_group_id": "4f9117d6-53a6-4978-94e7-37724d7b5c72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: exception: This rule already exists in group 4f9117d6-53a6-4978-94e7-37724d7b5c72 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4f9117d6-53a6-4978-94e7-37724d7b5c72', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 4f9117d6-53a6-4978-94e7-37724d7b5c72 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 4f9117d6-53a6-4978-94e7-37724d7b5c72 Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:45.111851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 4f9117d6-53a6-4978-94e7-37724d7b5c72 Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1579f239-1859-4480-8fdc-78c5797766cd tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 400 to user: This rule already exists in group 4f9117d6-53a6-4978-94e7-37724d7b5c72 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1579f239-1859-4480-8fdc-78c5797766cd tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.553396 Sep 16 14:07:45.124299 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1408/2841] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:07:44 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:07:45.157734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:45.159458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:45.224856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:45.228472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:45.229812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:45.236175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:45.243442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:45.249472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:45.825917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:45.873309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:45.881510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:45.883913 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e380bdb5-eb75-4d34-ab95-2d4d4f5ce4fe tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.757867 Sep 16 14:07:45.938504 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1409/2842] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:45 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:45.951290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7969b044-7d45-48bc-8045-ddf21c168d5f tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Action: 'create', calling method: .version_select at 0x7f724c3b5700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1918522272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG7dYFwnyXWbTpxTBwFxmseDNECWwv3beMML7zIyNXTrpjLoSk+e7W9bqR/2UaoxctALUNYHL4zolI7v1GcgePp/BeT0vv3l3ZW0mOPUA8AGYJ2wZseNIrKLkVTwBhHvA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:45.999324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7969b044-7d45-48bc-8045-ddf21c168d5f tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:07:46.031692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7969b044-7d45-48bc-8045-ddf21c168d5f tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Getting quotas for user d6260fd20e2c4f8fa1b741a4b774ba00 and project 8673aa9cb37345d28485810c84f20906. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:07:46.101016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7969b044-7d45-48bc-8045-ddf21c168d5f tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.160148 Sep 16 14:07:46.107621 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1410/2843] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:07:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:46.115285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e012a0c-ced1-430a-8d74-ad28520f613c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:46.144107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.compute.server_groups [None req-0e012a0c-ced1-430a-8d74-ad28520f613c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Querying cell 08ea4950-b373-4785-aced-301964963f98(cell1) for 1 instances {{(pid=128642) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 16 14:07:46.145197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e012a0c-ced1-430a-8d74-ad28520f613c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:46.145884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e012a0c-ced1-430a-8d74-ad28520f613c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:46.146871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e012a0c-ced1-430a-8d74-ad28520f613c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:46.161106 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e012a0c-ced1-430a-8d74-ad28520f613c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/d080e2c2-c4e2-40d9-96aa-c3bd57fff42e" status: 200 len: 184 microversion: 2.1 time: 0.051897 Sep 16 14:07:46.162083 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1411/2844] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:07:46 2022] GET /compute/v2.1/os-server-groups/d080e2c2-c4e2-40d9-96aa-c3bd57fff42e => generated 184 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:46.169257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-82ae1ec8-7a10-48d5-860e-c80314c2d958 req-24f77bf6-61a1-47d8-834f-2741750d11ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43037068-4003-4085-ba94-3cc0b027c722", "tag": "29d757e4-3e71-4eaa-bcc8-319ef877a467"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:46.190144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-82ae1ec8-7a10-48d5-860e-c80314c2d958 req-24f77bf6-61a1-47d8-834f-2741750d11ee service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:46.191474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-82ae1ec8-7a10-48d5-860e-c80314c2d958 req-24f77bf6-61a1-47d8-834f-2741750d11ee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:46.191943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-82ae1ec8-7a10-48d5-860e-c80314c2d958 req-24f77bf6-61a1-47d8-834f-2741750d11ee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:46.208403 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-82ae1ec8-7a10-48d5-860e-c80314c2d958 req-24f77bf6-61a1-47d8-834f-2741750d11ee service nova] Creating event network-changed:29d757e4-3e71-4eaa-bcc8-319ef877a467 for instance 43037068-4003-4085-ba94-3cc0b027c722 on n-h2-858129-2 Sep 16 14:07:46.217911 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-82ae1ec8-7a10-48d5-860e-c80314c2d958 req-24f77bf6-61a1-47d8-834f-2741750d11ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054183 Sep 16 14:07:46.219547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1412/2845] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:46.226154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2068551574"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:46.226770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:46.241351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:46.242074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:46.242669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:46.243408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:46.244365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:46.245736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:46.527803 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.security_group_api [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Adding security group 738579c3-4b8b-4b9b-8c9e-590201de1dfd to port 550ae592-f15b-4702-a8eb-56a6eabe3b3b Sep 16 14:07:48.015934 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0a31534-d647-47e0-9d1a-f0d807e5dc8e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d/action" status: 202 len: 0 microversion: 2.1 time: 1.794549 Sep 16 14:07:48.022094 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1413/2846] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:07:46 2022] POST /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d/action => generated 0 bytes in 1802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:48.031802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:48.043923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:48.062717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:48.071757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:48.073559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:48.075718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:48.076866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:48.079435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:48.317757 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee7eb427-1d7d-4595-abdf-0446fca74327 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.613286 Sep 16 14:07:48.318843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1434/2847] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:07:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:48.357891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f016fe70-18c5-417d-8510-ae3647f1248b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724d37b790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:48.751209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:48.779967 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa40bbfc-4c1a-4377-9469-0c0a6c1e7d59 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1294 microversion: 2.1 time: 0.755069 Sep 16 14:07:48.784409 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1414/2848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:48 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1294 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:48.804805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b903705-d951-4031-a0a1-c86a543fc1c9 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724c3b5280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:48.822077 n-d-858129-2 devstack@n-api.service[128642]: WARNING oslo_db.sqlalchemy.utils [None req-5b903705-d951-4031-a0a1-c86a543fc1c9 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 14:07:48.848060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b903705-d951-4031-a0a1-c86a543fc1c9 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.057255 Sep 16 14:07:48.852336 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1415/2849] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:07:48 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:48.880811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:48.881886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:48.904050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:48.904902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:48.905596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:48.906895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:48.914275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:48.915368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:48.943861 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f016fe70-18c5-417d-8510-ae3647f1248b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/406690da-1fe0-41f4-bdc6-7eaa9af2357d" status: 202 len: 0 microversion: 2.1 time: 0.623397 Sep 16 14:07:48.945233 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1435/2850] 10.222.0.60 () {58 vars in 1287 bytes} [Fri Sep 16 14:07:48 2022] DELETE /compute/v2.1/os-security-group-rules/406690da-1fe0-41f4-bdc6-7eaa9af2357d => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:48.962315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:48.968288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:48.993409 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 HTTP/1.1 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5806d198-3978-4ea2-887b-c07a054c6d73'} Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:07:48.997043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:49.006223 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8627755-e0db-423d-8b24-fda7529ecb27 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 404 len: 111 microversion: 2.1 time: 0.144312 Sep 16 14:07:49.008725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.008725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.009059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.009843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.011384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.011571 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1416/2851] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:07:48 2022] DELETE /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:49.011755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.017707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:49.018831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:49.030895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.031945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.032711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.034397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.035248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.035595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.189566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:49.218098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:49.229145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:49.234608 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-65d23764-69a9-4c7f-82d3-6df45ace8d58 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.286696 Sep 16 14:07:49.235435 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1436/2852] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:48 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:49.249326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7ae519-0081-4bc0-aeab-9729b5cd5f3d", "tag": "550ae592-f15b-4702-a8eb-56a6eabe3b3b"}, {"name": "network-changed", "server_uuid": "3a7ae519-0081-4bc0-aeab-9729b5cd5f3d", "tag": "550ae592-f15b-4702-a8eb-56a6eabe3b3b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:49.274557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.276008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.277106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.310250 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] Creating event network-changed:550ae592-f15b-4702-a8eb-56a6eabe3b3b for instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d on n-h1-858129-2 Sep 16 14:07:49.311466 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] Creating event network-changed:550ae592-f15b-4702-a8eb-56a6eabe3b3b for instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d on n-h1-858129-2 Sep 16 14:07:49.320965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e148c429-9e82-4456-92cd-b4caa74a4e18 req-31a3b803-2831-4e68-a431-4721a5221609 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083619 Sep 16 14:07:49.323654 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1437/2853] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:49.333759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.86"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:49.340646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:49.353316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.355140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.367716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.372495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:49.373894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:49.378518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:49.413649 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-faf57db1-6d90-48ac-bca3-c0680d60cc9b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.398354 Sep 16 14:07:49.417433 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1417/2854] 10.222.0.60 () {58 vars in 1293 bytes} [Fri Sep 16 14:07:49 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d/os-security-groups => generated 1158 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:49.446447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:07:49.447556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquired lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:07:49.455440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80c28e2f-1b49-4b0b-83c5-cbf60abd710d tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724c3b5c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:49.506762 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-80c28e2f-1b49-4b0b-83c5-cbf60abd710d tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1918522272" status: 202 len: 0 microversion: 2.1 time: 0.087308 Sep 16 14:07:49.514088 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1418/2855] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 14:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1918522272 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:49.524690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-996f3ec9-0de7-4e29-ad14-e06c8399af8d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c424790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-690339680", "description": "tempest-description-1181335654"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:50.374482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7.", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:07:50.375840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Releasing lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:07:50.376466 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.376466 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Request method failure captured: Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action HTTP/1.1 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 45 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL-XX7BiHnbhFYU4KC15hTvr2HXJoP9D9e_AJReYdQib4KItx8zqWgZVNwGXsVeC22ws2RgTalrtx1_2eg255P42nlE-WeaUNJ9V-gD_AfdyNIvcV2qAtRbqd7__jXQiI5C6SLEHkrfBFRthV8GyhdqtdZHbSZ9zMV_SRhZKF3AJ3o Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd8ba9eb6c6a490b87715fb84d70af01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}] Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 07787fdb99a6449a8f9fd6095ecb73fc Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: {"addFloatingIp": {"address": "172.25.3.86"}} Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '43037068-4003-4085-ba94-3cc0b027c722', 'body': {'addFloatingIp': {'address': '172.25.3.86'}}} Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:07:50.378662 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] Sep 16 14:07:50.382237 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.389199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Returning 400 to user: Cannot associate floating IP 172.25.3.86 (71888d9c-3511-4dc9-ad23-20822070d321) with port 29d757e4-3e71-4eaa-bcc8-319ef877a467 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network e94f8ce7-f79e-45b6-8df0-31adffa70cd7. Sep 16 14:07:50.389199 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-05b5724c-75d8-442f-b673-e5b33d80a383'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:50.390580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1d3e6d0-271d-4227-825b-2b21d8daedcc tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action" status: 400 len: 380 microversion: 2.1 time: 1.065005 Sep 16 14:07:50.395524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1438/2856] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:07:49 2022] POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action => generated 380 bytes in 1071 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:07:50.401765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:50.403000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] [instance: 5806d198-3978-4ea2-887b-c07a054c6d73] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:50.411336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:50.412089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:50.412731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:50.413943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:50.414757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:50.416882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:50.436854 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 HTTP/1.1 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '5806d198-3978-4ea2-887b-c07a054c6d73'} Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:50.439357 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. Sep 16 14:07:50.446285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:50.450156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance 5806d198-3978-4ea2-887b-c07a054c6d73 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:50.455961 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-44910922-fbc6-400f-b9f1-e33300f0f55d tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73" status: 404 len: 111 microversion: 2.1 time: 0.057077 Sep 16 14:07:50.457458 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1439/2857] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:50 2022] GET /compute/v2.1/servers/5806d198-3978-4ea2-887b-c07a054c6d73 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:50.475941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-996f3ec9-0de7-4e29-ad14-e06c8399af8d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.959496 Sep 16 14:07:50.477894 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1419/2858] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:49 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:50.481052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d631b4d4-f6d8-4bf9-86e0-f243fd780f24 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c5fb1f0>, body: {"security_group": {"name": " tempest-securitygroup -1275031100 ", "description": "tempest-description-1383363768"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:50.492810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a87cd63-8235-42d7-a0fc-bd7cc5454b86 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724c4ac280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:50.565957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a87cd63-8235-42d7-a0fc-bd7cc5454b86 tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-303919218" status: 202 len: 0 microversion: 2.1 time: 0.086118 Sep 16 14:07:50.567069 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1420/2859] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:07:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-303919218 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:50.579902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:50.591350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:50.605118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:50.613038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:50.615563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:50.617963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:50.621097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:50.623310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:50.694110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:51.368995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:51.382603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c2eba71-2029-42be-83dc-8c39530aeff4 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1294 microversion: 2.1 time: 0.813902 Sep 16 14:07:51.386624 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1421/2860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:50 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1294 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:51.404670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:51.406393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:51.426379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:51.427094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:51.427559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:51.428325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:51.428794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:51.429222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:51.494186 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d631b4d4-f6d8-4bf9-86e0-f243fd780f24 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.027819 Sep 16 14:07:51.506730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1440/2861] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:50 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:51.506730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7446466a-df65-4b27-bf3e-adeb1a9d4173 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '.version_select at 0x7f724c6599d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:51.709837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:51.733740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:51.735684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:51.742918 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fc57c05-1786-4a04-b7c7-57d373930f13 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.352961 Sep 16 14:07:51.743873 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1422/2862] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:51 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:51.762587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3726904-7088-4467-8bfa-b804c5272091 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:51.781550 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f3726904-7088-4467-8bfa-b804c5272091 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance group ecdea081-4788-4e85-ad46-60c63b728d10 could not be found. Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3726904-7088-4467-8bfa-b804c5272091 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-server-groups/ecdea081-4788-4e85-ad46-60c63b728d10 HTTP/1.1 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance group ecdea081-4788-4e85-ad46-60c63b728d10 could not be found. Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ecdea081-4788-4e85-ad46-60c63b728d10'} Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ecdea081-4788-4e85-ad46-60c63b728d10 could not be found. Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ecdea081-4788-4e85-ad46-60c63b728d10 could not be found. Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:51.786958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:51.791194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:51.791194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:51.791194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:51.791194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:51.791194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ecdea081-4788-4e85-ad46-60c63b728d10 could not be found. Sep 16 14:07:51.791194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:51.794026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3726904-7088-4467-8bfa-b804c5272091 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance group ecdea081-4788-4e85-ad46-60c63b728d10 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:51.795270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3726904-7088-4467-8bfa-b804c5272091 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ecdea081-4788-4e85-ad46-60c63b728d10" status: 404 len: 117 microversion: 2.1 time: 0.050036 Sep 16 14:07:51.796071 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1423/2863] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:07:51 2022] DELETE /compute/v2.1/os-server-groups/ecdea081-4788-4e85-ad46-60c63b728d10 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:51.807007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1594095b-267c-4000-b988-14f6443abf2b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c3fa790>, body: {"security_group_rule": {"parent_group_id": "4bca7b19-d9b2-448f-a262-8635e4830d6e", "ip_protocol": "tcp", "from_port": 949695605, "to_port": 22}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:52.050185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1594095b-267c-4000-b988-14f6443abf2b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Invalid port range 949695605:22. Former value cannot be greater than the later Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1594095b-267c-4000-b988-14f6443abf2b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 145 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: {"security_group_rule": {"parent_group_id": "4bca7b19-d9b2-448f-a262-8635e4830d6e", "ip_protocol": "tcp", "from_port": 949695605, "to_port": 22}} Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid port range 949695605:22. Former value cannot be greater than the later Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4bca7b19-d9b2-448f-a262-8635e4830d6e', 'ip_protocol': 'tcp', 'from_port': 949695605, 'to_port': 22}}} Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 949695605:22. Former value cannot be greater than the later Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 949695605:22. Former value cannot be greater than the later Sep 16 14:07:52.070174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 949695605:22. Former value cannot be greater than the later Sep 16 14:07:52.077269 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.085225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1594095b-267c-4000-b988-14f6443abf2b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 400 to user: Invalid port range 949695605:22. Former value cannot be greater than the later {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:52.091844 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1594095b-267c-4000-b988-14f6443abf2b tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.294014 Sep 16 14:07:52.097563 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1424/2864] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:07:51 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:07:52.134095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eefc9a07-6b8b-4e2e-941e-e41f1c8ee89e tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] Calling method '.version_select at 0x7f724d322b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:52.193466 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eefc9a07-6b8b-4e2e-941e-e41f1c8ee89e tempest-KeyPairsV2TestJSON-431770088 tempest-KeyPairsV2TestJSON-431770088-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1724874903" status: 202 len: 0 microversion: 2.1 time: 0.092707 Sep 16 14:07:52.229525 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1425/2865] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 14:07:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1724874903 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:52.258810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1047c36c-ca72-40b8-99de-5256a0081435 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c51c790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:52.664481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1047c36c-ca72-40b8-99de-5256a0081435 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f" status: 200 len: 224 microversion: 2.1 time: 0.432426 Sep 16 14:07:52.665485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1426/2866] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:07:52 2022] GET /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f => generated 224 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:52.685490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-efa23ae5-57da-49f3-a626-fa95c122773d req-f4c24a94-4ec2-4f6f-83e6-c30f9703737b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd2365b-d9b7-4953-a237-a3d85f200de2", "name": "network-vif-plugged", "status": "completed", "tag": "94aad940-9b36-4476-b421-e2cfdb77136d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:52.717908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-efa23ae5-57da-49f3-a626-fa95c122773d req-f4c24a94-4ec2-4f6f-83e6-c30f9703737b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:52.720067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-efa23ae5-57da-49f3-a626-fa95c122773d req-f4c24a94-4ec2-4f6f-83e6-c30f9703737b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:52.721119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-efa23ae5-57da-49f3-a626-fa95c122773d req-f4c24a94-4ec2-4f6f-83e6-c30f9703737b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:52.756955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-efa23ae5-57da-49f3-a626-fa95c122773d req-f4c24a94-4ec2-4f6f-83e6-c30f9703737b service nova] Creating event network-vif-plugged:94aad940-9b36-4476-b421-e2cfdb77136d for instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 on n-h2-858129-2 Sep 16 14:07:52.773064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-efa23ae5-57da-49f3-a626-fa95c122773d req-f4c24a94-4ec2-4f6f-83e6-c30f9703737b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103973 Sep 16 14:07:52.776884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1427/2867] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:52.808065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64ecd2b5-72e8-49ee-b1fc-a4c3fc5e2734 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:52.873977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:52.877636 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-64ecd2b5-72e8-49ee-b1fc-a4c3fc5e2734 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance group da81751d-cf4f-4959-a4ba-933f70a45ff0 could not be found. Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64ecd2b5-72e8-49ee-b1fc-a4c3fc5e2734 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-server-groups/da81751d-cf4f-4959-a4ba-933f70a45ff0 HTTP/1.1 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance group da81751d-cf4f-4959-a4ba-933f70a45ff0 could not be found. Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'da81751d-cf4f-4959-a4ba-933f70a45ff0'} Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group da81751d-cf4f-4959-a4ba-933f70a45ff0 could not be found. Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group da81751d-cf4f-4959-a4ba-933f70a45ff0 could not be found. Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.885925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group da81751d-cf4f-4959-a4ba-933f70a45ff0 could not be found. Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64ecd2b5-72e8-49ee-b1fc-a4c3fc5e2734 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance group da81751d-cf4f-4959-a4ba-933f70a45ff0 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:52.890341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-64ecd2b5-72e8-49ee-b1fc-a4c3fc5e2734 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/da81751d-cf4f-4959-a4ba-933f70a45ff0" status: 404 len: 117 microversion: 2.1 time: 0.109341 Sep 16 14:07:52.897411 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1428/2868] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:07:52 2022] DELETE /compute/v2.1/os-server-groups/da81751d-cf4f-4959-a4ba-933f70a45ff0 => generated 117 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:52.907902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6aaddea8-61dc-4123-ac85-1ec801941f0d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f725175b670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-96526994", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:52.912696 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-6aaddea8-61dc-4123-ac85-1ec801941f0d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Security group id should be uuid Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6aaddea8-61dc-4123-ac85-1ec801941f0d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 129 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-96526994", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group id should be uuid Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-96526994', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:52.919494 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:52.928682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 16 14:07:52.928682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:52.928682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6aaddea8-61dc-4123-ac85-1ec801941f0d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 400 to user: Security group id should be uuid {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:52.928682 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6aaddea8-61dc-4123-ac85-1ec801941f0d tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.022564 Sep 16 14:07:52.928682 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1429/2869] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:07:52 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:07:52.933599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:52.938563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:52.939939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:52.956876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:52.957776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:52.958669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:52.960023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:52.960949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:52.961862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:53.407619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:53.422048 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f72cb27e-ad75-4bc3-bd88-b5b86cd0eccb tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1294 microversion: 2.1 time: 0.496737 Sep 16 14:07:53.423253 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1430/2870] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:52 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1294 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:53.436803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59fac490-8332-403d-8067-4a527ae0a167 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c43e670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:54.827594 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59fac490-8332-403d-8067-4a527ae0a167 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f" status: 202 len: 0 microversion: 2.1 time: 1.402404 Sep 16 14:07:54.836317 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1431/2871] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:07:53 2022] DELETE /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f => generated 0 bytes in 1412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:54.866136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:54.868376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:54.918124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:54.920879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:54.925482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:54.927298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:54.933962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:54.935370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:54.989496 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7446466a-df65-4b27-bf3e-adeb1a9d4173 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/71888d9c-3511-4dc9-ad23-20822070d321" status: 202 len: 0 microversion: 2.1 time: 3.493257 Sep 16 14:07:54.990374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1441/2872] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:07:51 2022] DELETE /compute/v2.1/os-floating-ips/71888d9c-3511-4dc9-ad23-20822070d321 => generated 0 bytes in 3495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:07:54.999037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9928d3d-2378-4d04-ae2c-312d6156d70c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:55.015810 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f9928d3d-2378-4d04-ae2c-312d6156d70c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance group 611cb122-a07f-458a-873c-4eb1d17724ef could not be found. Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9928d3d-2378-4d04-ae2c-312d6156d70c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-server-groups/611cb122-a07f-458a-873c-4eb1d17724ef HTTP/1.1 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance group 611cb122-a07f-458a-873c-4eb1d17724ef could not be found. Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '611cb122-a07f-458a-873c-4eb1d17724ef'} Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 611cb122-a07f-458a-873c-4eb1d17724ef could not be found. Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 611cb122-a07f-458a-873c-4eb1d17724ef could not be found. Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.027131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.031314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:55.031314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:55.031314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:55.031314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:55.031314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 611cb122-a07f-458a-873c-4eb1d17724ef could not be found. Sep 16 14:07:55.031314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.033382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9928d3d-2378-4d04-ae2c-312d6156d70c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance group 611cb122-a07f-458a-873c-4eb1d17724ef could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:55.034753 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9928d3d-2378-4d04-ae2c-312d6156d70c tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/611cb122-a07f-458a-873c-4eb1d17724ef" status: 404 len: 117 microversion: 2.1 time: 0.043109 Sep 16 14:07:55.038495 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1442/2873] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:07:54 2022] DELETE /compute/v2.1/os-server-groups/611cb122-a07f-458a-873c-4eb1d17724ef => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:55.051936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70dbb133-045a-43d5-8df6-ec6fee9b7a80 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724db31c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1700060165", "description": "tempest-description-2046706346"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:55.122910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:55.139146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:55.145597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:55.149520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba2c3355-1733-45d7-98be-5cf9e56ff762 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.311421 Sep 16 14:07:55.151135 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1432/2874] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:54 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:55.161012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:55.162126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:55.174448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:55.175339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:55.176049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:55.177212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:55.177928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:55.178644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:55.682266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:55.700260 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7d2253e-cfe9-4f90-bc60-822f2613db16 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1294 microversion: 2.1 time: 0.540297 Sep 16 14:07:55.702454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1433/2875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:55 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1294 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:55.732276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c447ca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:55.810237 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70dbb133-045a-43d5-8df6-ec6fee9b7a80 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.770129 Sep 16 14:07:55.812882 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1443/2876] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:55 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:55.818246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.242"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:55.829800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:07:55.841792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.security_group_api [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f not found {{(pid=128642) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:07:55.842713 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.842713 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f HTTP/1.1 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '78eb41dd-dc5c-46b7-9bf6-5133a33dc62f'} Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:07:55.845301 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:07:55.849809 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-abd1cfaf-15e0-4375-b9d6-4e743e68114d'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:55.854936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44efb044-fbc5-46b1-b16b-7c00210171f6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f" status: 404 len: 194 microversion: 2.1 time: 0.135906 Sep 16 14:07:55.854936 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1434/2877] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:07:55 2022] GET /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f => generated 194 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:55.865731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7317632-b55a-4e37-a469-060b578e8cfe tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:55.884240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-c7317632-b55a-4e37-a469-060b578e8cfe tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] HTTP exception thrown: Instance group 3b7ed35f-b278-432f-baa8-26f1e3fe6182 could not be found. Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7317632-b55a-4e37-a469-060b578e8cfe tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Request method failure captured: Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-server-groups/3b7ed35f-b278-432f-baa8-26f1e3fe6182 HTTP/1.1 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILr2GMGFPJja_l1Xt8jQHLrC66XgUKlPeiwhwPcDgmAGqbmmd_JqCz5J8spiYI6N5SMXnonOSG9VhKlqCORQ6EJZNpO6s4XXcili58wlPxN0BWZNo2viw3S79pwMx7DUY2Wj-Jp07Ohnokju2fLY0LYvDA3v02anOCBvEYsAYDCMbM Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b65fa3fcf2243b285012ef6fdda1034", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b65fa3fcf2243b285012ef6fdda1034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b65fa3fcf2243b285012ef6fdda1034"}]}] Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1b65fa3fcf2243b285012ef6fdda1034 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerGroupTestJSON-1054921769 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8188562af9e84f929aef6a8f852660e8 Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerGroupTestJSON-1054921769-project Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance group 3b7ed35f-b278-432f-baa8-26f1e3fe6182 could not be found. Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3b7ed35f-b278-432f-baa8-26f1e3fe6182'} Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3b7ed35f-b278-432f-baa8-26f1e3fe6182 could not be found. Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3b7ed35f-b278-432f-baa8-26f1e3fe6182 could not be found. Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.886710 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3b7ed35f-b278-432f-baa8-26f1e3fe6182 could not be found. Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7317632-b55a-4e37-a469-060b578e8cfe tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Returning 404 to user: Instance group 3b7ed35f-b278-432f-baa8-26f1e3fe6182 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:55.890701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7317632-b55a-4e37-a469-060b578e8cfe tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/3b7ed35f-b278-432f-baa8-26f1e3fe6182" status: 404 len: 117 microversion: 2.1 time: 0.027828 Sep 16 14:07:55.900539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1435/2878] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:07:55 2022] DELETE /compute/v2.1/os-server-groups/3b7ed35f-b278-432f-baa8-26f1e3fe6182 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:07:55.906307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7fad038-db10-409e-818c-4df48a309571 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724d1bfdc0>, body: {"security_group_rule": {"parent_group_id": "8641c48f-5bc8-4d66-8aaa-c0241063c92d", "ip_protocol": "tempest-999-845448617", "from_port": 22, "to_port": 22}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:56.048433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:07:56.093070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-c7fad038-db10-409e-818c-4df48a309571 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Invalid IP protocol tempest-999-845448617. Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7fad038-db10-409e-818c-4df48a309571 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 156 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: {"security_group_rule": {"parent_group_id": "8641c48f-5bc8-4d66-8aaa-c0241063c92d", "ip_protocol": "tempest-999-845448617", "from_port": 22, "to_port": 22}} Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid IP protocol tempest-999-845448617. Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8641c48f-5bc8-4d66-8aaa-c0241063c92d', 'ip_protocol': 'tempest-999-845448617', 'from_port': 22, 'to_port': 22}}} Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-845448617. Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-845448617. Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:56.095323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-845448617. Sep 16 14:07:56.099228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:56.101503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7fad038-db10-409e-818c-4df48a309571 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 400 to user: Invalid IP protocol tempest-999-845448617. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:56.103025 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7fad038-db10-409e-818c-4df48a309571 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.201014 Sep 16 14:07:56.111388 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1436/2879] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:07:55 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:07:56.117680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93278447-70f3-4e1b-90c3-f1c1e166fdfd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c3ceee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1839619878", "description": "tempest-description-802700041"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:56.337058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:56.348455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:56.353130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:56.354358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:56.355481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:56.356253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:56.356923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:56.644394 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93278447-70f3-4e1b-90c3-f1c1e166fdfd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.531434 Sep 16 14:07:56.645018 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1437/2880] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:56.669581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7766ed03-ee5d-48e1-8e8b-872618e61d41 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:56.777269 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7766ed03-ee5d-48e1-8e8b-872618e61d41 tempest-ServerGroupTestJSON-1054921769 tempest-ServerGroupTestJSON-1054921769-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/d080e2c2-c4e2-40d9-96aa-c3bd57fff42e" status: 204 len: 0 microversion: 2.1 time: 0.123950 Sep 16 14:07:56.783403 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1438/2881] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:07:56 2022] DELETE /compute/v2.1/os-server-groups/d080e2c2-c4e2-40d9-96aa-c3bd57fff42e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:07:56.788709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff454d86-3689-4882-9a38-ed74479655d6 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c3ceee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-431044389", "description": "tempest-description-1351035355"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:56.874349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:07:56.875393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquired lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:07:57.558340 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff454d86-3689-4882-9a38-ed74479655d6 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.779300 Sep 16 14:07:57.559181 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1439/2882] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:56 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:57.574317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:57.575435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:57.590144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:57.591196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:57.592118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:57.593157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:57.596205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:57.598235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:57.782719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:57.801172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:57.805532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7495b1a889034a07a4b40f871ddc701f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289bec6033074acb97a59abc8bd0ee1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:57.813975 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-726a9873-a7f3-49f1-8c8c-1f2f9ccdf461 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 200 len: 1604 microversion: 2.32 time: 0.250354 Sep 16 14:07:57.814742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1440/2883] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:57 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:07:57.824516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0983e2c6-0bd5-41af-b809-3a367ced8e35 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c4473a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-120922509", "description": "tempest-description-745149623"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:58.455474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Building network info cache for instance {{(pid=128643) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:07:58.480906 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0983e2c6-0bd5-41af-b809-3a367ced8e35 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.664919 Sep 16 14:07:58.481832 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1441/2884] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:58.503047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:58.506381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:58.523261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:58.528466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:58.529173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:58.530157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:58.536363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:58.547102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:58.907533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:07:58.934766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2c4fc00-4210-4de8-84bb-bd0962573454 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1485 microversion: 2.1 time: 0.449155 Sep 16 14:07:58.946998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1442/2885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:07:58 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1485 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:07:59.350092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:59.352350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.354635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.362763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:59.371695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.372470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.373127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:59.434355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54a056d1-0c55-4eaa-b4c8-d4c883e5e869 tempest-AZV2TestJSON-870751112 tempest-AZV2TestJSON-870751112-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.482634 Sep 16 14:07:59.435327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1443/2886] 10.222.0.60 () {58 vars in 1164 bytes} [Fri Sep 16 14:07:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:07:59.472642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95373845-9f31-49b2-9210-e6da8e160eab tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c3d4ca0>, body: {"security_group_rule": {"parent_group_id": "b10abb95-54ca-4111-a207-07dd8bd7b72a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:59.505011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Updating instance_info_cache with network_info: [{"id": "29d757e4-3e71-4eaa-bcc8-319ef877a467", "address": "fa:16:3e:cd:eb:a0", "network": {"id": "7f2e04b7-fc6e-4a4b-a083-0345699a23f6", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-711628865-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dd8ba9eb6c6a490b87715fb84d70af01", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap29d757e4-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128643) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:07:59.523185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Releasing lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:07:59.525198 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55457313-8df3-47ea-ab0e-bab9bce39fde tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action" status: 202 len: 0 microversion: 2.1 time: 3.710960 Sep 16 14:07:59.526772 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1444/2887] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:07:55 2022] POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action => generated 0 bytes in 3713 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:07:59.536097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5bf1a926-74ad-4e86-9bec-7b2556aa7103 req-15c1491d-0336-40ad-bac3-294de49e9675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43037068-4003-4085-ba94-3cc0b027c722", "tag": "29d757e4-3e71-4eaa-bcc8-319ef877a467"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:59.568271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5bf1a926-74ad-4e86-9bec-7b2556aa7103 req-15c1491d-0336-40ad-bac3-294de49e9675 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.569691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5bf1a926-74ad-4e86-9bec-7b2556aa7103 req-15c1491d-0336-40ad-bac3-294de49e9675 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.570367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5bf1a926-74ad-4e86-9bec-7b2556aa7103 req-15c1491d-0336-40ad-bac3-294de49e9675 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:59.589308 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5bf1a926-74ad-4e86-9bec-7b2556aa7103 req-15c1491d-0336-40ad-bac3-294de49e9675 service nova] Creating event network-changed:29d757e4-3e71-4eaa-bcc8-319ef877a467 for instance 43037068-4003-4085-ba94-3cc0b027c722 on n-h2-858129-2 Sep 16 14:07:59.604317 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5bf1a926-74ad-4e86-9bec-7b2556aa7103 req-15c1491d-0336-40ad-bac3-294de49e9675 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075600 Sep 16 14:07:59.606575 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1445/2888] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:07:59.615542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6348c8b3-0c74-48f0-8c8f-d8aa2ff20f81 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724d339ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1463068941", "description": "tempest-description-1344285085"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:07:59.784485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-95373845-9f31-49b2-9210-e6da8e160eab tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95373845-9f31-49b2-9210-e6da8e160eab tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 138 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: {"security_group_rule": {"parent_group_id": "b10abb95-54ca-4111-a207-07dd8bd7b72a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b10abb95-54ca-4111-a207-07dd8bd7b72a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 14:07:59.786147 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95373845-9f31-49b2-9210-e6da8e160eab tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-95373845-9f31-49b2-9210-e6da8e160eab tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.333442 Sep 16 14:07:59.792203 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1444/2889] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:07:59 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:07:59.798477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:59.799116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:59.823882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.824604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.825398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:59.826374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.828648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.829360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:59.851967 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] HTTP exception thrown: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Request method failure captured: Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d HTTP/1.1 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIE-dKNrPi235M1zScKZJXqMT8BrWcr3xM5PyWcmUTdT3h5XgjM242pSsRcTH01-EY5Cb8V8RPw7ezT9YfQdGOR7AgSuyKQjW7sELVVVxv-BBUzZ2AMHbYQpp1gW0PTMUGSx9rAI4lVHDQPnvNzLXCWLWSvyF3SoCcJt2_GSumyiG7g Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.32 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 289bec6033074acb97a59abc8bd0ee1d Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_289bec6033074acb97a59abc8bd0ee1d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/289bec6033074acb97a59abc8bd0ee1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/289bec6033074acb97a59abc8bd0ee1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/289bec6033074acb97a59abc8bd0ee1d"}]}] Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 289bec6033074acb97a59abc8bd0ee1d Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TaggedBootDevicesTest-1993957224-project Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7495b1a889034a07a4b40f871ddc701f Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TaggedBootDevicesTest-1993957224-project Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0ac2334e-4371-4b54-8482-752a508e6d9d'} Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.855039 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:07:59.859610 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:07:59.861077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Returning 404 to user: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:07:59.863241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6523bd9-df02-4c79-bc82-caa5d1b59361 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 404 len: 111 microversion: 2.32 time: 0.072950 Sep 16 14:07:59.865564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1445/2890] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:07:59 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:07:59.872302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:07:59.873097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:07:59.882250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.883198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.884147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:07:59.885159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:07:59.885854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:07:59.886493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:00.014444 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c07d1c2-a16d-40dc-9656-dca3c1247a09 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147118 Sep 16 14:08:00.015342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1446/2891] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:07:59 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:00.032338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f75f077a-1532-4435-9674-571699172ba0 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '.version_select at 0x7f724c4ec670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:00.840106 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6348c8b3-0c74-48f0-8c8f-d8aa2ff20f81 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.231827 Sep 16 14:08:00.840842 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1446/2892] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:07:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:00.854986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45021936-c00b-4f85-adbb-0e1f4d9a131e tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724db31dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-318615255", "description": "tempest-description-335844928"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:01.709460 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45021936-c00b-4f85-adbb-0e1f4d9a131e tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.859077 Sep 16 14:08:01.710239 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1447/2893] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:08:00 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:01.723251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8b068b2-e08c-4eb8-bce7-cd728dd8e138 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '.version_select at 0x7f724c5fb430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:01.738902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:01.755216 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8b068b2-e08c-4eb8-bce7-cd728dd8e138 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624999119" status: 204 len: 0 microversion: 2.32 time: 0.043175 Sep 16 14:08:01.760847 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1448/2894] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 14:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624999119 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:08:01.767847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-92bc0b89-bfee-40bb-b04a-0ef0adc7309a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f72517cc040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:04.161310 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-92bc0b89-bfee-40bb-b04a-0ef0adc7309a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 2.398330 Sep 16 14:08:04.162296 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1449/2895] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 14:08:01 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:04.177621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ab76874-0595-4737-8acc-604a6215e946 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724d339dc0>, body: {"security_group_rule": {"parent_group_id": "7da94e9c-a337-4cb3-9f44-75e15d8626bc", "ip_protocol": "tcp", "from_port": 22, "to_port": 1850988425}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:04.643734 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f75f077a-1532-4435-9674-571699172ba0 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/29279222-c295-4367-a31a-d553585690a3" status: 202 len: 0 microversion: 2.1 time: 4.624165 Sep 16 14:08:04.645305 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1447/2896] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:08:00 2022] DELETE /compute/v2.1/os-floating-ips/29279222-c295-4367-a31a-d553585690a3 => generated 0 bytes in 4630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:04.652428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d171cfb-8225-4cf5-8839-8786a88c855a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c49caf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:04.676661 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-0ab76874-0595-4737-8acc-604a6215e946 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Invalid port range 22:1850988425. Valid TCP ports should be between 1-65535 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ab76874-0595-4737-8acc-604a6215e946 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 146 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: {"security_group_rule": {"parent_group_id": "7da94e9c-a337-4cb3-9f44-75e15d8626bc", "ip_protocol": "tcp", "from_port": 22, "to_port": 1850988425}} Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid port range 22:1850988425. Valid TCP ports should be between 1-65535 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7da94e9c-a337-4cb3-9f44-75e15d8626bc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1850988425}}} Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1850988425. Valid TCP ports should be between 1-65535 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1850988425. Valid TCP ports should be between 1-65535 Sep 16 14:08:04.679885 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1850988425. Valid TCP ports should be between 1-65535 Sep 16 14:08:04.685860 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.689018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ab76874-0595-4737-8acc-604a6215e946 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 400 to user: Invalid port range 22:1850988425. Valid TCP ports should be between 1-65535 {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:04.693200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0ab76874-0595-4737-8acc-604a6215e946 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.519590 Sep 16 14:08:04.699129 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1450/2897] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:08:04 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 536 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:08:04.748560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd19cf46-e579-4e1a-8ff4-54d3634f6a8a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd19cf46-e579-4e1a-8ff4-54d3634f6a8a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Request method failure captured: Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action HTTP/1.1 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 34 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL-XX7BiHnbhFYU4KC15hTvr2HXJoP9D9e_AJReYdQib4KItx8zqWgZVNwGXsVeC22ws2RgTalrtx1_2eg255P42nlE-WeaUNJ9V-gD_AfdyNIvcV2qAtRbqd7__jXQiI5C6SLEHkrfBFRthV8GyhdqtdZHbSZ9zMV_SRhZKF3AJ3o Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd8ba9eb6c6a490b87715fb84d70af01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}] Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 07787fdb99a6449a8f9fd6095ecb73fc Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: {"addFloatingIp": {"address": ""}} Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '43037068-4003-4085-ba94-3cc0b027c722', 'body': {'addFloatingIp': {'address': ''}}} Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi '' Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:08:04.771762 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 16 14:08:04.787379 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:04.813054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd19cf46-e579-4e1a-8ff4-54d3634f6a8a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:04.816162 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd19cf46-e579-4e1a-8ff4-54d3634f6a8a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action" status: 400 len: 142 microversion: 2.1 time: 0.113512 Sep 16 14:08:04.818856 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1451/2898] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:08:04 2022] POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action => generated 142 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:08:04.832840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Action: 'create', calling method: .version_select at 0x7f724c5fb820>, body: {"security_group_rule": {"parent_group_id": "efddaffa-d209-46f0-96ae-438cc66cc171", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:05.023465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:08:05.024835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Neutron security group efddaffa-d209-46f0-96ae-438cc66cc171 not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:08:05.026537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.026537 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 138 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: {"security_group_rule": {"parent_group_id": "efddaffa-d209-46f0-96ae-438cc66cc171", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'efddaffa-d209-46f0-96ae-438cc66cc171', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:08:05.031285 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] Sep 16 14:08:05.037224 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.044318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 404 to user: Security group efddaffa-d209-46f0-96ae-438cc66cc171 does not exist Sep 16 14:08:05.044318 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-08f8c2b5-08d4-4f81-a406-1aab496d1c68'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:05.059730 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-588ccde7-d38c-4f3c-af2f-4c7ace88102f tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.233239 Sep 16 14:08:05.060831 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1452/2899] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:08:04 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:08:05.082352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:05.093385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:05.120788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:05.122849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:05.128394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:05.129630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:05.130367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:05.131334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:05.214595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:08:05.216092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquired lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:08:05.617642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Releasing lock "refresh_cache-43037068-4003-4085-ba94-3cc0b027c722" {{(pid=128643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:08:05.619635 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] HTTP exception thrown: floating IP not found Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Request method failure captured: Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action HTTP/1.1 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 41 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL-XX7BiHnbhFYU4KC15hTvr2HXJoP9D9e_AJReYdQib4KItx8zqWgZVNwGXsVeC22ws2RgTalrtx1_2eg255P42nlE-WeaUNJ9V-gD_AfdyNIvcV2qAtRbqd7__jXQiI5C6SLEHkrfBFRthV8GyhdqtdZHbSZ9zMV_SRhZKF3AJ3o Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd8ba9eb6c6a490b87715fb84d70af01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}] Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 07787fdb99a6449a8f9fd6095ecb73fc Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: exception: floating IP not found Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '43037068-4003-4085-ba94-3cc0b027c722', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 16 14:08:05.623288 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Returning 404 to user: floating IP not found {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b7b0c84-e210-4485-bbc2-11c58e8a82e5 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action" status: 404 len: 67 microversion: 2.1 time: 0.561539 Sep 16 14:08:05.635262 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1453/2900] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:08:05 2022] POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action => generated 67 bytes in 564 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:08:05.648611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:05.649805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:05.675736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:05.676639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:05.677432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:05.678779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:05.679653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:05.680439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:06.115994 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d171cfb-8225-4cf5-8839-8786a88c855a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638" status: 202 len: 0 microversion: 2.1 time: 1.468571 Sep 16 14:08:06.117051 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1448/2901] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:04 2022] DELETE /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638 => generated 0 bytes in 1471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:06.143229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7558c46e-ae39-41b7-b0a5-0d53d2c2fed2 req-e6f43650-14ba-4aaf-884b-c24c401292fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd2365b-d9b7-4953-a237-a3d85f200de2", "tag": "94aad940-9b36-4476-b421-e2cfdb77136d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:06.192066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7558c46e-ae39-41b7-b0a5-0d53d2c2fed2 req-e6f43650-14ba-4aaf-884b-c24c401292fe service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:06.200446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7558c46e-ae39-41b7-b0a5-0d53d2c2fed2 req-e6f43650-14ba-4aaf-884b-c24c401292fe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:06.201386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7558c46e-ae39-41b7-b0a5-0d53d2c2fed2 req-e6f43650-14ba-4aaf-884b-c24c401292fe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:06.262152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7558c46e-ae39-41b7-b0a5-0d53d2c2fed2 req-e6f43650-14ba-4aaf-884b-c24c401292fe service nova] Creating event network-changed:94aad940-9b36-4476-b421-e2cfdb77136d for instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 on n-h2-858129-2 Sep 16 14:08:06.285090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7558c46e-ae39-41b7-b0a5-0d53d2c2fed2 req-e6f43650-14ba-4aaf-884b-c24c401292fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165440 Sep 16 14:08:06.288169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1449/2902] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:06.330908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724c4471f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:06.437392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:06.463151 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06bdccb6-44d9-4fe9-94cf-3d35438f793e tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1485 microversion: 2.1 time: 0.833651 Sep 16 14:08:06.470201 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1454/2903] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:05 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1485 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:06.492455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bec4adb-aa5f-4279-9414-3989384ac23c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:06.496773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:08:06.499133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.security_group_api [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Neutron security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c not found {{(pid=128642) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 16 14:08:06.500115 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] HTTP exception thrown: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.500115 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Request method failure captured: Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-security-group-rules/7022b01e-2067-4ba7-b8c1-34491813d70c HTTP/1.1 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIMpovwK1acZwC2ds9oF1aAjfSBZmcDmSLEW14ef38BdQAx8XnPXm9wtWHHG9liCE5U3mhi5f2dHfnSVAZKg7auPimdrHC8yvKBOvMHVq5K_RUzCoQJ--JdycHcaWYeW4uGQfGRVmkNVFvS_9URxuoAe3wr5TjVMJHfW5VxArQlLQqQ Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6b2b70dc19442d190708b99fe5712ed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6b2b70dc19442d190708b99fe5712ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6b2b70dc19442d190708b99fe5712ed"}]}] Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6b2b70dc19442d190708b99fe5712ed Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: af5c7c40f17b4560b86e1bab1c5e7d5b Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-971089468-project Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7022b01e-2067-4ba7-b8c1-34491813d70c'} Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:08:06.503271 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Returning 404 to user: Security group rule 7022b01e-2067-4ba7-b8c1-34491813d70c does not exist Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-99a0b89e-7af8-4a76-a802-1fff4e8f467f'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4fe8575e-e14f-4b6a-ae56-48fdb3990036 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/7022b01e-2067-4ba7-b8c1-34491813d70c" status: 404 len: 199 microversion: 2.1 time: 0.209071 Sep 16 14:08:06.513060 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1450/2904] 10.222.0.60 () {58 vars in 1287 bytes} [Fri Sep 16 14:08:06 2022] DELETE /compute/v2.1/os-security-group-rules/7022b01e-2067-4ba7-b8c1-34491813d70c => generated 199 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:08:06.526830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c4dd430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:06.738606 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-7bec4adb-aa5f-4279-9414-3989384ac23c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bec4adb-aa5f-4279-9414-3989384ac23c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Request method failure captured: Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action HTTP/1.1 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 44 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL-XX7BiHnbhFYU4KC15hTvr2HXJoP9D9e_AJReYdQib4KItx8zqWgZVNwGXsVeC22ws2RgTalrtx1_2eg255P42nlE-WeaUNJ9V-gD_AfdyNIvcV2qAtRbqd7__jXQiI5C6SLEHkrfBFRthV8GyhdqtdZHbSZ9zMV_SRhZKF3AJ3o Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd8ba9eb6c6a490b87715fb84d70af01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}] Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 07787fdb99a6449a8f9fd6095ecb73fc Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: exception: Floating IP not found for address 0.0.0.0. Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '43037068-4003-4085-ba94-3cc0b027c722', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 16 14:08:06.742708 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 16 14:08:06.751496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.755464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bec4adb-aa5f-4279-9414-3989384ac23c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:06.756986 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7bec4adb-aa5f-4279-9414-3989384ac23c tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action" status: 404 len: 88 microversion: 2.1 time: 0.285037 Sep 16 14:08:06.761234 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1455/2905] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:08:06 2022] POST /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722/action => generated 88 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:08:06.768110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:08:06.768948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.security_group_api [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group dc92b004-3c94-4496-b884-e5f1e3802638 not found {{(pid=128642) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:08:06.769547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.769547 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638 HTTP/1.1 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'dc92b004-3c94-4496-b884-e5f1e3802638'} Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:08:06.772297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] Sep 16 14:08:06.779186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:06.782683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9cc6c680-f4eb-4470-907f-c7c335392fa5 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724d37b5e0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:06.782980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:08:06.782980 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-6b93e9a2-bc7d-42f1-8650-b860fd73a39f'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:06.782980 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2eafb7eb-aada-4ad0-81ea-54be009a6989 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638" status: 404 len: 194 microversion: 2.1 time: 0.267034 Sep 16 14:08:06.782980 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1451/2906] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:08:06 2022] GET /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638 => generated 194 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:08:06.817275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:06.818452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:06.844124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:06.844917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:06.845861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:06.847481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:06.848324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:06.849102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:06.941529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:08:07.174030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-169a5e5f-99e5-41be-9b95-753b2015153a tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "DELETE /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 204 len: 0 microversion: 2.1 time: 0.385352 Sep 16 14:08:07.176354 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1452/2907] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:08:06 2022] DELETE /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:08:07.189574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-127a82fa-3122-4574-ba0f-d0b8a2f899d2 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c3d4ca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:08.368567 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-127a82fa-3122-4574-ba0f-d0b8a2f899d2 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3" status: 202 len: 0 microversion: 2.1 time: 1.190574 Sep 16 14:08:08.373731 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1453/2908] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:07 2022] DELETE /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3 => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:08.388728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:08.391045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:08.413057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:08.413636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:08.414091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:08.421144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:08.422761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:08.424281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:08.437393 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9cc6c680-f4eb-4470-907f-c7c335392fa5 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7da94e9c-a337-4cb3-9f44-75e15d8626bc" status: 202 len: 0 microversion: 2.1 time: 1.674225 Sep 16 14:08:08.437973 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1456/2909] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:06 2022] DELETE /compute/v2.1/os-security-groups/7da94e9c-a337-4cb3-9f44-75e15d8626bc => generated 0 bytes in 1676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:08.450326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c67ad30>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:08.592511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:08:08.593501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:08:08.595693 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.595693 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3 HTTP/1.1 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '596f1f0c-e0da-4741-bc41-1507ff2f6ad3'} Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:08:08.598608 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] Sep 16 14:08:08.603566 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:08.608536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:08:08.608536 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-326682e1-18c6-4842-a783-8615ca8679c0'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:08.614919 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ad2c5f8-6054-4c59-a479-66bcfc48b0b6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3" status: 404 len: 194 microversion: 2.1 time: 0.170764 Sep 16 14:08:08.618165 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1457/2910] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:08:08 2022] GET /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:08:08.635908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a219310e-0e3a-4d18-9e0f-bff31274da20 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724d37b670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:08.983888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:09.000992 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1434fd75-0e55-40cf-8603-b4aeef4dca32 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1540 microversion: 2.1 time: 0.622990 Sep 16 14:08:09.006868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1454/2911] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:08 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1540 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:09.015203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8c55b39-b4b8-4228-9204-28def64d5669 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c3f4ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:09.390664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:10.031785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a219310e-0e3a-4d18-9e0f-bff31274da20 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b10abb95-54ca-4111-a207-07dd8bd7b72a" status: 202 len: 0 microversion: 2.1 time: 1.409188 Sep 16 14:08:10.037293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1458/2912] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:08 2022] DELETE /compute/v2.1/os-security-groups/b10abb95-54ca-4111-a207-07dd8bd7b72a => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:10.079561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:10.086908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:10.121454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:10.124414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:10.126728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:10.129988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:10.132788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:10.134779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:10.146759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:10.671842 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8c55b39-b4b8-4228-9204-28def64d5669 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea" status: 202 len: 0 microversion: 2.1 time: 1.662244 Sep 16 14:08:10.672490 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1455/2913] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:09 2022] DELETE /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea => generated 0 bytes in 1665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:10.678618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67171ae0-5545-4028-86a2-8a03e9fc1346 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724c37c3a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:11.021230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:11.052945 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73792c06-6295-42fa-9ede-0fc84a432401 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1540 microversion: 2.1 time: 1.012977 Sep 16 14:08:11.060152 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1459/2914] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:10 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1540 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:11.079783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d433a60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:11.368991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:08:11.370357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group b2ca63ff-5e3e-4724-821f-dfe6399436ea not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:08:11.371645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.371645 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea HTTP/1.1 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b2ca63ff-5e3e-4724-821f-dfe6399436ea'} Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:08:11.375896 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] Sep 16 14:08:11.383880 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:11.396663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:08:11.396663 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-5f7d1e6a-ff98-412f-b0ff-1782eefddd26'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:11.399132 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b06060a4-b1bb-4ba2-b167-eb1c90dca9ce tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea" status: 404 len: 194 microversion: 2.1 time: 0.336652 Sep 16 14:08:11.401377 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1460/2915] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:08:11 2022] GET /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea => generated 194 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:08:11.413548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97ef8d8c-fb43-4fc1-911e-84db4e74a60e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d3cd1f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:12.030774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67171ae0-5545-4028-86a2-8a03e9fc1346 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/8641c48f-5bc8-4d66-8aaa-c0241063c92d" status: 202 len: 0 microversion: 2.1 time: 1.357037 Sep 16 14:08:12.032501 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1456/2916] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:10 2022] DELETE /compute/v2.1/os-security-groups/8641c48f-5bc8-4d66-8aaa-c0241063c92d => generated 0 bytes in 1359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:12.047193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b2de5e2-9137-4e08-9a05-a17bfa90bf99 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724c37c8b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:13.141905 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97ef8d8c-fb43-4fc1-911e-84db4e74a60e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.735158 Sep 16 14:08:13.155780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1461/2917] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 14:08:11 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:13.169488 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b2de5e2-9137-4e08-9a05-a17bfa90bf99 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4bca7b19-d9b2-448f-a262-8635e4830d6e" status: 202 len: 0 microversion: 2.1 time: 1.131607 Sep 16 14:08:13.170326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1457/2918] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:12 2022] DELETE /compute/v2.1/os-security-groups/4bca7b19-d9b2-448f-a262-8635e4830d6e => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:08:13.175725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f61c47d-7feb-4a96-927d-68991622086c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c37ce50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1656862946", "description": "tempest-description-1478006338"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:13.188328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:13.189505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:13.217803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:13.219264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:13.222527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:13.228561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:13.229908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:13.231041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:13.530387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07787fdb99a6449a8f9fd6095ecb73fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8ba9eb6c6a490b87715fb84d70af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:13.566799 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38a7bf09-b0ac-473e-b9ba-531a914f64ab tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 200 len: 1498 microversion: 2.1 time: 0.408844 Sep 16 14:08:13.569067 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1462/2919] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:13 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 1498 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:13.581705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4bf6896-60f2-4666-9873-3fc3b676a371 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] Calling method '.version_select at 0x7f724d35e8b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:14.627431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f61c47d-7feb-4a96-927d-68991622086c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.456011 Sep 16 14:08:14.629233 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1458/2920] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:08:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:15.036582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-382a86c4-9008-440b-bab3-ccc1b3ea781c req-ba9a2a65-a7db-4ef8-a0be-6437e5122a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43037068-4003-4085-ba94-3cc0b027c722", "name": "network-vif-deleted", "tag": "29d757e4-3e71-4eaa-bcc8-319ef877a467"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:15.059687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-382a86c4-9008-440b-bab3-ccc1b3ea781c req-ba9a2a65-a7db-4ef8-a0be-6437e5122a2b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:15.060946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-382a86c4-9008-440b-bab3-ccc1b3ea781c req-ba9a2a65-a7db-4ef8-a0be-6437e5122a2b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:15.061967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-382a86c4-9008-440b-bab3-ccc1b3ea781c req-ba9a2a65-a7db-4ef8-a0be-6437e5122a2b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:15.085394 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-382a86c4-9008-440b-bab3-ccc1b3ea781c req-ba9a2a65-a7db-4ef8-a0be-6437e5122a2b service nova] Creating event network-vif-deleted:29d757e4-3e71-4eaa-bcc8-319ef877a467 for instance 43037068-4003-4085-ba94-3cc0b027c722 on n-h2-858129-2 Sep 16 14:08:15.105941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-382a86c4-9008-440b-bab3-ccc1b3ea781c req-ba9a2a65-a7db-4ef8-a0be-6437e5122a2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463344 Sep 16 14:08:15.113171 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1459/2921] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:15.131267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:15.135957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] [instance: 43037068-4003-4085-ba94-3cc0b027c722] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:15.161758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:15.163268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:15.166249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:15.169581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:15.175882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:15.176965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:15.210792 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] HTTP exception thrown: Instance 43037068-4003-4085-ba94-3cc0b027c722 could not be found. Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Request method failure captured: Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 HTTP/1.1 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIL-XX7BiHnbhFYU4KC15hTvr2HXJoP9D9e_AJReYdQib4KItx8zqWgZVNwGXsVeC22ws2RgTalrtx1_2eg255P42nlE-WeaUNJ9V-gD_AfdyNIvcV2qAtRbqd7__jXQiI5C6SLEHkrfBFRthV8GyhdqtdZHbSZ9zMV_SRhZKF3AJ3o Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dd8ba9eb6c6a490b87715fb84d70af01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dd8ba9eb6c6a490b87715fb84d70af01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dd8ba9eb6c6a490b87715fb84d70af01"}]}] Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: dd8ba9eb6c6a490b87715fb84d70af01 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659 Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 07787fdb99a6449a8f9fd6095ecb73fc Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 43037068-4003-4085-ba94-3cc0b027c722 could not be found. Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '43037068-4003-4085-ba94-3cc0b027c722'} Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43037068-4003-4085-ba94-3cc0b027c722 could not be found. Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43037068-4003-4085-ba94-3cc0b027c722 could not be found. Sep 16 14:08:15.224793 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43037068-4003-4085-ba94-3cc0b027c722 could not be found. Sep 16 14:08:15.230228 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:08:15.235698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] Returning 404 to user: Instance 43037068-4003-4085-ba94-3cc0b027c722 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:15.237953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-117549c0-170b-403c-87f8-d781539bcc60 tempest-FloatingIPsAssociationNegativeTestJSON-360303659 tempest-FloatingIPsAssociationNegativeTestJSON-360303659-project] 10.222.0.60 "GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722" status: 404 len: 111 microversion: 2.1 time: 0.121242 Sep 16 14:08:15.239024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1460/2922] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:15 2022] GET /compute/v2.1/servers/43037068-4003-4085-ba94-3cc0b027c722 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:08:15.249426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1cc85f50-b27b-4ac8-8a7f-4af54d5150d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c37c040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-783504200", "description": "tempest-description-593883907"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:15.514076 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4bf6896-60f2-4666-9873-3fc3b676a371 tempest-SecurityGroupRulesNegativeTestJSON-971089468 tempest-SecurityGroupRulesNegativeTestJSON-971089468-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/4f9117d6-53a6-4978-94e7-37724d7b5c72" status: 202 len: 0 microversion: 2.1 time: 1.942513 Sep 16 14:08:15.515495 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1463/2923] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:08:13 2022] DELETE /compute/v2.1/os-security-groups/4f9117d6-53a6-4978-94e7-37724d7b5c72 => generated 0 bytes in 1946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:08:15.915502 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1cc85f50-b27b-4ac8-8a7f-4af54d5150d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.674367 Sep 16 14:08:15.917437 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1461/2924] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:08:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:16.198191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-150842206", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "e1731765-d189-4d10-b135-50f525e73f37"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:16.357633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] validate_networks() for [('e1731765-d189-4d10-b135-50f525e73f37', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:08:18.905529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:08:18.910089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:08:18.911439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:08:18.912190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:08:18.913104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:08:18.943784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:18.947506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:18.949054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:18.951123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:18.953549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:18.954629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:19.008996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Getting quotas for project a9d47597cbd942ea88af1b5c7e70c365. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:08:19.018003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Getting quotas for user 15a665ee509e48a9b2e3b6a1d173081b and project a9d47597cbd942ea88af1b5c7e70c365. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:08:19.043423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:08:19.047264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:08:19.141866 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad8b2016-5f7d-4ff2-ae95-cddef78dd6d5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.954289 Sep 16 14:08:19.144047 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1464/2925] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:08:19.164162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3aa2636-7300-4cd1-8044-c76cd0f7a8fa tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:19.168203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3aa2636-7300-4cd1-8044-c76cd0f7a8fa tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:19.646954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3aa2636-7300-4cd1-8044-c76cd0f7a8fa tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:19.679643 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3aa2636-7300-4cd1-8044-c76cd0f7a8fa tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1215 microversion: 2.1 time: 0.527001 Sep 16 14:08:19.690112 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1462/2926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:19 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1215 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:08:20.709487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:20.710867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:20.725666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:20.726175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:20.726655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:20.727417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:20.728671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:20.729324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:21.093228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:21.106128 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad9020ec-fbcc-49db-95bd-022f463ffe58 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1211 microversion: 2.1 time: 0.401052 Sep 16 14:08:21.112798 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1465/2927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:20 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1211 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:22.161707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:22.164862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:22.192400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:22.201185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:22.208673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:22.213379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:22.214720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:22.228916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:22.322154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:22.434993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:22.435904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:22.463053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:22.464398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:22.465466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:22.468075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:22.471685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:22.494329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:22.547283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] HTTP exception thrown: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Request method failure captured: Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d HTTP/1.1 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIE-dKNrPi235M1zScKZJXqMT8BrWcr3xM5PyWcmUTdT3h5XgjM242pSsRcTH01-EY5Cb8V8RPw7ezT9YfQdGOR7AgSuyKQjW7sELVVVxv-BBUzZ2AMHbYQpp1gW0PTMUGSx9rAI4lVHDQPnvNzLXCWLWSvyF3SoCcJt2_GSumyiG7g Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.32 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 289bec6033074acb97a59abc8bd0ee1d Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_289bec6033074acb97a59abc8bd0ee1d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/289bec6033074acb97a59abc8bd0ee1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/289bec6033074acb97a59abc8bd0ee1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/289bec6033074acb97a59abc8bd0ee1d"}]}] Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 289bec6033074acb97a59abc8bd0ee1d Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TaggedBootDevicesTest-1993957224-project Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7495b1a889034a07a4b40f871ddc701f Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TaggedBootDevicesTest-1993957224-project Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0ac2334e-4371-4b54-8482-752a508e6d9d'} Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:08:22.551188 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.560796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.565846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Returning 404 to user: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:22.569199 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae413edc-8c1a-45c9-9ee0-f2df10c62938 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 404 len: 111 microversion: 2.32 time: 0.142529 Sep 16 14:08:22.571142 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1466/2928] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:08:22 2022] DELETE /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:08:22.584147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:22.586864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] [instance: 0ac2334e-4371-4b54-8482-752a508e6d9d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:22.603843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:22.605400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:22.606838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:22.609896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:22.610879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:22.611507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:22.660527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] HTTP exception thrown: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Request method failure captured: Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d HTTP/1.1 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIE-dKNrPi235M1zScKZJXqMT8BrWcr3xM5PyWcmUTdT3h5XgjM242pSsRcTH01-EY5Cb8V8RPw7ezT9YfQdGOR7AgSuyKQjW7sELVVVxv-BBUzZ2AMHbYQpp1gW0PTMUGSx9rAI4lVHDQPnvNzLXCWLWSvyF3SoCcJt2_GSumyiG7g Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.32 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 289bec6033074acb97a59abc8bd0ee1d Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_289bec6033074acb97a59abc8bd0ee1d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/289bec6033074acb97a59abc8bd0ee1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/289bec6033074acb97a59abc8bd0ee1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/289bec6033074acb97a59abc8bd0ee1d"}]}] Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 289bec6033074acb97a59abc8bd0ee1d Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1993957224 Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TaggedBootDevicesTest-1993957224-project Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7495b1a889034a07a4b40f871ddc701f Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TaggedBootDevicesTest-1993957224-project Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0ac2334e-4371-4b54-8482-752a508e6d9d'} Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.667033 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. Sep 16 14:08:22.673403 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:22.675853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] Returning 404 to user: Instance 0ac2334e-4371-4b54-8482-752a508e6d9d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:22.680624 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81ee20b3-14b1-461d-9598-f96600249f49 tempest-TaggedBootDevicesTest-1993957224 tempest-TaggedBootDevicesTest-1993957224-project] 10.222.0.60 "GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d" status: 404 len: 111 microversion: 2.32 time: 0.100940 Sep 16 14:08:22.687687 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1467/2929] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:08:22 2022] GET /compute/v2.1/servers/0ac2334e-4371-4b54-8482-752a508e6d9d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:08:22.776209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:22.794449 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81e9af4d-f2dd-4287-832d-14c3cc71245e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1273 microversion: 2.1 time: 0.654507 Sep 16 14:08:22.798904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1463/2930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:22 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1273 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:23.850883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:23.852286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:23.895389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:23.900879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:23.905254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:23.907583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:23.908716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:23.922361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:24.910299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:24.961516 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00203468-4299-4a6f-8dcc-8eaa79d82c01 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1273 microversion: 2.1 time: 1.114773 Sep 16 14:08:24.969739 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1468/2931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:23 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1273 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:26.014044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:26.015300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:26.021211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:26.041280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:26.043066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:26.043842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:26.047004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:26.048824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:26.049782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:26.867855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:26.885977 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6407c79a-2bdc-459d-ada5-205cbabf98a4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.877296 Sep 16 14:08:26.886849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1464/2932] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:26 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:08:27.937245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:27.942204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:27.986988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:27.988934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:27.990149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:27.991951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:27.993280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:27.994786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:28.724866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:28.752975 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-295227d0-2cb1-4032-9255-d9ea9349e6ba tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.823673 Sep 16 14:08:28.754730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1469/2933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:27 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:28.877261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1586639687", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "941f1dd8-b04a-486d-bbeb-3b2d2413b0c1"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:29.066039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] validate_networks() for [('941f1dd8-b04a-486d-bbeb-3b2d2413b0c1', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:08:29.679429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:29.797133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:29.797944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:29.810816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:29.811663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:29.813254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:29.814695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:29.815183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:29.815967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:29.816508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:29.816939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:30.226211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:30.235312 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b4b618a-4ad8-4750-982d-ee13ce6d68ff tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.442096 Sep 16 14:08:30.240145 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1470/2934] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:29 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:30.253255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5a9485a2-c854-4113-b144-aabd222fb5f6 req-d4a3c418-493c-4be2-bed4-86c543c0c686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73ceef4-1887-4d38-8284-dbdbb2b101a9", "tag": "b647a263-3849-4a5a-85f4-9488ea229562"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:30.276374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5a9485a2-c854-4113-b144-aabd222fb5f6 req-d4a3c418-493c-4be2-bed4-86c543c0c686 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:30.276850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5a9485a2-c854-4113-b144-aabd222fb5f6 req-d4a3c418-493c-4be2-bed4-86c543c0c686 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:30.277283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5a9485a2-c854-4113-b144-aabd222fb5f6 req-d4a3c418-493c-4be2-bed4-86c543c0c686 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:30.291325 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5a9485a2-c854-4113-b144-aabd222fb5f6 req-d4a3c418-493c-4be2-bed4-86c543c0c686 service nova] Creating event network-changed:b647a263-3849-4a5a-85f4-9488ea229562 for instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 on n-h1-858129-2 Sep 16 14:08:30.298456 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5a9485a2-c854-4113-b144-aabd222fb5f6 req-d4a3c418-493c-4be2-bed4-86c543c0c686 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056410 Sep 16 14:08:30.299596 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1471/2935] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:30.832415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:08:30.833184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:08:30.833573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:08:30.834108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:08:30.834679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:08:30.856611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:30.857316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:30.871146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:30.872211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:30.873050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:30.873420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:30.913787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:08:30.932492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for user 35e0a11712764fa5b78e9ac4d1859f3a and project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:08:30.979565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:08:30.985548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:08:31.130260 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13710cb1-4479-4293-8ff0-26513af38cd2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420618 Sep 16 14:08:31.131423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1465/2936] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:08:31.178162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-092d5b17-671a-4140-a581-a97491454ca7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:31.185897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-092d5b17-671a-4140-a581-a97491454ca7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:31.283657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:31.284747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:31.346936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:31.351424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:31.352678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:31.364451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:31.365312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:31.366093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:31.683777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-092d5b17-671a-4140-a581-a97491454ca7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:31.728129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-092d5b17-671a-4140-a581-a97491454ca7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1211 microversion: 2.1 time: 0.578816 Sep 16 14:08:31.744475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1472/2937] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:31 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1211 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:31.995819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:32.008429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e3f530f-d52c-4747-a100-9e1ab5c07e2f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.734138 Sep 16 14:08:32.027522 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1466/2938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:31 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:08:32.801406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f4b04ac-7d79-469c-8293-2d3811798669 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:32.803554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f4b04ac-7d79-469c-8293-2d3811798669 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:32.836061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:33.035811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:33.036600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:33.078901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:33.081915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:33.083753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:33.096011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f4b04ac-7d79-469c-8293-2d3811798669 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:33.110384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:33.111435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:33.113101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:33.125601 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f4b04ac-7d79-469c-8293-2d3811798669 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1211 microversion: 2.1 time: 0.340878 Sep 16 14:08:33.147445 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1473/2939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:32 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1211 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:34.158011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:34.171871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:34.207373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:34.215001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:34.220408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:34.224189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:34.229952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:34.231359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:34.357302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:34.379680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2db9b38f-b427-49bc-97a2-973f159e17be tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 1.343961 Sep 16 14:08:34.380404 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1467/2940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:33 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:34.818850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:34.852236 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-906d59ce-b042-461f-841c-bf215ed940fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1263 microversion: 2.1 time: 0.701421 Sep 16 14:08:34.876245 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1474/2941] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:34 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1263 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:35.414255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:35.419553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:35.441739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:35.448646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:35.450260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:35.454713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:35.456474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:35.458368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:35.933245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:35.935227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:35.950745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:35.963673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:35.965950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:35.974045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:35.974613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:35.975792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:37.061687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:37.123115 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b1eb1a2-51ff-4d05-842c-68b438f9f706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1269 microversion: 2.1 time: 1.220025 Sep 16 14:08:37.125274 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1475/2942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:35 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1269 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:37.381978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:37.421936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b042f732-ff70-4225-a98f-072a3f5ef644 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 2.016994 Sep 16 14:08:37.437371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1468/2943] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:35 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:38.162739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:38.164710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:38.195167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:38.198118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:38.200613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:38.207147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:38.208142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:38.208926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:38.473774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:38.498898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:38.503363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:38.543347 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abab1162-c652-4e86-8985-92351444054d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1269 microversion: 2.1 time: 0.382535 Sep 16 14:08:38.546129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:38.547153 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1476/2944] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:38 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1269 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:38.554724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:38.554724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:38.554724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:38.554724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:38.554724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:39.079859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:39.092177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dfd837fa-4ff5-4fc7-8ecf-ef94d561405c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.626036 Sep 16 14:08:39.092785 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1469/2945] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:38 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:08:39.577799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:39.591859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:39.624824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:39.630959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:39.632383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:39.638632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:39.640607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:39.648506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.059119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:40.084266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:40.085772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Searching by: {'deleted': False, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:08:40.110054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:40.110942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:40.122717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.124672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:40.125830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:40.127800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.242116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:08:40.346834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cbab91b8-2948-4116-b54b-467d3a820f04 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.294962 Sep 16 14:08:40.353273 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1470/2946] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:08:40 2022] GET /compute/v2.1/servers => generated 344 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:08:40.389473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:40.396256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:40.436367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:40.437943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:40.440546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.448112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:40.449431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:40.450627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.682321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:40.687033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=66 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:40.720258 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29b40014-6c57-4452-b716-dd3318c76491 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 1.133996 Sep 16 14:08:40.721343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1477/2947] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:39 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:40.730584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:40.763016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:40.768130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Searching by: {'deleted': False, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:08:40.779172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:40.780517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:40.781583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.783456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:40.785206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:40.786353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:40.926953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:08:40.964974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:41.002346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:41.037720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e9f5863-9c5f-4b2f-a831-01818651b03e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.670161 Sep 16 14:08:41.044389 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1471/2948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:40 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:41.081300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:41.116917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:41.119998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:41.132935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:41.469246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-162168204", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "5f817dcb-053f-4ccb-8fa5-186bb49681f3"}, {"uuid": "ff4431c5-5a94-4c83-9792-ff66532c2c56"}, {"uuid": "5f817dcb-053f-4ccb-8fa5-186bb49681f3"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:41.694160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] validate_networks() for [('5f817dcb-053f-4ccb-8fa5-186bb49681f3', None, None, None, None, None), ('ff4431c5-5a94-4c83-9792-ff66532c2c56', None, None, None, None, None), ('5f817dcb-053f-4ccb-8fa5-186bb49681f3', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:08:41.738162 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d518251-dfc7-414d-a511-1548179261b5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 1.013793 Sep 16 14:08:41.739680 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1478/2949] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:08:40 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:41.765089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:41.785421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:41.844580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:41.859624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:41.862736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:41.875728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:41.877522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:41.878907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:42.814937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:42.851066 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b329a64c-3020-49ca-9b92-c3d888a8ce24 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 1.081533 Sep 16 14:08:42.853087 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1479/2950] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:41 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:42.887544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4d978e7-bc87-4c27-84c9-a8e3f7af5b91 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:42.921062 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4d978e7-bc87-4c27-84c9-a8e3f7af5b91 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065592 Sep 16 14:08:42.922172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1480/2951] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:08:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:42.941473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:42.941473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:42.969301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:42.970177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:42.970960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:42.972214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:42.973468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:42.973828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:43.676318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:43.728016 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9985922-4d3b-4117-935f-b5cdbc3af5d9 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.799061 Sep 16 14:08:43.733674 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1481/2952] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:42 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:43.770140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:43.775447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:43.819772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:43.822548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:43.823387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:43.837425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:43.842907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:43.844070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:43.912126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:08:44.103642 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11a89ed6-4885-474f-ba80-97cc05fe1c48 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 204 len: 0 microversion: 2.1 time: 0.367571 Sep 16 14:08:44.104289 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1482/2953] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:08:43 2022] DELETE /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:08:44.123559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:44.124297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:44.148542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:44.149630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:44.150080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:44.155180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:44.159973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:44.160849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:45.261976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:45.326043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a6612150-6004-49e4-9432-b38fd127cd87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 1.216872 Sep 16 14:08:45.331417 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1483/2954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:44 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:45.369995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:45.369995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:45.445042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:45.452694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:45.457200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:45.465723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:45.468847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:45.475537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:46.194118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:46.219001 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-09746d55-d708-4332-9858-8c202a153712 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1610 microversion: 2.1 time: 0.885260 Sep 16 14:08:46.220848 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1484/2955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:45 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1610 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:46.229787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7f7ac06f-6eec-4a3b-98b5-48f89e069051 req-42d8dd5a-5704-445d-be1c-d2251745df45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f688628-999c-4cb5-a109-dbcef0dd7b53", "tag": "2501a8f9-83ad-477f-9fc2-b55d2c748974"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:46.260108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7f7ac06f-6eec-4a3b-98b5-48f89e069051 req-42d8dd5a-5704-445d-be1c-d2251745df45 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:46.261552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7f7ac06f-6eec-4a3b-98b5-48f89e069051 req-42d8dd5a-5704-445d-be1c-d2251745df45 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:46.262758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7f7ac06f-6eec-4a3b-98b5-48f89e069051 req-42d8dd5a-5704-445d-be1c-d2251745df45 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:46.322645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7f7ac06f-6eec-4a3b-98b5-48f89e069051 req-42d8dd5a-5704-445d-be1c-d2251745df45 service nova] Creating event network-changed:2501a8f9-83ad-477f-9fc2-b55d2c748974 for instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 on n-h2-858129-2 Sep 16 14:08:46.345044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7f7ac06f-6eec-4a3b-98b5-48f89e069051 req-42d8dd5a-5704-445d-be1c-d2251745df45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121331 Sep 16 14:08:46.349955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1485/2956] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:46.375788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:46.379247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:46.392086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:46.398650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:46.399768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:46.403121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:46.407412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:46.411513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:46.610236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:08:46.611120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:08:46.611849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:08:46.613141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:08:46.613870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:08:46.651186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:46.651907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:46.652680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:46.660624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:46.661321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:46.665197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:46.738985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Getting quotas for project 83b243d4de294eeebcd2c8ce44d02bed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:08:46.758885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Getting quotas for user 782fbafaf3004e72aabae9768d700361 and project 83b243d4de294eeebcd2c8ce44d02bed. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:08:46.806562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:08:46.813266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:08:46.838113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:46.866314 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8a034bf8-0701-4ac5-b52f-e76ecbe79bcd tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 0.513326 Sep 16 14:08:46.874971 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1486/2957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:46 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:47.050711 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66e2ee48-25b0-4c46-bb0a-0deb8f866be1 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.584353 Sep 16 14:08:47.056994 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1472/2958] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:08:47.082467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:47.084843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:47.114215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:47.115384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:47.119323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:47.126663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:47.129531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:47.132183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:47.654093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:47.702241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be0248f0-3eea-4f81-bd4a-036fbc019ca3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 0.639275 Sep 16 14:08:47.703472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1473/2959] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:47 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:47.728739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c44a2de9-8fc6-4839-84a5-21ba6038aad7 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:47.729578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c44a2de9-8fc6-4839-84a5-21ba6038aad7 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:47.779725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1162805954", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "46b099ef-20aa-497a-b1e1-fdb8a699054d"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:47.942361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c44a2de9-8fc6-4839-84a5-21ba6038aad7 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:47.958047 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c44a2de9-8fc6-4839-84a5-21ba6038aad7 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1212 microversion: 2.1 time: 0.245082 Sep 16 14:08:47.964321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1474/2960] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:47 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1212 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:47.973803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:47.974566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:47.980418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] validate_networks() for [('46b099ef-20aa-497a-b1e1-fdb8a699054d', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:08:48.016460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:48.016961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:48.017400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:48.024572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:48.025220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:48.025682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:48.720894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:48.767295 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6381d32f-3efa-4a38-9b45-2bb97fe1e8bf tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1610 microversion: 2.1 time: 0.801136 Sep 16 14:08:48.770391 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1475/2961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:47 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1610 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:48.818825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:48.820089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:48.850864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:48.851747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:48.852707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:48.853965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:48.879628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:48.881769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:49.730741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:08:49.731628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:08:49.731628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:08:49.732118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:08:49.733253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:08:49.754377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:49.755283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:49.757142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:49.758392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:49.758750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:49.759198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:49.859092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:49.866532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Getting quotas for project 981d20129f2c4bc8b6dc3209a2c94ceb. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:08:49.879978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Getting quotas for user 2f6b0424165e45b4ba7174edf479056b and project 981d20129f2c4bc8b6dc3209a2c94ceb. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:08:49.919256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:08:49.924700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:08:49.934081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-daf657c5-af15-4ed0-aa10-690cf99e5dbb tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 1.158971 Sep 16 14:08:49.942176 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1476/2962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:48 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:50.203742 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3cf0e6a9-de6b-45cf-b1cd-26bcd6dd7e77 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.326500 Sep 16 14:08:50.219387 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1487/2963] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:08:50.234767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:50.239486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:50.273611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:50.278077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:50.279896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:50.287093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:50.291079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:50.294846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:50.726928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Calling method '.version_select at 0x7f724c4dda60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:50.770266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:50.774647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:50.775569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:50.787967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:50.788834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:50.789680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:50.884943 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac9d46ab-61cb-4340-8430-c4913e2dcd3d tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.938776 Sep 16 14:08:50.899716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1477/2964] 10.222.0.60 () {58 vars in 1122 bytes} [Fri Sep 16 14:08:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:50.925169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:50.926313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:50.974789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:50.975994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:50.976890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:50.981745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:50.986152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:50.987069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:51.821788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:51.881117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-242de663-d93a-4acf-bf21-20b407215516 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1270 microversion: 2.1 time: 0.950546 Sep 16 14:08:51.882295 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1478/2965] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:50 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1270 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:51.903192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:51.908540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:51.932976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:51.933762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:51.934796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:51.936974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:51.938306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:51.947332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:52.219958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:52.229396 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3417ad3-ba57-47b9-bd69-66271e694d8c tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1253 microversion: 2.1 time: 0.341847 Sep 16 14:08:52.235418 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1479/2966] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:51 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1253 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:52.247730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:52.248311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:52.263225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:52.263891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:52.264716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:52.265079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:52.265546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:52.265974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:52.410313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=86 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:52.554251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:52.604128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:52.610782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:52.620380 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6e29bbf-cccb-4f3b-96d9-4ee3ed3f0c47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1258 microversion: 2.26 time: 0.376062 Sep 16 14:08:52.622845 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1480/2967] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:08:52 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1258 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:08:52.667748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:52.668807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:52.708633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:52.709208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:52.710202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:52.712086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:52.716650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:52.717940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:52.889347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:52.927620 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6339766a-54cf-457a-bfef-5780f8bef426 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 2.706105 Sep 16 14:08:52.937437 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1488/2968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:50 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:52.954068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-225656605", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:53.198102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:08:54.417353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:54.435147 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e4c5d9c-3049-45a1-bfdf-6c1af85cdfec tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 1.809804 Sep 16 14:08:54.437696 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1481/2969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:52 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:54.543482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Getting quotas for project 86d42b373e4640178a30da9710ecb262. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:08:54.558949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Getting quotas for user e143c2c2b2a9474d803696fb96965bdc and project 86d42b373e4640178a30da9710ecb262. Resources: dict_keys(['metadata_items']) {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:08:54.583980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Request method failure captured: Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 1751 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINvMiTqntRfCsCDuSJZ_73nCDpkoQnKPMK1AlmfPKJjZ6mLXAbmguva0fKIySzbtuv3M0qtpAR-gVy8ydqtfGNRXGw8abAWHGxTlemPrUOz6XLVr9Cvet8o_71hptX2S_n9rJrbzjx4JB6RcvljMAUqk4DFeo4UaPRCCqtkcmpzLlw Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 86d42b373e4640178a30da9710ecb262 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1258669457 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86d42b373e4640178a30da9710ecb262", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d42b373e4640178a30da9710ecb262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86d42b373e4640178a30da9710ecb262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d42b373e4640178a30da9710ecb262"}]}] Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1258669457 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 86d42b373e4640178a30da9710ecb262 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1258669457 Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e143c2c2b2a9474d803696fb96965bdc Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-225656605", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:08:54.587529 n-d-858129-2 devstack@n-api.service[128643]: exception: Maximum number of metadata items exceeds 128 Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-225656605', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:08:54.590119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 16 14:08:54.594015 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:08:54.602131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c36fd376-1bab-45c8-99c9-101e7646f2eb req-7e26432a-ddea-4c94-84f2-8dc492636545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73ceef4-1887-4d38-8284-dbdbb2b101a9", "name": "network-vif-plugged", "status": "completed", "tag": "b647a263-3849-4a5a-85f4-9488ea229562"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:54.608644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:08:54.611663 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-691f8cb5-0f5c-4d98-8161-e136552c2fc5 tempest-AbsoluteLimitsNegativeTestJSON-1258669457 tempest-AbsoluteLimitsNegativeTestJSON-1258669457-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.672351 Sep 16 14:08:54.614593 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1489/2970] 10.222.0.60 () {60 vars in 1148 bytes} [Fri Sep 16 14:08:52 2022] POST /compute/v2.1/servers => generated 87 bytes in 1676 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:08:54.642737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c36fd376-1bab-45c8-99c9-101e7646f2eb req-7e26432a-ddea-4c94-84f2-8dc492636545 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:54.644344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-fe3d9fa5-50fb-42b3-8d31-5322de94c6a4 req-bbdd7050-49c7-4ab5-9eb4-0f7042989344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd2365b-d9b7-4953-a237-a3d85f200de2", "name": "network-vif-deleted", "tag": "94aad940-9b36-4476-b421-e2cfdb77136d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:08:54.644857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c36fd376-1bab-45c8-99c9-101e7646f2eb req-7e26432a-ddea-4c94-84f2-8dc492636545 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:54.650015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c36fd376-1bab-45c8-99c9-101e7646f2eb req-7e26432a-ddea-4c94-84f2-8dc492636545 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:54.682071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fe3d9fa5-50fb-42b3-8d31-5322de94c6a4 req-bbdd7050-49c7-4ab5-9eb4-0f7042989344 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:54.682878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fe3d9fa5-50fb-42b3-8d31-5322de94c6a4 req-bbdd7050-49c7-4ab5-9eb4-0f7042989344 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:54.687567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fe3d9fa5-50fb-42b3-8d31-5322de94c6a4 req-bbdd7050-49c7-4ab5-9eb4-0f7042989344 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:54.704270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c36fd376-1bab-45c8-99c9-101e7646f2eb req-7e26432a-ddea-4c94-84f2-8dc492636545 service nova] Creating event network-vif-plugged:b647a263-3849-4a5a-85f4-9488ea229562 for instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 on n-h1-858129-2 Sep 16 14:08:54.717143 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c36fd376-1bab-45c8-99c9-101e7646f2eb req-7e26432a-ddea-4c94-84f2-8dc492636545 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276991 Sep 16 14:08:54.719852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1482/2971] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:54.737886 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-fe3d9fa5-50fb-42b3-8d31-5322de94c6a4 req-bbdd7050-49c7-4ab5-9eb4-0f7042989344 service nova] Creating event network-vif-deleted:94aad940-9b36-4476-b421-e2cfdb77136d for instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 on n-h2-858129-2 Sep 16 14:08:54.740897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:54.753891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-fe3d9fa5-50fb-42b3-8d31-5322de94c6a4 req-bbdd7050-49c7-4ab5-9eb4-0f7042989344 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134883 Sep 16 14:08:54.755184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:54.761410 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1490/2972] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:08:54.773799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:54.775771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:54.808919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:54.820928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:54.823366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:54.824919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:54.832781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:54.833576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:54.842356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:54.843413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:54.844220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:54.869888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:54.876978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:54.878278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:55.374674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:55.413021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7bdef55-f928-4151-8c1d-5d0fc5714388 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1270 microversion: 2.1 time: 0.684888 Sep 16 14:08:55.421117 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1483/2973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:54 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1270 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:55.443509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:55.444691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:55.460969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:55.481173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:55.482019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:55.500574 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eec46ef0-bce3-475e-b61e-98154cb82573 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1253 microversion: 2.1 time: 0.735442 Sep 16 14:08:55.501658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1491/2974] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:54 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1253 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:55.507035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:55.508457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:55.509317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:55.510117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:55.539078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:55.540922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:55.568914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:55.569729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:55.586718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:55.588268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:55.589159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:55.589982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:55.721670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:55.735811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:55.738226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:55.740544 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d03789d3-7118-439e-b96c-88bec915a7fa tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1320 microversion: 2.26 time: 0.317730 Sep 16 14:08:55.741703 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1484/2975] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:08:55 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:08:55.748391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:55.749910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:55.761265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:55.762497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:55.763173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:55.764321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:55.765260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:55.766381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:56.564057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:56.609424 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d4a95912-0543-48a4-88db-8b04feb738f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 1.105732 Sep 16 14:08:56.610555 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1492/2976] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:55 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:56.660586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:56.666653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:56.696553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:56.697593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:56.698880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:56.701389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:56.703465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:56.704247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:57.041822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:57.073827 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a56090e2-7d69-4e32-b38c-756f6081b50a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1315 microversion: 2.1 time: 1.329778 Sep 16 14:08:57.084722 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1485/2977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:55 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:57.093886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:57.094545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:57.131653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:08:57.140441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:57.141257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:57.142284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:57.143247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:57.143903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:57.146993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:57.607396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:57.655099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-33455f68-cbb3-466e-88eb-65d31f90adc5 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1253 microversion: 2.1 time: 0.567492 Sep 16 14:08:57.657682 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1486/2978] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:57 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1253 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:57.667616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:57.683142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5eb22ffd-306b-43d1-88ee-223fe2f7ebc0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1312 microversion: 2.1 time: 1.045105 Sep 16 14:08:57.687430 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1493/2979] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:56 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1312 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:57.710717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:57.713314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:57.736290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:57.737877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:57.745971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:57.746993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:57.749255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:57.751488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:57.751849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:57.753971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:57.853560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:57.856985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:57.863892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:57.869368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:57.874675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:57.878194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:59.353016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:59.375555 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e359b5b3-5db5-4884-9984-558d85825fdc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 1.683899 Sep 16 14:08:59.390441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1494/2980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:57 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:08:59.390441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:59.390441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:59.408494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:59.409013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:59.409466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:59.410194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:59.410740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:59.413551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:59.542921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:59.604926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:59.626248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:08:59.636960 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f48535fc-c994-4c00-a67f-7c70230b3204 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 1.971411 Sep 16 14:08:59.643424 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1487/2981] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:08:57 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:08:59.678236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:08:59.692219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:08:59.727396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:59.732748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:59.733682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:59.742035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:08:59.747989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:08:59.748971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:08:59.783192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:00.689024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4d7b4b367d434582d7fc24a007c7e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5dc35d3935447f1925d80a58b1a3b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:00.722736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c793ce30-d9a1-4a82-a563-7f5f80de33da tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 200 len: 1253 microversion: 2.1 time: 1.069931 Sep 16 14:09:00.734025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:00.741918 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1488/2982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:59 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 1253 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:00.766481 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a681e499-4409-4b35-b499-0bec95d580db tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1502 microversion: 2.1 time: 1.388350 Sep 16 14:09:00.767617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1495/2983] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:08:59 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1502 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:00.772426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:00.783465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:00.794020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:00.812945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:00.817974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:00.826573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:00.835201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:00.839266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:00.842063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:00.847140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:00.849691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:00.851185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:00.853278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:00.854801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:00.857647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:00.864659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:00.868570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:00.871815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:00.995629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:02.531110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:02.564451 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a95c1844-9f25-42c5-9895-4628a82c5c0a tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1333 microversion: 2.1 time: 1.819731 Sep 16 14:09:02.578485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1489/2984] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:00 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1333 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:02.593014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:02.599707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:02.639695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:02.642665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:02.649180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:02.654233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:02.655421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:02.656355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:02.761397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:02.804422 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50b9dccb-5624-4868-9d4d-079a8b4817f6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 2.035260 Sep 16 14:09:02.809543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1496/2985] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:00 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:02.827836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1656862946"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:02.831274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:02.861494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:02.866297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:02.868237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:02.886822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:02.887915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:02.889820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:03.599530 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.network.security_group_api [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Adding security group fba08248-7dbd-4374-8bd5-44567c365b19 to port b647a263-3849-4a5a-85f4-9488ea229562 Sep 16 14:09:04.579280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:04.861998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:04.884151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:04.896944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:04.899188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ebb44df-2449-4ba4-b05e-46074fb63f15 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 2.331294 Sep 16 14:09:04.903489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1490/2986] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:02 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:04.919293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d0a33515-6c2c-4b7d-83e2-e1d18a6d4b74 req-37f559db-551e-4da5-bdec-aab972c5cefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f688628-999c-4cb5-a109-dbcef0dd7b53", "name": "network-vif-plugged", "status": "completed", "tag": "2501a8f9-83ad-477f-9fc2-b55d2c748974"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:04.959928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d0a33515-6c2c-4b7d-83e2-e1d18a6d4b74 req-37f559db-551e-4da5-bdec-aab972c5cefe service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:04.969641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d0a33515-6c2c-4b7d-83e2-e1d18a6d4b74 req-37f559db-551e-4da5-bdec-aab972c5cefe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:04.969809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d0a33515-6c2c-4b7d-83e2-e1d18a6d4b74 req-37f559db-551e-4da5-bdec-aab972c5cefe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:04.989212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d0a33515-6c2c-4b7d-83e2-e1d18a6d4b74 req-37f559db-551e-4da5-bdec-aab972c5cefe service nova] Creating event network-vif-plugged:2501a8f9-83ad-477f-9fc2-b55d2c748974 for instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 on n-h2-858129-2 Sep 16 14:09:04.996546 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d0a33515-6c2c-4b7d-83e2-e1d18a6d4b74 req-37f559db-551e-4da5-bdec-aab972c5cefe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088584 Sep 16 14:09:04.998618 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1491/2987] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:05.009410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:05.011359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] [instance: 3dd2365b-d9b7-4953-a237-a3d85f200de2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:05.022985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:05.023878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:05.024712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:05.025663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:05.026324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:05.026943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:05.073740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] HTTP exception thrown: Instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 could not be found. Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Request method failure captured: Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 HTTP/1.1 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJILRia1hI21qXRAdcbaOHt3QUux6NJY-IE8G8Yb13s6D83dHisBgFFG50N3XwKiPuUyIcs5qa5i8QfJK1KSpplklnXQgwpLqp5PvOWeuul_VSxejGRlcggAYFvbu6yPqnZNyFAzZHd_kL1zQUcXEJ0Ydh1s1rQ_yZa0Sn_6t3wU1UDU Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e5dc35d3935447f1925d80a58b1a3b2e Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestBootFromVolume-260746064 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e5dc35d3935447f1925d80a58b1a3b2e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e5dc35d3935447f1925d80a58b1a3b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e5dc35d3935447f1925d80a58b1a3b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e5dc35d3935447f1925d80a58b1a3b2e"}]}] Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestBootFromVolume-260746064 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e5dc35d3935447f1925d80a58b1a3b2e Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestBootFromVolume-260746064 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestBootFromVolume-260746064-project Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6f4d7b4b367d434582d7fc24a007c7e1 Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestBootFromVolume-260746064-project Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 could not be found. Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3dd2365b-d9b7-4953-a237-a3d85f200de2'} Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 could not be found. Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 could not be found. Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:05.079726 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 could not be found. Sep 16 14:09:05.085401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:05.090949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Returning 404 to user: Instance 3dd2365b-d9b7-4953-a237-a3d85f200de2 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:05.092071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c3449d8-d587-4b32-92fc-f5b296f14c11 tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2" status: 404 len: 111 microversion: 2.1 time: 0.092007 Sep 16 14:09:05.106895 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1492/2988] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:04 2022] GET /compute/v2.1/servers/3dd2365b-d9b7-4953-a237-a3d85f200de2 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:05.117057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:05.118035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:05.131619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:05.132472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:05.133749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:05.135201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:05.135890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:05.136537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:06.146459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:06.164620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71f0bfb2-8a07-4421-996f-bef2e5dc5b07 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 1.055301 Sep 16 14:09:06.167218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1493/2989] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:05 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:06.182899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:06.184902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:06.207932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:06.210185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:06.212395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:06.213578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:06.216876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:06.217620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:06.832456 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c1c706d-0b60-4e51-869c-095a924e3a4e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9/action" status: 202 len: 0 microversion: 2.1 time: 4.021466 Sep 16 14:09:06.833699 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1497/2990] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:09:02 2022] POST /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9/action => generated 0 bytes in 4023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:06.839191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00df2b16-95f2-465c-95dd-d0656267cc4b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] Calling method '.version_select at 0x7f724d37be50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:06.849462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:06.873778 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00df2b16-95f2-465c-95dd-d0656267cc4b tempest-ServersTestBootFromVolume-260746064 tempest-ServersTestBootFromVolume-260746064-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984629720" status: 202 len: 0 microversion: 2.1 time: 0.038387 Sep 16 14:09:06.875855 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1498/2991] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984629720 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:06.888470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:06.889417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:06.900903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:06.901676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:06.902366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:06.903455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:06.904132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:06.904744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:07.693229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:07.711724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c51c5e94-8126-4339-892d-e6f38769459d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1311 microversion: 2.1 time: 1.537890 Sep 16 14:09:07.713488 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1494/2992] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:06 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1311 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:07.738934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-03a32742-b220-417d-bf48-fdb0901627d6 req-ad9e012e-1720-400c-ab2f-73cf8577d066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe54e0ec-98cd-40b1-b7ec-73c492646b97", "tag": "3eff67ed-5f20-43bb-9e04-a53381d4bc5a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:07.781718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-03a32742-b220-417d-bf48-fdb0901627d6 req-ad9e012e-1720-400c-ab2f-73cf8577d066 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:07.782893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-03a32742-b220-417d-bf48-fdb0901627d6 req-ad9e012e-1720-400c-ab2f-73cf8577d066 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:07.783601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-03a32742-b220-417d-bf48-fdb0901627d6 req-ad9e012e-1720-400c-ab2f-73cf8577d066 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:07.836174 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-03a32742-b220-417d-bf48-fdb0901627d6 req-ad9e012e-1720-400c-ab2f-73cf8577d066 service nova] Creating event network-changed:3eff67ed-5f20-43bb-9e04-a53381d4bc5a for instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 on n-h2-858129-2 Sep 16 14:09:07.855870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-03a32742-b220-417d-bf48-fdb0901627d6 req-ad9e012e-1720-400c-ab2f-73cf8577d066 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139506 Sep 16 14:09:07.864395 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1495/2993] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:07.876398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee021dee-4db5-4c71-9dcd-caa8763ea244 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c3f44c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:07.913203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:07.939234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:07.944260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:07.945614 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f79a6be0-1f7b-4cb5-92b3-9523dcda187d tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 1.067811 Sep 16 14:09:07.946237 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1499/2994] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:06 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:08.190118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a3d0abd7-dc9d-4ba1-8764-9cf45e334619 req-642b8b23-9cbf-467e-85f8-993765e52330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73ceef4-1887-4d38-8284-dbdbb2b101a9", "tag": "b647a263-3849-4a5a-85f4-9488ea229562"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:08.201750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a3d0abd7-dc9d-4ba1-8764-9cf45e334619 req-642b8b23-9cbf-467e-85f8-993765e52330 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.202633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a3d0abd7-dc9d-4ba1-8764-9cf45e334619 req-642b8b23-9cbf-467e-85f8-993765e52330 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.203239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a3d0abd7-dc9d-4ba1-8764-9cf45e334619 req-642b8b23-9cbf-467e-85f8-993765e52330 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:08.219628 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a3d0abd7-dc9d-4ba1-8764-9cf45e334619 req-642b8b23-9cbf-467e-85f8-993765e52330 service nova] Creating event network-changed:b647a263-3849-4a5a-85f4-9488ea229562 for instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 on n-h1-858129-2 Sep 16 14:09:08.227475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a3d0abd7-dc9d-4ba1-8764-9cf45e334619 req-642b8b23-9cbf-467e-85f8-993765e52330 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277442 Sep 16 14:09:08.228785 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1500/2995] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:08.235234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:08.236351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:08.244408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.245126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.245869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:08.246828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.247509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.248128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:08.591228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-ee021dee-4db5-4c71-9dcd-caa8763ea244 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use.", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:08.592422 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ee021dee-4db5-4c71-9dcd-caa8763ea244 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.592422 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee021dee-4db5-4c71-9dcd-caa8763ea244 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19 HTTP/1.1 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: exception: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'fba08248-7dbd-4374-8bd5-44567c365b19'} Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:08.596400 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee021dee-4db5-4c71-9dcd-caa8763ea244 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 400 to user: Security Group fba08248-7dbd-4374-8bd5-44567c365b19 in use. Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-b8607edc-6e4a-4c41-8b02-fbffefbb4375'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:08.601728 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee021dee-4db5-4c71-9dcd-caa8763ea244 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19" status: 400 len: 185 microversion: 2.1 time: 0.734349 Sep 16 14:09:08.606005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1496/2996] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:07 2022] DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19 => generated 185 bytes in 737 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:09:08.628459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:08.635241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:08.644422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.644934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.645536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:08.646471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.647641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.648141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:08.834563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dfaecc9c-8b9d-42b3-9c85-a4f2c56d47c5 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9/action" status: 202 len: 0 microversion: 2.1 time: 0.225664 Sep 16 14:09:08.836344 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1497/2997] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:09:08 2022] POST /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:08.857924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:08.870724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:08.910953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.912276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.913101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:08.915174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:08.916067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:08.916874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:10.184877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:10.203415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-892ef6ee-f41a-42ad-991c-9d53d12cbdb9 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 1.973055 Sep 16 14:09:10.204381 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1501/2998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:08 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:10.209403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:10.210030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:10.224251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:10.228746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:10.229281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:10.231229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:10.232757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:10.235104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:10.397359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:10.411094 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0612777-5336-4610-8384-3e34c144ce42 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1493 microversion: 2.1 time: 1.571563 Sep 16 14:09:10.411755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1498/2999] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:08 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1493 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:10.449559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:10.460717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:10.494093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:10.495155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:10.498143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:10.500457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:10.506792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:10.508199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:10.558927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:11.157201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:11.173224 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e6283401-8222-46af-ad85-2c12e9e95e97 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1573 microversion: 2.1 time: 0.967280 Sep 16 14:09:11.174785 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1502/3000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:10 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1573 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:11.207308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3f4fa78b-d648-4de2-aeb8-e0f5c73a31ec req-97e2c016-d34f-428e-807d-2fc36bf98c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "tag": "c232d20d-75fa-4211-97d8-6f619be4b717"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:11.230143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3f4fa78b-d648-4de2-aeb8-e0f5c73a31ec req-97e2c016-d34f-428e-807d-2fc36bf98c9f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:11.231461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3f4fa78b-d648-4de2-aeb8-e0f5c73a31ec req-97e2c016-d34f-428e-807d-2fc36bf98c9f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:11.232564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3f4fa78b-d648-4de2-aeb8-e0f5c73a31ec req-97e2c016-d34f-428e-807d-2fc36bf98c9f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:11.263488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3f4fa78b-d648-4de2-aeb8-e0f5c73a31ec req-97e2c016-d34f-428e-807d-2fc36bf98c9f service nova] Creating event network-changed:c232d20d-75fa-4211-97d8-6f619be4b717 for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:11.279881 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3f4fa78b-d648-4de2-aeb8-e0f5c73a31ec req-97e2c016-d34f-428e-807d-2fc36bf98c9f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101633 Sep 16 14:09:11.282013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1503/3001] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:11.338008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:11.365773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:11.370040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:11.374820 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf290858-69d1-4861-ad2c-e267c1206159 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 0.959539 Sep 16 14:09:11.417506 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1499/3002] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:10 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:11.428281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:11.431308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:11.465629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:11.470171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:11.472971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:11.473826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:11.474328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:11.478529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:11.615417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:11.619447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:11.635089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:11.635866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:11.636481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:11.637464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:11.638125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:11.638763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:12.492500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:12.510082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99a61821-1a9e-4d52-bf3d-a752d2f4e916 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 1.089514 Sep 16 14:09:12.522538 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1500/3003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:11 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:12.522538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:12.522538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:12.534144 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54edb55b-3726-4f0c-90bf-8ebdef1ac03d tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1644 microversion: 2.1 time: 1.249773 Sep 16 14:09:12.543674 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1504/3004] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:11 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1644 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:12.560582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:12.563279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:12.564017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:12.564760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:12.565724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:12.566511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:12.566633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:12.567530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:12.583162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:12.587393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:12.589229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:12.591645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:12.593486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:12.594545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:13.637773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:13.650350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:13.658983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:13.660678 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f10305ea-885a-4bce-a8d7-2d7369ee7486 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 1.115159 Sep 16 14:09:13.664332 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1505/3005] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:12 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:13.676682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:13.677765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:13.699785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:13.700719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:13.701390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:13.702392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:13.703117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:13.703782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:13.750685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:13.794429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b66045a-0880-4e70-b1fb-67da9b92ed7b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1573 microversion: 2.1 time: 1.271343 Sep 16 14:09:13.796138 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1501/3006] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:12 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1573 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:13.813569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-81fc7354-c52b-4e03-8be1-6b7b756e10f0 req-6544333a-0c31-4c8d-b55a-314adfb55ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "tag": "582a7045-1ab3-40df-b52c-337c05d3e22e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:13.845087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81fc7354-c52b-4e03-8be1-6b7b756e10f0 req-6544333a-0c31-4c8d-b55a-314adfb55ecf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:13.852565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81fc7354-c52b-4e03-8be1-6b7b756e10f0 req-6544333a-0c31-4c8d-b55a-314adfb55ecf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:13.853553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81fc7354-c52b-4e03-8be1-6b7b756e10f0 req-6544333a-0c31-4c8d-b55a-314adfb55ecf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:13.894593 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-81fc7354-c52b-4e03-8be1-6b7b756e10f0 req-6544333a-0c31-4c8d-b55a-314adfb55ecf service nova] Creating event network-changed:582a7045-1ab3-40df-b52c-337c05d3e22e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:13.918701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-81fc7354-c52b-4e03-8be1-6b7b756e10f0 req-6544333a-0c31-4c8d-b55a-314adfb55ecf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120230 Sep 16 14:09:13.930454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1502/3007] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:13.936755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:13.937489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:13.955417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:13.955949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:13.956476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:13.957273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:13.957771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:13.958256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:15.393173 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a415d8b-e930-4986-9162-8b3ec0429580 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1644 microversion: 2.1 time: 1.727334 Sep 16 14:09:15.415756 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1506/3008] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:13 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1644 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:15.420830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:15.421475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:15.446778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:15.447298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:15.447755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:15.448497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:15.448971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:15.449409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:15.667848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:15.677841 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e88d1f5-6557-4d3c-9101-cbe31ebc7316 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 1.745583 Sep 16 14:09:15.678483 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1503/3009] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:13 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:15.690655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:15.709699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:15.733276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:15.734093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:15.743849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:15.748814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:15.750614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:15.755290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:16.882315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:16.896298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:16.898620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:16.901232 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-44ab5ab0-d6fe-439a-9467-fe7a786b9eab tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 1.484334 Sep 16 14:09:16.902707 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1507/3010] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:15 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:17.051781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-731853451", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:17.143595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] validate_networks() for [('b6e96422-2e47-440f-acfe-9dff7e892f6d', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:09:17.203551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:17.219804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc8945ea-b176-424c-ae31-0b7b3274c235 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1573 microversion: 2.1 time: 1.535714 Sep 16 14:09:17.221072 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1504/3011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:15 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1573 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:17.232684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:17.241047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:17.242762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:17.244397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:17.246355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:17.247356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:17.248052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:17.287009 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8b08c17-4a9a-427d-8cf3-6ac20158f391 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.058290 Sep 16 14:09:17.288616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1505/3012] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 14:09:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:17.294355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:17.295869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:17.304250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:17.305160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:17.305859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:17.308483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:17.309244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:17.309938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:18.633996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:18.648516 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c4be6de-0f81-49d3-a386-bee32b1bf789 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 1.358342 Sep 16 14:09:18.674511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1506/3013] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:17 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:18.689253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858129-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:18.704036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:18.775850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:18.776795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:18.777398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:18.789784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:18.793838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:18.813404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:19.109754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lazy-loading 'flavor' on Instance uuid 7f688628-999c-4cb5-a109-dbcef0dd7b53 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:19.159372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Going to try to live migrate instance to n-h1-858129-2 {{(pid=128642) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:09:20.176384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:09:20.196244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:09:20.197399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:09:20.198141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:09:20.198945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:09:20.313968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:20.318721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:20.320202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:20.321631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:20.324832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:20.325477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:20.381638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Getting quotas for project b57b11c530fd41fcae85cdeb1625bef1. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:09:20.400041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Getting quotas for user ad33707d02ae4a88a4e3ec736e192fd9 and project b57b11c530fd41fcae85cdeb1625bef1. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:09:20.443341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:09:20.451393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:09:20.665229 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70f462e5-da90-47f5-a172-d39b5a94ea41 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.760466 Sep 16 14:09:20.667232 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1508/3014] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:09:20.688731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:20.689913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:20.724494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:20.729477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:20.730598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:20.734768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:20.738258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:20.743149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:21.233463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:21.252387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:21.253909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:21.266457 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-771c5fcb-8291-4ef2-b2a0-c706c51d7a47 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 0.597341 Sep 16 14:09:21.267082 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1509/3015] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:20 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:21.292282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:21.293352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:21.330477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:21.332794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:21.333689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:21.362307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:21.364240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:21.365654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:22.307636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:22.329678 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a48beb87-6c4e-48c4-8883-faccb3816963 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1571 microversion: 2.1 time: 1.061352 Sep 16 14:09:22.336744 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1510/3016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:21 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1571 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:22.341829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5cd21c5f-e427-4ce3-b8c0-fb944c477a0c req-501256b4-ea30-46ee-ba82-3b702cb05a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe54e0ec-98cd-40b1-b7ec-73c492646b97", "name": "network-vif-plugged", "status": "completed", "tag": "3eff67ed-5f20-43bb-9e04-a53381d4bc5a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:22.384944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5cd21c5f-e427-4ce3-b8c0-fb944c477a0c req-501256b4-ea30-46ee-ba82-3b702cb05a54 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:22.390860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5cd21c5f-e427-4ce3-b8c0-fb944c477a0c req-501256b4-ea30-46ee-ba82-3b702cb05a54 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:22.391526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5cd21c5f-e427-4ce3-b8c0-fb944c477a0c req-501256b4-ea30-46ee-ba82-3b702cb05a54 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:22.424342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5cd21c5f-e427-4ce3-b8c0-fb944c477a0c req-501256b4-ea30-46ee-ba82-3b702cb05a54 service nova] Creating event network-vif-plugged:3eff67ed-5f20-43bb-9e04-a53381d4bc5a for instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 on n-h2-858129-2 Sep 16 14:09:22.448596 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5cd21c5f-e427-4ce3-b8c0-fb944c477a0c req-501256b4-ea30-46ee-ba82-3b702cb05a54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106958 Sep 16 14:09:22.457566 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1511/3017] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:22.469455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9c78acb7-193f-49e7-b305-8ae6b7c80d13 req-66d63444-e4a1-4307-ae1e-5c3ad927bfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "tag": "2293d578-698c-4604-88fc-8118b199b95e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:22.497019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9c78acb7-193f-49e7-b305-8ae6b7c80d13 req-66d63444-e4a1-4307-ae1e-5c3ad927bfb7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:22.499201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9c78acb7-193f-49e7-b305-8ae6b7c80d13 req-66d63444-e4a1-4307-ae1e-5c3ad927bfb7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:22.502202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9c78acb7-193f-49e7-b305-8ae6b7c80d13 req-66d63444-e4a1-4307-ae1e-5c3ad927bfb7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:22.527196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9c78acb7-193f-49e7-b305-8ae6b7c80d13 req-66d63444-e4a1-4307-ae1e-5c3ad927bfb7 service nova] Creating event network-changed:2293d578-698c-4604-88fc-8118b199b95e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:22.540129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9c78acb7-193f-49e7-b305-8ae6b7c80d13 req-66d63444-e4a1-4307-ae1e-5c3ad927bfb7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080442 Sep 16 14:09:22.543881 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1512/3018] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:22.558614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:22.559839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:22.587753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:22.588622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:22.589318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:22.590304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:22.591052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:22.591706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:23.293865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:23.303281 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80286d7a-7c20-4098-991d-e510b896d96e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.757507 Sep 16 14:09:23.319309 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1513/3019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:22 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:23.329673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:23.330743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:23.338105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:23.338982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:23.340025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:23.341141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:23.341827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:23.342504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:23.596935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:23.612022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31f30732-7b66-4dcf-96aa-5766b3d46252 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1275 microversion: 2.1 time: 0.287154 Sep 16 14:09:23.615418 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1514/3020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:23 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:23.630740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:23.635506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:23.651739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:23.654350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:23.655126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:23.659027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:23.660128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:23.661800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:24.758674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:24.780006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:24.813161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:24.822441 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa959913-d495-47d4-adfb-ca2fd7c32fd7 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1362 microversion: 2.26 time: 1.196727 Sep 16 14:09:24.825086 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1515/3021] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:23 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1362 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:24.847450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-783504200"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:24.849836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:24.873356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:24.875112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:24.877004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:24.880244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:24.882424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:24.883625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:25.192372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b58bc92e-5670-4877-a301-826ea7dfc00c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53/action" status: 202 len: 0 microversion: 2.1 time: 6.516055 Sep 16 14:09:25.195633 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1507/3022] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:09:18 2022] POST /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53/action => generated 0 bytes in 6521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:25.482635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f40a7cb7-5048-496a-8fe5-eb3d1f5b41ad tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c424670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-137277445", "description": "tempest-description-917240446"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:25.865687 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.network.security_group_api [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Adding security group 7b96feee-4063-409a-ac83-1e27758dbceb to port b647a263-3849-4a5a-85f4-9488ea229562 Sep 16 14:09:26.743488 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f40a7cb7-5048-496a-8fe5-eb3d1f5b41ad tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.545720 Sep 16 14:09:26.753702 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1508/3023] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:25 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:26.753702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:26.753702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:26.768839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:26.772730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:26.773435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:26.776741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:26.777541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:26.778319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:27.259781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:27.677261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:27.699080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9fd75436-273a-4e16-9a94-52e6baa489a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.951415 Sep 16 14:09:27.699605 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1509/3024] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:26 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:27.717715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:27.717715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:27.731834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=48 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:27.738114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:27.745333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:27.746008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:27.747353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:27.747858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:27.748326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:28.026793 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4647b5f0-1745-4a42-8df5-f897f9cc9c23 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9/action" status: 202 len: 0 microversion: 2.1 time: 3.195735 Sep 16 14:09:28.027631 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1516/3025] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:09:24 2022] POST /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9/action => generated 0 bytes in 3201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:28.035803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:28.036444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:28.052418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:28.052925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:28.055244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:28.058206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:28.059281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:28.059971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:28.318701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:28.344595 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e651cac1-0bde-467f-99cb-6aeab02966a3 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1323 microversion: 2.1 time: 0.640147 Sep 16 14:09:28.345945 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1510/3026] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:27 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:28.351662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:28.352678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:28.360383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:28.362098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:28.363188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:28.364925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:28.365711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:28.366460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:28.400921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:28.403903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:28.416202 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fef91d9-23a7-4bcd-9c89-5bc35de3acf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.384259 Sep 16 14:09:28.434310 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1517/3027] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:28 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:28.450610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23b2b17b-2340-4892-87b2-f1c167860e7d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724d3cd550>, body: {"security_group_rule": {"parent_group_id": "f166eb52-ad74-43f2-9271-4c2e49107dc6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:28.880769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:28.944589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:28.947792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:28.957843 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2f32bb8-5f1c-4e3c-83aa-a117a35fed82 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1545 microversion: 2.26 time: 0.608949 Sep 16 14:09:28.960976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1511/3028] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:28 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1545 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:28.973372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7874388f-81dd-434f-8abc-57beea092c0a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c424d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:29.430744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23b2b17b-2340-4892-87b2-f1c167860e7d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.995281 Sep 16 14:09:29.437493 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1518/3029] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:09:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:29.506272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bae87109-8964-441c-9917-16f02460cb0a req-225a4235-c039-4713-821e-318068e0c482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73ceef4-1887-4d38-8284-dbdbb2b101a9", "tag": "b647a263-3849-4a5a-85f4-9488ea229562"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:29.558557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bae87109-8964-441c-9917-16f02460cb0a req-225a4235-c039-4713-821e-318068e0c482 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.565727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bae87109-8964-441c-9917-16f02460cb0a req-225a4235-c039-4713-821e-318068e0c482 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.566549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bae87109-8964-441c-9917-16f02460cb0a req-225a4235-c039-4713-821e-318068e0c482 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.593111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-7874388f-81dd-434f-8abc-57beea092c0a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use.", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:29.594710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7874388f-81dd-434f-8abc-57beea092c0a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.594710 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7874388f-81dd-434f-8abc-57beea092c0a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb HTTP/1.1 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: exception: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7b96feee-4063-409a-ac83-1e27758dbceb'} Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:29.601598 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] Sep 16 14:09:29.609848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:29.619649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7874388f-81dd-434f-8abc-57beea092c0a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 400 to user: Security Group 7b96feee-4063-409a-ac83-1e27758dbceb in use. Sep 16 14:09:29.619649 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-6936f927-7e3d-4b8c-a8d8-ffd0bea22b17'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:29.623654 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bae87109-8964-441c-9917-16f02460cb0a req-225a4235-c039-4713-821e-318068e0c482 service nova] Creating event network-changed:b647a263-3849-4a5a-85f4-9488ea229562 for instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 on n-h1-858129-2 Sep 16 14:09:29.626298 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7874388f-81dd-434f-8abc-57beea092c0a tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb" status: 400 len: 185 microversion: 2.1 time: 0.661478 Sep 16 14:09:29.630809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1512/3030] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:28 2022] DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb => generated 185 bytes in 669 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:09:29.643742 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bae87109-8964-441c-9917-16f02460cb0a req-225a4235-c039-4713-821e-318068e0c482 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199659 Sep 16 14:09:29.649280 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1519/3031] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:29.656317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8ac57055-5cdb-4de3-b7cb-03036afdf5ac req-bddf7b73-8ee6-4129-b1b6-a5f33fe08afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9578e0-724f-45cb-9441-6b9fd5cea54d", "tag": "8d82a513-7379-48a7-b02d-9a4094f7ff73"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:29.661077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:29.663373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:29.682474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.687945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.690204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.691624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.694007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.695407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.696458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8ac57055-5cdb-4de3-b7cb-03036afdf5ac req-bddf7b73-8ee6-4129-b1b6-a5f33fe08afb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.698843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8ac57055-5cdb-4de3-b7cb-03036afdf5ac req-bddf7b73-8ee6-4129-b1b6-a5f33fe08afb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.700313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8ac57055-5cdb-4de3-b7cb-03036afdf5ac req-bddf7b73-8ee6-4129-b1b6-a5f33fe08afb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.732071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8ac57055-5cdb-4de3-b7cb-03036afdf5ac req-bddf7b73-8ee6-4129-b1b6-a5f33fe08afb service nova] Creating event network-changed:8d82a513-7379-48a7-b02d-9a4094f7ff73 for instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d on n-h2-858129-2 Sep 16 14:09:29.750860 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8ac57055-5cdb-4de3-b7cb-03036afdf5ac req-bddf7b73-8ee6-4129-b1b6-a5f33fe08afb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115462 Sep 16 14:09:29.752842 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1513/3032] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:29.767094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c424c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:29.795883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.796703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.797452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.798856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:29.814614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.816058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.817342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.818910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.821424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.822861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.898129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.900191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.901171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:29.933288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:29.935323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:29.936544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:30.004395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:30.068557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-386b35fe-58d9-4719-9fde-6882467c4fcd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1172590177" status: 201 len: 0 microversion: 2.26 time: 0.313358 Sep 16 14:09:30.070555 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1514/3033] 10.222.0.60 () {62 vars in 1380 bytes} [Fri Sep 16 14:09:29 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1172590177 => generated 0 bytes in 316 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 16 14:09:30.077534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:30.078789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:30.091815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:30.095571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:30.096269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:30.097808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:30.101145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:30.101832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:30.360617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:30.429357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:30.931426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:30.948934 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-94605438-9c26-4597-afce-9290113d27bb tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 1.296211 Sep 16 14:09:30.950136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1520/3034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:29 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:30.957918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:30.959621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:30.975013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:30.977559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:30.978800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:30.980671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:30.981821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:30.982945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:31.002876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:31.024337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bfb3dadb-3856-430b-b676-6caeea2c7734 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1323 microversion: 2.1 time: 0.950582 Sep 16 14:09:31.026941 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1515/3035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:30 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1323 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:31.043783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18ec5c25-b210-4e8f-baaa-a40bc4404717 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c5681f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1980680967", "description": "tempest-description-1003102860"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:32.401663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:32.425606 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6467b00-2e72-4813-8b51-6892b1742871 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 1.473669 Sep 16 14:09:32.452044 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1521/3036] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:30 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:32.469773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:32.472777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:32.497971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:32.504929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:32.512024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:32.514298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:32.516360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:32.517200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:32.582610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:09:32.807970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d189c194-a191-458c-8188-9f4848a04339 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 204 len: 0 microversion: 2.1 time: 0.350418 Sep 16 14:09:32.809357 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1522/3037] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:09:32 2022] DELETE /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:09:32.820420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b08863c9-9eb3-41e4-b008-49cad4d33b6a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724d339f70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:32.827286 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18ec5c25-b210-4e8f-baaa-a40bc4404717 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.797695 Sep 16 14:09:32.838793 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1516/3038] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:32.846356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:32.848008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:32.877814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:32.879096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b08863c9-9eb3-41e4-b008-49cad4d33b6a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:32.884705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b08863c9-9eb3-41e4-b008-49cad4d33b6a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:32.885745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:32.888708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:32.889104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b08863c9-9eb3-41e4-b008-49cad4d33b6a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:32.892063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:32.894330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:32.895126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:32.955850 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b08863c9-9eb3-41e4-b008-49cad4d33b6a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1172590177" status: 204 len: 0 microversion: 2.26 time: 0.143619 Sep 16 14:09:32.965787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:32.969579 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1523/3039] 10.222.0.60 () {60 vars in 1361 bytes} [Fri Sep 16 14:09:32 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1172590177 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:32.977001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:32.983882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:33.003252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:33.005687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:33.007970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:33.011393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:33.013915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:33.015018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:33.394734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:33.407028 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9e74f4dc-f230-4f2b-b93e-2bd69116c231 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1323 microversion: 2.1 time: 0.435549 Sep 16 14:09:33.412385 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1524/3040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:32 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:33.426029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:33.426677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:33.434640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:33.435643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:33.436251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:33.437163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:33.438122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:33.438763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:33.444191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:33.462016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fff9df6-7248-4a38-b02e-571b6a97adef tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.620032 Sep 16 14:09:33.479255 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1517/3041] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:32 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:33.503485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-709b2941-b531-4e1e-9ade-3167960d783b tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c568160>, body: {"security_group_rule": {"parent_group_id": "427b66b3-774c-40f8-ac55-b0e73409cd96", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:34.005234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:34.018283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a8ff6a0e-83e7-4209-a542-19e68f10be92 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1645 microversion: 2.1 time: 0.599098 Sep 16 14:09:34.030491 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1525/3042] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:33 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1645 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:34.035872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724d3940d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:34.044890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.045814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.046463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.047124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:34.055174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.055679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.056123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.056861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.057324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.057757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.090556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.091338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.091951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.122735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:34.144809 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9c275950-2219-4903-a4bd-f8dc330229ff tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 204 len: 0 microversion: 2.26 time: 0.112971 Sep 16 14:09:34.155004 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1526/3043] 10.222.0.60 () {60 vars in 1295 bytes} [Fri Sep 16 14:09:34 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:34.602904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1185478329", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:34.689790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:09:34.690628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:09:34.691260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:09:34.691782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:09:34.692303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:09:34.708393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.711391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.712035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.712971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.713967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.714819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.759619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Getting quotas for project c890d662261d4097904f4d0af9eab89f. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:09:34.770489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Getting quotas for user 191128c26e5149d184537ae451f16a16 and project c890d662261d4097904f4d0af9eab89f. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:09:34.794593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:09:34.799033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:09:34.873146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ddc414f-390f-4c67-950b-d3f228ee67e7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.715259 Sep 16 14:09:34.874957 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1527/3044] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:09:34.906384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:34.907660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:34.936912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.938528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.939364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:34.940894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:34.941761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:34.942575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:35.026103 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-709b2941-b531-4e1e-9ade-3167960d783b tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.544770 Sep 16 14:09:35.042484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1518/3045] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:09:33 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:35.043654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7b070d59-166e-4ed9-ad92-fbfa0717cd8e req-a6f38ea7-e986-4ff2-bf53-e9a6dc29eaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f688628-999c-4cb5-a109-dbcef0dd7b53", "name": "network-vif-unplugged", "status": "completed", "tag": "2501a8f9-83ad-477f-9fc2-b55d2c748974"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:35.076927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7b070d59-166e-4ed9-ad92-fbfa0717cd8e req-a6f38ea7-e986-4ff2-bf53-e9a6dc29eaed service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:35.078040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7b070d59-166e-4ed9-ad92-fbfa0717cd8e req-a6f38ea7-e986-4ff2-bf53-e9a6dc29eaed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:35.079015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7b070d59-166e-4ed9-ad92-fbfa0717cd8e req-a6f38ea7-e986-4ff2-bf53-e9a6dc29eaed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:35.130178 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7b070d59-166e-4ed9-ad92-fbfa0717cd8e req-a6f38ea7-e986-4ff2-bf53-e9a6dc29eaed service nova] Creating event network-vif-unplugged:2501a8f9-83ad-477f-9fc2-b55d2c748974 for instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 on n-h2-858129-2 Sep 16 14:09:35.157059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7b070d59-166e-4ed9-ad92-fbfa0717cd8e req-a6f38ea7-e986-4ff2-bf53-e9a6dc29eaed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124626 Sep 16 14:09:35.165614 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1519/3046] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:35.191771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fda482a7-0d2b-4a09-85eb-781d9cfe1ccd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c504040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:35.229300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda482a7-0d2b-4a09-85eb-781d9cfe1ccd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:35.229672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda482a7-0d2b-4a09-85eb-781d9cfe1ccd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:35.230461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fda482a7-0d2b-4a09-85eb-781d9cfe1ccd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:35.270553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fda482a7-0d2b-4a09-85eb-781d9cfe1ccd tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 200 len: 12 microversion: 2.26 time: 0.102451 Sep 16 14:09:35.271656 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1520/3047] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 14:09:35 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 12 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:35.295475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:35.301514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:35.326019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:35.332216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:35.337188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:35.339218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:35.344772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:35.348247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:35.620818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:35.636266 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a6f96d56-db7a-4473-8c6d-f1e9ef6d6401 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.758803 Sep 16 14:09:35.637639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1528/3048] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:34 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:35.644576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:35.645638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:35.654821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:35.655721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:35.656409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:35.657466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:35.658724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:35.659665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:36.117810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:36.129813 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-198fa17f-c902-4bd5-8e0a-2ada3f65c9a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1323 microversion: 2.1 time: 0.855114 Sep 16 14:09:36.130874 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1521/3049] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:35 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1323 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:36.138128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:36.139089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:36.148841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:36.149665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:36.150551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:36.152556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:36.153253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:36.154017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:36.270673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:36.293719 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2211430b-c41c-4086-b572-4886f5f857af tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.654006 Sep 16 14:09:36.305295 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1529/3050] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:35 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:36.323683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:36.325363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:36.338867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:36.342193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:36.343674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:36.344764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:36.347057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:36.349162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:36.350291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:36.370724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:36.392126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:36.394579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:36.397065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d737ac9-d0e6-418d-be77-f1a5702d1f42 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1274 microversion: 2.54 time: 0.263631 Sep 16 14:09:36.408912 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1522/3051] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:36 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1274 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:36.440631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5e56045-39e3-4895-8bb7-758eb42cf3da tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c5049d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1051686660", "description": "tempest-description-1624828224"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:36.976269 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5e56045-39e3-4895-8bb7-758eb42cf3da tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.562730 Sep 16 14:09:36.977239 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1523/3052] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:36 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:36.993689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c424160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:37.015206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.015910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.016484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.017103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:37.030864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.032103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.033142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.035062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.036548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.037577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.107529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.108927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.109701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.131510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.133386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.134584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.223453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:37.229420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:37.269512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c103c399-60ea-4b98-8223-f2882ffa9d7e tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 200 len: 1645 microversion: 2.1 time: 0.959402 Sep 16 14:09:37.270452 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1530/3053] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:36 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 1645 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:37.291330 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40fd7444-288d-4ee4-94a6-206440731258 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-681454356" status: 201 len: 0 microversion: 2.26 time: 0.312237 Sep 16 14:09:37.292757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:37.303448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:37.306610 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1524/3054] 10.222.0.60 () {62 vars in 1377 bytes} [Fri Sep 16 14:09:36 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-681454356 => generated 0 bytes in 329 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 16 14:09:37.337941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1ca89c1d-46fe-4bc2-9d7b-ac23f45a8374 req-17919eb7-9617-4c9d-8d5d-bc046d16445d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9578e0-724f-45cb-9441-6b9fd5cea54d", "name": "network-vif-plugged", "status": "completed", "tag": "8d82a513-7379-48a7-b02d-9a4094f7ff73"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:37.361854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.364516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.368592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.375306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.377768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.379651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1ca89c1d-46fe-4bc2-9d7b-ac23f45a8374 req-17919eb7-9617-4c9d-8d5d-bc046d16445d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.380767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.381526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1ca89c1d-46fe-4bc2-9d7b-ac23f45a8374 req-17919eb7-9617-4c9d-8d5d-bc046d16445d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.383232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1ca89c1d-46fe-4bc2-9d7b-ac23f45a8374 req-17919eb7-9617-4c9d-8d5d-bc046d16445d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.417850 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1ca89c1d-46fe-4bc2-9d7b-ac23f45a8374 req-17919eb7-9617-4c9d-8d5d-bc046d16445d service nova] Creating event network-vif-plugged:8d82a513-7379-48a7-b02d-9a4094f7ff73 for instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d on n-h2-858129-2 Sep 16 14:09:37.431870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1ca89c1d-46fe-4bc2-9d7b-ac23f45a8374 req-17919eb7-9617-4c9d-8d5d-bc046d16445d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112606 Sep 16 14:09:37.434003 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1525/3055] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:37.444899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f352ca46-5be9-4b77-954f-c91a0003905d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c37c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-449995468", "description": "tempest-description-450243037"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:37.781851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:37.819855 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4a2edc6-5322-4e26-9e45-0677a4927cb1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.545621 Sep 16 14:09:37.823607 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1531/3056] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:37 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:37.846631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:37.856455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:37.872821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.873675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.874494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:37.875878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:37.876781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:37.877570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.142234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f352ca46-5be9-4b77-954f-c91a0003905d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.705348 Sep 16 14:09:38.143888 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1526/3057] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:37 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:38.157923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f688628-999c-4cb5-a109-dbcef0dd7b53", "tag": "2501a8f9-83ad-477f-9fc2-b55d2c748974"}, {"server_uuid": "b73ceef4-1887-4d38-8284-dbdbb2b101a9", "name": "network-vif-deleted", "tag": "b647a263-3849-4a5a-85f4-9488ea229562"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:38.185081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.186499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.187005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.217144 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] Creating event network-changed:2501a8f9-83ad-477f-9fc2-b55d2c748974 for instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 on n-h2-858129-2 Sep 16 14:09:38.217671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] Creating event network-vif-deleted:b647a263-3849-4a5a-85f4-9488ea229562 for instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 on n-h1-858129-2 Sep 16 14:09:38.244662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-dce71eb1-136c-4658-af56-10fa8506e2bc req-b749bdff-11dd-4cc2-aa16-c053a5558c2a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098592 Sep 16 14:09:38.245632 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1527/3058] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:38.253738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1a7c68d-a4c1-420d-9b61-b494906f6c22 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724d690a60>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:38.268844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a7c68d-a4c1-420d-9b61-b494906f6c22 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.269437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a7c68d-a4c1-420d-9b61-b494906f6c22 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.271499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a7c68d-a4c1-420d-9b61-b494906f6c22 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.317042 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1a7c68d-a4c1-420d-9b61-b494906f6c22 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 200 len: 35 microversion: 2.26 time: 0.070003 Sep 16 14:09:38.323564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1528/3059] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 14:09:38 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 35 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:38.332161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:38.332946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:38.353241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.354911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.355911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.358827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.359312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.359774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.408002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:38.425687 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6a053aba-e037-4bfe-bee1-bb8b744c5392 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1323 microversion: 2.1 time: 0.599659 Sep 16 14:09:38.430667 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1532/3060] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:37 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:38.441614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:38.443323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:38.455690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.457081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.458190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.460700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.462019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.463258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.671755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:38.684354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:38.684860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:38.686142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e498e95c-aea9-47c3-a05f-1efca82b7229 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1336 microversion: 2.54 time: 0.253559 Sep 16 14:09:38.699854 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1533/3061] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:38 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1336 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:38.715171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52548595-f828-4d33-a3bc-08383d1cad72 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724d001a60>, body: {"security_group_rule": {"parent_group_id": "a9cff83d-89a8-4a30-8c2c-e9ae68299747", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1632faf7-9113-48ba-88ca-76dc0b29e825"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:38.754331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:38.771076 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4879c32e-cdfb-4e5b-8507-381eb44926a2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.448014 Sep 16 14:09:38.773422 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1529/3062] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:38 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:38.780693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:38.782605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:38.792827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.794138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.795043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.796165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.796892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.797491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.822093 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 HTTP/1.1 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'b73ceef4-1887-4d38-8284-dbdbb2b101a9'} Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:38.825014 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:38.830391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:38.832674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:38.836142 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-245bd12a-2087-4a2f-94fe-9f8fd49b57d0 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 404 len: 111 microversion: 2.1 time: 0.059479 Sep 16 14:09:38.841877 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1530/3063] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:38 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:38.849439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c5681f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:38.860150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.860981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.862348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.863553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:38.875183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.876431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.878724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.884855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.887037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.888050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:38.949740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:38.951287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:38.952367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:39.016189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:39.068882 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8385a1c-3513-4cb1-b6bb-71356c603871 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-681454356" status: 204 len: 0 microversion: 2.26 time: 0.224891 Sep 16 14:09:39.070883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1531/3064] 10.222.0.60 () {60 vars in 1361 bytes} [Fri Sep 16 14:09:38 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-681454356 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:39.081886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-949f3722-c7da-41a4-a232-baed3c0a7adf tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c568280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:39.198428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52548595-f828-4d33-a3bc-08383d1cad72 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.497243 Sep 16 14:09:39.199664 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1534/3065] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:09:38 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:39.215087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:39.215773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:39.239392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:39.240549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:39.249600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:39.252946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:39.253913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:39.255327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:39.450093 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-949f3722-c7da-41a4-a232-baed3c0a7adf tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19" status: 202 len: 0 microversion: 2.1 time: 0.377722 Sep 16 14:09:39.451884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1532/3066] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:39 2022] DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:39.457802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe027afd-881c-4adb-a6fd-3e5c08af9bdb tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724d690820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:39.484959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe027afd-881c-4adb-a6fd-3e5c08af9bdb tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:39.485924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe027afd-881c-4adb-a6fd-3e5c08af9bdb tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:39.486794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe027afd-881c-4adb-a6fd-3e5c08af9bdb tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:39.507971 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe027afd-881c-4adb-a6fd-3e5c08af9bdb tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 200 len: 12 microversion: 2.26 time: 0.054648 Sep 16 14:09:39.512982 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1533/3067] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 14:09:39 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:39.522967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f485f6f-ab5a-4ba4-924e-f976a2f48574 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c4c69d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1816514605", "description": "tempest-description-1111542144"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:39.656009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:39.680367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-840be1ba-5a50-435c-acae-2b4b7013e46e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.471021 Sep 16 14:09:39.680982 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1535/3068] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:39 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:39.686586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:39.687506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:39.695132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:39.695956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:39.696590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:39.697574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:39.698225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:39.698867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:39.702276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:39.953218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f485f6f-ab5a-4ba4-924e-f976a2f48574 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.438532 Sep 16 14:09:39.959629 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1534/3069] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:39.974246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37816d85-24e4-4b33-b37d-40e073e3673b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c3f4280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:40.154653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:40.181116 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35ee58f1-85dc-4ccc-a8f8-b1a21a257dfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1323 microversion: 2.1 time: 0.498184 Sep 16 14:09:40.182709 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1536/3070] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:39 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:40.214346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-plugged", "status": "completed", "tag": "582a7045-1ab3-40df-b52c-337c05d3e22e"}, {"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-plugged", "status": "completed", "tag": "2293d578-698c-4604-88fc-8118b199b95e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:40.255832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.257436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.258911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.303741 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] Creating event network-vif-plugged:582a7045-1ab3-40df-b52c-337c05d3e22e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:40.305399 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] Creating event network-vif-plugged:2293d578-698c-4604-88fc-8118b199b95e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:40.317641 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-734761ff-119c-48d8-a336-52bb3eb3e740 req-8369dfc9-92d1-465e-b65b-84869ee90e92 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117024 Sep 16 14:09:40.319867 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1537/3071] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:40.332694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724d37be50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:40.351034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.352549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.353599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.355140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:40.367736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.368989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.370025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.371512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.372590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.373566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.452409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.453008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.453496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.507144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:40.519873 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37816d85-24e4-4b33-b37d-40e073e3673b tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb" status: 202 len: 0 microversion: 2.1 time: 0.557435 Sep 16 14:09:40.524771 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1535/3072] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:39 2022] DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:40.533889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:40.534853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:40.581593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.582908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.583978 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-18816249-32ee-4b87-81d6-f0a8d0d57d4c tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 204 len: 0 microversion: 2.26 time: 0.259646 Sep 16 14:09:40.585790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.587340 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1538/3073] 10.222.0.60 () {60 vars in 1295 bytes} [Fri Sep 16 14:09:40 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:40.593707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.594696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.595598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.599856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:40.600727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:40.609362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.610227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.610802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.611638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:40.612235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:40.613216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:40.747527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:40.764526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:40.767726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:40.771402 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46214d14-28e7-468d-bc20-c2fb380db69e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1336 microversion: 2.54 time: 0.244251 Sep 16 14:09:40.786792 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1536/3074] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:40 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1336 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:40.787678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c8e7d29-0868-4a22-97ee-925d5bfd93eb tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c51c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-73146556", "description": "tempest-description-242397498"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:40.925142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:40.940040 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7de12fed-e479-48c2-89b2-255c473d2d6c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.350963 Sep 16 14:09:40.944305 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1539/3075] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:40 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:40.952712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b31e53e-9699-4fb2-bd6f-716133de9762 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'create', calling method: .version_select at 0x7f724c5fbe50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-463918435", "description": "tempest-description-1646123044"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:41.166023 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c8e7d29-0868-4a22-97ee-925d5bfd93eb tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.384897 Sep 16 14:09:41.188757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1537/3076] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:40 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:41.215228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c4244c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:41.244876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.246654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.248460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.249447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:41.262503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.264133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.265730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.266213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.266699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.267205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.303916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.304686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.305199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.328856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.329998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.331066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.400200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:41.406668 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b31e53e-9699-4fb2-bd6f-716133de9762 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.460781 Sep 16 14:09:41.421210 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1540/3077] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:41.421210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:41.421210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:41.434235 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-341b1289-d7f2-4669-aa2e-5c3db1924895 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1952310592" status: 201 len: 0 microversion: 2.26 time: 0.243151 Sep 16 14:09:41.436077 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1538/3078] 10.222.0.60 () {62 vars in 1380 bytes} [Fri Sep 16 14:09:41 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1952310592 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 16 14:09:41.445757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.447094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.447544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2adeaaf1-bf9a-4160-9af8-7683c99a4626 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724c33b3a0>, body: {"security_group_rule": {"parent_group_id": "fe425ef0-fcd0-4892-8116-303708f802a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "06cfc7e7-19ba-4ce9-a381-d6df94b23f1a"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:41.448055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.451981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.453013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.459230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.830103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:41.853051 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dd53c7d9-d74f-4ee9-b513-3ca03eafdcba tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.444236 Sep 16 14:09:41.854978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1541/3079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:41 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:41.875169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:41.876645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:41.894043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.895320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.896218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:41.897254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:41.898221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:41.899193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.098931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2adeaaf1-bf9a-4160-9af8-7683c99a4626 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.660471 Sep 16 14:09:42.115139 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1539/3080] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:09:41 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:42.129742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3709515e-9333-4856-adc6-9345fe7b1d29 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Action: 'update', calling method: .version_select at 0x7f724c51cb80>, body: {"security_group": {"name": "tempest-sg-hth-12305485", "description": "tempest-description-hth-1904032023"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:42.277602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:42.296214 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eece7059-82aa-40f5-be48-9d2ac2ed688d tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1519 microversion: 2.1 time: 0.439264 Sep 16 14:09:42.303215 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1542/3081] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:41 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1519 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:42.309244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f72517cc0d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:42.321113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.321787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.322346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.323032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:42.330188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.330967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.331721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.332624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.333210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.333827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.427879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.429196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.430261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.454374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.457623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.458753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.520061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:42.535000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3709515e-9333-4856-adc6-9345fe7b1d29 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/166eaf97-3471-4b75-892c-e962c851cab3" status: 200 len: 216 microversion: 2.1 time: 0.418274 Sep 16 14:09:42.536324 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1540/3082] 10.222.0.60 () {60 vars in 1290 bytes} [Fri Sep 16 14:09:42 2022] PUT /compute/v2.1/os-security-groups/166eaf97-3471-4b75-892c-e962c851cab3 => generated 216 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:42.545143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:42.547044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:42.573691 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0ded90d1-f457-47a5-87bd-03e3ada5be8e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-294654920" status: 201 len: 0 microversion: 2.26 time: 0.268753 Sep 16 14:09:42.576245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.576878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1543/3083] 10.222.0.60 () {62 vars in 1377 bytes} [Fri Sep 16 14:09:42 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-294654920 => generated 0 bytes in 273 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 16 14:09:42.577762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.579937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.580985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.582471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.584403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.588358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:42.589189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:42.597419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.598293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.599016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.599967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:42.603259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:42.604021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:42.708183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:42.724312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:42.733313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:42.739433 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7af07e2-54f0-490d-9348-5fdedfe997f3 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1336 microversion: 2.54 time: 0.201019 Sep 16 14:09:42.743140 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1541/3084] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:42 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1336 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:42.762679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-beb7f1c7-2f79-4575-985d-cadb22880e31 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f7251795700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:42.956446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:42.972828 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01fff1ec-42ce-422a-838d-125580b30e78 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.393378 Sep 16 14:09:42.973462 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1544/3085] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:42 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:42.997406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b4bd6796-64ec-4654-ae8c-d98d9771eee6 req-593b92b6-336e-49ac-9f1d-3232f216f129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-plugged", "status": "completed", "tag": "c232d20d-75fa-4211-97d8-6f619be4b717"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:43.021380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b4bd6796-64ec-4654-ae8c-d98d9771eee6 req-593b92b6-336e-49ac-9f1d-3232f216f129 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.024675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b4bd6796-64ec-4654-ae8c-d98d9771eee6 req-593b92b6-336e-49ac-9f1d-3232f216f129 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.025115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b4bd6796-64ec-4654-ae8c-d98d9771eee6 req-593b92b6-336e-49ac-9f1d-3232f216f129 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.052927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b4bd6796-64ec-4654-ae8c-d98d9771eee6 req-593b92b6-336e-49ac-9f1d-3232f216f129 service nova] Creating event network-vif-plugged:c232d20d-75fa-4211-97d8-6f619be4b717 for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:43.062908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b4bd6796-64ec-4654-ae8c-d98d9771eee6 req-593b92b6-336e-49ac-9f1d-3232f216f129 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072042 Sep 16 14:09:43.063555 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1545/3086] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:43.079371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-34df5b96-b8c3-4c43-9621-85c2b1e99885 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d23d310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:43.190821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-34df5b96-b8c3-4c43-9621-85c2b1e99885 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/166eaf97-3471-4b75-892c-e962c851cab3" status: 200 len: 216 microversion: 2.1 time: 0.120587 Sep 16 14:09:43.199708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1546/3087] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:09:43 2022] GET /compute/v2.1/os-security-groups/166eaf97-3471-4b75-892c-e962c851cab3 => generated 216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:43.231142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724d3cd160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:43.248482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.249356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.250036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.251722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:43.264796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.266083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.266768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.270568 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-beb7f1c7-2f79-4575-985d-cadb22880e31 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/06cfc7e7-19ba-4ce9-a381-d6df94b23f1a" status: 202 len: 0 microversion: 2.1 time: 0.523951 Sep 16 14:09:43.273200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1542/3088] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:42 2022] DELETE /compute/v2.1/os-security-groups/06cfc7e7-19ba-4ce9-a381-d6df94b23f1a => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:43.278568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88e2dc5d-7fe8-4b9b-b606-df8f54ee5c96 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1920918966", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:43.283474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.285519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88e2dc5d-7fe8-4b9b-b606-df8f54ee5c96 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 243 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1920918966", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1920918966', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b6e96422-2e47-440f-acfe-9dff7e892f6d'}]}}} Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:43.299482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:43.304893 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:43.309158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.314643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88e2dc5d-7fe8-4b9b-b606-df8f54ee5c96 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:43.317662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88e2dc5d-7fe8-4b9b-b606-df8f54ee5c96 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.041639 Sep 16 14:09:43.319489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1543/3089] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:43 2022] POST /compute/v2.1/servers => generated 175 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:09:43.332956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:43.334535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:43.352830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.353659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.354264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.355002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.356006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.357086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.358584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:43.360609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:43.362037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:43.388274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:43.414979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-008ed906-4bc0-47fd-b86f-28425f276e7b tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 204 len: 0 microversion: 2.26 time: 0.213457 Sep 16 14:09:43.415972 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1547/3090] 10.222.0.60 () {60 vars in 1295 bytes} [Fri Sep 16 14:09:43 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:43.419362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:43.422019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c48c9f17-6072-4b25-9762-21c9679e9f5d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d35eb80>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:43.835812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:43.857376 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3d16364-aac9-49f9-a8ff-42a9b0356cf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.534725 Sep 16 14:09:43.858356 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1544/3091] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:43 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:43.877560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e901eef-fb2c-4d54-bed7-dde8a1719bfc tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f7251795b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.065107 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c48c9f17-6072-4b25-9762-21c9679e9f5d tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/166eaf97-3471-4b75-892c-e962c851cab3" status: 202 len: 0 microversion: 2.1 time: 0.647799 Sep 16 14:09:44.066739 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1548/3092] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:43 2022] DELETE /compute/v2.1/os-security-groups/166eaf97-3471-4b75-892c-e962c851cab3 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:44.074134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-96bfc014-0ce5-4152-b8e5-822db7d470df tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.074724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-96bfc014-0ce5-4152-b8e5-822db7d470df tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 531e25ea-a4e8-4893-a0db-4fba284c4529] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:44.106720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e901eef-fb2c-4d54-bed7-dde8a1719bfc tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/fe425ef0-fcd0-4892-8116-303708f802a8" status: 200 len: 248 microversion: 2.1 time: 0.245779 Sep 16 14:09:44.106989 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-96bfc014-0ce5-4152-b8e5-822db7d470df tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] HTTP exception thrown: Instance 531e25ea-a4e8-4893-a0db-4fba284c4529 could not be found. Sep 16 14:09:44.107980 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1545/3093] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:09:43 2022] GET /compute/v2.1/os-security-groups/fe425ef0-fcd0-4892-8116-303708f802a8 => generated 248 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:44.115536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ddb58cc6-684d-4a91-84bb-21c33ab9d43e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724ceb6820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-96bfc014-0ce5-4152-b8e5-822db7d470df tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/531e25ea-a4e8-4893-a0db-4fba284c4529/metadata HTTP/1.1 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 531e25ea-a4e8-4893-a0db-4fba284c4529 could not be found. Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': '531e25ea-a4e8-4893-a0db-4fba284c4529'} Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531e25ea-a4e8-4893-a0db-4fba284c4529 could not be found. Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531e25ea-a4e8-4893-a0db-4fba284c4529 could not be found. Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:44.119460 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:44.124132 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:44.124132 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:44.124132 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531e25ea-a4e8-4893-a0db-4fba284c4529 could not be found. Sep 16 14:09:44.124132 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.126942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-96bfc014-0ce5-4152-b8e5-822db7d470df tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 404 to user: Instance 531e25ea-a4e8-4893-a0db-4fba284c4529 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:44.129537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-96bfc014-0ce5-4152-b8e5-822db7d470df tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/531e25ea-a4e8-4893-a0db-4fba284c4529/metadata" status: 404 len: 111 microversion: 2.1 time: 0.061661 Sep 16 14:09:44.147125 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1549/3094] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:09:44 2022] GET /compute/v2.1/servers/531e25ea-a4e8-4893-a0db-4fba284c4529/metadata => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:44.161833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.162363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb58cc6-684d-4a91-84bb-21c33ab9d43e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.165039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb58cc6-684d-4a91-84bb-21c33ab9d43e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.166197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb58cc6-684d-4a91-84bb-21c33ab9d43e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.166525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:44.200858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.203074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.204322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.206492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.206817 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ddb58cc6-684d-4a91-84bb-21c33ab9d43e tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 200 len: 12 microversion: 2.26 time: 0.097327 Sep 16 14:09:44.208199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.209250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.212655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1546/3095] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 14:09:44 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 12 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:44.222715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.223370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:44.232664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.233185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.233636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.234380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.234970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.235416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.353681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:44.373031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:44.377663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:44.381242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ac1a45fe-789f-491e-9295-ca94f8cc14c7 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1357 microversion: 2.54 time: 0.229080 Sep 16 14:09:44.395356 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1550/3096] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:44 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:44.415333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.416578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:44.440580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.441721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.443151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.445161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.446147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.447244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.477731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 HTTP/1.1 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b73ceef4-1887-4d38-8284-dbdbb2b101a9'} Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:44.481118 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.489812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:44.493233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c26fbb36-368a-40ca-9303-b6b92dc8d50c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 404 len: 111 microversion: 2.1 time: 0.094635 Sep 16 14:09:44.495371 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1551/3097] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:09:44 2022] DELETE /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:44.505356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6320a0ec-9e0e-462d-99ac-18948f4d0caf tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724d0453a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1805640133", "description": "tempest-description-1678077183"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:44.549525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:44.558995 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3dba7135-7f38-4e7d-b6df-5b2779803cd5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1354 microversion: 2.1 time: 0.344858 Sep 16 14:09:44.575725 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1547/3098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:44 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1354 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:44.584027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c3b5940>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:44.594728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.595753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.597718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.600702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:44.608992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.610853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.611518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.612423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.613321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.613929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.664579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:44.671685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:44.672428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:44.695635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:44.726815 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f8b8b02-da7f-4a98-bf17-3acd75a05ed1 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 204 len: 0 microversion: 2.26 time: 0.149523 Sep 16 14:09:44.734873 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1548/3099] 10.222.0.60 () {60 vars in 1295 bytes} [Fri Sep 16 14:09:44 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:44.741763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:44.744643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3d114f7-c1c5-4d56-8b33-afa9c03a8e74 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1403779127", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3d114f7-c1c5-4d56-8b33-afa9c03a8e74 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 499 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1403779127", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1403779127', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b6e96422-2e47-440f-acfe-9dff7e892f6d'}]}}} Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:09:44.755791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:44.765597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3d114f7-c1c5-4d56-8b33-afa9c03a8e74 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:44.772610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3d114f7-c1c5-4d56-8b33-afa9c03a8e74 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.042095 Sep 16 14:09:44.774393 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1549/3100] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:44 2022] POST /compute/v2.1/servers => generated 687 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:09:44.786512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:44.788962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-537a9879-e2d2-446c-aab9-8237bccd19af tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Action: 'create', calling method: .version_select at 0x7f724d690310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-89041090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHiVa/GxpSp+0uFA92WLIoMCmf65Sg6sSF2eiQSvhO3UtaTLLVLlBW/n7vWZmBvYjY/DzeM0utu1kTpiutSnXi5vG42GAM/OzGixDZROJxcszhtWHh/Y+wuok5vBh+Y/g=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:44.830864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-537a9879-e2d2-446c-aab9-8237bccd19af tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Getting quotas for project c890d662261d4097904f4d0af9eab89f. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:09:44.858568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-537a9879-e2d2-446c-aab9-8237bccd19af tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Getting quotas for user 191128c26e5149d184537ae451f16a16 and project c890d662261d4097904f4d0af9eab89f. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:09:44.977726 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6320a0ec-9e0e-462d-99ac-18948f4d0caf tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.480231 Sep 16 14:09:44.980645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1552/3101] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:09:44 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:44.982940 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-537a9879-e2d2-446c-aab9-8237bccd19af tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.206086 Sep 16 14:09:44.994444 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1550/3102] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 14:09:44 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 14:09:45.008322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:45.010839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c447820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:45.012404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: b73ceef4-1887-4d38-8284-dbdbb2b101a9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:45.028693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.030825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.031923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.033642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.034803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.036312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.067303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.070838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.071748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.071938 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:45.072607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 HTTP/1.1 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b73ceef4-1887-4d38-8284-dbdbb2b101a9'} Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:45.076243 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Instance b73ceef4-1887-4d38-8284-dbdbb2b101a9 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a59c7b47-e655-499a-a4eb-06420fe8ae2c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9" status: 404 len: 111 microversion: 2.1 time: 0.101595 Sep 16 14:09:45.087612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1553/3103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:44 2022] GET /compute/v2.1/servers/b73ceef4-1887-4d38-8284-dbdbb2b101a9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:45.097153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:45.097153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:45.102161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.105030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.106926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.107706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.109442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.109928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.110782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.111397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.116191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.117866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.118999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.119683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.192138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.193308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.195051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.232648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.233304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.234036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.304406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:45.325463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40db3109-940f-4daa-a5e5-c28cef91672a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1975495925" status: 201 len: 0 microversion: 2.26 time: 0.338952 Sep 16 14:09:45.333583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1551/3104] 10.222.0.60 () {62 vars in 1380 bytes} [Fri Sep 16 14:09:44 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-1975495925 => generated 0 bytes in 341 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 16 14:09:45.333583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-841fce8a-3ebb-4287-bc8e-af41d6ee9ba7 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724daa3b80>, body: {"security_group_rule": {"parent_group_id": "b530f0d0-869b-4db5-90c3-e2400afd2469", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:45.372708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:45.388929 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed5e1584-f297-4371-81ef-4e59a2f15485 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.298847 Sep 16 14:09:45.389670 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1554/3105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:45 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:45.400143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-89041090", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:45.403701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:45.411686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.412521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.414595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.415631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.416273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.416875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.636256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:09:45.637165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:09:45.638027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:09:45.638654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:09:45.639259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:09:45.802875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:45.836852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:45.856132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.857324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.858977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.861370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:45.863077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:45.864343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:45.960312 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9459208b-591a-4ae2-8962-7305d2bba76e tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "POST /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4/action" status: 202 len: 1138 microversion: 2.54 time: 0.567984 Sep 16 14:09:45.961930 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1555/3106] 10.222.0.60 () {62 vars in 1320 bytes} [Fri Sep 16 14:09:45 2022] POST /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4/action => generated 1138 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 14:09:45.971762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74abedab-199a-4372-9d10-c3c2a86cedd2 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-471269704", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74abedab-199a-4372-9d10-c3c2a86cedd2 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 499 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-471269704", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-471269704', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b6e96422-2e47-440f-acfe-9dff7e892f6d'}]}}} Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:09:45.993734 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:46.000131 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.008549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74abedab-199a-4372-9d10-c3c2a86cedd2 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:46.008549 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-74abedab-199a-4372-9d10-c3c2a86cedd2 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.041864 Sep 16 14:09:46.019044 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1556/3107] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:45 2022] POST /compute/v2.1/servers => generated 689 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:09:46.041198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d3cd700>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:46.122842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:46.124384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group 7b96feee-4063-409a-ac83-1e27758dbceb not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:46.125738 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.125738 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb HTTP/1.1 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7b96feee-4063-409a-ac83-1e27758dbceb'} Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:46.130157 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] Sep 16 14:09:46.141899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.162368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group 7b96feee-4063-409a-ac83-1e27758dbceb does not exist Sep 16 14:09:46.162368 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-b1275d7b-b177-4982-a24d-1a4f7e69a065'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:46.168820 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-617e54c2-23ce-40e3-b166-f38704933dd8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb" status: 404 len: 194 microversion: 2.1 time: 0.146159 Sep 16 14:09:46.174690 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1557/3108] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:46 2022] DELETE /compute/v2.1/os-security-groups/7b96feee-4063-409a-ac83-1e27758dbceb => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:46.208345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724e2bf040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:46.230603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.231270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.231779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.232428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:46.247295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.255195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.255877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.259105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.260060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.260701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.283361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-841fce8a-3ebb-4287-bc8e-af41d6ee9ba7 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.955194 Sep 16 14:09:46.285581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1552/3109] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:09:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:46.295332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:46.306901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:46.326744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.327797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.328641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.330564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.331616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.332424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.337124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.337628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.338240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.361658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.362171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.362899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.409280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:46.432117 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9c50eb67-7d35-4df6-8864-0d71fbd5c60f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-982364237" status: 201 len: 0 microversion: 2.26 time: 0.243421 Sep 16 14:09:46.433669 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1558/3110] 10.222.0.60 () {62 vars in 1377 bytes} [Fri Sep 16 14:09:46 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags/tempest-tag-982364237 => generated 0 bytes in 258 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 16 14:09:46.440332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:46.441740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:46.451395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.452813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.453786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.455105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:46.456080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:46.456793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:46.680928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:46.690069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:46.692721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:46.694370 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a91e9732-e077-4a39-9157-3a725847d7e6 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.259470 Sep 16 14:09:46.695614 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1559/3111] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:46 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:46.700927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91cacef3-09c7-4d06-8e27-3060b806bdfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-365019349", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91cacef3-09c7-4d06-8e27-3060b806bdfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 753 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-365019349", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-365019349', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b6e96422-2e47-440f-acfe-9dff7e892f6d'}]}}} Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:09:46.708913 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:09:46.712495 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:09:46.716738 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:46.716738 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.716738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91cacef3-09c7-4d06-8e27-3060b806bdfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:46.716738 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91cacef3-09c7-4d06-8e27-3060b806bdfd tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014912 Sep 16 14:09:46.728382 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1560/3112] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:46 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 16 14:09:46.757711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d3cdf70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:46.914441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:46.915104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group fba08248-7dbd-4374-8bd5-44567c365b19 not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:46.915637 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.915637 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19 HTTP/1.1 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'fba08248-7dbd-4374-8bd5-44567c365b19'} Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:46.918521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group fba08248-7dbd-4374-8bd5-44567c365b19 does not exist Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-ff091be9-a3be-40b7-b43c-e7cf5ae763bf'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f44e177-5ef4-4f00-a399-b610be46073f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19" status: 404 len: 194 microversion: 2.1 time: 0.174922 Sep 16 14:09:46.924819 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1561/3113] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:46 2022] DELETE /compute/v2.1/os-security-groups/fba08248-7dbd-4374-8bd5-44567c365b19 => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:46.932702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c92b8bbc-5c61-4d81-b2d4-9613da2f5a4e tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Action: 'create', calling method: .version_select at 0x7f724d0765e0>, body: {"security_group_rule": {"parent_group_id": "b530f0d0-869b-4db5-90c3-e2400afd2469", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:47.055605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:47.073342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-afff05ce-2cda-4afa-8505-38a7bc4c8f79 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1804 microversion: 2.1 time: 0.785438 Sep 16 14:09:47.074514 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1553/3114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:46 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1804 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:47.084533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.087437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:47.100437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.102043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.106443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.109483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.110886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.112114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.409958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:47.419419 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01cf0898-4dcb-431c-b609-689121722506 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1503 microversion: 2.1 time: 0.342796 Sep 16 14:09:47.435048 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1554/3115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:47 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:47.443412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Action: 'update_all', calling method: .version_select at 0x7f7251817160>, body: {"tags": ["tempest-tag-1075003990", "tempest-tag-1615069150"]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:47.455200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.455703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.456374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.457323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:47.463877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.464372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.464877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.465614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.466078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.466545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.495487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.495984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.496428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.508335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c92b8bbc-5c61-4d81-b2d4-9613da2f5a4e tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.580273 Sep 16 14:09:47.519355 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1562/3116] 10.222.0.60 () {60 vars in 1195 bytes} [Fri Sep 16 14:09:46 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:47.525350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e67056e-673e-46ff-8390-0ac6f480b4e7 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1177311011", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:47.532869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e67056e-673e-46ff-8390-0ac6f480b4e7 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 1266 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1177311011", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b6e96422-2e47-440f-acfe-9dff7e892f6d"}]}} Sep 16 14:09:47.534942 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1177311011', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b6e96422-2e47-440f-acfe-9dff7e892f6d'}]}}} Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.539479 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:09:47.541711 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:09:47.550146 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 16 14:09:47.550146 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.550146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e67056e-673e-46ff-8390-0ac6f480b4e7 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:47.550146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e67056e-673e-46ff-8390-0ac6f480b4e7 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.015418 Sep 16 14:09:47.550146 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1563/3117] 10.222.0.60 () {60 vars in 1148 bytes} [Fri Sep 16 14:09:47 2022] POST /compute/v2.1/servers => generated 2221 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 16 14:09:47.560377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d0019d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.565694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ddd77b50-913f-47d0-b061-984cdc278723 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 200 len: 62 microversion: 2.26 time: 0.129083 Sep 16 14:09:47.567000 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1555/3118] 10.222.0.60 () {62 vars in 1312 bytes} [Fri Sep 16 14:09:47 2022] PUT /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 62 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:47.602918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:47.609945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group b2ca63ff-5e3e-4724-821f-dfe6399436ea not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:47.610869 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.610869 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea HTTP/1.1 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b2ca63ff-5e3e-4724-821f-dfe6399436ea'} Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:47.614584 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] Sep 16 14:09:47.620056 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.625097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group b2ca63ff-5e3e-4724-821f-dfe6399436ea does not exist Sep 16 14:09:47.625097 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-cb1f7afe-33ea-4d1c-92b5-8ddc85fec707'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:47.626388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1e36b11-148e-438d-9b14-e5384ba69ab4 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea" status: 404 len: 194 microversion: 2.1 time: 0.088307 Sep 16 14:09:47.627230 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1564/3119] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:47 2022] DELETE /compute/v2.1/os-security-groups/b2ca63ff-5e3e-4724-821f-dfe6399436ea => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:47.643976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.651744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:47.652818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87858c6a-f669-4b79-86d9-af3030135303 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Action: 'create', calling method: .version_select at 0x7f72518171f0>, body: {"keypair": {"name": "tempest-keypair-542374580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL16yBAKf0lGJnJxK1VjZqn5Gp9XI3NmqwVasNiOZHToJGqL8HlCW7sX1Fz0+XiKlHyuBrGpXFYSYv8lKLnj+f/3GDa5f3eBZMMtx6LBjOqcOd1XOEJyehjoKER6awa2FQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:47.659675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.660278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.660800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.661626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.662187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.662793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.693951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-87858c6a-f669-4b79-86d9-af3030135303 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Getting quotas for project 2eb7fba2489d4550b2d9427e40497843. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:09:47.701175 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0a65cf6-138c-451a-99c2-bea459c2388f tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79/ips" status: 200 len: 218 microversion: 2.1 time: 0.072559 Sep 16 14:09:47.702719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1565/3120] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:09:47 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79/ips => generated 218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:47.710736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bba935db-e99e-4cee-9c6e-badfc2985dbd tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f72517cc4c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.716583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-87858c6a-f669-4b79-86d9-af3030135303 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Getting quotas for user 8c5518cf0c1847889877570177c3fbb1 and project 2eb7fba2489d4550b2d9427e40497843. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:09:47.765865 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87858c6a-f669-4b79-86d9-af3030135303 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.197639 Sep 16 14:09:47.766967 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1556/3121] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:09:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:47.781453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0d658d6-ad5d-4156-9e72-7bb5e12d65a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.782713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0d658d6-ad5d-4156-9e72-7bb5e12d65a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 9c5e9515-e48b-4264-829b-c70c5637951b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:47.790655 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b0d658d6-ad5d-4156-9e72-7bb5e12d65a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] HTTP exception thrown: Instance 9c5e9515-e48b-4264-829b-c70c5637951b could not be found. Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0d658d6-ad5d-4156-9e72-7bb5e12d65a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/9c5e9515-e48b-4264-829b-c70c5637951b/metadata/test2 HTTP/1.1 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9c5e9515-e48b-4264-829b-c70c5637951b could not be found. Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '9c5e9515-e48b-4264-829b-c70c5637951b', 'id': 'test2'} Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5e9515-e48b-4264-829b-c70c5637951b could not be found. Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5e9515-e48b-4264-829b-c70c5637951b could not be found. Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.792959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.797066 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:47.797066 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:47.797066 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5e9515-e48b-4264-829b-c70c5637951b could not be found. Sep 16 14:09:47.797066 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.799947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0d658d6-ad5d-4156-9e72-7bb5e12d65a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 404 to user: Instance 9c5e9515-e48b-4264-829b-c70c5637951b could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:47.801739 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0d658d6-ad5d-4156-9e72-7bb5e12d65a9 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/9c5e9515-e48b-4264-829b-c70c5637951b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024979 Sep 16 14:09:47.814893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1557/3122] 10.222.0.60 () {58 vars in 1281 bytes} [Fri Sep 16 14:09:47 2022] GET /compute/v2.1/servers/9c5e9515-e48b-4264-829b-c70c5637951b/metadata/test2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:47.836770 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bba935db-e99e-4cee-9c6e-badfc2985dbd tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/b530f0d0-869b-4db5-90c3-e2400afd2469" status: 200 len: 665 microversion: 2.1 time: 0.132403 Sep 16 14:09:47.837424 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1566/3123] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:09:47 2022] GET /compute/v2.1/os-security-groups/b530f0d0-869b-4db5-90c3-e2400afd2469 => generated 665 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:47.846093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3340d187-3d04-4edc-8fe7-ec28d5dc3c2a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c51cb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.855941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d076280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.863348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3340d187-3d04-4edc-8fe7-ec28d5dc3c2a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.865114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3340d187-3d04-4edc-8fe7-ec28d5dc3c2a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.867951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3340d187-3d04-4edc-8fe7-ec28d5dc3c2a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.880086 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3340d187-3d04-4edc-8fe7-ec28d5dc3c2a tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 200 len: 62 microversion: 2.26 time: 0.064705 Sep 16 14:09:47.882006 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1558/3124] 10.222.0.60 () {60 vars in 1292 bytes} [Fri Sep 16 14:09:47 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 62 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:47.887820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.888630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:47.891266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:47.898343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.899250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.899911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.900932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.901600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.902262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:47.938956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:47.940051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:47.941415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.941415 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3 HTTP/1.1 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '596f1f0c-e0da-4741-bc41-1507ff2f6ad3'} Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:47.945801 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] Sep 16 14:09:47.950253 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:47.954432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group 596f1f0c-e0da-4741-bc41-1507ff2f6ad3 does not exist Sep 16 14:09:47.954432 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-f2c71c55-ebee-4091-9636-032612fc5503'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:47.956363 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97776e4e-0d3f-4332-951a-9d9a2581ab74 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3" status: 404 len: 194 microversion: 2.1 time: 0.107469 Sep 16 14:09:47.960897 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1567/3125] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:47 2022] DELETE /compute/v2.1/os-security-groups/596f1f0c-e0da-4741-bc41-1507ff2f6ad3 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:47.966154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:09:47.971845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:47.974642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:47.995227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:47.999123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:47.999596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.000380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.003323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.004535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.145799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:48.154209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9532e501-ed8b-40ac-97bc-3daf5923d3ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 204 len: 0 microversion: 2.1 time: 0.269335 Sep 16 14:09:48.155205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1559/3126] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:09:47 2022] DELETE /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:09:48.162775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:48.163994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:48.164872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:48.169477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:48.171947 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0928685-2a86-4860-9505-3c37471caba8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.209419 Sep 16 14:09:48.172788 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1568/3127] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:47 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:48.173905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.174686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.175433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.176385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.177033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.177647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.180766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6088be10-57fa-4bb0-a6ef-a1f49617aa83 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724c6598b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:48.218376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:09:48.394791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-021d2344-3104-4f2f-a3dc-0f9579b66d19 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 204 len: 0 microversion: 2.1 time: 0.237615 Sep 16 14:09:48.396683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1560/3128] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:09:48 2022] DELETE /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:09:48.407292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '.version_select at 0x7f724c3343a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:48.420194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.422897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.428798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.429757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:48.437589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.438788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.439468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.440610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.441309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.441918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.456146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6088be10-57fa-4bb0-a6ef-a1f49617aa83 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/d8b73f78-367b-4000-9862-3c3dfb0f8bc3" status: 202 len: 0 microversion: 2.1 time: 0.281363 Sep 16 14:09:48.457149 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1569/3129] 10.222.0.60 () {58 vars in 1287 bytes} [Fri Sep 16 14:09:48 2022] DELETE /compute/v2.1/os-security-group-rules/d8b73f78-367b-4000-9862-3c3dfb0f8bc3 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:48.466275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724cff30d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:48.473583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=4,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:48.533019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.534607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.535573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.555579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:48.556176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group dc92b004-3c94-4496-b884-e5f1e3802638 not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:48.556698 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.556698 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638 HTTP/1.1 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'dc92b004-3c94-4496-b884-e5f1e3802638'} Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:48.559436 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] Sep 16 14:09:48.563766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:48.568053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group dc92b004-3c94-4496-b884-e5f1e3802638 does not exist Sep 16 14:09:48.568053 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-d95dd360-1d15-4f57-9d4e-cfdb3dd10c0a'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:48.570010 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-855f5525-ae50-46e2-978a-36f80d05e14c tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638" status: 404 len: 194 microversion: 2.1 time: 0.111650 Sep 16 14:09:48.571280 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1570/3130] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:48 2022] DELETE /compute/v2.1/os-security-groups/dc92b004-3c94-4496-b884-e5f1e3802638 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:48.583086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:48.588199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:48.592275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lazy-loading 'flavor' on Instance uuid fe54e0ec-98cd-40b1-b7ec-73c492646b97 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:48.615232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.615763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.616755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.617505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.618152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.618817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.634621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa76b440-bae0-46cf-8037-1f2b348a0796 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags" status: 204 len: 0 microversion: 2.26 time: 0.235059 Sep 16 14:09:48.635904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1561/3131] 10.222.0.60 () {60 vars in 1295 bytes} [Fri Sep 16 14:09:48 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97/tags => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:48.649988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:48.651437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:48.663614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.664527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.665317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:48.666730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:48.667503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:48.668231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.333689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:49.354649 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b8db34f-3b1e-4d6c-83b5-86d0093d425d tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1810 microversion: 2.1 time: 0.781881 Sep 16 14:09:49.356675 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1571/3132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:48 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1810 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:49.384251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:49.386257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:49.394511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:49.395329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:49.399004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:49.399223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.400524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:49.401310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:49.402002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.409946 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56bf4d38-061d-48ca-91cb-2d80b5125172 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1525 microversion: 2.1 time: 0.767395 Sep 16 14:09:49.411407 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1562/3133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:48 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1525 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:49.426925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3275245-9bb9-4c07-a611-c1f0a8c6564d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724ceb61f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:49.655233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:49.683486 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4ce62aca-38f8-4782-9a24-767bd856c335 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1493 microversion: 2.1 time: 0.309534 Sep 16 14:09:49.684099 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1572/3134] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:49 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1493 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:49.722915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724d37bdc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:49.782668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:49.785431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Neutron security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:49.786822 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.786822 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] Sep 16 14:09:49.797875 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3275245-9bb9-4c07-a611-c1f0a8c6564d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b530f0d0-869b-4db5-90c3-e2400afd2469" status: 202 len: 0 microversion: 2.1 time: 0.383788 Sep 16 14:09:49.800151 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1563/3135] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:49 2022] DELETE /compute/v2.1/os-security-groups/b530f0d0-869b-4db5-90c3-e2400afd2469 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f HTTP/1.1 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '78eb41dd-dc5c-46b7-9bf6-5133a33dc62f'} Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:49.812861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] Sep 16 14:09:49.823866 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:49.835980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Security group 78eb41dd-dc5c-46b7-9bf6-5133a33dc62f does not exist Sep 16 14:09:49.835980 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-69f10aa7-a382-4259-9904-8ccab5733458'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:49.836671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:49.837993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f68beab9-fe17-413d-8b76-18cbe45f6923 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f" status: 404 len: 194 microversion: 2.1 time: 0.148494 Sep 16 14:09:49.841328 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1573/3136] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:49 2022] DELETE /compute/v2.1/os-security-groups/78eb41dd-dc5c-46b7-9bf6-5133a33dc62f => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:49.842514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:49.873173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:49.873999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:49.875154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.877098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:49.878251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:49.880015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.882454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:49.883306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:49.915463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:49.917434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:49.920113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.925437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:49.926760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:49.932279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:49.949363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:09:50.065510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:50.083366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:50.092240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:50.095464 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55aec361-275f-464e-ab09-28d3886b3972 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.250234 Sep 16 14:09:50.097448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1574/3137] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:49 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:50.106610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3dad3a1d-8a05-4bfe-a451-a004065187fe tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '.version_select at 0x7f724d0763a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:50.116989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dad3a1d-8a05-4bfe-a451-a004065187fe tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.118450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dad3a1d-8a05-4bfe-a451-a004065187fe tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.119578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dad3a1d-8a05-4bfe-a451-a004065187fe tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.121374 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a75e2758-90b5-47d5-a121-f948adfa7520 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 204 len: 0 microversion: 2.26 time: 0.318305 Sep 16 14:09:50.123044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1564/3138] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:09:49 2022] DELETE /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:09:50.138856 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3dad3a1d-8a05-4bfe-a451-a004065187fe tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.038966 Sep 16 14:09:50.139806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724c3f4040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:50.156032 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1575/3139] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 14:09:50 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:50.165830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:50.168349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:50.184959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.185870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.186704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.188267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.189293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.190235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.225912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:09:50.226965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.security_group_api [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Neutron security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a not found {{(pid=128642) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:09:50.228006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] HTTP exception thrown: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.228006 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Request method failure captured: Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-security-groups/06cfc7e7-19ba-4ce9-a381-d6df94b23f1a HTTP/1.1 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIOT2rsik_wJ1z5h3rpYxDrwWV3w2qolyXbhiCguh-bLT2JeF4nOHIAr0R8PvL35p3Ej8mBEwC4P48PmNy-eBfi_nAWmTYX6yKxKjvq595ubGJPVE_qDKRbFEoHdJIPsFFztQL-es2byGifpc_meTSUsoq8eoU_h2Su56No4r64XfcM Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 02643ef5bfed41a5bf4e8d46dbab1f25 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1573205207 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_02643ef5bfed41a5bf4e8d46dbab1f25", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02643ef5bfed41a5bf4e8d46dbab1f25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/02643ef5bfed41a5bf4e8d46dbab1f25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/02643ef5bfed41a5bf4e8d46dbab1f25"}]}] Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1573205207 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 02643ef5bfed41a5bf4e8d46dbab1f25 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1573205207 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupRulesTestJSON-1573205207-project Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 78434fbbe8534d53b89574b4abfce7f7 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1573205207-project Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '06cfc7e7-19ba-4ce9-a381-d6df94b23f1a'} Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:09:50.232403 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Returning 404 to user: Security group 06cfc7e7-19ba-4ce9-a381-d6df94b23f1a does not exist Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-accdd408-b802-44a6-a77a-412c050fc57d'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:50.245824 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-15c321cc-8c89-4aa7-9c03-0e49317f7e36 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/06cfc7e7-19ba-4ce9-a381-d6df94b23f1a" status: 404 len: 194 microversion: 2.1 time: 0.110930 Sep 16 14:09:50.261338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:09:50.261904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1565/3140] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:50 2022] DELETE /compute/v2.1/os-security-groups/06cfc7e7-19ba-4ce9-a381-d6df94b23f1a => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:50.270062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:50.271529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:50.321997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.323034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.324757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.325840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.326960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.327763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.399043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af0368d7-3b17-40d1-87da-e692047a8f6f tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 204 len: 0 microversion: 2.1 time: 0.240237 Sep 16 14:09:50.401905 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1576/3141] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:09:50 2022] DELETE /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:09:50.414699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:50.416168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:50.428074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.429425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.433172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.435300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:50.436756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:50.437915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:50.861351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:50.874894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:50.877334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f6b0424165e45b4ba7174edf479056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981d20129f2c4bc8b6dc3209a2c94ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:50.879060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-921cc27a-cad5-4006-9dc5-8a49ec5df379 tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 200 len: 1551 microversion: 2.26 time: 0.628051 Sep 16 14:09:50.879891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1566/3142] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:50 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 1551 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:50.886062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3895b7f9-0850-4dff-93fb-1edba458a183 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724c447af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:51.025974 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c78e84f9-a1e1-415f-99d1-eeccbc7e6035 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1644 microversion: 2.1 time: 0.620098 Sep 16 14:09:51.028062 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1577/3143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:50 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1644 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:51.040301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:51.042205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:51.056190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:51.057448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:51.058212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:51.059777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:51.060717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:51.061357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:51.539909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:51.564983 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a57893ab-0431-4d49-a94c-48315f1f091e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1810 microversion: 2.1 time: 0.533467 Sep 16 14:09:51.567322 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1578/3144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:51 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1810 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:51.578516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:51.580498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:51.645571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:51.651469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:51.655606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:51.660377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:51.663335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:51.669405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:51.717888 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3895b7f9-0850-4dff-93fb-1edba458a183 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fe425ef0-fcd0-4892-8116-303708f802a8" status: 202 len: 0 microversion: 2.1 time: 0.836270 Sep 16 14:09:51.719419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1567/3145] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:50 2022] DELETE /compute/v2.1/os-security-groups/fe425ef0-fcd0-4892-8116-303708f802a8 => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:51.728730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:51.729855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:51.768902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:51.769782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:51.770611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:51.772812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:51.777078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:51.779415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:52.628973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad33707d02ae4a88a4e3ec736e192fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57b11c530fd41fcae85cdeb1625bef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:52.645778 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-632a6bc3-6734-42c9-818e-321787508518 tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 200 len: 1525 microversion: 2.1 time: 0.924592 Sep 16 14:09:52.660166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1568/3146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:51 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 1525 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:52.677153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5735796b-5b28-443d-aca0-a2066c6c0be3"}], "security_groups": [{"name": "tempest-securitygroup--1304824433"}], "key_name": "tempest-keypair-542374580", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:52.887570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a665ee509e48a9b2e3b6a1d173081b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d47597cbd942ea88af1b5c7e70c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:52.909235 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ff9adf22-b976-45c1-80da-222c350cdec8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 200 len: 1646 microversion: 2.1 time: 1.338704 Sep 16 14:09:52.928433 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1579/3147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:51 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 1646 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:52.946732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:52.950625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:52.966219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:52.968581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:52.969711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:52.971547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:52.972688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:52.975004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:53.077679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] validate_networks() for [('5735796b-5b28-443d-aca0-a2066c6c0be3', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:09:53.170062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:53.194225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:53.198635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:53.202057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-171e6941-ca98-407b-95cb-5898a636b447 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.271532 Sep 16 14:09:53.204210 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1580/3148] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:52 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:53.214745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1873612371", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "941f1dd8-b04a-486d-bbeb-3b2d2413b0c1"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:53.356840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] validate_networks() for [('941f1dd8-b04a-486d-bbeb-3b2d2413b0c1', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:09:55.044672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:09:55.045476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:09:55.045860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:09:55.051628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:09:55.052460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:09:55.070952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.071942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.072575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.073576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.074568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.075179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.103675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Getting quotas for project 2eb7fba2489d4550b2d9427e40497843. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:09:55.113479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Getting quotas for user 8c5518cf0c1847889877570177c3fbb1 and project 2eb7fba2489d4550b2d9427e40497843. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:09:55.142254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:09:55.147964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:09:55.246758 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4cdd43f7-018b-4212-882e-733b935f2a07 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.584501 Sep 16 14:09:55.259201 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1569/3149] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:09:55.268595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ae111b9e-7071-47e8-a53e-a7375c929a48 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724c334790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:55.650125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:09:55.651051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:09:55.652098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:09:55.652098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:09:55.652435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:09:55.663137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.663790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.664176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.665203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.665663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.666142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.691202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:09:55.699709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for user 35e0a11712764fa5b78e9ac4d1859f3a and project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:09:55.717639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:09:55.720283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:09:55.743183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:55.775097 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abc9e1c8-7c40-45d6-818b-47b57c440d7b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.568836 Sep 16 14:09:55.782780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1581/3150] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:09:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:09:55.789329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:55.790372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] [instance: fe54e0ec-98cd-40b1-b7ec-73c492646b97] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:55.798137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.799089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.799874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.800956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.801660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.802330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.820702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:09:55.823326 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] HTTP exception thrown: Instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 could not be found. Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Request method failure captured: Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 HTTP/1.1 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINsMWD-fRZrojw7ZXKLE3iFi_qSaXFYn9Hy7ejjrTJd1VajWGy-3QAeQ3oKd4WldCxhKZKttj0gFx_ULbAmRZbjRYDqn5Q2qx3pb4clMRPWC61wys9kV3XKPJxXP31oz-h-rVPALopcmO_j7UlqcoVJI4QOgRWS8o6zvriHjlwQejQ Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.26 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 981d20129f2c4bc8b6dc3209a2c94ceb Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerTagsTestJSON-733401056 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_981d20129f2c4bc8b6dc3209a2c94ceb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/981d20129f2c4bc8b6dc3209a2c94ceb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/981d20129f2c4bc8b6dc3209a2c94ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/981d20129f2c4bc8b6dc3209a2c94ceb"}]}] Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerTagsTestJSON-733401056 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 981d20129f2c4bc8b6dc3209a2c94ceb Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerTagsTestJSON-733401056 Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerTagsTestJSON-733401056-project Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2f6b0424165e45b4ba7174edf479056b Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerTagsTestJSON-733401056-project Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 could not be found. Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'fe54e0ec-98cd-40b1-b7ec-73c492646b97'} Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 could not be found. Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 could not be found. Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:55.827314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 could not be found. Sep 16 14:09:55.831716 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:55.835083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] Returning 404 to user: Instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:55.836456 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54b088ff-df97-499c-a2f1-990a6127654f tempest-ServerTagsTestJSON-733401056 tempest-ServerTagsTestJSON-733401056-project] 10.222.0.60 "GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97" status: 404 len: 111 microversion: 2.26 time: 0.052257 Sep 16 14:09:55.841178 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1582/3151] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:55 2022] GET /compute/v2.1/servers/fe54e0ec-98cd-40b1-b7ec-73c492646b97 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:09:55.848198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bfc95f87-5d99-4c19-b49e-207b2efafd5d req-0400f6e0-dbac-4a95-b8eb-648aa3ccfbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-deleted", "tag": "2293d578-698c-4604-88fc-8118b199b95e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:55.867669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bfc95f87-5d99-4c19-b49e-207b2efafd5d req-0400f6e0-dbac-4a95-b8eb-648aa3ccfbfe service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.869647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bfc95f87-5d99-4c19-b49e-207b2efafd5d req-0400f6e0-dbac-4a95-b8eb-648aa3ccfbfe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.870808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bfc95f87-5d99-4c19-b49e-207b2efafd5d req-0400f6e0-dbac-4a95-b8eb-648aa3ccfbfe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.896763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bfc95f87-5d99-4c19-b49e-207b2efafd5d req-0400f6e0-dbac-4a95-b8eb-648aa3ccfbfe service nova] Creating event network-vif-deleted:2293d578-698c-4604-88fc-8118b199b95e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:55.909177 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bfc95f87-5d99-4c19-b49e-207b2efafd5d req-0400f6e0-dbac-4a95-b8eb-648aa3ccfbfe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065311 Sep 16 14:09:55.911274 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1583/3152] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:55.930237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:55.932032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:55.962168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.964687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.965439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:55.972861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:55.973743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:55.974660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:56.996623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:57.033950 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2fe46dac-40d9-48f7-9b8f-1e74a8e2cd14 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1653 microversion: 2.1 time: 1.119353 Sep 16 14:09:57.035809 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1584/3153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:55 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1653 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:57.041514 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae111b9e-7071-47e8-a53e-a7375c929a48 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/1632faf7-9113-48ba-88ca-76dc0b29e825" status: 202 len: 0 microversion: 2.1 time: 1.780285 Sep 16 14:09:57.045863 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1570/3154] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:55 2022] DELETE /compute/v2.1/os-security-groups/1632faf7-9113-48ba-88ca-76dc0b29e825 => generated 0 bytes in 1786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:57.050452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:57.052565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ceecbaf8-d282-4f06-94c4-4b86ba9e1ab2 req-ea7e67e8-ec92-47a2-9dc0-d46774045577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9578e0-724f-45cb-9441-6b9fd5cea54d", "name": "network-vif-deleted", "tag": "8d82a513-7379-48a7-b02d-9a4094f7ff73"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:57.060312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] [instance: 8f9578e0-724f-45cb-9441-6b9fd5cea54d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:57.081914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ceecbaf8-d282-4f06-94c4-4b86ba9e1ab2 req-ea7e67e8-ec92-47a2-9dc0-d46774045577 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.082695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ceecbaf8-d282-4f06-94c4-4b86ba9e1ab2 req-ea7e67e8-ec92-47a2-9dc0-d46774045577 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.083317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ceecbaf8-d282-4f06-94c4-4b86ba9e1ab2 req-ea7e67e8-ec92-47a2-9dc0-d46774045577 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.086370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.087235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.087978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.089328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.090182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.091284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.125121 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] HTTP exception thrown: Instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d could not be found. Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Request method failure captured: Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d HTTP/1.1 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIOKuL7ZR-s_n3vAP0zb1mC3sWD8O8zQo7nF8tW4AKIZKpH8XL85zw1RODPRu7gm9Z5fmv5hNS0na3yxIuMGhkS6wer_0Uh4UurkEjA-0C0jXTrIfVPaKXdn8GdxG7Wk0rdUVka59yOzeMbIWLkw6dnlEYTIUjD_hAa0rLUQhp6xGBM Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b57b11c530fd41fcae85cdeb1625bef1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b57b11c530fd41fcae85cdeb1625bef1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b57b11c530fd41fcae85cdeb1625bef1"}]}] Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b57b11c530fd41fcae85cdeb1625bef1 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1965444463 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ad33707d02ae4a88a4e3ec736e192fd9 Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1965444463-project Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d could not be found. Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8f9578e0-724f-45cb-9441-6b9fd5cea54d'} Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d could not be found. Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d could not be found. Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.128326 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d could not be found. Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] Returning 404 to user: Instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb73f394-aaf1-4cdf-867b-86839e81dd1e tempest-ServerMetadataNegativeTestJSON-1965444463 tempest-ServerMetadataNegativeTestJSON-1965444463-project] 10.222.0.60 "GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d" status: 404 len: 111 microversion: 2.1 time: 0.093470 Sep 16 14:09:57.141451 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1585/3155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:57 2022] GET /compute/v2.1/servers/8f9578e0-724f-45cb-9441-6b9fd5cea54d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:57.146212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ceecbaf8-d282-4f06-94c4-4b86ba9e1ab2 req-ea7e67e8-ec92-47a2-9dc0-d46774045577 service nova] Creating event network-vif-deleted:8d82a513-7379-48a7-b02d-9a4094f7ff73 for instance 8f9578e0-724f-45cb-9441-6b9fd5cea54d on n-h2-858129-2 Sep 16 14:09:57.146487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:57.146487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] [instance: 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:57.153739 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ceecbaf8-d282-4f06-94c4-4b86ba9e1ab2 req-ea7e67e8-ec92-47a2-9dc0-d46774045577 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105040 Sep 16 14:09:57.159795 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1571/3156] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:57.163083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.163945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.164723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.165966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.166824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.167552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.177199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:57.179572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:57.202607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.204035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.205251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.209451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.210908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.212116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.231102 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] HTTP exception thrown: Instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d could not be found. Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Request method failure captured: Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d HTTP/1.1 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIL2rBN57QDKwCVNtl-hm0nHgPxM0IseozkfzHxmTSNzuqWMPd4lvGkld_wi6BBx9nqO_5p_E6Ij29v4oj3PGTy6h6jnHHuMwSb1Wn65gq4P9aYH4ZNeVT7pecFWKLDK4bDIPron7ooctavXOSRFEAcoCVEb3DjuKulvIB4mxXBHJRI Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a9d47597cbd942ea88af1b5c7e70c365", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a9d47597cbd942ea88af1b5c7e70c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a9d47597cbd942ea88af1b5c7e70c365"}]}] Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: a9d47597cbd942ea88af1b5c7e70c365 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-739179359 Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 15a665ee509e48a9b2e3b6a1d173081b Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsTestJSON-739179359-project Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d could not be found. Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '3a7ae519-0081-4bc0-aeab-9729b5cd5f3d'} Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d could not be found. Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d could not be found. Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:09:57.234128 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d could not be found. Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Returning 404 to user: Instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca6fa033-8682-465b-95c8-1c922a008bd6 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d" status: 404 len: 111 microversion: 2.1 time: 0.102088 Sep 16 14:09:57.246638 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1586/3157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:57 2022] GET /compute/v2.1/servers/3a7ae519-0081-4bc0-aeab-9729b5cd5f3d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:09:57.268124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a75601ed-c6b9-4578-b2ec-98ef5c209eb6 req-b4dede1c-ff66-4497-ae3a-050ed7edb32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-unplugged", "status": "completed", "tag": "582a7045-1ab3-40df-b52c-337c05d3e22e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:57.321140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a75601ed-c6b9-4578-b2ec-98ef5c209eb6 req-b4dede1c-ff66-4497-ae3a-050ed7edb32d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.322441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a75601ed-c6b9-4578-b2ec-98ef5c209eb6 req-b4dede1c-ff66-4497-ae3a-050ed7edb32d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.323450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a75601ed-c6b9-4578-b2ec-98ef5c209eb6 req-b4dede1c-ff66-4497-ae3a-050ed7edb32d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.347626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a75601ed-c6b9-4578-b2ec-98ef5c209eb6 req-b4dede1c-ff66-4497-ae3a-050ed7edb32d service nova] Creating event network-vif-unplugged:582a7045-1ab3-40df-b52c-337c05d3e22e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:57.358353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a75601ed-c6b9-4578-b2ec-98ef5c209eb6 req-b4dede1c-ff66-4497-ae3a-050ed7edb32d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118191 Sep 16 14:09:57.366821 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1587/3158] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:57.377663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:57.379669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:57.397773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.399099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.400131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.401684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.402754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.403795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.490076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:57.571055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:57.588029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:57.600810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28b2e86e-2cb6-4728-b2d1-e65e3cbed9b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.430110 Sep 16 14:09:57.631968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1572/3159] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:57 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:57.655947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:57.656604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:57.678764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.680400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.681872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.683806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:57.687355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:57.691076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:57.833697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:57.884904 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d6ce5be7-67fd-4e0e-95fe-d096d32600ab tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1277 microversion: 2.1 time: 0.515241 Sep 16 14:09:57.889179 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1588/3160] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:57 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1277 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:57.906104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62c40b69-0db7-429d-ad6d-9f640dc73abb tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f72517dc670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:57.945495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:57.982464 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00bd23fc-d587-4392-ac0b-0df8771d7076 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1263 microversion: 2.1 time: 0.347663 Sep 16 14:09:57.985860 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1573/3161] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:57 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1263 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:58.004793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4708205f-b93f-4cdd-b1ea-d4c272beb1a8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f7251817d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:58.741228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62c40b69-0db7-429d-ad6d-9f640dc73abb tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a9cff83d-89a8-4a30-8c2c-e9ae68299747" status: 202 len: 0 microversion: 2.1 time: 0.846447 Sep 16 14:09:58.745513 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1589/3162] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:57 2022] DELETE /compute/v2.1/os-security-groups/a9cff83d-89a8-4a30-8c2c-e9ae68299747 => generated 0 bytes in 855 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:58.750665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7ae519-0081-4bc0-aeab-9729b5cd5f3d", "name": "network-vif-deleted", "tag": "550ae592-f15b-4702-a8eb-56a6eabe3b3b"}, {"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-deleted", "tag": "c232d20d-75fa-4211-97d8-6f619be4b717"}, {"server_uuid": "b0596d51-2b1f-423a-9783-a1d31bc3dd79", "name": "network-vif-deleted", "tag": "582a7045-1ab3-40df-b52c-337c05d3e22e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:09:58.767064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4708205f-b93f-4cdd-b1ea-d4c272beb1a8 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/738579c3-4b8b-4b9b-8c9e-590201de1dfd" status: 202 len: 0 microversion: 2.1 time: 0.778077 Sep 16 14:09:58.767942 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1574/3163] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:57 2022] DELETE /compute/v2.1/os-security-groups/738579c3-4b8b-4b9b-8c9e-590201de1dfd => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:58.773632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:58.774601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:58.799327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:58.799832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:58.802209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:58.804175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:58.805821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:58.811230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:58.812192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:58.828538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:58.828538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:58.857558 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Creating event network-vif-deleted:550ae592-f15b-4702-a8eb-56a6eabe3b3b for instance 3a7ae519-0081-4bc0-aeab-9729b5cd5f3d on n-h1-858129-2 Sep 16 14:09:58.858497 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Creating event network-vif-deleted:c232d20d-75fa-4211-97d8-6f619be4b717 for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:58.859174 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] Creating event network-vif-deleted:582a7045-1ab3-40df-b52c-337c05d3e22e for instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 on n-h1-858129-2 Sep 16 14:09:58.884841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6acd3405-6aa5-4a6e-ae35-2ced291ea721 req-94cb3978-798d-4ad1-8dcf-8ac55fe70c9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.137873 Sep 16 14:09:58.888640 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1590/3164] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:09:58.896331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:58.896727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:58.898316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:58.899211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:58.899348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:58.900082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lazy-loading 'fault' on Instance uuid b0596d51-2b1f-423a-9783-a1d31bc3dd79 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:09:58.910595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:58.911348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:58.912058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:58.913780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:58.914474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:58.915788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:59.016191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:59.025353 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91f715a9-7104-4582-96c2-c37c4a194ff5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 200 len: 1302 microversion: 2.1 time: 0.256597 Sep 16 14:09:59.026562 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1575/3165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:58 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 1302 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:09:59.031860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3666729-5a6d-42ca-b876-df855545dfe2 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724c3b5670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:59.056430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:59.088161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:59.092068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:09:59.095328 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a1aa3e8-d066-4e88-ba53-349aa1fdbb3a tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.204873 Sep 16 14:09:59.097668 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1591/3166] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:09:58 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:09:59.113062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d442f7e-ab33-477b-a3fb-b6504dc84833 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] Calling method '.version_select at 0x7f724c659a60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:59.734178 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3666729-5a6d-42ca-b876-df855545dfe2 tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/427b66b3-774c-40f8-ac55-b0e73409cd96" status: 202 len: 0 microversion: 2.1 time: 0.706128 Sep 16 14:09:59.742222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1576/3167] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:59 2022] DELETE /compute/v2.1/os-security-groups/427b66b3-774c-40f8-ac55-b0e73409cd96 => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:59.748408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:59.749290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:59.767345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:59.768368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:59.768368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:59.769006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:59.769474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:59.769914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:59.798499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d442f7e-ab33-477b-a3fb-b6504dc84833 tempest-SecurityGroupsTestJSON-739179359 tempest-SecurityGroupsTestJSON-739179359-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/fea3e961-8b95-4689-a2a3-d6d6d863ad3e" status: 202 len: 0 microversion: 2.1 time: 0.698756 Sep 16 14:09:59.799255 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1592/3168] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:09:59 2022] DELETE /compute/v2.1/os-security-groups/fea3e961-8b95-4689-a2a3-d6d6d863ad3e => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:09:59.804025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:09:59.805070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:09:59.832090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:59.832909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:59.833353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:59.834081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:09:59.835747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:09:59.836205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:09:59.986663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:00.017687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3bdd1260-27ca-4396-b0c8-69749e02912f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1283 microversion: 2.1 time: 0.273563 Sep 16 14:10:00.019937 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1577/3169] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:59 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:00.035604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8d6b3176-5772-41a3-9400-8e4f2ecad75a req-3d43ff2e-7ebc-4271-9cdd-06f5dfe22b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe54e0ec-98cd-40b1-b7ec-73c492646b97", "name": "network-vif-deleted", "tag": "3eff67ed-5f20-43bb-9e04-a53381d4bc5a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:00.063272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:00.075663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d6b3176-5772-41a3-9400-8e4f2ecad75a req-3d43ff2e-7ebc-4271-9cdd-06f5dfe22b26 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:00.078352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d6b3176-5772-41a3-9400-8e4f2ecad75a req-3d43ff2e-7ebc-4271-9cdd-06f5dfe22b26 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:00.078652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d0654e5-aa1a-4183-b43d-6df02f289763 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1269 microversion: 2.1 time: 0.273507 Sep 16 14:10:00.079315 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1593/3170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:09:59 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1269 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:00.081503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d6b3176-5772-41a3-9400-8e4f2ecad75a req-3d43ff2e-7ebc-4271-9cdd-06f5dfe22b26 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:00.112029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b61d71f2-381e-41d2-b6ba-e0d2385a026d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] Calling method '.version_select at 0x7f724c6598b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:00.116089 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8d6b3176-5772-41a3-9400-8e4f2ecad75a req-3d43ff2e-7ebc-4271-9cdd-06f5dfe22b26 service nova] Creating event network-vif-deleted:3eff67ed-5f20-43bb-9e04-a53381d4bc5a for instance fe54e0ec-98cd-40b1-b7ec-73c492646b97 on n-h2-858129-2 Sep 16 14:10:00.132488 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8d6b3176-5772-41a3-9400-8e4f2ecad75a req-3d43ff2e-7ebc-4271-9cdd-06f5dfe22b26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108302 Sep 16 14:10:00.134042 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1578/3171] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:00.148525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:00.149891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:00.161823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:00.162769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:00.163579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:00.164913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:00.165774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:00.166589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:00.196871 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] HTTP exception thrown: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Request method failure captured: Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 HTTP/1.1 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJINgSBqxA0xYytbVEyNJ9be93wImlgrOc7KlEnJE3D6q4IdWZVMxhkDIr7absFQkKWCU_p15qWg46t14QWFZ7uJSOQ7Ddy_o_KPqiK0vwTq5wytnfnZkn8A_VGBm3gT41aABXqwTT3ez7i4I0xjut6BbsAWvN3HtEScPl0cN5moH4m0 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83b243d4de294eeebcd2c8ce44d02bed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}] Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestMultiNic-1875902398 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 782fbafaf3004e72aabae9768d700361 Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'b0596d51-2b1f-423a-9783-a1d31bc3dd79'} Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:00.200333 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Returning 404 to user: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:00.204448 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18776c86-ecd2-4e30-b1d5-8e797c51351e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 404 len: 111 microversion: 2.1 time: 0.066690 Sep 16 14:10:00.206574 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1579/3172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:00 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:10:00.214485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:00.216045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:00.228378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:00.229640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:00.230681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:00.232324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:00.233450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:00.234558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:00.708918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:00.724632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:00.728963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:00.731565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-73bc599e-0eb1-4897-a897-a3a7700f0d3d tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.525358 Sep 16 14:10:00.735918 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1580/3173] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:00 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:01.043824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:01.044768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:01.059945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:01.059945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:01.059945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:01.060569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:01.060816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:01.061434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:01.987162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:02.008945 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4409059a-1d8d-4412-9f35-3f86bb1d86ad tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 0.968975 Sep 16 14:10:02.009943 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1581/3174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:01 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:02.015006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:02.016009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:02.026152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:02.026691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:02.027357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:02.028301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:02.029270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:02.029913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:02.418993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b61d71f2-381e-41d2-b6ba-e0d2385a026d tempest-SecurityGroupRulesTestJSON-1573205207 tempest-SecurityGroupRulesTestJSON-1573205207-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/f166eb52-ad74-43f2-9271-4c2e49107dc6" status: 202 len: 0 microversion: 2.1 time: 2.326779 Sep 16 14:10:02.421211 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1594/3175] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:10:00 2022] DELETE /compute/v2.1/os-security-groups/f166eb52-ad74-43f2-9271-4c2e49107dc6 => generated 0 bytes in 2341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:10:02.435493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:02.438001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:02.464907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:02.470840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:02.473226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:02.474740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:02.475651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:02.476743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:02.733952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:02.757585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:02.761357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:02.764936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0fd4b82-b4d1-49ab-9768-7a34e74b709b tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.340090 Sep 16 14:10:02.767042 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1595/3176] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:02 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:02.837649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:02.866580 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93f192ab-48f1-434a-af1a-31c97e97bec5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 0.854717 Sep 16 14:10:02.867901 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1582/3177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:02 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:03.036083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:03.037029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:03.054063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:03.054612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:03.055054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:03.055784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:03.056242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:03.056669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:03.261735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ec75df87-b928-4d9c-ae64-cd8526c573a7 req-68f3cf0c-ded9-4817-8ab1-19f5c2bbb372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e9d5d6-15cf-4532-af49-c84f1de5d43b", "tag": "43e8b125-d5fa-46a2-a1cc-71933573b38d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:03.285781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ec75df87-b928-4d9c-ae64-cd8526c573a7 req-68f3cf0c-ded9-4817-8ab1-19f5c2bbb372 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:03.288044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ec75df87-b928-4d9c-ae64-cd8526c573a7 req-68f3cf0c-ded9-4817-8ab1-19f5c2bbb372 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:03.289637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ec75df87-b928-4d9c-ae64-cd8526c573a7 req-68f3cf0c-ded9-4817-8ab1-19f5c2bbb372 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:03.331805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ec75df87-b928-4d9c-ae64-cd8526c573a7 req-68f3cf0c-ded9-4817-8ab1-19f5c2bbb372 service nova] Creating event network-changed:43e8b125-d5fa-46a2-a1cc-71933573b38d for instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b on n-h2-858129-2 Sep 16 14:10:03.348994 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ec75df87-b928-4d9c-ae64-cd8526c573a7 req-68f3cf0c-ded9-4817-8ab1-19f5c2bbb372 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099084 Sep 16 14:10:03.350305 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1583/3178] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:03.822353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:03.823661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:03.838789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:03.840895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:03.841930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:03.843224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:03.844337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:03.845394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:04.162831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:04.186904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:04.194992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:04.206305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:04.208953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7494073-0603-4df7-b508-8c32438a58f9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.394800 Sep 16 14:10:04.209856 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1584/3179] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:03 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:10:04.224469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:04.227976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:04.250529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:04.252373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:04.254193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:04.256010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:04.257783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:04.258989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:04.402793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:04.418775 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d80c1f5-90f3-4bc4-a691-615b5fbe0462 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 1.389058 Sep 16 14:10:04.421404 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1596/3180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:03 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:05.093069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:05.123716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=14 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:05.271133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:05.273282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:05.285106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:05.288466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:05.289658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:05.291320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:05.292443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:05.293431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:05.520303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:05.530891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:05.532544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:05.534676 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21019b0f-b1c9-403b-895b-e03e27ea50a9 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.271933 Sep 16 14:10:05.535524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1597/3181] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:05 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:10:05.559666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3206e900-7af2-4c3c-adfe-1a1053f1aca6 req-57d9dbf7-51bf-4760-a608-00fc6c2ed8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c236989-5cd0-4119-9e6d-f747cf03e7c7", "tag": "cf840358-f1c1-437b-89e1-58d21beeea72"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:05.573378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3206e900-7af2-4c3c-adfe-1a1053f1aca6 req-57d9dbf7-51bf-4760-a608-00fc6c2ed8f0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:05.574112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3206e900-7af2-4c3c-adfe-1a1053f1aca6 req-57d9dbf7-51bf-4760-a608-00fc6c2ed8f0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:05.574761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3206e900-7af2-4c3c-adfe-1a1053f1aca6 req-57d9dbf7-51bf-4760-a608-00fc6c2ed8f0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:05.591878 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3206e900-7af2-4c3c-adfe-1a1053f1aca6 req-57d9dbf7-51bf-4760-a608-00fc6c2ed8f0 service nova] Creating event network-changed:cf840358-f1c1-437b-89e1-58d21beeea72 for instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 on n-h2-858129-2 Sep 16 14:10:05.598641 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3206e900-7af2-4c3c-adfe-1a1053f1aca6 req-57d9dbf7-51bf-4760-a608-00fc6c2ed8f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046699 Sep 16 14:10:05.606352 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1598/3182] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:05.616857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:05.618119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:05.630641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:05.632068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:05.632792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:05.634072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:05.634889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:05.635876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:05.636630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:05.661748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc80bb3f-8713-4a1e-951d-d82a2c1de711 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 1.449408 Sep 16 14:10:05.662759 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1585/3183] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:04 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:05.686064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:05.710603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:06.566010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:06.566696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:06.574851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:06.575577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:06.576209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:06.577164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:06.577805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:06.578444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:06.891950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:06.902777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:06.904459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:06.905942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8483b664-8602-4415-a93f-ee10c70fb0f8 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.344434 Sep 16 14:10:06.906780 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1586/3184] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:06 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:06.916434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:06.917615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:06.930760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:06.931983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:06.933092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:06.934468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:06.936663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:06.937935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:06.967008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:06.989452 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fad05ab3-8312-455e-a2b5-c74c36937321 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 1.380800 Sep 16 14:10:07.001475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1599/3185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:05 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:07.594308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:07.615433 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a8f4a9a-35bf-4281-8ce1-fcc574d4361a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 0.706547 Sep 16 14:10:07.617135 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1587/3186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:06 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:07.963601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:07.965462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:07.979614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:07.980710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:07.981337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:07.982746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:07.983704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:07.984573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:08.032779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:08.033734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:08.073095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:08.073794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:08.074651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:08.075841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:08.076531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:08.077122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:08.156015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:08.178559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:08.183043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:08.185479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-454da227-e01b-4c99-b3ec-642a76941b24 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.234913 Sep 16 14:10:08.202544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1600/3187] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:07 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:08.667805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:08.669621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:08.685040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:08.686567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:08.687899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:08.689730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:08.691013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:08.691904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:09.023022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:09.039647 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-564e2e2c-2e29-4d76-898a-be0e1d244dde tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 1.017875 Sep 16 14:10:09.041058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1588/3188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:08 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:09.242306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:09.245049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:09.258043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:09.260805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:09.261620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:09.263178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:09.270320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:09.273186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:09.483438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:09.498517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:09.502656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:09.505147 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19f041ac-1a9b-4e99-8ff5-fbd3d1cc73ed tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.274061 Sep 16 14:10:09.506244 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1589/3189] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:09 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:09.524001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:09.550219 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b58aab1a-96cb-4695-a4bb-d87149a18701 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 0.897552 Sep 16 14:10:09.552551 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1601/3190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:08 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:10.097288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:10.101715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:10.120305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:10.121627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:10.123112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:10.125162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:10.126314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:10.127392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:10.551915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:10.553351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:10.576000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:10.576536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:10.577060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:10.577714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:10.578189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:10.578650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:11.038556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:11.150815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:11.163951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:11.165579 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-beb95fa1-1fd9-4685-b117-525aa3efc969 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.617923 Sep 16 14:10:11.166439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1602/3191] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:10 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:10:11.184351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:11.184978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:11.202862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:11.203381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:11.203837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:11.204763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:11.205442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:11.206050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:11.392741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:11.421042 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0053dad2-1779-45d7-b143-449c1b982f32 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 1.346520 Sep 16 14:10:11.434555 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1590/3192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:10 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:12.060170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:12.077233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-34e51595-76b5-495e-832d-576c0ab760fa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 0.909030 Sep 16 14:10:12.078970 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1603/3193] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:11 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:12.202803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:12.203858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:12.234164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:12.235066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:12.236381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:12.238225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:12.243719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:12.244426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:12.450035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:12.451470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:12.463895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:12.464947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:12.465855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:12.467270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:12.468395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:12.469225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:12.565363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:12.582603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:12.585669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:12.588826 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87e1d74d-9209-44ca-a53d-1ce84c980626 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1407 microversion: 2.54 time: 0.392133 Sep 16 14:10:12.602986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1591/3194] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:12 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:13.120043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:13.125069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:13.149234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:13.150486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:13.152569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:13.154823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:13.156066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:13.158604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:13.471586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:13.511076 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7199e114-5822-4bc2-bf34-af6f3e150c23 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 1.068778 Sep 16 14:10:13.518263 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1604/3195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:12 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:13.537541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-31854a00-c4e9-4ecf-b1bc-bd2b16502bd9 req-36895150-a595-4b72-bb7b-16057b6c447f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e9d5d6-15cf-4532-af49-c84f1de5d43b", "name": "network-vif-plugged", "status": "completed", "tag": "43e8b125-d5fa-46a2-a1cc-71933573b38d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:13.590841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31854a00-c4e9-4ecf-b1bc-bd2b16502bd9 req-36895150-a595-4b72-bb7b-16057b6c447f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:13.591670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31854a00-c4e9-4ecf-b1bc-bd2b16502bd9 req-36895150-a595-4b72-bb7b-16057b6c447f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:13.593427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31854a00-c4e9-4ecf-b1bc-bd2b16502bd9 req-36895150-a595-4b72-bb7b-16057b6c447f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:13.634575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:13.664260 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-31854a00-c4e9-4ecf-b1bc-bd2b16502bd9 req-36895150-a595-4b72-bb7b-16057b6c447f service nova] Creating event network-vif-plugged:43e8b125-d5fa-46a2-a1cc-71933573b38d for instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b on n-h2-858129-2 Sep 16 14:10:13.680766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18c13735-6f73-4ca3-8896-6f0c5859f96b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 0.568065 Sep 16 14:10:13.681858 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1592/3196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:13 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:13.685913 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-31854a00-c4e9-4ecf-b1bc-bd2b16502bd9 req-36895150-a595-4b72-bb7b-16057b6c447f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164933 Sep 16 14:10:13.687661 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1605/3197] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:13.743089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:13.744399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:13.769847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:13.770721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:13.775578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:13.777397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:13.778718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:13.787784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:14.224193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:14.235725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:14.244070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:14.245824 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a328211-7d34-4adb-b47f-4ccd30015b1f tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1413 microversion: 2.54 time: 0.522798 Sep 16 14:10:14.251239 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1593/3198] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:13 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1413 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:14.555203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:14.557141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:14.587197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:14.587641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:14.588055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:14.588840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:14.589262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:14.602105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:14.726538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:14.728501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:14.748394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:14.749318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:14.749995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:14.751101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:14.751874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:14.752552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:15.235222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:15.246429 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a69c71f-6e33-4292-905b-75c3473f6f8b tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 0.699305 Sep 16 14:10:15.263591 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1606/3199] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:14 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:15.291997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:15.292795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:15.308886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:15.310626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:15.313671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:15.314887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:15.315727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:15.317626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:15.395191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:15.548682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:15.563078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:15.565449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:15.566873 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-17a535ea-ef01-42e8-b951-550eeac36fa2 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1413 microversion: 2.54 time: 0.280374 Sep 16 14:10:15.568707 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1607/3200] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:15 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1413 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:15.620540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:15.638273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77094248-e5e6-4be9-a6f6-f9d01c00a425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 0.916374 Sep 16 14:10:15.649970 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1594/3201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:14 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:16.291440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:16.298857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:16.316057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:16.328737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:16.329396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:16.334957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:16.335163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:16.335831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:16.625924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:16.629083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:16.645113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:16.645947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:16.648452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:16.649937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:16.652891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:16.654104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:16.887271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:16.913078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:16.927200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e57e0941-9f5b-46a5-885d-f64f63ca214e tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1351 microversion: 2.1 time: 0.645012 Sep 16 14:10:16.930719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1608/3202] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:16 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1351 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:16.938371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:16.940309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:16.945394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:16.949607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:16.953409 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0100b57f-5a48-458e-93c7-3e1175cdda51 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1413 microversion: 2.54 time: 0.337878 Sep 16 14:10:16.955386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1595/3203] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:16 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1413 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:10:16.975575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:16.976500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:16.977194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:16.978286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:16.979040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:16.979691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:17.980893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:17.989288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:17.991064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:18.007306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:18.013964 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c743d3b-33a6-4089-9999-d298edff0306 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 1.081622 Sep 16 14:10:18.019297 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1609/3204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:16 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:18.028635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:18.029825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:18.030838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.047563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.054528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.057849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.059007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.060017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.063044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.063874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.064581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.065785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.066623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.067362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.338368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:18.393698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:18.404312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:18.410141 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b042e06d-7ed5-4fbc-ae09-2c2fa6fe50e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1398 microversion: 2.54 time: 0.388922 Sep 16 14:10:18.419003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1610/3205] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:18 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1398 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:18.450041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-faec928b-7e80-4c79-8e50-06606f5004e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '.version_select at 0x7f724cf8f0d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:18.518006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:18.518618 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-faec928b-7e80-4c79-8e50-06606f5004e4 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-89041090" status: 204 len: 0 microversion: 2.54 time: 0.075831 Sep 16 14:10:18.526945 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1611/3206] 10.222.0.60 () {60 vars in 1313 bytes} [Fri Sep 16 14:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-89041090 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 14:10:18.542172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46b31a7b-c302-44f2-aab1-7c116b7d2544 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1542 microversion: 2.1 time: 0.573921 Sep 16 14:10:18.544225 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1596/3207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:17 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1542 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:18.554960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:18.567376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:18.596203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:18.597628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.598811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.601735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:18.602281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.611758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.613469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.623068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.623689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.625615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.626103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.626973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:18.627489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:18.628069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:18.743681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:10:19.059069 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d9b352c-3ce4-45d9-94d4-cc7bc33db68f tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.466675 Sep 16 14:10:19.074872 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1597/3208] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:10:18 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b/os-interface => generated 285 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:10:19.105705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b2a74d39-9514-4951-8c39-1e1a1dfa69e0 req-32ecbb5c-b8f2-440f-86dc-79f98f25773f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c236989-5cd0-4119-9e6d-f747cf03e7c7", "name": "network-vif-plugged", "status": "completed", "tag": "cf840358-f1c1-437b-89e1-58d21beeea72"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:19.125373 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60f07d7d-390f-4500-8ac4-cb27f12349b5 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "DELETE /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 204 len: 0 microversion: 2.54 time: 0.575505 Sep 16 14:10:19.134657 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1612/3209] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:10:18 2022] DELETE /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:10:19.163453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:19.168465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:19.170589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b2a74d39-9514-4951-8c39-1e1a1dfa69e0 req-32ecbb5c-b8f2-440f-86dc-79f98f25773f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:19.173611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b2a74d39-9514-4951-8c39-1e1a1dfa69e0 req-32ecbb5c-b8f2-440f-86dc-79f98f25773f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:19.175673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b2a74d39-9514-4951-8c39-1e1a1dfa69e0 req-32ecbb5c-b8f2-440f-86dc-79f98f25773f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:19.195866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:19.201321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:19.202635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:19.204559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:19.205490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:19.206268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:19.232397 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b2a74d39-9514-4951-8c39-1e1a1dfa69e0 req-32ecbb5c-b8f2-440f-86dc-79f98f25773f service nova] Creating event network-vif-plugged:cf840358-f1c1-437b-89e1-58d21beeea72 for instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 on n-h2-858129-2 Sep 16 14:10:19.257018 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b2a74d39-9514-4951-8c39-1e1a1dfa69e0 req-32ecbb5c-b8f2-440f-86dc-79f98f25773f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189110 Sep 16 14:10:19.261099 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1598/3210] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:19.307767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:19.308900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:19.342291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:19.344213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:19.345047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:19.351341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:19.352204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:19.352995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:19.932151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:19.992757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:19.997742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:20.000136 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52bd7610-ab4d-495d-8a00-6abca42af761 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1404 microversion: 2.54 time: 0.736775 Sep 16 14:10:20.001233 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1599/3211] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:19 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1404 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:20.949953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:20.973276 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f1e77f22-54aa-4d00-9f0c-13d3953eb525 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 1.828177 Sep 16 14:10:20.975613 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1613/3212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:19 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:21.070273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:21.071461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:21.128595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:21.130243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:21.155525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:21.160602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:21.161568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:21.165116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:21.391242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:21.406484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:21.418015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '191128c26e5149d184537ae451f16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890d662261d4097904f4d0af9eab89f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:21.430072 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a114bdf0-145f-4bf6-9cc6-516821dcbd09 tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 200 len: 1404 microversion: 2.54 time: 0.371634 Sep 16 14:10:21.442870 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1600/3213] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:21 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 1404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:10:21.644648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1311393632", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "23be08a1-fb65-4cb7-ab54-b88188943c8d"}, {"uuid": "b38bb34d-b8c6-491e-aebd-c10a8e93a4d9"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:21.837741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] validate_networks() for [('23be08a1-fb65-4cb7-ab54-b88188943c8d', None, None, None, None, None), ('b38bb34d-b8c6-491e-aebd-c10a8e93a4d9', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:10:22.031576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:22.032594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:22.041654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:22.042445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:22.043228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:22.045808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:22.046702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:22.047514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:24.251523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:24.270121 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63ef3fc7-405c-4c39-b6fe-fedb7b10c3fe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1311 microversion: 2.1 time: 2.240330 Sep 16 14:10:24.273142 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1601/3214] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:22 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1311 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:24.279842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:24.286099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] [instance: 784c53cc-0212-4aea-a71f-5ee04eba83e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:24.309887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:24.311157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:24.311857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:24.312974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:24.313727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:24.315144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:24.352367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] HTTP exception thrown: Instance 784c53cc-0212-4aea-a71f-5ee04eba83e4 could not be found. Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Request method failure captured: Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 HTTP/1.1 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIOcqEUaGYfd1ggv1jzDXKvBU-f4zj6FwpHb12jUXgbnMNsYWaU7juob1bFrIVODQN_HuTv8vfS4_yNmQjFh8ssVdgJ5B_e8pMMxwE1nVnG0IURnvJvBXKoqmCL84Xmm7XQKFL4-WrjxE3Qc90nJW75Rro10V7W6eyy8Ojc74ANVAQM Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.54 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c890d662261d4097904f4d0af9eab89f Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerShowV254Test-851040791 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c890d662261d4097904f4d0af9eab89f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c890d662261d4097904f4d0af9eab89f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c890d662261d4097904f4d0af9eab89f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c890d662261d4097904f4d0af9eab89f"}]}] Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerShowV254Test-851040791 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c890d662261d4097904f4d0af9eab89f Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerShowV254Test-851040791 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerShowV254Test-851040791-project Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 191128c26e5149d184537ae451f16a16 Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerShowV254Test-851040791-project Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 784c53cc-0212-4aea-a71f-5ee04eba83e4 could not be found. Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '784c53cc-0212-4aea-a71f-5ee04eba83e4'} Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784c53cc-0212-4aea-a71f-5ee04eba83e4 could not be found. Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784c53cc-0212-4aea-a71f-5ee04eba83e4 could not be found. Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:24.354682 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784c53cc-0212-4aea-a71f-5ee04eba83e4 could not be found. Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] Returning 404 to user: Instance 784c53cc-0212-4aea-a71f-5ee04eba83e4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63139d44-be9b-4288-b29a-5e7968de19ef tempest-ServerShowV254Test-851040791 tempest-ServerShowV254Test-851040791-project] 10.222.0.60 "GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4" status: 404 len: 111 microversion: 2.54 time: 0.081948 Sep 16 14:10:24.377329 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1602/3215] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:10:24 2022] GET /compute/v2.1/servers/784c53cc-0212-4aea-a71f-5ee04eba83e4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:10:25.274014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96c98e4a-eda9-4f37-9568-cfc6d9711cbb tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Action: 'create', calling method: .version_select at 0x7f7251817310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1825547229", "metadata": {"Type": "work"}}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96c98e4a-eda9-4f37-9568-cfc6d9711cbb tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Request method failure captured: Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 122 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPOYeT8gAcjo6vp6uJWuL01TSroMxsUTxLfWDGCbw8DrIZlLRxzCttPupql0_xdNSn5es3krt7JTmJF1Y3-ienphy2jpRSMGVBXcqfPj_RSNX8yiR7YCjOetNsCbhHrwoVoOvzdzA73P2pLBXAPAikmYFujm0ftGE-ytUkhEcbB0YU Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25022b8b3894a2ba2ca59763f166506", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}] Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 37e89397f8ba4488af26f419383a4b14 Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1825547229", "metadata": {"Type": "work"}}} Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1825547229', 'metadata': {'Type': 'work'}}}} Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '#$%' Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:10:25.289136 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96c98e4a-eda9-4f37-9568-cfc6d9711cbb tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96c98e4a-eda9-4f37-9568-cfc6d9711cbb tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.923883 Sep 16 14:10:25.311490 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1603/3216] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Sep 16 14:10:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 935 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:10:25.334765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6ad762d-742d-48ba-b6e8-b00ca43ff33f tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Action: 'create', calling method: .version_select at 0x7f724def5b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-998335321", "metadata": {"Type": "work"}}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6ad762d-742d-48ba-b6e8-b00ca43ff33f tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Request method failure captured: Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 119 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPOYeT8gAcjo6vp6uJWuL01TSroMxsUTxLfWDGCbw8DrIZlLRxzCttPupql0_xdNSn5es3krt7JTmJF1Y3-ienphy2jpRSMGVBXcqfPj_RSNX8yiR7YCjOetNsCbhHrwoVoOvzdzA73P2pLBXAPAikmYFujm0ftGE-ytUkhEcbB0YU Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25022b8b3894a2ba2ca59763f166506", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}] Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 37e89397f8ba4488af26f419383a4b14 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-998335321", "metadata": {"Type": "work"}}} Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-998335321', 'metadata': {'Type': 'work'}}}} Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '0' Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:10:25.353930 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 14:10:25.363432 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:25.374090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6ad762d-742d-48ba-b6e8-b00ca43ff33f tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:25.387307 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6ad762d-742d-48ba-b6e8-b00ca43ff33f tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.069929 Sep 16 14:10:25.401269 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1604/3217] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Sep 16 14:10:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:10:25.415823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:25.416460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:25.429993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:25.432175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:25.432597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:25.433659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:25.434657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:25.435391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:25.488834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:25.977806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:10:25.978542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:10:25.979696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:10:25.980483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:10:25.981226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:10:26.008326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:26.045746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:26.050083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:26.051386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:26.056486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:26.057730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:26.061491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:26.062570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:26.073896 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36e02e42-6aed-4032-b8e8-1df255892aaf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1494 microversion: 2.1 time: 0.678708 Sep 16 14:10:26.094975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1605/3218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:25 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1494 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:26.094975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4e5bf3c-050b-4d34-8301-2d1a8210f4f7 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Action: 'create', calling method: .version_select at 0x7f7251795700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-323666148", "metadata": {"Type": "work"}}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4e5bf3c-050b-4d34-8301-2d1a8210f4f7 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Request method failure captured: Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 118 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPOYeT8gAcjo6vp6uJWuL01TSroMxsUTxLfWDGCbw8DrIZlLRxzCttPupql0_xdNSn5es3krt7JTmJF1Y3-ienphy2jpRSMGVBXcqfPj_RSNX8yiR7YCjOetNsCbhHrwoVoOvzdzA73P2pLBXAPAikmYFujm0ftGE-ytUkhEcbB0YU Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25022b8b3894a2ba2ca59763f166506", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}] Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 37e89397f8ba4488af26f419383a4b14 Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-323666148", "metadata": {"Type": "work"}}} Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-323666148', 'metadata': {'Type': 'work'}}}} Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '' Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:10:26.103133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4e5bf3c-050b-4d34-8301-2d1a8210f4f7 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4e5bf3c-050b-4d34-8301-2d1a8210f4f7 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015355 Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1606/3219] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Sep 16 14:10:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:10:26.136720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d6a39156-7c4e-425d-85d5-e311b2f28fa7 req-f7857b39-278b-4f31-a99a-10f941fd70fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e9d5d6-15cf-4532-af49-c84f1de5d43b", "tag": "43e8b125-d5fa-46a2-a1cc-71933573b38d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:26.210571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6a39156-7c4e-425d-85d5-e311b2f28fa7 req-f7857b39-278b-4f31-a99a-10f941fd70fd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:26.212406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6a39156-7c4e-425d-85d5-e311b2f28fa7 req-f7857b39-278b-4f31-a99a-10f941fd70fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:26.213247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Getting quotas for project 83b243d4de294eeebcd2c8ce44d02bed. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:10:26.214020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d6a39156-7c4e-425d-85d5-e311b2f28fa7 req-f7857b39-278b-4f31-a99a-10f941fd70fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:26.229118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Getting quotas for user 782fbafaf3004e72aabae9768d700361 and project 83b243d4de294eeebcd2c8ce44d02bed. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:10:26.252259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d6a39156-7c4e-425d-85d5-e311b2f28fa7 req-f7857b39-278b-4f31-a99a-10f941fd70fd service nova] Creating event network-changed:43e8b125-d5fa-46a2-a1cc-71933573b38d for instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b on n-h2-858129-2 Sep 16 14:10:26.264681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:10:26.268150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:10:26.270077 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d6a39156-7c4e-425d-85d5-e311b2f28fa7 req-f7857b39-278b-4f31-a99a-10f941fd70fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155534 Sep 16 14:10:26.280424 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1607/3220] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:26.300452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f3f5365-d97d-4e13-aa0c-d9df76c97962 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Calling method '.version_select at 0x7f724d245700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:26.406187 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1f3f5365-d97d-4e13-aa0c-d9df76c97962 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] HTTP exception thrown: Volume tempest-invalid-394880266 could not be found. Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f3f5365-d97d-4e13-aa0c-d9df76c97962 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Request method failure captured: Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-394880266 HTTP/1.1 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPOYeT8gAcjo6vp6uJWuL01TSroMxsUTxLfWDGCbw8DrIZlLRxzCttPupql0_xdNSn5es3krt7JTmJF1Y3-ienphy2jpRSMGVBXcqfPj_RSNX8yiR7YCjOetNsCbhHrwoVoOvzdzA73P2pLBXAPAikmYFujm0ftGE-ytUkhEcbB0YU Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25022b8b3894a2ba2ca59763f166506", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}] Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 37e89397f8ba4488af26f419383a4b14 Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: exception: Volume tempest-invalid-394880266 could not be found. Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'tempest-invalid-394880266'} Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-394880266 could not be found. (HTTP 404) (Request-ID: req-d2ab2aeb-c1ac-4e8a-b876-cd1bd3f61ab0) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:10:26.431484 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-394880266 could not be found. Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-394880266 could not be found. Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-394880266 could not be found. Sep 16 14:10:26.449597 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.480652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dd653f0c-f667-447c-8d17-3f01b08cc6a3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.809968 Sep 16 14:10:26.480652 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1614/3221] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:10:26.482301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f3f5365-d97d-4e13-aa0c-d9df76c97962 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Returning 404 to user: Volume tempest-invalid-394880266 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:26.482301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f3f5365-d97d-4e13-aa0c-d9df76c97962 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-394880266" status: 404 len: 98 microversion: 2.1 time: 0.176498 Sep 16 14:10:26.482301 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1608/3222] 10.222.0.60 () {58 vars in 1215 bytes} [Fri Sep 16 14:10:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-394880266 => generated 98 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:10:26.482301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8af0240-c375-41fa-a402-388fd8705132 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:26.482301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8af0240-c375-41fa-a402-388fd8705132 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:26.484837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:26.484837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:26.519674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:26.520180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:26.522614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:26.524141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:26.525231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:26.526460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:26.658093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f8af0240-c375-41fa-a402-388fd8705132 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:26.672577 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f8af0240-c375-41fa-a402-388fd8705132 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1213 microversion: 2.1 time: 0.208178 Sep 16 14:10:26.673179 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1609/3223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:26 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:26.688324 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae65c414-05d1-4e3b-9d73-91d9a35d6d6d tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004464 Sep 16 14:10:26.713968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1610/3224] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Sep 16 14:10:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 14:10:26.739072 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b45965a-5eb7-41d6-8925-4830a42b05ab tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012015 Sep 16 14:10:26.745996 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1611/3225] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:10:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 16 14:10:26.766325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac64f6fd-cf08-4647-91ac-f6a166cc36c5 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Calling method '.version_select at 0x7f724c4ac430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:26.890484 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ac64f6fd-cf08-4647-91ac-f6a166cc36c5 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] HTTP exception thrown: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac64f6fd-cf08-4647-91ac-f6a166cc36c5 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Request method failure captured: Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-volumes/0570cd54-8142-402d-a57c-4b2d34b89d15 HTTP/1.1 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPOYeT8gAcjo6vp6uJWuL01TSroMxsUTxLfWDGCbw8DrIZlLRxzCttPupql0_xdNSn5es3krt7JTmJF1Y3-ienphy2jpRSMGVBXcqfPj_RSNX8yiR7YCjOetNsCbhHrwoVoOvzdzA73P2pLBXAPAikmYFujm0ftGE-ytUkhEcbB0YU Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25022b8b3894a2ba2ca59763f166506", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}] Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 37e89397f8ba4488af26f419383a4b14 Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: exception: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0570cd54-8142-402d-a57c-4b2d34b89d15'} Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. (HTTP 404) (Request-ID: req-69e8578f-dbd9-4a26-b09f-f2519e30e201) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:10:26.894242 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac64f6fd-cf08-4647-91ac-f6a166cc36c5 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Returning 404 to user: Volume 0570cd54-8142-402d-a57c-4b2d34b89d15 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac64f6fd-cf08-4647-91ac-f6a166cc36c5 tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/0570cd54-8142-402d-a57c-4b2d34b89d15" status: 404 len: 109 microversion: 2.1 time: 0.137143 Sep 16 14:10:26.909899 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1612/3226] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:10:26 2022] DELETE /compute/v2.1/os-volumes/0570cd54-8142-402d-a57c-4b2d34b89d15 => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:10:26.914947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-caf485d7-4ca9-4f61-b97d-b5c5dfb8030b tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Calling method '.version_select at 0x7f724d1a9820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:27.082047 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-caf485d7-4ca9-4f61-b97d-b5c5dfb8030b tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] HTTP exception thrown: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-caf485d7-4ca9-4f61-b97d-b5c5dfb8030b tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Request method failure captured: Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-volumes/5ea0a195-40f7-4097-be02-3838bd7c7037 HTTP/1.1 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPOYeT8gAcjo6vp6uJWuL01TSroMxsUTxLfWDGCbw8DrIZlLRxzCttPupql0_xdNSn5es3krt7JTmJF1Y3-ienphy2jpRSMGVBXcqfPj_RSNX8yiR7YCjOetNsCbhHrwoVoOvzdzA73P2pLBXAPAikmYFujm0ftGE-ytUkhEcbB0YU Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c25022b8b3894a2ba2ca59763f166506", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c25022b8b3894a2ba2ca59763f166506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c25022b8b3894a2ba2ca59763f166506"}]}] Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c25022b8b3894a2ba2ca59763f166506 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesNegativeTest-1753593189 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 37e89397f8ba4488af26f419383a4b14 Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesNegativeTest-1753593189-project Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: exception: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5ea0a195-40f7-4097-be02-3838bd7c7037'} Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. (HTTP 404) (Request-ID: req-14f5763d-f39f-404c-8fa1-9c7561a1203e) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:10:27.085522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. Sep 16 14:10:27.089956 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:10:27.097771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-caf485d7-4ca9-4f61-b97d-b5c5dfb8030b tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] Returning 404 to user: Volume 5ea0a195-40f7-4097-be02-3838bd7c7037 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:10:27.098164 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-caf485d7-4ca9-4f61-b97d-b5c5dfb8030b tempest-VolumesNegativeTest-1753593189 tempest-VolumesNegativeTest-1753593189-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5ea0a195-40f7-4097-be02-3838bd7c7037" status: 404 len: 109 microversion: 2.1 time: 0.187976 Sep 16 14:10:27.109303 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1613/3227] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:10:26 2022] GET /compute/v2.1/os-volumes/5ea0a195-40f7-4097-be02-3838bd7c7037 => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:10:27.135564 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e588e219-7298-4a0a-b78b-761b88487788 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1645 microversion: 2.1 time: 0.663266 Sep 16 14:10:27.138739 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1615/3228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:26 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1645 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:27.193190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:27.194785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:27.248900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:27.254139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:27.258066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:27.261911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:27.267000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:27.273214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:27.717779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:27.723110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:27.742516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:27.745383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:27.746142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:27.757412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:27.762845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:27.767424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:27.975734 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f26cdf43-680b-4e77-91a0-91652304d9e8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1645 microversion: 2.1 time: 0.789527 Sep 16 14:10:27.978595 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1614/3229] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:27 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1645 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:28.053438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:28.074025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:28.075024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:28.075836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:28.077919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:28.079787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:28.081002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:28.125163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:28.150139 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-092afd75-ba76-465f-a86f-786540645d3c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1217 microversion: 2.1 time: 0.439495 Sep 16 14:10:28.158846 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1616/3230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:27 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1217 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:28.202705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86222ca1-1939-46f3-9b37-2f77ae320094 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.167283 Sep 16 14:10:28.204809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1615/3231] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 14:10:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:28.232570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:28.233990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:28.253892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:28.255585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:28.256737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:28.258575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:28.259805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:28.261527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:28.620509 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-89510e01-716d-4b3f-bdab-f703f969570e tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7/action" status: 202 len: 0 microversion: 2.1 time: 0.396554 Sep 16 14:10:28.648088 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1617/3232] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:10:28 2022] POST /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:10:28.651202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:28.660704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:28.720787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:28.731035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:28.731942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:28.733249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:28.734081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:28.742913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:29.219043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:29.226282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:29.250531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:29.251967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:29.253009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:29.254135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:29.262023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:29.263130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:29.816481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:29.845424 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5007d8e6-b490-4f6e-8819-617f30b8cd18 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1265 microversion: 2.1 time: 0.649964 Sep 16 14:10:29.847467 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1618/3233] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:29 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1265 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:30.108707 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-debe9002-8fa0-4faf-991e-c5e6fc6e5c07 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1650 microversion: 2.1 time: 1.469006 Sep 16 14:10:30.110302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1616/3234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:28 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1650 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:30.909101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:30.914169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:30.961926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:30.965415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:30.970342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:30.979104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:30.983476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:30.986593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:31.158627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:31.159742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:31.174992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:31.175516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:31.175969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:31.176707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:31.177729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:31.178175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:31.381288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:31.407842 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9ddeac00-2dc6-4777-ab86-e6bec7e987c0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1271 microversion: 2.1 time: 0.515790 Sep 16 14:10:31.421671 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1619/3235] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:30 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1271 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:31.944990 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d3f3ff9-acf9-4733-8bbd-ad4f171a5ba8 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1630 microversion: 2.1 time: 0.788259 Sep 16 14:10:31.946028 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1617/3236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:31 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1630 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:31.994745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858129-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:31.998121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:32.028373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:32.028981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:32.029437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:32.030216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:32.030706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:32.031143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:32.375552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lazy-loading 'flavor' on Instance uuid 4c236989-5cd0-4119-9e6d-f747cf03e7c7 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:10:32.415700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Going to try to live migrate instance to n-h1-858129-2 {{(pid=128643) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:10:32.434610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:32.436820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:32.457145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:32.458562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:32.459615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:32.464655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:32.465774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:32.466545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:32.633979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:32.721400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:32.752143 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed376c76-17e3-4739-96b0-7418f5719810 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1271 microversion: 2.1 time: 0.322169 Sep 16 14:10:32.753701 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1618/3237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:32 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1271 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:34.780614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-915668094", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:34.995327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:10:36.166847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:36.249098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:36.663452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:36.775215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:10:36.775612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:10:36.776125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:10:36.776540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:10:36.777354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:10:36.801651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:36.802302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:36.802914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:36.803738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:36.804336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:36.804772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:36.875006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:10:36.891358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:10:36.930837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:10:36.937286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:10:37.077686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9fd4bd5a-cd8e-4c25-a9ab-d0873da9df02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.360130 Sep 16 14:10:37.079303 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1619/3238] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:10:37.098929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:37.099871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:37.108829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:37.109609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:37.110364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:37.111433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:37.112267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:37.113403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:37.636084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:37.650993 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f471161c-3d16-4d26-8d08-52ca1c326940 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1313 microversion: 2.1 time: 0.567823 Sep 16 14:10:37.655798 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1620/3239] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:37 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:37.676136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61f4f5c6-9cac-4b2c-b0a5-c1bcf18a5ce2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:37.676848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61f4f5c6-9cac-4b2c-b0a5-c1bcf18a5ce2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:38.002759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61f4f5c6-9cac-4b2c-b0a5-c1bcf18a5ce2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:38.035961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61f4f5c6-9cac-4b2c-b0a5-c1bcf18a5ce2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1192 microversion: 2.1 time: 0.373842 Sep 16 14:10:38.042891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1621/3240] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:37 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1192 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:38.679258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:38.684887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:38.736319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:38.742432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:38.745022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:38.761737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:38.764266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:38.765655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:39.388731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-999a88ac-9fa8-45ec-9d75-a56f406c4d16 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7/action" status: 202 len: 0 microversion: 2.1 time: 7.399023 Sep 16 14:10:39.396556 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1620/3241] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:10:31 2022] POST /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7/action => generated 0 bytes in 7409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:10:39.413135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:39.418272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:39.462896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:39.463990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:39.464793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:39.466164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:39.468612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:39.469889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:40.156220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:40.177638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d96c4530-c2ec-4bfc-ae99-681ef6a52ab7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1244 microversion: 2.1 time: 0.779232 Sep 16 14:10:40.187371 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1621/3242] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:39 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1244 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:40.187371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:40.187371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:40.207172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:40.208587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:40.209751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:40.216943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:40.217399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:40.226454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:41.121491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:41.141357 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04cd2cf4-b403-46cc-a0b3-12894434c22e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 2.467220 Sep 16 14:10:41.143670 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1622/3243] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:38 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:41.222537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:41.223447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:41.237599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:41.241418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:41.242256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:41.243269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:41.246343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:41.247200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:41.801585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:41.817769 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d1f0746-ed98-40ef-9349-50b6e58439ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1262 microversion: 2.1 time: 0.598069 Sep 16 14:10:41.818698 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1623/3244] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:41 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1262 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:42.188594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:42.190213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:42.217448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:42.219230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:42.219860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:42.220751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:42.221377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:42.222817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:42.931597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:42.943248 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f038cb3-e795-4620-9b47-4bf7281a3721 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 2.763316 Sep 16 14:10:42.962541 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1622/3245] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:40 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:42.970615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:42.970615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:42.983675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:42.984302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:42.984865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:42.985779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:42.986377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:42.986947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:43.608576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:43.683867 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b95ed86-8558-444f-8467-ca1f50b533b9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1250 microversion: 2.1 time: 0.720556 Sep 16 14:10:43.684949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1623/3246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:42 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1250 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:43.984869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:43.986007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:44.041865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:44.045410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:44.046261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:44.047651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:44.048522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:44.049308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:45.280825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:45.325082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cc1f48e1-c6e0-4211-a86c-0cea6f6622ab tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 3.141930 Sep 16 14:10:45.334057 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1624/3247] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:42 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:45.372142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:45.376167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:45.414377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:45.417551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:45.424490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:45.428400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:45.435051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:45.439355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:46.238344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:46.271006 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e9414d86-de57-4f4f-ac44-776151cf06e7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 2.293369 Sep 16 14:10:46.294305 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1624/3248] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:43 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:46.377004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:46.378342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:46.388805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:46.393432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:46.394493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:46.397371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:46.400680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:46.404486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:46.847268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:46.976243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:46.995390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f00f442f-4748-4477-a89e-75770a5d95e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1292 microversion: 2.1 time: 1.653995 Sep 16 14:10:47.019015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1625/3249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:45 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1292 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:47.327613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:47.328839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:47.377768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:47.382767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:47.383124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:47.384683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:47.389549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:47.390916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:48.021993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:48.030286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:48.069825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0248cbe3-52c3-44f2-8813-123d051f5ba3 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.697405 Sep 16 14:10:48.076232 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1625/3250] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:46 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:10:48.095325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:48.099016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:48.121530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:48.125376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:48.128868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:48.134375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:48.140420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:48.142892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:49.799688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:49.820781 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ab51ce9-a589-421f-b983-20eace4dfa94 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 2.501085 Sep 16 14:10:49.834963 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1626/3251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:47 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:49.860754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2cf6337a-f4b0-483d-98e2-1c710610fd03 req-d2d1c8dc-e055-4f48-ad24-34a9fb7b9f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac01276-8448-4514-8a4b-70183e0e2879", "tag": "5ddebda4-bb49-4f29-9476-24179bb35be9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:49.895971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:49.902046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2cf6337a-f4b0-483d-98e2-1c710610fd03 req-d2d1c8dc-e055-4f48-ad24-34a9fb7b9f0e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:49.904787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2cf6337a-f4b0-483d-98e2-1c710610fd03 req-d2d1c8dc-e055-4f48-ad24-34a9fb7b9f0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:49.905949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2cf6337a-f4b0-483d-98e2-1c710610fd03 req-d2d1c8dc-e055-4f48-ad24-34a9fb7b9f0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:49.933689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2cf6337a-f4b0-483d-98e2-1c710610fd03 req-d2d1c8dc-e055-4f48-ad24-34a9fb7b9f0e service nova] Creating event network-changed:5ddebda4-bb49-4f29-9476-24179bb35be9 for instance aac01276-8448-4514-8a4b-70183e0e2879 on n-h2-858129-2 Sep 16 14:10:49.948134 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2cf6337a-f4b0-483d-98e2-1c710610fd03 req-d2d1c8dc-e055-4f48-ad24-34a9fb7b9f0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110582 Sep 16 14:10:49.950317 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1627/3252] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:49.963513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:49.965220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:49.978062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:49.979002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:49.980120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:49.981712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:49.982883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:49.983973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:50.496353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:50.579877 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-63f20ff5-7c52-4c01-aa5b-c32b5377f9d2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1292 microversion: 2.1 time: 2.501920 Sep 16 14:10:50.589917 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1626/3253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:48 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1292 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:50.601884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7ec14ac4-070f-48a4-ae02-cb42f32a37b9 req-23c867ca-1008-48ad-94e3-52fceb88a852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "tag": "6859feee-fb82-4c51-910b-480ffc925bfa"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:50.647376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7ec14ac4-070f-48a4-ae02-cb42f32a37b9 req-23c867ca-1008-48ad-94e3-52fceb88a852 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:50.651030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7ec14ac4-070f-48a4-ae02-cb42f32a37b9 req-23c867ca-1008-48ad-94e3-52fceb88a852 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:50.651799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7ec14ac4-070f-48a4-ae02-cb42f32a37b9 req-23c867ca-1008-48ad-94e3-52fceb88a852 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:50.690371 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7ec14ac4-070f-48a4-ae02-cb42f32a37b9 req-23c867ca-1008-48ad-94e3-52fceb88a852 service nova] Creating event network-changed:6859feee-fb82-4c51-910b-480ffc925bfa for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:10:50.713522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7ec14ac4-070f-48a4-ae02-cb42f32a37b9 req-23c867ca-1008-48ad-94e3-52fceb88a852 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121428 Sep 16 14:10:50.715833 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1627/3254] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:50.875093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:50.876409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:50.906901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:50.907421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:50.907873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:50.912378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:50.912863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:50.915997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:51.186088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:51.213549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e1ce2a1-6aeb-4a44-ae4c-fa9e20d2658e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.260571 Sep 16 14:10:51.226174 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1628/3255] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:49 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:51.631175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:51.632878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:51.687143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:51.689286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:51.690416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:51.700289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:51.703847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:51.707381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:52.164500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:52.181598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4fd4d34-d236-4d8e-b920-82df313aa23b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 1.319784 Sep 16 14:10:52.182982 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1628/3256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:50 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:52.410597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-559967870", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:52.501539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:10:53.450944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:53.481117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e10e3721-6a47-4ff2-89dd-05481c5cf377 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1292 microversion: 2.1 time: 1.862500 Sep 16 14:10:53.490968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1629/3257] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:51 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1292 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:53.503736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:53.513889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:53.533582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:53.534586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:53.535288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:53.537154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:53.549616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:53.550430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:54.639279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:54.678346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27e2b115-9473-4f25-b7d8-fb85c906a75c tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.184857 Sep 16 14:10:54.683209 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1630/3258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:53 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:54.714661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9b1384ce-fcdf-4811-88af-538c03a1192e req-4ee2b4a2-c02f-44c6-87a3-2c1443f1f6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c236989-5cd0-4119-9e6d-f747cf03e7c7", "name": "network-vif-unplugged", "status": "completed", "tag": "cf840358-f1c1-437b-89e1-58d21beeea72"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:54.726499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9b1384ce-fcdf-4811-88af-538c03a1192e req-4ee2b4a2-c02f-44c6-87a3-2c1443f1f6e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:54.727325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9b1384ce-fcdf-4811-88af-538c03a1192e req-4ee2b4a2-c02f-44c6-87a3-2c1443f1f6e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:54.727770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9b1384ce-fcdf-4811-88af-538c03a1192e req-4ee2b4a2-c02f-44c6-87a3-2c1443f1f6e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:54.742369 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9b1384ce-fcdf-4811-88af-538c03a1192e req-4ee2b4a2-c02f-44c6-87a3-2c1443f1f6e2 service nova] Creating event network-vif-unplugged:cf840358-f1c1-437b-89e1-58d21beeea72 for instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 on n-h2-858129-2 Sep 16 14:10:54.748388 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9b1384ce-fcdf-4811-88af-538c03a1192e req-4ee2b4a2-c02f-44c6-87a3-2c1443f1f6e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062159 Sep 16 14:10:54.749956 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1631/3259] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:54.757270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:54.758468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:54.771260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:54.772211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:54.772932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:54.774829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:54.775676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:54.776369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:55.529994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:55.535324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:55.575861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e84505cc-5a00-467d-aed8-c0dfb8c37afa tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 0.823318 Sep 16 14:10:55.585782 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1632/3260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:54 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:55.620700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:55.621964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:55.652325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:55.657472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:55.658734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:55.661022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:55.664953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:55.669899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:56.028679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:10:56.029468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:10:56.030224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:10:56.038790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:10:56.039583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:10:56.113597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:56.113597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:56.114661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:56.116075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:56.116929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:56.117714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:56.191151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:10:56.222727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:10:56.229902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:10:56.290931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:10:56.318462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:10:56.591655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:56.607049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66613517-06ab-433d-af61-847c9a9736bb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1292 microversion: 2.1 time: 1.004497 Sep 16 14:10:56.623945 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1633/3261] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:55 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1292 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:56.636531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:56.640183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:56.662214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:56.665528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:56.666373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:56.668819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:56.670613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:56.673340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:56.708616 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7bca82f4-b2ba-4aaf-b3bf-ac9d75d0ebbb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.510434 Sep 16 14:10:56.716846 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1629/3262] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:10:56.756128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:56.757458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:56.829631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:56.832460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:56.833791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:56.842847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:56.847570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:56.850917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:59.050158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:59.099485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57513dbd-213e-41db-a443-2d8f1faa64ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 2.473324 Sep 16 14:10:59.103168 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1634/3263] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:56 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:59.146000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:59.147437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:59.162744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:59.164842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:59.165881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:59.168271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:59.169280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:59.170264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:59.190915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:59.230029 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5688ef92-86a9-42ab-8161-a4799e83d723 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 2.511199 Sep 16 14:10:59.234115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1630/3264] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:56 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:59.247412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c236989-5cd0-4119-9e6d-f747cf03e7c7", "tag": "cf840358-f1c1-437b-89e1-58d21beeea72"}, {"name": "network-changed", "server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "tag": "8639f59b-8f5d-419b-939b-6b3c70076e5b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:10:59.320914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:59.321729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:59.333644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:59.381163 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] Creating event network-changed:cf840358-f1c1-437b-89e1-58d21beeea72 for instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 on n-h2-858129-2 Sep 16 14:10:59.382631 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] Creating event network-changed:8639f59b-8f5d-419b-939b-6b3c70076e5b for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:10:59.392396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:10:59.405292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8b9bbbf1-1400-4d6c-9853-8794ef20f34b req-d071d715-cea3-4ec9-afb1-18098de18b3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.160742 Sep 16 14:10:59.407883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1631/3265] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:10:59.413953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab17733a-f2ca-41b4-89a7-15b301c0b307 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1266 microversion: 2.1 time: 0.307917 Sep 16 14:10:59.417577 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1635/3266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:59 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:10:59.436270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:10:59.437468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:10:59.446825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:59.447815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:59.448565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:10:59.449575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:10:59.450289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:10:59.450974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:00.044559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:00.061110 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-347c971f-de40-45b5-a7e0-623eb79e90ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1292 microversion: 2.1 time: 0.650846 Sep 16 14:11:00.061748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1632/3267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:10:59 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1292 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:00.080029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ccffb8af-307d-4db6-b4b5-89aafa4b9b00 req-da21d246-ebff-47eb-8a3f-59f0e3ef4094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac01276-8448-4514-8a4b-70183e0e2879", "name": "network-vif-plugged", "status": "completed", "tag": "5ddebda4-bb49-4f29-9476-24179bb35be9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:00.103835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ccffb8af-307d-4db6-b4b5-89aafa4b9b00 req-da21d246-ebff-47eb-8a3f-59f0e3ef4094 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:00.106766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ccffb8af-307d-4db6-b4b5-89aafa4b9b00 req-da21d246-ebff-47eb-8a3f-59f0e3ef4094 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:00.108098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ccffb8af-307d-4db6-b4b5-89aafa4b9b00 req-da21d246-ebff-47eb-8a3f-59f0e3ef4094 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:00.130790 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ccffb8af-307d-4db6-b4b5-89aafa4b9b00 req-da21d246-ebff-47eb-8a3f-59f0e3ef4094 service nova] Creating event network-vif-plugged:5ddebda4-bb49-4f29-9476-24179bb35be9 for instance aac01276-8448-4514-8a4b-70183e0e2879 on n-h2-858129-2 Sep 16 14:11:00.131027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:00.132074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:00.142917 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ccffb8af-307d-4db6-b4b5-89aafa4b9b00 req-da21d246-ebff-47eb-8a3f-59f0e3ef4094 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077189 Sep 16 14:11:00.144226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1636/3268] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 16 14:11:00.148826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:00.149445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:00.149898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:00.156493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:00.157050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:00.161174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:00.281046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:00.282103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:00.300448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:00.304803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:00.306281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:00.320731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:00.322765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:00.328732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:01.251692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:01.264679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a688d471-27ae-4225-8118-2d4911c14b9e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.139117 Sep 16 14:11:01.265302 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1633/3269] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:00 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:01.279357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:01.280057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:01.301092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:01.302361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:01.302845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:01.303612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:01.304074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:01.309105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:01.392134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:01.446798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-11dc994e-a927-4cf6-8e1d-a061e3c77194 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 1.172261 Sep 16 14:11:01.459218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1637/3270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:00 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:01.464333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:01.465241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:01.484231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:01.484738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:01.485183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:01.485924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:01.486390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:01.486928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:01.659623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:01.684389 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-92ab0298-151e-4534-86ef-b4f579734823 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1272 microversion: 2.1 time: 0.413237 Sep 16 14:11:01.706268 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1634/3271] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:01 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:02.128095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:02.153775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01bbe690-e50a-4c5f-992b-ba89c5ef0bed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1292 microversion: 2.1 time: 0.701106 Sep 16 14:11:02.156532 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1638/3272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:01 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1292 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:02.311494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:02.313657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:02.327468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:02.327963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:02.328417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:02.329215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:02.329687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:02.330334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:02.482989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:02.484300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:02.513660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:02.514595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:02.515419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:02.526277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:02.527120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:02.528188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:03.797116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:03.812239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6cd1a42-83ab-4d81-b552-cb35ec9a14a8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 1.340306 Sep 16 14:11:03.813259 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1639/3273] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:02 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:03.823356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:03.826682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:03.847372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:03.850953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:03.851870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:03.855476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:03.856532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:03.859086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:04.160004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:04.168984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=77 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:04.184460 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4ed75763-954b-4bcc-b5ae-dca34a3e88b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.884090 Sep 16 14:11:04.199927 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1635/3274] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:02 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:04.212166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:04.213052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:04.222467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:04.223334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:04.224120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:04.225106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:04.225954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:04.226604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:04.597363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:04.627224 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c6c0248-b336-44d9-b622-ff8eeb084d98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 0.812478 Sep 16 14:11:04.631470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1640/3275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:03 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:04.742331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:04.764906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43a296e7-ca02-40a6-8749-5eb34707bb12 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1473 microversion: 2.1 time: 0.562662 Sep 16 14:11:04.765805 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1636/3276] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:04 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1473 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:04.849874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:04.851112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:04.906330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:04.925209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:04.931343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:04.933854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:04.940400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:04.943937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:05.214684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:05.216020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:05.234153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:05.241005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:05.245316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:05.248369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:05.255972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:05.258814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:06.163171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:06.267533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:06.387269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:06.435390 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-731b23db-8133-43dd-a19a-d7ec9aef15ca tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.226325 Sep 16 14:11:06.436013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1637/3277] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:05 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:06.474467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-425500165", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:06.578477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:11:07.006648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:07.023016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a7c90f94-6251-4858-afd1-700a5464c6d6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 2.182626 Sep 16 14:11:07.024306 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1641/3278] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:04 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:07.031785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:07.033188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:07.042957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:07.043719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:07.044315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:07.045639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:07.046424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:07.067644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:09.060424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:09.071117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8a8d190-3cdf-4892-b4ac-367b655eac57 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 2.044872 Sep 16 14:11:09.075388 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1642/3279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:07 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:09.093181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:09.106529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:09.136131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:09.142202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:09.143491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:09.146367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:09.150785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:09.152182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:10.134324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:11:10.138589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:11:10.140033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:11:10.141082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:11:10.143340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:11:10.181312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:10.186520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:10.186990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:10.187833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:10.188306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:10.188741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:10.244087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:10.262535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:10.320464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:11:10.325611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7dd6d593-fd41-48d0-a9dc-dedaaceafba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:11:10.491114 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5fb3f4a7-5434-414b-8536-bc1d34ce0754 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.032258 Sep 16 14:11:10.507193 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1638/3280] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:11:10.519165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:10.521976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:10.542365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:10.543955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:10.547024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:10.548740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:10.550176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:10.551816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:10.742366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:10.755290 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1033099d-8050-444c-92cf-44d4830b6845 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.671285 Sep 16 14:11:10.766847 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1643/3281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:09 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:10.777823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:10.779214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:10.797602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:10.798623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:10.799499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:10.800733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:10.803478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:10.806077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:11.760145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:11.766831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:11.802822 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c3781fac-d110-4d49-9d5b-f2ce401e7ffe tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1504 microversion: 2.1 time: 1.291878 Sep 16 14:11:11.803066 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2690d5c-0da1-4258-a0da-c76513f14c4b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 1.027686 Sep 16 14:11:11.805038 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1639/3282] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:10 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1504 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:11.808783 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1644/3283] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:10 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:11.813791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:11.818147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7dd6d593-fd41-48d0-a9dc-dedaaceafba9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:11.836897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:11.839102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:11.860439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:11.860756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7dd6d593-fd41-48d0-a9dc-dedaaceafba9] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:11:11.862220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:11.864221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:11.870028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:11.870708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:11.871395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:11.919751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:11.920533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:11.921135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.020554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.021047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.021490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.023442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'flavor' on Instance uuid 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:11:12.047690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'system_metadata' on Instance uuid 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:11:12.280947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'metadata' on Instance uuid 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:11:12.506663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:12.550007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0563263-d3bf-40f5-bb4a-ca817f2b72da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 0.737251 Sep 16 14:11:12.558911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1645/3284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:11 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:12.586381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8174def2-10b0-4444-b475-6153fea87861 req-ea2bffc0-182d-4a66-be78-d94547ac5028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c53f4ae-a78c-492f-adb3-1b08edc22196", "tag": "788191a8-0041-43b8-b008-6e896a9cc623"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:12.639719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8174def2-10b0-4444-b475-6153fea87861 req-ea2bffc0-182d-4a66-be78-d94547ac5028 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.640235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8174def2-10b0-4444-b475-6153fea87861 req-ea2bffc0-182d-4a66-be78-d94547ac5028 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.640693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8174def2-10b0-4444-b475-6153fea87861 req-ea2bffc0-182d-4a66-be78-d94547ac5028 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.678264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8174def2-10b0-4444-b475-6153fea87861 req-ea2bffc0-182d-4a66-be78-d94547ac5028 service nova] Creating event network-changed:788191a8-0041-43b8-b008-6e896a9cc623 for instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 on n-h1-858129-2 Sep 16 14:11:12.689214 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8174def2-10b0-4444-b475-6153fea87861 req-ea2bffc0-182d-4a66-be78-d94547ac5028 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127144 Sep 16 14:11:12.697038 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1646/3285] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:12.774045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.scheduler.client.report [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Deleted allocations for instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 Sep 16 14:11:12.803274 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d35ec41-a1ab-4895-baf9-c6e014430ffe tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9" status: 204 len: 0 microversion: 2.1 time: 0.996768 Sep 16 14:11:12.803941 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1640/3286] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:11 2022] DELETE /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 => generated 0 bytes in 998 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:11:12.817742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:12.819807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7dd6d593-fd41-48d0-a9dc-dedaaceafba9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:12.830231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.830651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:12.832640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.833095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:12.833601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.834779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.835473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.836118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.847571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.848750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.849264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.850044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.850534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.850966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.867919 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 HTTP/1.1 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7dd6d593-fd41-48d0-a9dc-dedaaceafba9'} Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:12.873709 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:12.878628 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:12.878628 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:12.878628 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:12.878628 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:12.878628 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:11:12.878628 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:12.880470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:12.882770 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff708917-d670-4d79-8117-c0886bf41794 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9" status: 404 len: 111 microversion: 2.1 time: 0.070665 Sep 16 14:11:12.912425 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1647/3287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:12 2022] GET /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:12.920779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:12.921420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:12.933141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.933648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.937493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:12.939525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:12.941756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:12.942573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:13.684751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:13.719007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e5e5a49-93f1-46ad-9908-548f98941a27 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 0.803931 Sep 16 14:11:13.722427 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1648/3288] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:12 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:13.748998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1883603885", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:13.759048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:13.771965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79e84197-2fc6-4494-b769-493fa8024d97 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1479 microversion: 2.1 time: 0.945913 Sep 16 14:11:13.773275 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1641/3289] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:12 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1479 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:13.779620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:13.781135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:13.792258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:13.793073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:13.793855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:13.795082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:13.795757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:13.797820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:13.924399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:11:14.516248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:14.528650 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e479180-5d17-406f-9db7-89d5d51a13c4 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 0.753965 Sep 16 14:11:14.530169 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1642/3290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:13 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:14.565672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-87ca13a3-07da-470b-ba74-e26d0a25ee81 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '.version_select at 0x7f724cf8f310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:14.577365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87ca13a3-07da-470b-ba74-e26d0a25ee81 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:14.581837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87ca13a3-07da-470b-ba74-e26d0a25ee81 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:14.582600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87ca13a3-07da-470b-ba74-e26d0a25ee81 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:14.600208 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-87ca13a3-07da-470b-ba74-e26d0a25ee81 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 785 microversion: 2.1 time: 0.068368 Sep 16 14:11:14.609621 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1643/3291] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 14:11:14 2022] GET /compute/v2.1/os-migrations => generated 785 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:14.623233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:14.626370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:14.637702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:14.638215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:14.638737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:14.639492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:14.639965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:14.640394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:15.270453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2f254211-c751-4581-a6e2-acf8c8995e15 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1630 microversion: 2.1 time: 0.659431 Sep 16 14:11:15.276267 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1644/3292] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:14 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1630 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:15.291182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:15.292206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:15.309313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:15.311397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:15.313575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:15.323014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:15.323582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:15.324234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:15.748111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:11:15.753209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:11:15.763118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:11:15.764111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:11:15.768372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:11:15.810058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:15.811613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:15.816156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:15.822592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:15.823060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:15.824756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:15.825609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:15.833092 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-33edcd8e-4006-4b53-9f09-2bf158c4d282 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 0.553640 Sep 16 14:11:15.839293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1645/3293] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:15 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:15.848413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c200b22-bf8b-4893-a3d6-ef94cfcb10ca tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Action: 'create', calling method: .version_select at 0x7f725179dd30>, body: {"keypair": {"name": "tempest-keypair-1977272102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF77mXG85VU5JKkd48Z/r4jnjpYoLBiyxJkRuyvdsTVMC1J+XL+EENb/aHG5LkBmIn00+Q0A9o2ojLAhs25SFHjJXpQdtYD/5fa235rUAiZ+HMpnBVR9Wyw2apbIMykybw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:15.895606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-8c200b22-bf8b-4893-a3d6-ef94cfcb10ca tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:15.907033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-8c200b22-bf8b-4893-a3d6-ef94cfcb10ca tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for user 35e0a11712764fa5b78e9ac4d1859f3a and project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:15.930512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:15.964650 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c200b22-bf8b-4893-a3d6-ef94cfcb10ca tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123759 Sep 16 14:11:15.964977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:15.965435 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1646/3294] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:11:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:15.970855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:15.980019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:15.995453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:15.998670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:15.999308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:16.003271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:16.003888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:16.004461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:16.041589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:11:16.056329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:11:16.229083 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f96e7b0-cfa6-4ea1-a7a4-bdfbd64b37ca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.497500 Sep 16 14:11:16.241203 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1649/3295] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:11:16.250832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-679660bd-ce04-4b3c-a92a-94e009048662 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:16.251474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-679660bd-ce04-4b3c-a92a-94e009048662 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:16.605798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-679660bd-ce04-4b3c-a92a-94e009048662 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:16.621708 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-679660bd-ce04-4b3c-a92a-94e009048662 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1221 microversion: 2.1 time: 0.370842 Sep 16 14:11:16.626184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1650/3296] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:16 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1221 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:16.891308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:16.892114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:16.906876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:16.912333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:16.912940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:16.919018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:16.921968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:16.927411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:17.776753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:17.830995 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe301382-b53e-4d17-9038-533255169bce tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.862056 Sep 16 14:11:17.836777 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1647/3297] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:15 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:17.883636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3e704369-9aa8-4edf-8abd-17a5307ad3dc req-e9156614-297a-440c-8e91-15737f3110ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "name": "network-vif-plugged", "status": "completed", "tag": "6859feee-fb82-4c51-910b-480ffc925bfa"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:17.970044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3e704369-9aa8-4edf-8abd-17a5307ad3dc req-e9156614-297a-440c-8e91-15737f3110ce service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:17.971756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3e704369-9aa8-4edf-8abd-17a5307ad3dc req-e9156614-297a-440c-8e91-15737f3110ce service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:17.980460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3e704369-9aa8-4edf-8abd-17a5307ad3dc req-e9156614-297a-440c-8e91-15737f3110ce service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:18.057660 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3e704369-9aa8-4edf-8abd-17a5307ad3dc req-e9156614-297a-440c-8e91-15737f3110ce service nova] Creating event network-vif-plugged:6859feee-fb82-4c51-910b-480ffc925bfa for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:11:18.087277 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3e704369-9aa8-4edf-8abd-17a5307ad3dc req-e9156614-297a-440c-8e91-15737f3110ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243195 Sep 16 14:11:18.093449 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1648/3298] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:18.127395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:18.131274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:18.165856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:18.166718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:18.167359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:18.169247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:18.174228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:18.175189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:18.535175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:18.547491 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bab59384-3d08-4568-a47e-cb07f9bd1440 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 1.662757 Sep 16 14:11:18.552406 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1651/3299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:16 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:18.865290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:18.866240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:18.892087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:18.892984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:18.893634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:18.897592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:18.898302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:18.899043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:18.900738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:18.920802 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-152f951e-b828-4b65-9ec9-fc6fb659a5e6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1273 microversion: 2.1 time: 0.820904 Sep 16 14:11:18.924411 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1649/3300] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:18 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1273 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:19.616138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:19.625916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:19.674329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:19.676889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:19.678582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:19.685993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:19.694466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:19.695642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:20.208405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:21.724351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:21.737981 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b45342d-e783-4b6f-b4f3-d7074f0cbdb8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 2.877487 Sep 16 14:11:21.743436 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1652/3301] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:18 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:21.778059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:21.778751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:21.803200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:21.807208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:21.811311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:21.812215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:21.817777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:21.818289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:21.822071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:21.852998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:22.742227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:22.781723 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a840a596-eaf7-4efd-91b4-33e1e46da164 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 3.183102 Sep 16 14:11:22.783630 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1650/3302] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:19 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 3190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:22.825009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e07cece0-62c6-4920-b095-e701937a2cef req-c75d7b96-50df-4289-bed0-6229ee9ef512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "name": "network-vif-plugged", "status": "completed", "tag": "8639f59b-8f5d-419b-939b-6b3c70076e5b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:22.891177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:22.901071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3179393-b2be-4de0-9ca1-5d75dee2b898 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 1.139673 Sep 16 14:11:22.903945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e07cece0-62c6-4920-b095-e701937a2cef req-c75d7b96-50df-4289-bed0-6229ee9ef512 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:22.913723 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1653/3303] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:21 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:22.914717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e07cece0-62c6-4920-b095-e701937a2cef req-c75d7b96-50df-4289-bed0-6229ee9ef512 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:22.916332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e07cece0-62c6-4920-b095-e701937a2cef req-c75d7b96-50df-4289-bed0-6229ee9ef512 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:22.927208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:22.928316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:22.955355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:22.956190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:22.956715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:22.958876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:22.959471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:22.960104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:22.972399 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e07cece0-62c6-4920-b095-e701937a2cef req-c75d7b96-50df-4289-bed0-6229ee9ef512 service nova] Creating event network-vif-plugged:8639f59b-8f5d-419b-939b-6b3c70076e5b for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:11:22.983074 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e07cece0-62c6-4920-b095-e701937a2cef req-c75d7b96-50df-4289-bed0-6229ee9ef512 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195341 Sep 16 14:11:22.984336 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1651/3304] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:23.813172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:23.815425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:23.838017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:23.838997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:23.839911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:23.842806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:23.843888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:23.846455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:24.257213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:24.295800 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f085322f-c219-40c5-9e68-109505a236e8 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 1.386950 Sep 16 14:11:24.326317 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1654/3305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:22 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:24.343590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:24.344038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:24.364456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:24.365411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:24.365885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:24.366670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:24.367141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:24.376784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:24.573082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:24.604473 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6dbf10b5-c43b-4fab-b881-e9b29483aca4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 0.798089 Sep 16 14:11:24.609324 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1652/3306] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:23 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:24.886764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-91d971ea-2a57-4efd-a654-b158971fbece req-1e5f5c63-a579-403d-ab85-c4df0f206c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b5d40f-084a-4cda-b2f8-5cf865da2df1", "tag": "2ae26c04-df96-4aa1-be89-031a2e7ee815"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:24.906443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-91d971ea-2a57-4efd-a654-b158971fbece req-1e5f5c63-a579-403d-ab85-c4df0f206c0b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:24.908779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-91d971ea-2a57-4efd-a654-b158971fbece req-1e5f5c63-a579-403d-ab85-c4df0f206c0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:24.909328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-91d971ea-2a57-4efd-a654-b158971fbece req-1e5f5c63-a579-403d-ab85-c4df0f206c0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:24.954773 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-91d971ea-2a57-4efd-a654-b158971fbece req-1e5f5c63-a579-403d-ab85-c4df0f206c0b service nova] Creating event network-changed:2ae26c04-df96-4aa1-be89-031a2e7ee815 for instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 on n-h2-858129-2 Sep 16 14:11:24.972546 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-91d971ea-2a57-4efd-a654-b158971fbece req-1e5f5c63-a579-403d-ab85-c4df0f206c0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095643 Sep 16 14:11:24.975518 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1653/3307] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:11:25.133453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e2a17bf7-ff6a-4d61-a5c3-3b62a628b261 req-464e5149-0357-4b09-8b94-034ff944bb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c53f4ae-a78c-492f-adb3-1b08edc22196", "name": "network-vif-plugged", "status": "completed", "tag": "788191a8-0041-43b8-b008-6e896a9cc623"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:25.139014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:25.156540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8630443-108e-4db8-bbc9-5b9600272e9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.826056 Sep 16 14:11:25.173903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e2a17bf7-ff6a-4d61-a5c3-3b62a628b261 req-464e5149-0357-4b09-8b94-034ff944bb3f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:25.174684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e2a17bf7-ff6a-4d61-a5c3-3b62a628b261 req-464e5149-0357-4b09-8b94-034ff944bb3f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:25.175310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e2a17bf7-ff6a-4d61-a5c3-3b62a628b261 req-464e5149-0357-4b09-8b94-034ff944bb3f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:25.179426 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1655/3308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:24 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:25.213544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e2a17bf7-ff6a-4d61-a5c3-3b62a628b261 req-464e5149-0357-4b09-8b94-034ff944bb3f service nova] Creating event network-vif-plugged:788191a8-0041-43b8-b008-6e896a9cc623 for instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 on n-h1-858129-2 Sep 16 14:11:25.245715 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e2a17bf7-ff6a-4d61-a5c3-3b62a628b261 req-464e5149-0357-4b09-8b94-034ff944bb3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119107 Sep 16 14:11:25.246895 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1654/3309] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:11:25.367110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:25.372638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:25.393073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:25.394668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:25.396079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:25.397775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:25.407718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:25.409371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:25.635870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:25.636602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:25.647738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:25.648240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:25.652941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:25.653835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:25.654351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:25.654802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:25.856262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:25.924761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:26.612163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:27.031009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:27.049037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3fd7898b-707c-474c-a209-6db7e9fd50a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1314 microversion: 2.1 time: 1.418011 Sep 16 14:11:27.063662 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1655/3310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:25 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1314 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:27.074378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:27.075034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:27.092145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:27.094063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:27.094606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:27.095053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:27.095787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:27.096246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:27.096731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:27.137080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:27.502813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:27.542266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49aa2554-8ca1-490e-a3b7-8be29aec4815 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1334 microversion: 2.1 time: 2.193136 Sep 16 14:11:27.549982 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1656/3311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:25 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1334 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:27.661289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:27.680938 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06a758f5-5424-4df4-b60d-6c7d49c4fcd3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.615849 Sep 16 14:11:27.684013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1656/3312] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:27 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:27.872564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1387957271", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "941f1dd8-b04a-486d-bbeb-3b2d2413b0c1"}], "security_groups": [{"name": "tempest-securitygroup--1628692373"}], "key_name": "tempest-keypair-1977272102", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:28.197995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] validate_networks() for [('941f1dd8-b04a-486d-bbeb-3b2d2413b0c1', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:11:28.595252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-447206801", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "c17d5b8c-1a6d-4fb6-969b-32830af49051"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:28.770298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] validate_networks() for [('c17d5b8c-1a6d-4fb6-969b-32830af49051', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:11:29.537086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:11:29.537916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:11:29.538971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:11:29.539699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:11:29.540324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:11:29.552885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:29.553633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:29.554437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:29.555998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:29.556886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:29.557526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:29.592257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:29.600480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for user 35e0a11712764fa5b78e9ac4d1859f3a and project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:29.662559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:11:29.669645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:11:29.885833 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b0725be-686f-477e-a10a-051e5370fc0d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.017386 Sep 16 14:11:29.889359 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1657/3313] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:11:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:11:29.907382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:29.908453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:29.930191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:29.934085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:29.935127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:29.936562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:29.937509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:29.939968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:30.715106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:30.759319 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4dadf380-22d7-49d7-b330-45189b638516 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1501 microversion: 2.1 time: 0.864821 Sep 16 14:11:30.765926 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1658/3314] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:29 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1501 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:30.773141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:30.774108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:30.790776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:30.793065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:30.809508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:30.811897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:30.816423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:30.820071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.015088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:11:31.016716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:11:31.017919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:11:31.019003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:11:31.021064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:11:31.080192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.082667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.083522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.084876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.085756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.086865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.136150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Getting quotas for project 9d2424dd7c4d4503ac73ff093d66abe9. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:31.149241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Getting quotas for user 1779c56c495847dd9330fbadc7993dca and project 9d2424dd7c4d4503ac73ff093d66abe9. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:31.227470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:11:31.229976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:11:31.265553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:31.278238 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf3daa61-c1e2-4ba3-818e-0f824d81272e tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1670 microversion: 2.1 time: 0.506948 Sep 16 14:11:31.280317 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1659/3315] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:30 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1670 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:31.320350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:31.323146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:31.345486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.356759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.359158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.361890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.364244 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79533c97-ac69-4bc2-be34-98f432bb379f tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.511103 Sep 16 14:11:31.365396 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1657/3316] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:11:31.366861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.367840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.371372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:31.380002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:31.407321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.411989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.413204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.427180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.428085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.428870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.747419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:31.765561 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2da9bee0-cf41-4cab-a2a5-ab1d3e983a78 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1239 microversion: 2.1 time: 0.398995 Sep 16 14:11:31.766172 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1658/3317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:31 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1239 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:31.793097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:31.793629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:31.828627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.829328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.832556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.836806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.837317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.837770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.899406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:31.921096 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c8e7d25-fc9b-46b8-a4e0-2d48ea5d6cf6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.639535 Sep 16 14:11:31.923516 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1660/3318] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:31 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:31.939316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:31.939911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:31.984861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.986350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.986835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:11:31.993939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:31.995779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:31.997104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:31.998468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:32.158532 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-08d1beb4-4c57-4291-a987-ba58450931e2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c/ips" status: 200 len: 180 microversion: 2.1 time: 0.233196 Sep 16 14:11:32.194996 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1661/3319] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:11:31 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c/ips => generated 180 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:32.227162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de741d12-7314-43fe-bd51-7cea26935943 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:32.229100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de741d12-7314-43fe-bd51-7cea26935943 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:32.409650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de741d12-7314-43fe-bd51-7cea26935943 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:32.423885 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de741d12-7314-43fe-bd51-7cea26935943 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1227 microversion: 2.1 time: 0.227190 Sep 16 14:11:32.428263 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1662/3320] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:32 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1227 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:32.454210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:32.459340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:32.472490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a7e96d3-a4d3-4311-b8e3-dd6c94d6255d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 204 len: 0 microversion: 2.1 time: 0.677438 Sep 16 14:11:32.483981 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1659/3321] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:31 2022] DELETE /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:11:32.487887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:32.490250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:32.492021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:32.493084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:32.493788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:32.495167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:32.496184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:32.497734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:32.511816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:32.512647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:32.514688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:32.516824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:32.521309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:32.524601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:32.596623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:11:32.971268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:33.015026 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-95832921-093e-4740-b0bc-64525dc94cea tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1507 microversion: 2.1 time: 0.525133 Sep 16 14:11:33.017332 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1660/3322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:32 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:33.028793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:33.030547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:33.071555 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11d092d5-7a05-4877-9e3e-4875b21177b2 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 204 len: 0 microversion: 2.1 time: 0.639061 Sep 16 14:11:33.072666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1663/3323] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:32 2022] DELETE /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:11:33.088680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.091998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.094471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.096671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.099193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.099424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:33.100988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.103290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:33.161555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.164294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.167490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.171855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.173277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.177064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.366449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:33.406563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f14886e-52a8-4a4b-90c9-129b401ae990 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1287 microversion: 2.1 time: 0.384174 Sep 16 14:11:33.414000 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1661/3324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:33 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1287 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:33.423740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:33.434609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:33.451966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.453515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.454846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.456610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.458261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.459433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.834764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:33.859794 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bfeb6953-fef4-4735-b98b-b46de8afe99a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.784756 Sep 16 14:11:33.860860 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1664/3325] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:33 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:33.873822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:33.890885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:33.893094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:33.907162 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f84cf1bd-7559-4d2a-b845-f5bae0fc10b0 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1676 microversion: 2.1 time: 0.490674 Sep 16 14:11:33.922067 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1662/3326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:33 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1676 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:33.928629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.929567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.930365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:33.931693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:33.932548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:33.933325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.042549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:34.045937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:34.071460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.080052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.081923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.085073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.086950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:34.091653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.095963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.099290 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01702930-2a60-4efd-a345-af5438b8cdb4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1279 microversion: 2.1 time: 0.237002 Sep 16 14:11:34.101166 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1665/3327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:33 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1279 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:34.429002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:34.439024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:34.440299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:34.447239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ea48d4c-4979-41b3-a74b-a98cd0e8dc05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1507 microversion: 2.1 time: 0.408090 Sep 16 14:11:34.449176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.449367 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1663/3328] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:34 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:34.450101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.450913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.452124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.452594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.453290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.546220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:34.556263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4de01a13-a090-4143-bf1d-62f2758fe89a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1293 microversion: 2.1 time: 0.122796 Sep 16 14:11:34.556879 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1666/3329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:34 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:34.893370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:34.896150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:34.908645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.910845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.912088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.914005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.916317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.917566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.937786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:34.938586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:34.964192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.973956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.974814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:34.976053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:34.976901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:34.977974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:35.762930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:35.786847 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5c65a5f-b6ad-45e3-b868-660133f63430 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.900519 Sep 16 14:11:35.789456 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1664/3330] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:34 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:35.816878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:35.818856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:35.836005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:35.838271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:35.839860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:35.841642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:35.842790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:35.843885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:35.911574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:35.924942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-12a9fc66-b691-4de6-bcbf-18b381180431 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1676 microversion: 2.1 time: 0.993222 Sep 16 14:11:35.930132 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1667/3331] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:34 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1676 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:35.941934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:35.947681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:35.962578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:35.964197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:35.965973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:35.978626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:35.980600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:35.981569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.032050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:36.084301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67a6eff3-3d24-4b04-91fc-fa761440201a tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1285 microversion: 2.1 time: 0.287681 Sep 16 14:11:36.088025 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1665/3332] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:35 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1285 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:36.105256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-caf6ada9-0e8d-4483-a743-6acab4536bd8 req-35baa44b-e83c-44d8-966c-afd7633f6f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b5d40f-084a-4cda-b2f8-5cf865da2df1", "name": "network-vif-plugged", "status": "completed", "tag": "2ae26c04-df96-4aa1-be89-031a2e7ee815"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:36.123646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-caf6ada9-0e8d-4483-a743-6acab4536bd8 req-35baa44b-e83c-44d8-966c-afd7633f6f35 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.125128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-caf6ada9-0e8d-4483-a743-6acab4536bd8 req-35baa44b-e83c-44d8-966c-afd7633f6f35 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.125998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-caf6ada9-0e8d-4483-a743-6acab4536bd8 req-35baa44b-e83c-44d8-966c-afd7633f6f35 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.156727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-caf6ada9-0e8d-4483-a743-6acab4536bd8 req-35baa44b-e83c-44d8-966c-afd7633f6f35 service nova] Creating event network-vif-plugged:2ae26c04-df96-4aa1-be89-031a2e7ee815 for instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 on n-h2-858129-2 Sep 16 14:11:36.169386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-caf6ada9-0e8d-4483-a743-6acab4536bd8 req-35baa44b-e83c-44d8-966c-afd7633f6f35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075092 Sep 16 14:11:36.171552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1666/3333] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:36.186821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:36.188162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:36.204131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.205412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.206582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.208318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.209440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.210445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.755897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:36.773087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:36.779928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f95b021-d436-4fd7-8483-d160ffa541ca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1507 microversion: 2.1 time: 0.846479 Sep 16 14:11:36.781815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1668/3334] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:35 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:36.788608 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17b0187d-1e24-4a27-a1a1-98ad93733d65 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 0.614523 Sep 16 14:11:36.809511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1667/3335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:36 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:36.819571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:36.822087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:36.834739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.838368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.838856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.839621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.843214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.855366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.954758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:36.955529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:36.970309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.970894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.971417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:36.972383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:36.977445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:36.978195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:37.608637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:37.637393 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a8cd40ee-a6f1-4f77-a1b3-bf4b3de8f051 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.828349 Sep 16 14:11:37.638425 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1669/3336] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:36 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:37.644007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:37.652820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:37.665353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:37.670030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:37.670825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:37.672109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:37.673193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:37.675214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:37.958632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:38.007943 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72e8d316-980d-4595-966d-5b3b67ba9e96 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1676 microversion: 2.1 time: 1.057066 Sep 16 14:11:38.020125 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1668/3337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:36 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1676 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:38.044314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4fd0ff25-62da-49ed-8d05-5a46b4c80a67 req-e0203311-0060-4baf-9104-880bd93f0122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c53f4ae-a78c-492f-adb3-1b08edc22196", "name": "network-vif-deleted", "tag": "788191a8-0041-43b8-b008-6e896a9cc623"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:38.063918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:38.081045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4fd0ff25-62da-49ed-8d05-5a46b4c80a67 req-e0203311-0060-4baf-9104-880bd93f0122 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.081616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4fd0ff25-62da-49ed-8d05-5a46b4c80a67 req-e0203311-0060-4baf-9104-880bd93f0122 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.082651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4fd0ff25-62da-49ed-8d05-5a46b4c80a67 req-e0203311-0060-4baf-9104-880bd93f0122 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.085212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b987bf51-e194-43e8-902f-d3df906e3fd7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 0.445002 Sep 16 14:11:38.090511 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1670/3338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:37 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:38.107445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:38.108541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:38.131809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.132326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.132764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.133514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.133995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.134680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.141694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4fd0ff25-62da-49ed-8d05-5a46b4c80a67 req-e0203311-0060-4baf-9104-880bd93f0122 service nova] Creating event network-vif-deleted:788191a8-0041-43b8-b008-6e896a9cc623 for instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 on n-h1-858129-2 Sep 16 14:11:38.158785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4fd0ff25-62da-49ed-8d05-5a46b4c80a67 req-e0203311-0060-4baf-9104-880bd93f0122 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137145 Sep 16 14:11:38.164710 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1669/3339] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:38.180362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:38.181150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:38.216318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.216719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.217168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.217923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.218387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.218850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.222102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:38.349823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.350334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.350814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.351325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'fault' on Instance uuid 7c53f4ae-a78c-492f-adb3-1b08edc22196 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:11:38.610554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:38.638499 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-480605c5-715b-460c-a789-4e6f78ed5ba5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 200 len: 1304 microversion: 2.1 time: 0.470183 Sep 16 14:11:38.644301 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1670/3340] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:38 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 1304 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:38.665024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e693bb23-429e-4d4c-8baa-77dec3526d65 req-e22af00f-7dcb-49a4-b4fa-ba5990cb463f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "name": "network-vif-unplugged", "status": "completed", "tag": "6859feee-fb82-4c51-910b-480ffc925bfa"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:38.692018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:38.712410 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a508e1a-b7a3-49cd-94a8-a6b61c75b162 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 0.615448 Sep 16 14:11:38.718979 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1671/3341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:38 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:38.724736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:38.729020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e693bb23-429e-4d4c-8baa-77dec3526d65 req-e22af00f-7dcb-49a4-b4fa-ba5990cb463f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.733228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:38.744053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e693bb23-429e-4d4c-8baa-77dec3526d65 req-e22af00f-7dcb-49a4-b4fa-ba5990cb463f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.745314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e693bb23-429e-4d4c-8baa-77dec3526d65 req-e22af00f-7dcb-49a4-b4fa-ba5990cb463f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.750119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.751103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.751788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.753023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.754305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.759127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.849892 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e693bb23-429e-4d4c-8baa-77dec3526d65 req-e22af00f-7dcb-49a4-b4fa-ba5990cb463f service nova] Creating event network-vif-unplugged:6859feee-fb82-4c51-910b-480ffc925bfa for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:11:38.881504 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e693bb23-429e-4d4c-8baa-77dec3526d65 req-e22af00f-7dcb-49a4-b4fa-ba5990cb463f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.232882 Sep 16 14:11:38.900147 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1671/3342] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:38.924746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:38.925389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:38.984058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.989520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.991066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:38.997008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:38.997621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:38.998093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:39.101442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:11:39.352394 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd7a20b0-a92f-441e-a5c6-53e7f8f1fadb tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 204 len: 0 microversion: 2.1 time: 0.441562 Sep 16 14:11:39.353408 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1672/3343] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:38 2022] DELETE /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:11:39.363687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:39.364863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:39.395144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:39.396046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:39.398548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:39.399585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:39.401293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:39.403173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:39.583134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:39.596761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:39.633980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a30ffd5-70b5-4963-8626-28c3d5e95902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1321 microversion: 2.1 time: 0.912572 Sep 16 14:11:39.634950 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1672/3344] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:38 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1321 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:39.656374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:39.662561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:39.680347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:39.689856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:39.697683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:39.701252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:39.702918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:39.703967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:39.791160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:40.681705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '782fbafaf3004e72aabae9768d700361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b243d4de294eeebcd2c8ce44d02bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:40.748150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:40.783238 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6901dd95-5830-4e95-82c3-7b6134b343da tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 200 len: 1655 microversion: 2.1 time: 1.426108 Sep 16 14:11:40.789524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1673/3345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:39 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 1655 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:40.801053 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-047baeba-dbbd-4180-a7ba-a21b07ef8b55 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 1.157580 Sep 16 14:11:40.806963 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1673/3346] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:39 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:40.822965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:40.824688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:40.854652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:40.861898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:40.871508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:40.877371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:40.878326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:40.880245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:40.881148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:40.881950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:40.936072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:40.939662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:40.946117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:40.954386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:40.958202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:40.959341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.060668 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 HTTP/1.1 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '7c53f4ae-a78c-492f-adb3-1b08edc22196'} Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:41.068953 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:11:41.079107 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:41.085395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:41.092798 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9be7ab29-f360-4bed-8553-3cccf25dfebf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 404 len: 111 microversion: 2.1 time: 0.282056 Sep 16 14:11:41.093848 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1674/3347] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:40 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 111 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:41.115018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:41.121770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:41.129310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:41.152605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:41.153671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:41.154757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.156340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:41.158331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:41.159565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:41.160588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.646296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:41.655941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94b307b8-25b8-43e7-aab0-f1db96ec8245 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1667 microversion: 2.1 time: 0.860473 Sep 16 14:11:41.657102 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1674/3348] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:40 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1667 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:41.662583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-34ec74e8-8d54-4a4c-bb33-ae06af11ddd9 req-76505a59-cfdf-4008-a18e-34190d56af16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "name": "network-vif-deleted", "tag": "8639f59b-8f5d-419b-939b-6b3c70076e5b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:41.674611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-34ec74e8-8d54-4a4c-bb33-ae06af11ddd9 req-76505a59-cfdf-4008-a18e-34190d56af16 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:41.676225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-34ec74e8-8d54-4a4c-bb33-ae06af11ddd9 req-76505a59-cfdf-4008-a18e-34190d56af16 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:41.676969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-34ec74e8-8d54-4a4c-bb33-ae06af11ddd9 req-76505a59-cfdf-4008-a18e-34190d56af16 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.702545 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-34ec74e8-8d54-4a4c-bb33-ae06af11ddd9 req-76505a59-cfdf-4008-a18e-34190d56af16 service nova] Creating event network-vif-deleted:8639f59b-8f5d-419b-939b-6b3c70076e5b for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:11:41.709408 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-34ec74e8-8d54-4a4c-bb33-ae06af11ddd9 req-76505a59-cfdf-4008-a18e-34190d56af16 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050688 Sep 16 14:11:41.710895 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1675/3349] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:41.716781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ade53643-033c-4e42-a9f8-958c1775eada req-bb49c532-c6aa-40fc-9e43-2a0b8aed2cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d141f3-2891-487a-861e-ccaf4b2d5cbe", "tag": "20061ac3-c0ee-4011-9ba3-ecd56514297d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:41.729381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ade53643-033c-4e42-a9f8-958c1775eada req-bb49c532-c6aa-40fc-9e43-2a0b8aed2cba service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:41.730251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ade53643-033c-4e42-a9f8-958c1775eada req-bb49c532-c6aa-40fc-9e43-2a0b8aed2cba service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:41.730997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ade53643-033c-4e42-a9f8-958c1775eada req-bb49c532-c6aa-40fc-9e43-2a0b8aed2cba service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.747834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ade53643-033c-4e42-a9f8-958c1775eada req-bb49c532-c6aa-40fc-9e43-2a0b8aed2cba service nova] Creating event network-changed:20061ac3-c0ee-4011-9ba3-ecd56514297d for instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe on n-h2-858129-2 Sep 16 14:11:41.757778 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ade53643-033c-4e42-a9f8-958c1775eada req-bb49c532-c6aa-40fc-9e43-2a0b8aed2cba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045126 Sep 16 14:11:41.759463 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1676/3350] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:41.766594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:41.767807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:41.777977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:41.781727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:41.784082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.789296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:41.790543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:41.791289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:41.822228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:41.837536 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d2d276b-662d-4d31-a190-dac05f202286 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 0.741454 Sep 16 14:11:41.838748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1675/3351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:41 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:41.859583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1817163953", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:42.414520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:42.535400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:11:42.649411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:42.658031 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b6aadbf-0ffd-4fcb-914c-9cd3083c8e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1502 microversion: 2.1 time: 0.896133 Sep 16 14:11:42.658676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1677/3352] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:41 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1502 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:42.678634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:42.679601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:42.688740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:42.689265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:42.689693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:42.690460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:42.691515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:42.691967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:42.728291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] HTTP exception thrown: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Request method failure captured: Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c HTTP/1.1 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJINgSBqxA0xYytbVEyNJ9be93wImlgrOc7KlEnJE3D6q4IdWZVMxhkDIr7absFQkKWCU_p15qWg46t14QWFZ7uJSOQ7Ddy_o_KPqiK0vwTq5wytnfnZkn8A_VGBm3gT41aABXqwTT3ez7i4I0xjut6BbsAWvN3HtEScPl0cN5moH4m0 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83b243d4de294eeebcd2c8ce44d02bed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}] Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 782fbafaf3004e72aabae9768d700361 Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4cc45f48-8644-49d0-bd59-a53bb8b2451c'} Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:42.730040 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Returning 404 to user: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df0d0816-022c-4343-8602-34b6303faee6 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 404 len: 111 microversion: 2.1 time: 0.061469 Sep 16 14:11:42.740117 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1678/3353] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:42 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:42.741574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:42.741749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:42.770323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:42.770896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:42.771353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:42.772171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:42.772670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:42.773095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:43.360552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:43.397942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79b491d8-b3a7-4183-a062-ba8d1efe35f7 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 0.663528 Sep 16 14:11:43.403742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1679/3354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:42 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:43.415889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:43.417306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:43.430862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:43.432098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:43.433676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:43.435473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:43.436761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:43.437839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.196216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:44.213234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e3f8172-16c7-478c-9151-fc97153a07e2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1502 microversion: 2.1 time: 0.807024 Sep 16 14:11:44.215523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1680/3355] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:43 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1502 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:44.237843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:44.250131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:44.275528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.278225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.280531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.285735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.286314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.288379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.375359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:11:44.375771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:11:44.376241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:11:44.376655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:11:44.377690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:11:44.404821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.405335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.405791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.406687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.407943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.408444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.449775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:44.457750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:44.475269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:44.475850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:11:44.478636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:11:44.488532 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-26c479a5-ac45-427a-91c1-fd6a67d61a17 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1599 microversion: 2.1 time: 0.268453 Sep 16 14:11:44.490865 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1681/3356] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:44 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1599 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:44.507754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:44.508669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:44.527544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.528779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.529517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.530893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.531620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.534700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.557087 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-787b9365-86f3-48ca-8e71-c7e3d92e143a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.716858 Sep 16 14:11:44.592803 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1676/3357] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:11:44.606326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-202ade15-bd3c-46e9-8340-a4848645ac3e req-5ee64104-37ca-4994-a004-b49aee94cd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc45f48-8644-49d0-bd59-a53bb8b2451c", "name": "network-vif-deleted", "tag": "6859feee-fb82-4c51-910b-480ffc925bfa"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:44.633601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-202ade15-bd3c-46e9-8340-a4848645ac3e req-5ee64104-37ca-4994-a004-b49aee94cd67 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.636234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-202ade15-bd3c-46e9-8340-a4848645ac3e req-5ee64104-37ca-4994-a004-b49aee94cd67 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.638348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-202ade15-bd3c-46e9-8340-a4848645ac3e req-5ee64104-37ca-4994-a004-b49aee94cd67 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.672100 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-202ade15-bd3c-46e9-8340-a4848645ac3e req-5ee64104-37ca-4994-a004-b49aee94cd67 service nova] Creating event network-vif-deleted:6859feee-fb82-4c51-910b-480ffc925bfa for instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c on n-h1-858129-2 Sep 16 14:11:44.682345 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-202ade15-bd3c-46e9-8340-a4848645ac3e req-5ee64104-37ca-4994-a004-b49aee94cd67 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087742 Sep 16 14:11:44.685542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1677/3358] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:44.703919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7df05690-aca8-4f38-bb5d-74bd137c4363 req-46111d0c-ed84-4f51-8db4-c3613fe1df30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7233541-559a-49e7-a129-28daf73b7b91", "tag": "0909edc1-5783-4aef-8e7c-030829187017"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:44.734129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7df05690-aca8-4f38-bb5d-74bd137c4363 req-46111d0c-ed84-4f51-8db4-c3613fe1df30 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.734667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7df05690-aca8-4f38-bb5d-74bd137c4363 req-46111d0c-ed84-4f51-8db4-c3613fe1df30 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.735108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7df05690-aca8-4f38-bb5d-74bd137c4363 req-46111d0c-ed84-4f51-8db4-c3613fe1df30 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.772057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7df05690-aca8-4f38-bb5d-74bd137c4363 req-46111d0c-ed84-4f51-8db4-c3613fe1df30 service nova] Creating event network-changed:0909edc1-5783-4aef-8e7c-030829187017 for instance e7233541-559a-49e7-a129-28daf73b7b91 on n-h2-858129-2 Sep 16 14:11:44.796938 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7df05690-aca8-4f38-bb5d-74bd137c4363 req-46111d0c-ed84-4f51-8db4-c3613fe1df30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106959 Sep 16 14:11:44.813657 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1678/3359] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:44.830914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:44.831441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:44.872303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.876353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.879484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.882801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:44.885932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:44.889368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:44.969279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:11:45.169703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:45.231779 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8e2db2d-af07-4217-b743-3fd564775ce9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 0.735863 Sep 16 14:11:45.253848 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1682/3360] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:44 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:45.281345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:45.292507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:45.315872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:45.317753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:45.318892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:45.320863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:45.322028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:45.323287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:45.360783 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-040eb5e1-3c87-4141-85b1-890e3a2e1d6d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 204 len: 0 microversion: 2.1 time: 0.544897 Sep 16 14:11:45.362152 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1679/3361] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:44 2022] DELETE /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:11:45.394924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd3998a4-7af3-418a-9b6e-f957a87fa93a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:45.439600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cd3998a4-7af3-418a-9b6e-f957a87fa93a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:45.897922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd3998a4-7af3-418a-9b6e-f957a87fa93a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:45.933773 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd3998a4-7af3-418a-9b6e-f957a87fa93a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1215 microversion: 2.1 time: 0.559887 Sep 16 14:11:45.963059 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1680/3362] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:45 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1215 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:45.983891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:45.986150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:46.000045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.002934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.004479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.007309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.008617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.010160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.370671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:46.413637 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6bc73255-fd84-4f76-acf1-e01ce0bafbf1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 1.161094 Sep 16 14:11:46.419683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1683/3363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:45 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:46.462764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:46.463956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:46.479780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.482054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.484404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.486245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.487537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.489120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.633121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:46.648618 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ec03477-c906-4975-b75f-f5594aa2d4ff tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1508 microversion: 2.1 time: 0.683868 Sep 16 14:11:46.663423 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1681/3364] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:45 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:46.673324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:46.674228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:46.681303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.682125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.682804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.683769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.684425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.685027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.788771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:46.809270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f436762-adb5-4026-af0d-8daa978ec4cd tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1599 microversion: 2.1 time: 0.356043 Sep 16 14:11:46.810592 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1684/3365] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:46 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1599 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:46.821038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-98cff0b0-e492-44a0-a0e6-dd341233f007 req-309883eb-2a36-476b-81ed-adf3c5a42456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e9d5d6-15cf-4532-af49-c84f1de5d43b", "name": "network-vif-deleted", "tag": "43e8b125-d5fa-46a2-a1cc-71933573b38d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:46.857360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-98cff0b0-e492-44a0-a0e6-dd341233f007 req-309883eb-2a36-476b-81ed-adf3c5a42456 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:46.858255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-98cff0b0-e492-44a0-a0e6-dd341233f007 req-309883eb-2a36-476b-81ed-adf3c5a42456 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:46.869008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-98cff0b0-e492-44a0-a0e6-dd341233f007 req-309883eb-2a36-476b-81ed-adf3c5a42456 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:46.903110 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-98cff0b0-e492-44a0-a0e6-dd341233f007 req-309883eb-2a36-476b-81ed-adf3c5a42456 service nova] Creating event network-vif-deleted:43e8b125-d5fa-46a2-a1cc-71933573b38d for instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b on n-h2-858129-2 Sep 16 14:11:46.918543 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-98cff0b0-e492-44a0-a0e6-dd341233f007 req-309883eb-2a36-476b-81ed-adf3c5a42456 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105659 Sep 16 14:11:46.930879 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1685/3366] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:46.991263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:47.001918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:47.035916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:47.036439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:47.042520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:47.043796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:47.044652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:47.045510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:47.316718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:47.327176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21044efa-b5e8-446f-8d98-1c86cd06f6ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1267 microversion: 2.1 time: 0.348024 Sep 16 14:11:47.333799 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1686/3367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:46 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:47.423664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:47.459294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:47.461083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:47.477215 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b06387e2-d3a0-43f2-b5fe-d2837c446158 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 0.811843 Sep 16 14:11:47.486170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:47.487467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:47.489634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:47.490835 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1682/3368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:46 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:47.491192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:47.491987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:47.492715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:47.683309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:47.684559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:47.710069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:47.713746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:47.715124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:47.716627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:47.735063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:47.736502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:47.738843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:48.596294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:48.615583 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b07abd2f-e902-4aaa-adcb-ead2d80659a8 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 1.161150 Sep 16 14:11:48.627119 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1687/3369] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:47 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:48.641006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:48.641655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:48.672820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:48.676705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:48.678950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:48.683708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:48.687618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:48.688408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:48.707464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:49.541079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:49.567212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e21a067f-3e8b-4803-93ec-d695e4d033e5 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1310 microversion: 2.1 time: 0.937502 Sep 16 14:11:49.575477 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1688/3370] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:48 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1310 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:49.591899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:49.600844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:49.617298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:49.647604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:49.648856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:49.649907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:49.651504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:49.652785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:49.653543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:49.854168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:49.867826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:49.878630 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4ba741b-98bb-4c5e-aeaa-1638b6b2cc76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1508 microversion: 2.1 time: 2.205336 Sep 16 14:11:49.879966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d51b5be6-dbcb-40be-afb3-495a3afcc033 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1273 microversion: 2.1 time: 0.302568 Sep 16 14:11:49.884278 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1683/3371] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:47 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1508 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:49.896220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:49.899260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:49.912864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:49.916287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:49.917648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:49.918106 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1689/3372] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:49 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:49.919295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:49.922188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:49.922994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:49.938697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:49.939702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:49.961578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:49.963064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:49.964270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:49.966252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:49.967426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:49.968511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.104083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:51.124188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc43040e-d826-48c1-9cfc-5c4ac7198637 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 1.203825 Sep 16 14:11:51.128007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1690/3373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:49 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:51.143884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:51.150535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:51.167677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.169176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.173374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.176254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.181326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.182053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.260168 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] HTTP exception thrown: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:51.265287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Request method failure captured: Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c HTTP/1.1 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJINgSBqxA0xYytbVEyNJ9be93wImlgrOc7KlEnJE3D6q4IdWZVMxhkDIr7absFQkKWCU_p15qWg46t14QWFZ7uJSOQ7Ddy_o_KPqiK0vwTq5wytnfnZkn8A_VGBm3gT41aABXqwTT3ez7i4I0xjut6BbsAWvN3HtEScPl0cN5moH4m0 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83b243d4de294eeebcd2c8ce44d02bed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}] Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 782fbafaf3004e72aabae9768d700361 Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4cc45f48-8644-49d0-bd59-a53bb8b2451c'} Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:51.271627 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:11:51.280904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Returning 404 to user: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:51.282645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89d78ddd-842c-4758-961b-b622453a6814 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 404 len: 111 microversion: 2.1 time: 0.149472 Sep 16 14:11:51.286478 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1691/3374] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:51 2022] DELETE /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:51.313062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:51.313974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:51.333896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.334435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.337572 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a81a36c-872d-4403-af18-5243a48d3468 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 1.451068 Sep 16 14:11:51.339454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1684/3375] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:49 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:51.346689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.348433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.351103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.361967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.374076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:51.380435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:51.447601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.451584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.452951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.460048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.461855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.464079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.596331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.599381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.600768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.601814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lazy-loading 'fault' on Instance uuid a1e9d5d6-15cf-4532-af49-c84f1de5d43b {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:11:51.823898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5518cf0c1847889877570177c3fbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb7fba2489d4550b2d9427e40497843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:51.900136 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cee8879-44dc-425e-a94e-e31f8653a960 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 200 len: 1315 microversion: 2.1 time: 0.609933 Sep 16 14:11:51.929067 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1692/3376] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:51 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:51.967924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:51.969468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:51.988991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.990149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.994678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:51.996681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:51.997822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:51.999650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:52.409883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:52.452763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4eeaf27-7ae6-4f37-9481-c2fc4c5c57f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 1.109828 Sep 16 14:11:52.475517 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1685/3377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:51 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:52.496350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:52.497763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: 4cc45f48-8644-49d0-bd59-a53bb8b2451c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:52.510535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:52.512177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:52.513711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:52.522763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:52.523969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:52.525249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:52.569322 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] HTTP exception thrown: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Request method failure captured: Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c HTTP/1.1 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINgSBqxA0xYytbVEyNJ9be93wImlgrOc7KlEnJE3D6q4IdWZVMxhkDIr7absFQkKWCU_p15qWg46t14QWFZ7uJSOQ7Ddy_o_KPqiK0vwTq5wytnfnZkn8A_VGBm3gT41aABXqwTT3ez7i4I0xjut6BbsAWvN3HtEScPl0cN5moH4m0 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83b243d4de294eeebcd2c8ce44d02bed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}] Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 782fbafaf3004e72aabae9768d700361 Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '4cc45f48-8644-49d0-bd59-a53bb8b2451c'} Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:52.572823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. Sep 16 14:11:52.582698 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:52.585273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Returning 404 to user: Instance 4cc45f48-8644-49d0-bd59-a53bb8b2451c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:52.587088 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35dd7809-2a21-4d99-8e5b-32bd2ab75ecf tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c" status: 404 len: 111 microversion: 2.1 time: 0.109772 Sep 16 14:11:52.588635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1686/3378] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:52 2022] GET /compute/v2.1/servers/4cc45f48-8644-49d0-bd59-a53bb8b2451c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:52.599316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ba036b9e-2cd3-489c-82a4-77af07038ac5 req-5cad0cdf-3cbb-4aec-8561-292c20ec23d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d141f3-2891-487a-861e-ccaf4b2d5cbe", "name": "network-vif-plugged", "status": "completed", "tag": "20061ac3-c0ee-4011-9ba3-ecd56514297d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:52.626452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ba036b9e-2cd3-489c-82a4-77af07038ac5 req-5cad0cdf-3cbb-4aec-8561-292c20ec23d5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:52.627602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ba036b9e-2cd3-489c-82a4-77af07038ac5 req-5cad0cdf-3cbb-4aec-8561-292c20ec23d5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:52.635779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ba036b9e-2cd3-489c-82a4-77af07038ac5 req-5cad0cdf-3cbb-4aec-8561-292c20ec23d5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:52.677335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ba036b9e-2cd3-489c-82a4-77af07038ac5 req-5cad0cdf-3cbb-4aec-8561-292c20ec23d5 service nova] Creating event network-vif-plugged:20061ac3-c0ee-4011-9ba3-ecd56514297d for instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe on n-h2-858129-2 Sep 16 14:11:52.692019 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ba036b9e-2cd3-489c-82a4-77af07038ac5 req-5cad0cdf-3cbb-4aec-8561-292c20ec23d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100651 Sep 16 14:11:52.700403 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1687/3379] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:52.766081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:52.775984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:52.819248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:52.827692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:52.830815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:52.835879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:52.840003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:52.840886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:53.006072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:53.045157 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02fa45eb-5944-45a7-b816-d5f3aa92996d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1508 microversion: 2.1 time: 1.102124 Sep 16 14:11:53.089074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1693/3380] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:51 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1508 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:53.103692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:53.105000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:53.124036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:53.125358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:53.126396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:53.127981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:53.130191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:53.131830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:53.908940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:53.926538 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c104e47-02f0-4421-a5fc-2312103ce7d9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 1.222622 Sep 16 14:11:53.954550 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1688/3381] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:52 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:53.967723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:53.970150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:53.981239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:53.981746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:53.982189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:53.982949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:53.983414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:53.983842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.001685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:54.016216 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a78afa02-93e2-47cb-b76a-3cf6a4094397 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 0.925488 Sep 16 14:11:54.017330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1694/3382] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:53 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:54.022545 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] HTTP exception thrown: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Request method failure captured: Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 HTTP/1.1 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINgSBqxA0xYytbVEyNJ9be93wImlgrOc7KlEnJE3D6q4IdWZVMxhkDIr7absFQkKWCU_p15qWg46t14QWFZ7uJSOQ7Ddy_o_KPqiK0vwTq5wytnfnZkn8A_VGBm3gT41aABXqwTT3ez7i4I0xjut6BbsAWvN3HtEScPl0cN5moH4m0 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83b243d4de294eeebcd2c8ce44d02bed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}] Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 782fbafaf3004e72aabae9768d700361 Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b0596d51-2b1f-423a-9783-a1d31bc3dd79'} Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:54.024957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Returning 404 to user: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-716348d4-d7b6-4fd9-bb47-9bc902c35c40 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 404 len: 111 microversion: 2.1 time: 0.069977 Sep 16 14:11:54.034233 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1689/3383] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:11:53 2022] DELETE /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:54.036753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-081503e1-bcd0-48ef-ba25-3ebb9e3ed026 req-f6a1c175-0d0e-4e04-a5eb-4e30616334b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b5d40f-084a-4cda-b2f8-5cf865da2df1", "name": "network-vif-deleted", "tag": "2ae26c04-df96-4aa1-be89-031a2e7ee815"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:54.047403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:54.049990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] [instance: a1e9d5d6-15cf-4532-af49-c84f1de5d43b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:54.055599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-081503e1-bcd0-48ef-ba25-3ebb9e3ed026 req-f6a1c175-0d0e-4e04-a5eb-4e30616334b3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.057699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-081503e1-bcd0-48ef-ba25-3ebb9e3ed026 req-f6a1c175-0d0e-4e04-a5eb-4e30616334b3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.065414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-081503e1-bcd0-48ef-ba25-3ebb9e3ed026 req-f6a1c175-0d0e-4e04-a5eb-4e30616334b3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.073572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.074385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.078789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.079769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.083055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.091307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.192062 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-081503e1-bcd0-48ef-ba25-3ebb9e3ed026 req-f6a1c175-0d0e-4e04-a5eb-4e30616334b3 service nova] Creating event network-vif-deleted:2ae26c04-df96-4aa1-be89-031a2e7ee815 for instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 on n-h2-858129-2 Sep 16 14:11:54.214542 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-081503e1-bcd0-48ef-ba25-3ebb9e3ed026 req-f6a1c175-0d0e-4e04-a5eb-4e30616334b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195543 Sep 16 14:11:54.215777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1695/3384] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:54.228450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:54.228785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] HTTP exception thrown: Instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b could not be found. Sep 16 14:11:54.229189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Request method failure captured: Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b HTTP/1.1 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIOqO8MxWCUq9cMsEBF7gMSMzgyWbY3iBUgD7h2_Ve3plEpibbPaueps2bsWgi9PNeKYlo7x2fnR4Nr3pikBcX_afqI5h5sn0PY9DHj6ZxvSfFiBuHkgxXOHjCssJLJYCXoJ2s198IjQE_DPz9yR7T7KVxuLKkNySU1pjdv70L_xKqk Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 2eb7fba2489d4550b2d9427e40497843 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestFqdnHostnames-404475996 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2eb7fba2489d4550b2d9427e40497843", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2eb7fba2489d4550b2d9427e40497843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2eb7fba2489d4550b2d9427e40497843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2eb7fba2489d4550b2d9427e40497843"}]}] Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestFqdnHostnames-404475996 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 2eb7fba2489d4550b2d9427e40497843 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-404475996 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestFqdnHostnames-404475996-project Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8c5518cf0c1847889877570177c3fbb1 Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestFqdnHostnames-404475996-project Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b could not be found. Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'a1e9d5d6-15cf-4532-af49-c84f1de5d43b'} Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b could not be found. Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b could not be found. Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:54.231536 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b could not be found. Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Returning 404 to user: Instance a1e9d5d6-15cf-4532-af49-c84f1de5d43b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b305613-42d2-45ea-9b8b-3667e1affba4 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b" status: 404 len: 111 microversion: 2.1 time: 0.205140 Sep 16 14:11:54.247785 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1690/3385] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:54 2022] GET /compute/v2.1/servers/a1e9d5d6-15cf-4532-af49-c84f1de5d43b => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:54.249473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.249473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.249824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.252025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.253236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.255254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.261154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:54.262200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] [instance: b0596d51-2b1f-423a-9783-a1d31bc3dd79] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:54.278644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.279265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.279946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.283874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.294532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.306852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.367431 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] HTTP exception thrown: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Request method failure captured: Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 HTTP/1.1 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINgSBqxA0xYytbVEyNJ9be93wImlgrOc7KlEnJE3D6q4IdWZVMxhkDIr7absFQkKWCU_p15qWg46t14QWFZ7uJSOQ7Ddy_o_KPqiK0vwTq5wytnfnZkn8A_VGBm3gT41aABXqwTT3ez7i4I0xjut6BbsAWvN3HtEScPl0cN5moH4m0 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83b243d4de294eeebcd2c8ce44d02bed", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83b243d4de294eeebcd2c8ce44d02bed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83b243d4de294eeebcd2c8ce44d02bed"}]}] Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 83b243d4de294eeebcd2c8ce44d02bed Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestMultiNic-1875902398 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 782fbafaf3004e72aabae9768d700361 Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestMultiNic-1875902398-project Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b0596d51-2b1f-423a-9783-a1d31bc3dd79'} Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:54.370735 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] Returning 404 to user: Instance b0596d51-2b1f-423a-9783-a1d31bc3dd79 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55647f86-ef15-49ad-a888-dc4d63557cc5 tempest-ServersTestMultiNic-1875902398 tempest-ServersTestMultiNic-1875902398-project] 10.222.0.60 "GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79" status: 404 len: 111 microversion: 2.1 time: 0.126915 Sep 16 14:11:54.381114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1691/3386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:54 2022] GET /compute/v2.1/servers/b0596d51-2b1f-423a-9783-a1d31bc3dd79 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:54.406178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:54.420330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:54.431267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:54.451822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.453043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.461640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.463229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.465071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.466247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.580440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:54.581297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:54.583345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:54.583953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'fault' on Instance uuid 05b5d40f-084a-4cda-b2f8-5cf865da2df1 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:11:54.745101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:54.769462 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-903df732-6da6-4fe7-9cd0-5e54bed483ae tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 200 len: 1311 microversion: 2.1 time: 0.392387 Sep 16 14:11:54.776077 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1692/3387] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:54 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 1311 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:54.800508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-defe8025-a761-4359-9c36-10e0a79a1358 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] Calling method '.version_select at 0x7f724c656c10>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:54.852408 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-defe8025-a761-4359-9c36-10e0a79a1358 tempest-ServersTestFqdnHostnames-404475996 tempest-ServersTestFqdnHostnames-404475996-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-542374580" status: 202 len: 0 microversion: 2.1 time: 0.074099 Sep 16 14:11:54.858932 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1693/3388] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-542374580 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:11:54.862077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:54.893246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d8681d1-0baa-4b0d-9421-7fa6e35deccb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 0.675676 Sep 16 14:11:54.903558 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1696/3389] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:54 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:54.976499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:54.977445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:55.000638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:55.004432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:55.012643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:55.014382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:55.015495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:55.016544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:55.069163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:55.070341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:55.106320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:55.110781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:55.118924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:55.120620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:55.121780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:55.123183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:55.914071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:11:56.073026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:56.089350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4cd3cbfc-aaed-4bdb-a1c9-1509ba13603f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1361 microversion: 2.1 time: 1.029783 Sep 16 14:11:56.089992 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1697/3390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:55 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1361 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:56.124436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:56.129116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-85920d63-6671-45d6-8b95-8413ad756b69 req-5830f01f-d18c-4667-8f5a-54f28795b14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7233541-559a-49e7-a129-28daf73b7b91", "name": "network-vif-plugged", "status": "completed", "tag": "0909edc1-5783-4aef-8e7c-030829187017"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:56.164384 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f6c42725-6374-4b5c-90cc-69d7db0d11b0 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 1.195485 Sep 16 14:11:56.168989 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1694/3391] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:54 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:11:56.194021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-85920d63-6671-45d6-8b95-8413ad756b69 req-5830f01f-d18c-4667-8f5a-54f28795b14c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:56.205980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-85920d63-6671-45d6-8b95-8413ad756b69 req-5830f01f-d18c-4667-8f5a-54f28795b14c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:56.207358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-85920d63-6671-45d6-8b95-8413ad756b69 req-5830f01f-d18c-4667-8f5a-54f28795b14c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:56.218183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:56.252803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:56.286981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:56.291773 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-85920d63-6671-45d6-8b95-8413ad756b69 req-5830f01f-d18c-4667-8f5a-54f28795b14c service nova] Creating event network-vif-plugged:0909edc1-5783-4aef-8e7c-030829187017 for instance e7233541-559a-49e7-a129-28daf73b7b91 on n-h2-858129-2 Sep 16 14:11:56.292575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:56.294893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:56.299939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:56.302910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:56.308529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:56.310172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-85920d63-6671-45d6-8b95-8413ad756b69 req-5830f01f-d18c-4667-8f5a-54f28795b14c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216454 Sep 16 14:11:56.312214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1698/3392] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:56.326331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:56.330295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:56.343669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:56.344971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:56.346113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:56.347347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:56.348039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:56.348644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:56.389296 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 HTTP/1.1 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '05b5d40f-084a-4cda-b2f8-5cf865da2df1'} Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:56.391399 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:11:56.397086 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:11:56.397086 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:11:56.397086 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:11:56.397086 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:11:56.397086 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:11:56.397086 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:11:56.408564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:11:56.411903 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d233d6d-1025-4afe-a601-eb2206eecdb8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 404 len: 111 microversion: 2.1 time: 0.223025 Sep 16 14:11:56.414597 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1695/3393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:56 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:11:56.422253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8991bc9c-c129-4da1-ab28-4b169ed2900e req-84bc8519-8f04-4ab8-8527-838a5e4dfdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883be0de-5cc5-4181-84c2-a466f4758beb", "tag": "310cca58-0728-4893-a97f-03586fdd24a0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:56.440454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8991bc9c-c129-4da1-ab28-4b169ed2900e req-84bc8519-8f04-4ab8-8527-838a5e4dfdff service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:56.441927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8991bc9c-c129-4da1-ab28-4b169ed2900e req-84bc8519-8f04-4ab8-8527-838a5e4dfdff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:56.442599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8991bc9c-c129-4da1-ab28-4b169ed2900e req-84bc8519-8f04-4ab8-8527-838a5e4dfdff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:56.456684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8991bc9c-c129-4da1-ab28-4b169ed2900e req-84bc8519-8f04-4ab8-8527-838a5e4dfdff service nova] Creating event network-changed:310cca58-0728-4893-a97f-03586fdd24a0 for instance 883be0de-5cc5-4181-84c2-a466f4758beb on n-h1-858129-2 Sep 16 14:11:56.463708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8991bc9c-c129-4da1-ab28-4b169ed2900e req-84bc8519-8f04-4ab8-8527-838a5e4dfdff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047562 Sep 16 14:11:56.464609 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1696/3394] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:56.472109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11d0a761-7d66-4a02-8bf8-c1f9fe53cc0e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: .version_select at 0x7f724d0765e0>, body: {"keypair": {"name": "tempest-key-1999434919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP2R+SG+sKgtkF3tQPm/s3IyDkVBZvL3xezEV7wsxZfJy0r0Mnpu1NTr3dxFtbkzJ9dOlQFhVs8OeJ0hEhqG7TTaouUoZWRpYbDLnyCzD6f6l1Q4UrqcmuRLM9RnqwIPg=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:56.494081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-11d0a761-7d66-4a02-8bf8-c1f9fe53cc0e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:56.501341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-11d0a761-7d66-4a02-8bf8-c1f9fe53cc0e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:56.536757 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11d0a761-7d66-4a02-8bf8-c1f9fe53cc0e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.070532 Sep 16 14:11:56.537468 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1697/3395] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:11:56 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:56.556200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f140b27-8f31-40f8-86ae-b0bbd05f9f95 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '.version_select at 0x7f724c6031f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:56.563940 n-d-858129-2 devstack@n-api.service[128643]: WARNING oslo_db.sqlalchemy.utils [None req-8f140b27-8f31-40f8-86ae-b0bbd05f9f95 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 16 14:11:56.579093 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f140b27-8f31-40f8-86ae-b0bbd05f9f95 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.027235 Sep 16 14:11:56.579909 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1698/3396] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:11:56 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:11:56.854238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1684496191", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-key-1999434919", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:11:56.919615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:11:57.255604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:57.288137 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd2a9613-e88d-47a0-815c-579505d75d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 0.972059 Sep 16 14:11:57.291752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1699/3397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:56 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:57.307207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:57.308581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:57.326684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:57.328222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:57.329390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:57.332617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:57.334829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:57.336028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:58.443163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:58.467797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a1232e60-c6fe-4286-a9ed-dc81a805c0a0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1543 microversion: 2.1 time: 1.173817 Sep 16 14:11:58.469810 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1700/3398] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:57 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1543 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:58.482637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:58.487069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:58.514225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:58.515627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:58.516782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:58.518506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:58.520394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:58.521498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.262734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:59.277167 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bfde7c17-c27f-4e7b-b1c4-7e1b984ee3d1 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1327 microversion: 2.1 time: 0.805373 Sep 16 14:11:59.283317 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1701/3399] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:58 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1327 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:59.308518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:59.318832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:59.345864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:59.348414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:59.349405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.350927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:59.352175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:59.353317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.481649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:11:59.483644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:11:59.484568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:11:59.485322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:11:59.486098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:11:59.514293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:59.515609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:59.516712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.518362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:59.520364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:59.521359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.563020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:11:59.575200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:11:59.603635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:11:59.608477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:11:59.754650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:11:59.760040 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa85da60-e2b2-42f4-8257-a39dc04df9ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.909115 Sep 16 14:11:59.763381 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1699/3400] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:11:59.788715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:59.797740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:59.807831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4b3daf1-dfb6-4ce6-b49d-2d9f26888642 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 0.519560 Sep 16 14:11:59.811769 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1702/3401] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:59 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:11:59.825703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:59.835382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:59.836560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.837956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:11:59.838694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:11:59.839584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:11:59.842537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c99091cd-86b3-4621-9dcd-956b97cb614f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:11:59.849216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c99091cd-86b3-4621-9dcd-956b97cb614f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:11:59.874213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:00.121003 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc6d2a4b-59a8-4933-8b89-91de4d612868 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.352767 Sep 16 14:12:00.130654 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1700/3402] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:11:59 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-interface => generated 284 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:00.321809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:00.322465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:00.330798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:00.331612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:00.332262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:00.333174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:00.333803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:00.334394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:00.365736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c99091cd-86b3-4621-9dcd-956b97cb614f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:00.392090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c99091cd-86b3-4621-9dcd-956b97cb614f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1229 microversion: 2.1 time: 0.576212 Sep 16 14:12:00.397510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1703/3403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:11:59 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1229 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:00.857611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:00.863219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:00.909629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:00.928556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:00.937268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:00.938987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:00.945984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:00.950179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:01.588843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:01.630503 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-57cc083e-23e3-426e-b57e-d1655e59f2f5 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1526 microversion: 2.1 time: 1.322103 Sep 16 14:12:01.633963 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1701/3404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:00 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1526 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:01.665731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:01.667884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:01.691044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:01.695051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:01.696344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:01.698499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:01.699913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:01.701120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:02.287073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:02.326688 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-15d5d745-8694-4c34-b14f-91df5d136cc8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 1.489666 Sep 16 14:12:02.330974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1704/3405] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:00 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:02.353034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:02.356323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:02.396593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:02.399013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:02.402232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:02.403803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:02.406576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:02.410775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:02.514019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:02.547139 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fffe443c-50d0-48c2-bf97-a8f9d573008e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1225 microversion: 2.1 time: 0.904726 Sep 16 14:12:02.548253 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1702/3406] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:01 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1225 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:03.360722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:03.361874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:03.401272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:03.402255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:03.404723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:03.413860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:03.414948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:03.417723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:03.928181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:03.944011 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5307c0ab-359e-40c8-b391-408639a31295 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1526 microversion: 2.1 time: 1.610066 Sep 16 14:12:03.960025 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1705/3407] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:02 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1526 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:03.973628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:03.975428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:03.984732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:03.986306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:03.987138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:03.989093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:03.991082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:03.992211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:04.284080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:04.338524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e26775fd-b24d-4ae8-93c3-d850cbc1d376 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1287 microversion: 2.1 time: 0.375982 Sep 16 14:12:04.354970 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1706/3408] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:03 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1287 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:04.499642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:04.547779 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1cbfad7e-8b6b-4c2a-b7ae-a70ef2198a7b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 1.192593 Sep 16 14:12:04.551001 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1703/3409] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:03 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:04.871697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3b0584fa-068c-4908-a589-34d451a27ef8 req-29f0c911-858e-46a6-b293-70df4524c0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883be0de-5cc5-4181-84c2-a466f4758beb", "name": "network-vif-plugged", "status": "completed", "tag": "310cca58-0728-4893-a97f-03586fdd24a0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:04.879673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:04.881607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:04.889479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3b0584fa-068c-4908-a589-34d451a27ef8 req-29f0c911-858e-46a6-b293-70df4524c0b8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:04.899023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3b0584fa-068c-4908-a589-34d451a27ef8 req-29f0c911-858e-46a6-b293-70df4524c0b8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:04.899801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3b0584fa-068c-4908-a589-34d451a27ef8 req-29f0c911-858e-46a6-b293-70df4524c0b8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:04.926867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:04.927931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:04.928755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:04.930117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:04.930680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3b0584fa-068c-4908-a589-34d451a27ef8 req-29f0c911-858e-46a6-b293-70df4524c0b8 service nova] Creating event network-vif-plugged:310cca58-0728-4893-a97f-03586fdd24a0 for instance 883be0de-5cc5-4181-84c2-a466f4758beb on n-h1-858129-2 Sep 16 14:12:04.931089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:04.931899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:04.944703 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3b0584fa-068c-4908-a589-34d451a27ef8 req-29f0c911-858e-46a6-b293-70df4524c0b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083864 Sep 16 14:12:04.945724 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1704/3410] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:12:04.977264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] HTTP exception thrown: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Request method failure captured: Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 HTTP/1.1 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIQPoDoQ1kgf2h43YhDyeVRkfOMTT_K-toDz8C10ztBn10HMWV_HtHs2z6JAvUxVX3FNGsMy6iVPrFpfg4B2ibcpibvwEIuUgFz3D4yFMogvdSR7KOmeHrohtNDggmdMwHs8rUY2W1dxSInCtLyzBOkLad3ELaFl83T0qrt_Q5A3zVU Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e7b5e46d99bc49a68aa63b941c845003 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1665806789 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e7b5e46d99bc49a68aa63b941c845003", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e7b5e46d99bc49a68aa63b941c845003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e7b5e46d99bc49a68aa63b941c845003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e7b5e46d99bc49a68aa63b941c845003"}]}] Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1665806789 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e7b5e46d99bc49a68aa63b941c845003 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1665806789 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1665806789-project Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 672233f682be44f09095a164985353a6 Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1665806789-project Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e7233541-559a-49e7-a129-28daf73b7b91'} Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:12:04.983349 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:04.993090 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:04.999006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Returning 404 to user: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:12:04.999006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36f0942f-2ce9-4acf-9978-f2833129f8d7 tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 404 len: 111 microversion: 2.1 time: 0.647790 Sep 16 14:12:04.999717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1707/3411] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:12:04 2022] DELETE /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 111 bytes in 651 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:12:05.016959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:05.018037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:05.042672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:05.043209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:05.043796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:05.044441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:05.044911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:05.045346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:05.397469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:05.399316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:05.444739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:05.445594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:05.446785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:05.448580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:05.449348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:05.450234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:05.471577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:05.740535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:05.766820 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71bb8e3d-c3b3-423a-b6cf-247ee13a60ad tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1287 microversion: 2.1 time: 0.380445 Sep 16 14:12:05.779853 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1708/3412] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:05 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1287 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:05.791499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:05.792606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:05.810654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:05.812752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:05.814710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:05.816394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:05.817393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:05.818244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:06.829938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:06.856837 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7eee3b5a-d43f-4781-bca6-5ec4c8e3f8b4 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1526 microversion: 2.1 time: 1.843786 Sep 16 14:12:06.874737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1705/3413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:05 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1526 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:06.885067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:06.887186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:06.905526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:06.907270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:06.909721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:06.911409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:06.913486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:06.914770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:07.056414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:07.088699 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81537849-3ed3-4a07-a452-18af3d355c15 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 1.305529 Sep 16 14:12:07.094388 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1709/3414] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:05 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:07.117611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:07.118607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Action: 'update', calling method: >, body: {"server": {"name": "e7233541-559a-49e7-a129-28daf73b7b91_new"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:07.125130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:07.153141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:07.161124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:07.162000 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a8a5052-6563-4d12-a9b7-5cf783db2a5a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1287 microversion: 2.1 time: 0.295265 Sep 16 14:12:07.162287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:07.164467 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1706/3415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:06 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1287 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:07.172277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:07.173546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:07.176044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:07.225257 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] HTTP exception thrown: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Request method failure captured: Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: request: PUT /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 HTTP/1.1 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 64 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIQPoDoQ1kgf2h43YhDyeVRkfOMTT_K-toDz8C10ztBn10HMWV_HtHs2z6JAvUxVX3FNGsMy6iVPrFpfg4B2ibcpibvwEIuUgFz3D4yFMogvdSR7KOmeHrohtNDggmdMwHs8rUY2W1dxSInCtLyzBOkLad3ELaFl83T0qrt_Q5A3zVU Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e7b5e46d99bc49a68aa63b941c845003 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1665806789 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e7b5e46d99bc49a68aa63b941c845003", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e7b5e46d99bc49a68aa63b941c845003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e7b5e46d99bc49a68aa63b941c845003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e7b5e46d99bc49a68aa63b941c845003"}]}] Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1665806789 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e7b5e46d99bc49a68aa63b941c845003 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1665806789 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1665806789-project Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 672233f682be44f09095a164985353a6 Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1665806789-project Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "e7233541-559a-49e7-a129-28daf73b7b91_new"}} Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e7233541-559a-49e7-a129-28daf73b7b91', 'body': {'server': {'name': 'e7233541-559a-49e7-a129-28daf73b7b91_new'}}} Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:12:07.234697 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:07.243706 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:07.254794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] Returning 404 to user: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:12:07.257452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f2010af2-0295-43c9-beb4-b98d881e377c tempest-ServersNegativeTestMultiTenantJSON-1665806789 tempest-ServersNegativeTestMultiTenantJSON-1665806789-project] 10.222.0.60 "PUT /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 404 len: 111 microversion: 2.1 time: 0.158799 Sep 16 14:12:07.259357 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1710/3416] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:12:07 2022] PUT /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:12:07.348857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:07.349812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:07.405083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:07.407224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:07.409618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:07.411507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:07.412632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:07.413742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:07.501490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:12:07.697203 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0b3b6cf-e1fd-42ff-bdc3-58630fa482b9 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 204 len: 0 microversion: 2.1 time: 0.424072 Sep 16 14:12:07.700977 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1707/3417] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:12:07 2022] DELETE /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:12:07.712089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:07.713021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:07.740392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:07.747681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:07.748452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:07.749870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:07.761497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:07.762806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:08.049130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c466c1a7-5376-43a9-a29b-e8c4c8f53c34 req-9f2003b0-55b9-47e6-ae13-5b08a6bb4bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d141f3-2891-487a-861e-ccaf4b2d5cbe", "tag": "20061ac3-c0ee-4011-9ba3-ecd56514297d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:08.131945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c466c1a7-5376-43a9-a29b-e8c4c8f53c34 req-9f2003b0-55b9-47e6-ae13-5b08a6bb4bb8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:08.141929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c466c1a7-5376-43a9-a29b-e8c4c8f53c34 req-9f2003b0-55b9-47e6-ae13-5b08a6bb4bb8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:08.142832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c466c1a7-5376-43a9-a29b-e8c4c8f53c34 req-9f2003b0-55b9-47e6-ae13-5b08a6bb4bb8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:08.218047 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c466c1a7-5376-43a9-a29b-e8c4c8f53c34 req-9f2003b0-55b9-47e6-ae13-5b08a6bb4bb8 service nova] Creating event network-changed:20061ac3-c0ee-4011-9ba3-ecd56514297d for instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe on n-h2-858129-2 Sep 16 14:12:08.244600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c466c1a7-5376-43a9-a29b-e8c4c8f53c34 req-9f2003b0-55b9-47e6-ae13-5b08a6bb4bb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202892 Sep 16 14:12:08.246136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1708/3418] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:08.271010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:08.280167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:08.345602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:08.350226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:08.351456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:08.352965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:08.355518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:08.358732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:08.587413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:08.623328 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8b29c66-fff0-4dec-a475-e23c98354f27 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1532 microversion: 2.1 time: 0.912987 Sep 16 14:12:08.628810 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1711/3419] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:07 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1532 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:08.672124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:08.673614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:08.689684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:08.691303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:08.692566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:08.695018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:08.697086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:08.698200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:09.356214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:09.382964 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59c36ff3-4200-4e43-8123-24c764789473 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1315 microversion: 2.1 time: 1.134163 Sep 16 14:12:09.387102 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1709/3420] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:08 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:09.653383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:09.671124 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86c9bddf-c9b2-4c6f-bec3-38dfe95320fc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 1.039213 Sep 16 14:12:09.673570 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1712/3421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:08 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:09.696545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:09.697598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:09.716983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:09.720350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:09.726137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:09.726722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:09.727252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:09.728034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:09.728514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:09.729119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:10.122311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:10.139175 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f3e0b43-c90d-4381-bc30-6c31636fe368 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1532 microversion: 2.1 time: 0.469317 Sep 16 14:12:10.161755 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1710/3422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:09 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1532 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:10.430917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:10.431985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:10.435233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:10.445771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:10.447221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:10.448384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:10.450023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:10.451174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:10.452269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:10.719322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:10.720190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:10.731863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:10.732788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:10.733509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:10.734556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:10.735289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:10.735949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:11.129766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:11.179804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27a044d9-64bc-4f1a-b22b-9116e269e718 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1502 microversion: 2.1 time: 0.723563 Sep 16 14:12:11.185454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1713/3423] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:10 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1502 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:11.213836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:11.215862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:11.234983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:11.236437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:11.238209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:11.240231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:11.241419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:11.242680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:11.373385 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:12:11.373385 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 14:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 (ip 10.222.0.60) !!! Sep 16 14:12:11.648787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:11.687703 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fd41cc2-4e57-4686-997d-b06a4ea39feb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 0.972242 Sep 16 14:12:11.703714 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1711/3424] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:10 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:12.362578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:12.389512 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0db0751a-ddaa-4ae2-a01b-bde19615e70d tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1532 microversion: 2.1 time: 1.202056 Sep 16 14:12:12.390764 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1714/3425] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:11 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1532 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:12.729352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:12.730791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:12.751519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:12.753382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:12.753990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:12.765417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:12.765417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:12.765417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:13.218528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-63bc8f62-8c72-45f1-a88f-1819a6a202f1 req-e8627153-a499-447b-9751-8f98f9bbf980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7233541-559a-49e7-a129-28daf73b7b91", "name": "network-vif-deleted", "tag": "0909edc1-5783-4aef-8e7c-030829187017"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:13.247482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-63bc8f62-8c72-45f1-a88f-1819a6a202f1 req-e8627153-a499-447b-9751-8f98f9bbf980 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:13.252112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-63bc8f62-8c72-45f1-a88f-1819a6a202f1 req-e8627153-a499-447b-9751-8f98f9bbf980 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:13.254199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-63bc8f62-8c72-45f1-a88f-1819a6a202f1 req-e8627153-a499-447b-9751-8f98f9bbf980 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:13.304100 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-63bc8f62-8c72-45f1-a88f-1819a6a202f1 req-e8627153-a499-447b-9751-8f98f9bbf980 service nova] Creating event network-vif-deleted:0909edc1-5783-4aef-8e7c-030829187017 for instance e7233541-559a-49e7-a129-28daf73b7b91 on n-h2-858129-2 Sep 16 14:12:13.325630 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-63bc8f62-8c72-45f1-a88f-1819a6a202f1 req-e8627153-a499-447b-9751-8f98f9bbf980 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112307 Sep 16 14:12:13.327063 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1715/3426] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:13.421295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:13.423374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:13.447524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:13.448541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:13.449805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:13.455268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:13.456719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:13.461072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:14.091463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1779c56c495847dd9330fbadc7993dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2424dd7c4d4503ac73ff093d66abe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:14.118062 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b285932d-3d47-4b4d-aca9-eb46d52d040c tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 200 len: 1312 microversion: 2.1 time: 0.701141 Sep 16 14:12:14.118748 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1716/3427] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:13 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 1312 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:14.137761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-94b624a5-ecdb-4c7d-a49f-8d7a1edad05c req-8d7233ef-6f2b-44fe-9ec2-15e5bcd4bdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338a3ce1-f2bc-46c9-80de-52601116e911", "tag": "95c800e2-103e-494f-b002-ee46415eb50a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:14.161339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-94b624a5-ecdb-4c7d-a49f-8d7a1edad05c req-8d7233ef-6f2b-44fe-9ec2-15e5bcd4bdb0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:14.161923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-94b624a5-ecdb-4c7d-a49f-8d7a1edad05c req-8d7233ef-6f2b-44fe-9ec2-15e5bcd4bdb0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:14.162689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-94b624a5-ecdb-4c7d-a49f-8d7a1edad05c req-8d7233ef-6f2b-44fe-9ec2-15e5bcd4bdb0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:14.248886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-94b624a5-ecdb-4c7d-a49f-8d7a1edad05c req-8d7233ef-6f2b-44fe-9ec2-15e5bcd4bdb0 service nova] Creating event network-changed:95c800e2-103e-494f-b002-ee46415eb50a for instance 338a3ce1-f2bc-46c9-80de-52601116e911 on n-h1-858129-2 Sep 16 14:12:14.279432 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-94b624a5-ecdb-4c7d-a49f-8d7a1edad05c req-8d7233ef-6f2b-44fe-9ec2-15e5bcd4bdb0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157061 Sep 16 14:12:14.280945 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1717/3428] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:15.107407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:15.128430 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38f94eb6-0447-4bea-8440-aebc345f4ed2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 2.400398 Sep 16 14:12:15.129414 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1712/3429] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:12 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:15.184987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:15.189593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] [instance: e7233541-559a-49e7-a129-28daf73b7b91] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:15.224534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:15.227361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:15.228557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:15.230181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:15.231400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:15.232589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:15.281655 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] HTTP exception thrown: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Request method failure captured: Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 HTTP/1.1 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPyO8JLR9BV7ISRxznd9Umn_eZyY6ifWALgU0N88Fgdbgr7EkzKi1I4cwKk-XqB3s8mJWX4380nifk-sGu79121N--5oCNBu_rrw_Xs1EM2ZJqaESIWupTljBr7KD-fDURAQblBu_RphgbM_S4V-ybA4_3IlgcUh8hhtTCXkGMWaww Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 9d2424dd7c4d4503ac73ff093d66abe9 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-303110874 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9d2424dd7c4d4503ac73ff093d66abe9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d2424dd7c4d4503ac73ff093d66abe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9d2424dd7c4d4503ac73ff093d66abe9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d2424dd7c4d4503ac73ff093d66abe9"}]}] Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-303110874 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 9d2424dd7c4d4503ac73ff093d66abe9 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-303110874 Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestMultiTenantJSON-303110874-project Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1779c56c495847dd9330fbadc7993dca Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-303110874-project Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e7233541-559a-49e7-a129-28daf73b7b91'} Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:15.285441 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. Sep 16 14:12:15.292976 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:12:15.295462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] Returning 404 to user: Instance e7233541-559a-49e7-a129-28daf73b7b91 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:12:15.297996 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19f72763-63e3-4056-a4c0-83dfe1853839 tempest-ServersNegativeTestMultiTenantJSON-303110874 tempest-ServersNegativeTestMultiTenantJSON-303110874-project] 10.222.0.60 "GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91" status: 404 len: 111 microversion: 2.1 time: 0.127392 Sep 16 14:12:15.300854 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1718/3430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:15 2022] GET /compute/v2.1/servers/e7233541-559a-49e7-a129-28daf73b7b91 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:12:15.776041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4420440c-2475-4f62-9266-351175c966e1"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:15.780649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:15.794581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:15.795778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:15.796771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:15.798382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:15.805855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:15.807214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:16.188858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:16.191950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:16.215471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:16.215982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:16.216432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:16.217169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:16.217644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:16.218091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:17.068006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:17.099654 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31c8276c-59fc-447e-af41-6a6e3dddc306 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 0.926017 Sep 16 14:12:17.100724 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1719/3431] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:16 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:18.323674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:18.334926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:18.358814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:18.359839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:18.361520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:18.364499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:18.365700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:18.368081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:18.748446 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75203eb0-2add-4b62-87aa-802c228eb585 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.988176 Sep 16 14:12:18.762351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1713/3432] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:12:15 2022] POST /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb/os-volume_attachments => generated 194 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:19.430964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:19.466620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a749eca-da27-462b-aa1b-accbf116abca tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 1.179351 Sep 16 14:12:19.468581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1720/3433] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:18 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:20.521688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:20.528529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:20.553175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:20.584209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:20.587556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:20.588856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:20.594327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:20.597969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:20.599166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:22.596207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:22.617537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5cdc6f48-e588-4362-a471-25bc176c95f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 2.111046 Sep 16 14:12:22.618843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1714/3434] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:20 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:23.679441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:23.688998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:23.740183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=68 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:23.750768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:23.752122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:23.767416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:23.769395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:23.770723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:23.772181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:24.334590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:24.349515 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-345cfd1e-dd0e-4dc0-b56e-0baa1417dbaa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 0.687607 Sep 16 14:12:24.353857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1721/3435] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:23 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:25.405348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:25.412420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:25.436833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:25.439123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:25.441974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:25.443806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:25.444950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:25.446138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:25.505037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:27.267330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:27.292396 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8456d9d0-e442-462a-b76c-dbb5212f07d7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 1.899331 Sep 16 14:12:27.311805 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1715/3436] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:25 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:28.339376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:28.340236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:28.367577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:28.368332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:28.368797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:28.372179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:28.378598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:28.379372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:28.405476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-283e0774-cc3c-4ef7-91e0-be0dab183f7f req-66d493fe-8136-429a-94b8-a1a615dc4381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338a3ce1-f2bc-46c9-80de-52601116e911", "name": "network-vif-plugged", "status": "completed", "tag": "95c800e2-103e-494f-b002-ee46415eb50a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:28.451899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-283e0774-cc3c-4ef7-91e0-be0dab183f7f req-66d493fe-8136-429a-94b8-a1a615dc4381 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:28.453422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-283e0774-cc3c-4ef7-91e0-be0dab183f7f req-66d493fe-8136-429a-94b8-a1a615dc4381 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:28.454619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-283e0774-cc3c-4ef7-91e0-be0dab183f7f req-66d493fe-8136-429a-94b8-a1a615dc4381 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:28.507211 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-283e0774-cc3c-4ef7-91e0-be0dab183f7f req-66d493fe-8136-429a-94b8-a1a615dc4381 service nova] Creating event network-vif-plugged:95c800e2-103e-494f-b002-ee46415eb50a for instance 338a3ce1-f2bc-46c9-80de-52601116e911 on n-h1-858129-2 Sep 16 14:12:28.523542 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-283e0774-cc3c-4ef7-91e0-be0dab183f7f req-66d493fe-8136-429a-94b8-a1a615dc4381 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128309 Sep 16 14:12:28.529348 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1716/3437] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:12:30.142546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:30.175421 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72cb741c-42f4-4360-9435-6b9cdf5d539c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 1.840683 Sep 16 14:12:30.176587 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1722/3438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:28 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:31.206918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:31.207663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:31.227021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:31.227524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:31.227964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:31.228699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:31.237833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:31.238827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:31.552956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:31.576577 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6dccdc63-65a3-47dd-8c33-a15b33315cd7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1329 microversion: 2.1 time: 0.376123 Sep 16 14:12:31.597526 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1717/3439] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:31 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1329 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:32.624729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:32.650076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:32.677778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:32.683566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:32.687973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:32.689449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:32.695639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:32.695639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:33.298120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:33.370378 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e074d38-a523-47dc-9a5f-1ee2aca538ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1510 microversion: 2.1 time: 0.760053 Sep 16 14:12:33.372158 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1723/3440] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:32 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:33.409721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:33.412124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:33.446437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:33.448306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:33.450076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:33.451835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:33.454346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:33.456015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:33.726687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:33.743488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-749c3a54-eecd-4fe0-b9f9-ae2c0f524fec tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1510 microversion: 2.1 time: 0.344481 Sep 16 14:12:33.744327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1718/3441] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:33 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:33.777408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:33.778859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:33.810463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:33.811528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:33.812395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:33.814029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:33.815829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:33.816836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:33.896373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:12:33.982768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efaff165-b7c6-4170-a1db-d6961a5e22d1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Action: 'create', calling method: .version_select at 0x7f724cfc1f70>, body: {"keypair": {"name": "tempest-keypair-1777213397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOlg5YsX2LwZE5nQMrNpULkMLx8gG5DgGiFFfNe/e5STUScu9byejxVuUb3yUZDC/3agM/vsDzb36b+U1cXXZkDj4LmZ2LpbfCqp3PTNSSt5JsruHnREDZd4K9sRkpsyw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:34.040474 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9599b8f-fd36-42bf-ac2d-58bf46b076c0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 204 len: 0 microversion: 2.1 time: 0.274445 Sep 16 14:12:34.041752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1724/3442] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:12:33 2022] DELETE /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:12:34.047673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-efaff165-b7c6-4170-a1db-d6961a5e22d1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Getting quotas for project 89a728706eb44e0bb214733383cb9959. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:34.064159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-efaff165-b7c6-4170-a1db-d6961a5e22d1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Getting quotas for user a248191406934e0f8e6137af391df828 and project 89a728706eb44e0bb214733383cb9959. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:34.064417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:34.067863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:34.085672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:34.090511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:34.091278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:34.093479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:34.096457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:34.097042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:34.122302 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-efaff165-b7c6-4170-a1db-d6961a5e22d1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.142771 Sep 16 14:12:34.126690 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1719/3443] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 14:12:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 14:12:34.620745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:34.650277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:34.734212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e189d394-de68-42d6-8b51-bf10f03ac0ee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1516 microversion: 2.1 time: 0.680380 Sep 16 14:12:34.735511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1725/3444] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:34 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1516 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:35.775380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:35.778893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:35.822998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:35.824304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:35.825345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:35.826953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:35.830637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:35.835479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:36.478716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:36.492883 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cab9b36e-d128-42d9-a709-44f01b2b27b5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1516 microversion: 2.1 time: 0.732481 Sep 16 14:12:36.494307 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1720/3445] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:35 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1516 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:37.525610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:37.526493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:37.556528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:37.557043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:37.557490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:37.558853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:37.559341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:37.559787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:37.572742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-88d417c6-b10d-44c8-a7e2-33f9045471b3 req-0c43b8ca-f627-4a9d-8585-764b47a8cfcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338a3ce1-f2bc-46c9-80de-52601116e911", "name": "network-vif-deleted", "tag": "95c800e2-103e-494f-b002-ee46415eb50a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:37.604138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-88d417c6-b10d-44c8-a7e2-33f9045471b3 req-0c43b8ca-f627-4a9d-8585-764b47a8cfcb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:37.607465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-88d417c6-b10d-44c8-a7e2-33f9045471b3 req-0c43b8ca-f627-4a9d-8585-764b47a8cfcb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:37.608761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-88d417c6-b10d-44c8-a7e2-33f9045471b3 req-0c43b8ca-f627-4a9d-8585-764b47a8cfcb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:37.676426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-88d417c6-b10d-44c8-a7e2-33f9045471b3 req-0c43b8ca-f627-4a9d-8585-764b47a8cfcb service nova] Creating event network-vif-deleted:95c800e2-103e-494f-b002-ee46415eb50a for instance 338a3ce1-f2bc-46c9-80de-52601116e911 on n-h1-858129-2 Sep 16 14:12:37.701547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-88d417c6-b10d-44c8-a7e2-33f9045471b3 req-0c43b8ca-f627-4a9d-8585-764b47a8cfcb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129240 Sep 16 14:12:37.702366 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1721/3446] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:37.817106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:37.828636 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0df9f277-6b68-461f-9f58-1b39fc72cb3d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 200 len: 1474 microversion: 2.1 time: 0.308187 Sep 16 14:12:37.836004 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1726/3447] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:37 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:38.863408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:38.864851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:38.912800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:38.913672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:38.928876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:38.930675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:38.931533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:38.932309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:38.998886 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 HTTP/1.1 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '338a3ce1-f2bc-46c9-80de-52601116e911'} Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:12:39.001759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:12:39.008314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:12:39.008314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:12:39.008314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:12:39.008314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:12:39.008314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:12:39.008314 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:12:39.026515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:12:39.027524 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f8d0352-dbb3-48ae-9e79-a6e9c807b73e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 404 len: 111 microversion: 2.1 time: 0.172089 Sep 16 14:12:39.028272 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1722/3448] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:38 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:12:39.039676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8849c22f-30f9-42b5-9aab-d053e05ee751 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '.version_select at 0x7f724d81e9d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:39.098752 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8849c22f-30f9-42b5-9aab-d053e05ee751 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-key-1999434919" status: 202 len: 0 microversion: 2.1 time: 0.062932 Sep 16 14:12:39.104820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1727/3449] 10.222.0.60 () {58 vars in 1209 bytes} [Fri Sep 16 14:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1999434919 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:12:39.701773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a52683b6-6fcf-4ada-b040-b413b3b62df0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'create', calling method: .version_select at 0x7f7251769280>, body: {"keypair": {"name": "tempest-keypair-320214297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZKLMl6Kg6Ur75FKqrGrn2ah8EUTEDmtgcSTTvIfndedlfmH7Gt0ld9LHRqyJ0ZTp9yodn+hDma2ceRrsiMdBYR72f/krmwHvWaV9BVJTW5ZvqU2arqmW2gpluyUIMQCg=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:39.740075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a52683b6-6fcf-4ada-b040-b413b3b62df0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:39.760729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a52683b6-6fcf-4ada-b040-b413b3b62df0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for user 7b08b72cf46345f2a3c88a6251b1c996 and project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:39.835041 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a52683b6-6fcf-4ada-b040-b413b3b62df0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.444779 Sep 16 14:12:39.844958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1728/3450] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:12:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:39.851870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1693552042", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "67efa02a-e488-46fd-ae7d-2194a2654684"}, {"port": "2aff764a-ab44-46a9-85e7-d790dbbf7730", "tag": "port-1"}, {"port": "a16fb69b-f2c7-4b30-905c-5df0a528462b", "tag": "port-2"}, {"uuid": "eeb04342-7781-44c2-b0b9-7b93747634f8", "tag": "net-1"}, {"uuid": "eeb04342-7781-44c2-b0b9-7b93747634f8"}, {"uuid": "fedf41a4-cd25-4726-acbb-2782cff9acf1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fedf41a4-cd25-4726-acbb-2782cff9acf1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7eb64d06-7064-4d8d-95a8-19e616a6f855", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a391daca-3c63-4959-90ca-da517aeb00dc", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "eeaff4cf-33fc-4172-a630-0d18bc9d4570", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1009295692"}], "key_name": "tempest-keypair-1777213397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:39.868843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Calling method '.version_select at 0x7f724c5573a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:39.870970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:39.871680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:39.873066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:39.922909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:39.923413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:39.923859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:39.953586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:39.954089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:39.954679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:39.971500 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b343e96-208a-44da-8943-8a1fba49d77d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1992965875-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.673755 Sep 16 14:12:39.972121 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1723/3451] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:12:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:12:39.991798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-274028094", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:40.109681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:12:40.553851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] validate_networks() for [('67efa02a-e488-46fd-ae7d-2194a2654684', None, None, None, None, None), (None, None, '2aff764a-ab44-46a9-85e7-d790dbbf7730', None, None, None), (None, None, 'a16fb69b-f2c7-4b30-905c-5df0a528462b', None, None, None), ('eeb04342-7781-44c2-b0b9-7b93747634f8', None, None, None, None, None), ('eeb04342-7781-44c2-b0b9-7b93747634f8', None, None, None, None, None), ('fedf41a4-cd25-4726-acbb-2782cff9acf1', '10.2.2.100', None, None, None, None), ('fedf41a4-cd25-4726-acbb-2782cff9acf1', '10.2.2.200', None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:12:41.656184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:12:41.657185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:12:41.657435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:12:41.657843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:12:41.658304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:12:41.691854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:41.692842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:41.693522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:41.694754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:41.695207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:41.695662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:41.745090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:41.791491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:41.925587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:12:41.933516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:12:42.036300 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-109db323-982b-46cd-8ab3-a0118465e691 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057257 Sep 16 14:12:42.039597 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1724/3452] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:12:42.053927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:42.065008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:42.074913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:42.075994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:42.077602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:42.078824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:42.079634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:42.080677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:42.117821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:12:42.264001 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e06f50b3-eba8-4638-adec-69a98b285957 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 204 len: 0 microversion: 2.1 time: 0.222318 Sep 16 14:12:42.265141 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1725/3453] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:12:42 2022] DELETE /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:12:42.290743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1fb9e44-402b-4b54-be0c-a4264bea66a9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:42.292434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1fb9e44-402b-4b54-be0c-a4264bea66a9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:43.179564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b1fb9e44-402b-4b54-be0c-a4264bea66a9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:43.195898 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1fb9e44-402b-4b54-be0c-a4264bea66a9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1208 microversion: 2.1 time: 0.929315 Sep 16 14:12:43.197294 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1726/3454] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:42 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1208 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:43.209010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:43.222354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:43.248565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:43.249090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:43.249542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:43.250284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:43.255931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:43.256534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:43.867522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:43.884414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ddad522f-1f10-4b9c-9a93-4a7221c9ffb2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1554 microversion: 2.1 time: 0.685671 Sep 16 14:12:43.885710 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1727/3455] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:43 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1554 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:44.224925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:44.225796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:44.240571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:44.244165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:44.247675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:44.248742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:44.253344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:44.254136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:44.449978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:44.515007 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0526054c-835c-44c9-ae37-862300e8b996 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1260 microversion: 2.1 time: 0.289980 Sep 16 14:12:44.530750 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1728/3456] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:44 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1260 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:44.910244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:44.910910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:44.928116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:44.929211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:44.929211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:44.929875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:44.930301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:44.930748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:45.739544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:45.750206 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-272e325d-74a6-4f09-9471-eed0b23af7f4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1554 microversion: 2.1 time: 0.844439 Sep 16 14:12:45.756722 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1729/3457] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:44 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1554 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:45.837291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dac8b0de-7a9d-4a20-b08c-8d7e2b540d23 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Action: 'create', calling method: .version_select at 0x7f724c50d670>, body: {"keypair": {"name": "tempest-keypair-443792697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7hveohAqPxBZ/50VzVLAFONsVTxMkJqEyFOz5BKKi9Fj7cMDELeaa+5BofCYJOXqn5wST8AYlai9JU0lpInObDnAtvEhyvpHwBuL//+rUm0gIHrgEtqU8tj2kXvVWWog=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:45.873108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dac8b0de-7a9d-4a20-b08c-8d7e2b540d23 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Getting quotas for project e11c1fa51ebe4326969ca9748602b95d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:45.891780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dac8b0de-7a9d-4a20-b08c-8d7e2b540d23 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Getting quotas for user e2f2a892f02f452b96a306b6b009e3b4 and project e11c1fa51ebe4326969ca9748602b95d. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:45.947502 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dac8b0de-7a9d-4a20-b08c-8d7e2b540d23 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186999 Sep 16 14:12:45.948963 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1730/3458] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:12:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:45.963695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:45.964949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:45.983701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:45.984682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:45.985364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:45.987032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:45.988526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:45.989518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:46.659202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:46.669344 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce9b8f91-1549-4d73-b077-862f3ca78d9b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1266 microversion: 2.1 time: 0.718057 Sep 16 14:12:46.673357 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1731/3459] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:45 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1266 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:46.774258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:46.775710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:46.786935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:46.787895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:46.788581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:46.792758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:46.793572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:46.794184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:47.241761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:47.261669 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-050c4b10-65fa-4fe2-ad54-a533bc1ef990 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1554 microversion: 2.1 time: 0.491217 Sep 16 14:12:47.263401 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1732/3460] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:46 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1554 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:47.269871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b3e9047a-a73d-42eb-a15c-a310a6d1d56b req-c9beaeda-8a24-4d00-afef-85d16836e9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883be0de-5cc5-4181-84c2-a466f4758beb", "name": "network-vif-unplugged", "status": "completed", "tag": "310cca58-0728-4893-a97f-03586fdd24a0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:47.309181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b3e9047a-a73d-42eb-a15c-a310a6d1d56b req-c9beaeda-8a24-4d00-afef-85d16836e9dd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:47.310009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b3e9047a-a73d-42eb-a15c-a310a6d1d56b req-c9beaeda-8a24-4d00-afef-85d16836e9dd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:47.310768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b3e9047a-a73d-42eb-a15c-a310a6d1d56b req-c9beaeda-8a24-4d00-afef-85d16836e9dd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:47.332531 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b3e9047a-a73d-42eb-a15c-a310a6d1d56b req-c9beaeda-8a24-4d00-afef-85d16836e9dd service nova] Creating event network-vif-unplugged:310cca58-0728-4893-a97f-03586fdd24a0 for instance 883be0de-5cc5-4181-84c2-a466f4758beb on n-h1-858129-2 Sep 16 14:12:47.351490 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b3e9047a-a73d-42eb-a15c-a310a6d1d56b req-c9beaeda-8a24-4d00-afef-85d16836e9dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085839 Sep 16 14:12:47.355671 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1733/3461] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:47.733211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:47.736487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:47.774356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:47.778736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:47.782277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:47.786514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:47.789196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:47.793140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:47.823005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=7 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:48.013170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:48.042316 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a7adb7b-1e3c-4f58-a689-f29c900c3681 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1266 microversion: 2.1 time: 0.322762 Sep 16 14:12:48.057159 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1734/3462] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:47 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:48.102691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ff6acb2b-7030-4998-adf0-35a8700ba502 req-56f3d65d-4885-4fb1-b9f1-2b51a371cc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883be0de-5cc5-4181-84c2-a466f4758beb", "name": "network-vif-deleted", "tag": "310cca58-0728-4893-a97f-03586fdd24a0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:48.124898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ff6acb2b-7030-4998-adf0-35a8700ba502 req-56f3d65d-4885-4fb1-b9f1-2b51a371cc24 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:48.125312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ff6acb2b-7030-4998-adf0-35a8700ba502 req-56f3d65d-4885-4fb1-b9f1-2b51a371cc24 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:48.125813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ff6acb2b-7030-4998-adf0-35a8700ba502 req-56f3d65d-4885-4fb1-b9f1-2b51a371cc24 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:48.156472 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ff6acb2b-7030-4998-adf0-35a8700ba502 req-56f3d65d-4885-4fb1-b9f1-2b51a371cc24 service nova] Creating event network-vif-deleted:310cca58-0728-4893-a97f-03586fdd24a0 for instance 883be0de-5cc5-4181-84c2-a466f4758beb on n-h1-858129-2 Sep 16 14:12:48.173202 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ff6acb2b-7030-4998-adf0-35a8700ba502 req-56f3d65d-4885-4fb1-b9f1-2b51a371cc24 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106182 Sep 16 14:12:48.175377 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1735/3463] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:48.309370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:48.311308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:48.332722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:48.333275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:48.333726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:48.334524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:48.339459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:48.339923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:48.558989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:48.575000 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-89539f14-fd24-4895-9beb-5c4a1f45b6ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1346 microversion: 2.1 time: 0.273055 Sep 16 14:12:48.575666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1736/3464] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:48 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1346 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:49.088909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:49.096758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:49.119942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:49.121421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:49.128665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:49.131316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:49.135272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:49.138820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:49.242526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:49.784145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:49.784768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:49.828398 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83f7c428-e749-4d9d-915a-445ffae63fbb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1266 microversion: 2.1 time: 0.743529 Sep 16 14:12:49.846947 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1737/3465] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:49 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1266 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:49.870396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:49.878550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:49.914085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:49.915077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:49.915873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:49.917328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:49.918174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:49.918992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:50.451069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:50.483401 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8146ec8d-828f-429b-a4ed-e6ff1978f3ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1346 microversion: 2.1 time: 0.644030 Sep 16 14:12:50.503605 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1738/3466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:49 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1346 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:50.784430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1138720279", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64a9d39-280d-4bfc-99d8-7531ba64697a"}], "security_groups": [{"name": "tempest-securitygroup--1168258230"}], "key_name": "tempest-keypair-320214297", "user_data": "}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:50.819374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:51.712809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:52.005427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:12:52.050739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] validate_networks() for [('f64a9d39-280d-4bfc-99d8-7531ba64697a', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:12:53.177919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:12:53.178885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:12:53.179329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:12:53.180859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:12:53.181900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:12:53.226505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:53.229127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:53.230249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:53.233752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:53.234672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:53.238500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:53.280145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Getting quotas for project 89a728706eb44e0bb214733383cb9959. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:53.289027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Getting quotas for user a248191406934e0f8e6137af391df828 and project 89a728706eb44e0bb214733383cb9959. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:53.550976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:12:53.554759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7eb64d06-7064-4d8d-95a8-19e616a6f855',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a391daca-3c63-4959-90ca-da517aeb00dc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eeaff4cf-33fc-4172-a630-0d18bc9d4570',volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:12:53.657034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:12:53.657915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:12:53.661188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:12:53.665927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:12:53.667106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:12:53.704187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:53.709925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:53.712817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:53.716109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:53.717777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:53.719425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:53.803600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:53.817857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for user 7b08b72cf46345f2a3c88a6251b1c996 and project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:53.844601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:12:53.850637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:12:54.075895 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6fd67218-39cd-478b-846b-1f235a28d3bb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.292474 Sep 16 14:12:54.084730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1739/3467] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:12:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 3306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:12:54.146185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:54.147350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:54.193028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee498a4d-a168-44bd-9608-57c9751d9969 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 14.339582 Sep 16 14:12:54.194143 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1729/3468] 10.222.0.60 () {62 vars in 1189 bytes} [Fri Sep 16 14:12:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 14348 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:12:54.213151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:54.216739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:54.227694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:54.228672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:54.230574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:54.231827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:54.232623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:54.246038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:54.296008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:54.299794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:54.301202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:54.311918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:54.313618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:54.317115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:54.545022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:54.563641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8941197-0aaa-43d4-a07d-950d744483f1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1346 microversion: 2.1 time: 0.365874 Sep 16 14:12:54.567652 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1730/3469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:54 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1346 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:54.583150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1499380933", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e2313869-5996-4a62-98e6-e06a363b4562"}], "security_groups": [{"name": "tempest-securitygroup--1071069504"}], "key_name": "tempest-keypair-443792697", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:54.915015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] validate_networks() for [('e2313869-5996-4a62-98e6-e06a363b4562', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:12:54.970488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:55.001005 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8e5f5d6-8b6d-418e-a376-8df35211196e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 0.909955 Sep 16 14:12:55.020955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1740/3470] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:54 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:55.054223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e041a51a-ef2d-4525-b100-da5883701741 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:55.059873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e041a51a-ef2d-4525-b100-da5883701741 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:55.215061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e041a51a-ef2d-4525-b100-da5883701741 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:55.224553 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e041a51a-ef2d-4525-b100-da5883701741 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1238 microversion: 2.1 time: 0.200977 Sep 16 14:12:55.225167 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1741/3471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:55 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1238 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:55.241712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8685c99-09a4-4b57-932a-997752f47241 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:55.244016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d8685c99-09a4-4b57-932a-997752f47241 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:55.388089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d8685c99-09a4-4b57-932a-997752f47241 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:55.423204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d8685c99-09a4-4b57-932a-997752f47241 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:55.429190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d8685c99-09a4-4b57-932a-997752f47241 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:55.436479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d8685c99-09a4-4b57-932a-997752f47241 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1286 microversion: 2.42 time: 0.204163 Sep 16 14:12:55.451989 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1742/3472] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:12:55 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:12:55.474342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6563dd57-5695-4a59-90b1-b3492bddd199 req-98aa1c11-175f-4720-9d9c-c930aa2af021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0737b8b6-face-435b-b259-34523816febb", "tag": "ffbf4812-c86b-45ae-86c0-8b613cec19a7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:55.512750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6563dd57-5695-4a59-90b1-b3492bddd199 req-98aa1c11-175f-4720-9d9c-c930aa2af021 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:55.513270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6563dd57-5695-4a59-90b1-b3492bddd199 req-98aa1c11-175f-4720-9d9c-c930aa2af021 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:55.513719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6563dd57-5695-4a59-90b1-b3492bddd199 req-98aa1c11-175f-4720-9d9c-c930aa2af021 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:55.552571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6563dd57-5695-4a59-90b1-b3492bddd199 req-98aa1c11-175f-4720-9d9c-c930aa2af021 service nova] Creating event network-changed:ffbf4812-c86b-45ae-86c0-8b613cec19a7 for instance 0737b8b6-face-435b-b259-34523816febb on n-h2-858129-2 Sep 16 14:12:55.567715 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6563dd57-5695-4a59-90b1-b3492bddd199 req-98aa1c11-175f-4720-9d9c-c930aa2af021 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113835 Sep 16 14:12:55.569343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1743/3473] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:55.628731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:55.629988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:55.639032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:55.639869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:55.640648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:55.641713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:55.642976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:55.643597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:55.761374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:55.771573 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c45c1ed-3c88-4312-a75d-124f0df7e982 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1346 microversion: 2.1 time: 0.164823 Sep 16 14:12:55.794804 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1744/3474] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:55 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:56.061798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:56.063221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:56.088831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.092259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.095025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.097968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.102978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.104776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.476573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Getting quotas for project e11c1fa51ebe4326969ca9748602b95d. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:56.491489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:56.498599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Getting quotas for user e2f2a892f02f452b96a306b6b009e3b4 and project e11c1fa51ebe4326969ca9748602b95d. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:56.505512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b0a2dd4-d896-4b2d-ab23-111fd9928ec7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 0.456392 Sep 16 14:12:56.506139 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1745/3475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:56 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:56.532800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:12:56.536087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:12:56.536943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:56.537160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:12:56.539074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:56.539318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:12:56.540899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:12:56.553553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.554787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.563922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.567533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.568302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.568940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.569115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.570133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.571709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.572649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.573296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.573809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.612361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Getting quotas for project e11c1fa51ebe4326969ca9748602b95d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:12:56.630908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Getting quotas for user e2f2a892f02f452b96a306b6b009e3b4 and project e11c1fa51ebe4326969ca9748602b95d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:12:56.663551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:12:56.667155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:12:56.732133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:56.743257 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-358173bf-30e1-4cae-964d-0673301b43aa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1290 microversion: 2.1 time: 0.235965 Sep 16 14:12:56.744613 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1746/3476] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:56 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1290 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:56.747378 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c9b43d8-38ce-4ea2-bf19-69f503c2572b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.177526 Sep 16 14:12:56.748378 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1731/3477] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:12:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:12:56.751400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:56.753199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:56.760683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.762066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.763033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.763990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.764649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.765264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.767054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0b22ed1-4de4-44f1-9691-eedacda7a45a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:56.767721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0b22ed1-4de4-44f1-9691-eedacda7a45a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:56.892347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0b22ed1-4de4-44f1-9691-eedacda7a45a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:56.908180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0b22ed1-4de4-44f1-9691-eedacda7a45a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1277 microversion: 2.1 time: 0.144903 Sep 16 14:12:56.909020 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1732/3478] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:56 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:12:56.919450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:56.920481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:56.937452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.938297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.938939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:56.940410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:56.941737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:56.944461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:57.013759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:57.032730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:57.041609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:57.043231 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e896cb7f-cfe7-48a5-b956-57bece2420bf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1528 microversion: 2.42 time: 0.296993 Sep 16 14:12:57.058194 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1747/3479] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:12:56 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:12:57.068907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:57.079627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-face1f80-3e9e-40cd-aa9f-e77a4a5869da tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1346 microversion: 2.1 time: 0.169302 Sep 16 14:12:57.095681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1733/3480] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:56 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:57.543047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:57.544037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:57.554500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:57.555646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:57.556581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:57.557559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:57.558455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:57.559272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:57.789658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:57.789658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:57.810859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:57.811478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:57.812000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:57.812773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:57.813236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:57.813909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:57.912967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:57.923196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c34c38b8-be44-4d4c-baa6-e0c14c614543 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 0.385720 Sep 16 14:12:57.923888 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1748/3481] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:57 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:57.963662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:57.973936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9622dd95-dcb2-4f51-89e8-74cc42acd339 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1296 microversion: 2.1 time: 0.190533 Sep 16 14:12:57.975097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1734/3482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:57 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:57.980925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:57.982037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:57.995869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:57.997456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:57.998285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:57.999327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:58.000033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:58.000718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:58.140614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ff5ed638-a483-44e1-ac94-e336c6e09791 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Action: 'create', calling method: .version_select at 0x7f724c656af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1171788900"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:12:58.503184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:58.531095 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7564cb23-3356-4c9a-a5c7-37bc2146b90b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1281 microversion: 2.1 time: 0.553547 Sep 16 14:12:58.562743 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1735/3483] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:57 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1281 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:58.586503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:58.588060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:58.605969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:58.607283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:58.609836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:58.610716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:58.611271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:58.611755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:58.686850 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ff5ed638-a483-44e1-ac94-e336c6e09791 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.761255 Sep 16 14:12:58.687783 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1749/3484] 10.222.0.60 () {60 vars in 1155 bytes} [Fri Sep 16 14:12:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 763 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 14:12:58.695420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:58.696865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:58.709906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:58.711210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:58.711973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:58.712436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:58.712909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'fault' on Instance uuid 883be0de-5cc5-4181-84c2-a466f4758beb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:12:58.716913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:58.717361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:58.718120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:58.718650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:58.719086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:58.841616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:58.853165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:58.855248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:58.857037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-497b40d5-aaa0-4cc9-98ec-cf4ffaef6e79 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1594 microversion: 2.42 time: 0.168218 Sep 16 14:12:58.859093 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1750/3485] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:12:58 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1594 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:12:58.864838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-636ff3ab-2680-4b10-a1db-5c07c08c0835 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724cfc15e0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:58.889767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:58.928235 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ea98ab8-3ff8-4ded-a6c4-b163aa86f6c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 200 len: 1351 microversion: 2.1 time: 0.363705 Sep 16 14:12:58.958443 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1736/3486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:58 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 1351 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:58.979438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:58.980246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:59.005780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:59.010650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:59.011265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:59.012043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:59.012545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:59.012986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:59.097518 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-636ff3ab-2680-4b10-a1db-5c07c08c0835 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 200 len: 345 microversion: 2.1 time: 0.237272 Sep 16 14:12:59.098113 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1751/3487] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:12:58 2022] GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:12:59.104257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:59.110187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:59.135433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:59.136048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:59.136488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:59.137237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:59.137792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:59.138180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:59.901480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:12:59.913502 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e5f15434-2d0a-4783-affa-47f27595f434 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1296 microversion: 2.1 time: 0.813823 Sep 16 14:12:59.914108 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1752/3488] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:59 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1296 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:12:59.944881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:12:59.945796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:12:59.956585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:59.961048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:59.961792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:12:59.962763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:12:59.963401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:12:59.964026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.309047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:00.328638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e82b329-09e8-41f5-bd84-3c692e9c1b8b tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1329 microversion: 2.1 time: 0.387600 Sep 16 14:13:00.330645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1753/3489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:59 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1329 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:00.337046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:00.340568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:00.358373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:00.359362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:00.360057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.361152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:00.361932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:00.362641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.469968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:00.481624 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e59d93e-204a-404e-8258-d068e671b2d0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 1.521747 Sep 16 14:13:00.484467 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1737/3490] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:12:58 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:00.501614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:00.503412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:00.516424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:00.518921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:00.520359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.521672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:00.525296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:00.526195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.545252 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb HTTP/1.1 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '883be0de-5cc5-4181-84c2-a466f4758beb'} Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:00.547599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:00.553176 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:00.557056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:00.558236 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a5903b16-828e-45e9-8867-882ee672b5f0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 404 len: 111 microversion: 2.1 time: 0.072009 Sep 16 14:13:00.559496 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1738/3491] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:00 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:00.565622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b98b9d02-08a1-43b2-9286-eda1ddf50532 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724da148b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:00.736156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:00.754659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:00.762525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:00.763903 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16790581-2a7c-436d-a471-ad5197449725 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1594 microversion: 2.42 time: 0.431807 Sep 16 14:13:00.765291 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1754/3492] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:00 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1594 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:00.944311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:00.948785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:00.969684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:00.976915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:00.978609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.980408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:00.982862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:00.984079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:00.990305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b98b9d02-08a1-43b2-9286-eda1ddf50532 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 200 len: 346 microversion: 2.1 time: 0.429355 Sep 16 14:13:00.991075 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1739/3493] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:13:00 2022] GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 346 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:01.005378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4349e145-9805-48f7-a81d-8d3136a5f9e9 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Action: 'create', calling method: .version_select at 0x7f724d3e5c10>, body: {"snapshot": {"volume_id": "d0e57733-2fe9-4829-b6e5-dcaf2ff92937", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1750063082"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:01.821787 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4349e145-9805-48f7-a81d-8d3136a5f9e9 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.820506 Sep 16 14:13:01.823702 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1740/3494] 10.222.0.60 () {60 vars in 1162 bytes} [Fri Sep 16 14:13:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:01.835947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:01.840825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:01.854985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:01.857695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:01.859778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:01.865411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:01.867423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:01.868612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:01.902797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb/os-volume_attachments HTTP/1.1 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '883be0de-5cc5-4181-84c2-a466f4758beb'} Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:13:01.907270 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:13:01.923107 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:01.926031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:01.928413 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-667c2698-a01c-4031-a83b-3ec6759b67e1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.101537 Sep 16 14:13:01.930826 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1741/3495] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:13:01 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb/os-volume_attachments => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:01.968707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:01.975384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:02.013687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:02.017874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:02.021335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:02.024701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:02.026603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:02.028905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:02.353992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:02.386840 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67e2858b-39e7-40af-aeb9-30910b712d63 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 1.452044 Sep 16 14:13:02.389161 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1755/3496] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:00 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:02.412294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:02.432288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:02.469283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:02.472818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:02.478815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:02.482935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:02.490171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:02.495123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:02.566290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:02.583704 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c86eedc-5ec8-4bbd-a5b3-b6ea4c9d375e tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1335 microversion: 2.1 time: 0.649261 Sep 16 14:13:02.584661 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1742/3497] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:01 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1335 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:02.596888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:02.597792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:02.615896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:02.616694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:02.618177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:02.622239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:02.623035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:02.623663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:02.957069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:02.986936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:02.996455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:02.997633 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45dcf549-03e8-4c49-ae4e-cc044b142c13 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1594 microversion: 2.42 time: 0.406023 Sep 16 14:13:02.998250 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1743/3498] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:02 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1594 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:03.027970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43bb97eb-b1fb-422e-9411-a0a319828c24 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724c4dc5e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:03.159909 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43bb97eb-b1fb-422e-9411-a0a319828c24 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6" status: 200 len: 287 microversion: 2.1 time: 0.160293 Sep 16 14:13:03.161919 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1744/3499] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 14:13:02 2022] GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:03.168275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1710969900", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:03.273844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:13:03.617456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:03.658296 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed9bbd79-8a32-4e45-8c58-d00709b6cf02 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 1.265982 Sep 16 14:13:03.660217 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1756/3500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:02 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:03.674789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec744724-fdc8-430c-86b1-9b5cf6d418c0 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724c50d9d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:03.761894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:03.790579 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec744724-fdc8-430c-86b1-9b5cf6d418c0 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.128072 Sep 16 14:13:03.791632 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1757/3501] 10.222.0.60 () {58 vars in 1140 bytes} [Fri Sep 16 14:13:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:03.806077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:03.811936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:03.837498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:03.839001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:03.844166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:03.847155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:03.848369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:03.855877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:05.419901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=26 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:05.772164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:05.800587 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1868796f-3c07-4ce0-82b9-14817576bb41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 2.006957 Sep 16 14:13:05.801849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1758/3502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:03 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:05.824475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:05.834802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:05.855172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:05.856543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:05.857720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:05.859392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:05.860634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:05.862439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:06.421117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:13:06.431671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:13:06.435762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:13:06.441668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:13:06.444757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:13:06.520850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:06.521452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:06.522109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:06.523144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:06.523860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:06.524649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:06.556190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:13:06.563231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:13:06.587789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:13:06.590700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:13:06.614582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:06.667792 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2480f7ae-d7e4-445e-9342-cf727b895909 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1403 microversion: 2.1 time: 0.857683 Sep 16 14:13:06.670930 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9452c6d4-e89a-4a53-9d69-181cd55ca284 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.507251 Sep 16 14:13:06.672757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1745/3503] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:13:06.673345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1759/3504] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:05 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1403 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:06.686901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a612450a-f356-478d-8472-8597af7c663a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724d190af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:06.696777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:06.706709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:06.778957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:06.779784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:06.780526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:06.790044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:06.796797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a612450a-f356-478d-8472-8597af7c663a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6" status: 200 len: 288 microversion: 2.1 time: 0.122823 Sep 16 14:13:06.800025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:06.800959 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1746/3505] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 14:13:06 2022] GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 => generated 288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:06.801105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:06.812201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ac6e4e32-5fab-40a5-8232-34d8cde0ee3d req-a20a1c2e-9b73-4a10-b70e-89db38a07afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0737b8b6-face-435b-b259-34523816febb", "name": "network-vif-plugged", "status": "completed", "tag": "ffbf4812-c86b-45ae-86c0-8b613cec19a7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:06.840764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ac6e4e32-5fab-40a5-8232-34d8cde0ee3d req-a20a1c2e-9b73-4a10-b70e-89db38a07afd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:06.841536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ac6e4e32-5fab-40a5-8232-34d8cde0ee3d req-a20a1c2e-9b73-4a10-b70e-89db38a07afd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:06.842141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ac6e4e32-5fab-40a5-8232-34d8cde0ee3d req-a20a1c2e-9b73-4a10-b70e-89db38a07afd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:06.866236 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ac6e4e32-5fab-40a5-8232-34d8cde0ee3d req-a20a1c2e-9b73-4a10-b70e-89db38a07afd service nova] Creating event network-vif-plugged:ffbf4812-c86b-45ae-86c0-8b613cec19a7 for instance 0737b8b6-face-435b-b259-34523816febb on n-h2-858129-2 Sep 16 14:13:06.876042 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ac6e4e32-5fab-40a5-8232-34d8cde0ee3d req-a20a1c2e-9b73-4a10-b70e-89db38a07afd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073434 Sep 16 14:13:06.881144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1747/3506] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:06.888576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:06.904822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-80b0b40b-6603-4692-b80a-7f77666688f8 req-3e224058-1b11-4cee-b102-a308bb2ab717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28da2ac1-41aa-4662-9e58-f77953c6e8b6", "tag": "2ca58b8f-9a7a-4d79-91e1-75dfad7504bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:06.946846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-80b0b40b-6603-4692-b80a-7f77666688f8 req-3e224058-1b11-4cee-b102-a308bb2ab717 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:06.947616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-80b0b40b-6603-4692-b80a-7f77666688f8 req-3e224058-1b11-4cee-b102-a308bb2ab717 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:06.952934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-80b0b40b-6603-4692-b80a-7f77666688f8 req-3e224058-1b11-4cee-b102-a308bb2ab717 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:07.000839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-80b0b40b-6603-4692-b80a-7f77666688f8 req-3e224058-1b11-4cee-b102-a308bb2ab717 service nova] Creating event network-changed:2ca58b8f-9a7a-4d79-91e1-75dfad7504bc for instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 on n-h2-858129-2 Sep 16 14:13:07.021006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-80b0b40b-6603-4692-b80a-7f77666688f8 req-3e224058-1b11-4cee-b102-a308bb2ab717 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136356 Sep 16 14:13:07.022096 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1748/3507] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:07.032136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:07.033670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:07.045507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:07.046563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:07.049374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:07.051166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:07.052215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:07.053201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:07.562826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:07.594885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:07.597922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:07.614215 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0113725e-338e-453d-ba48-5fc5cf02faea tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1662 microversion: 2.42 time: 0.937798 Sep 16 14:13:07.615271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1760/3508] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:06 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1662 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:07.634180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4eddffb7-6770-4d24-a0f1-5bc34eda987a req-21c2d9b6-29b8-4055-b312-a56b0d84caae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:07.676638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4eddffb7-6770-4d24-a0f1-5bc34eda987a req-21c2d9b6-29b8-4055-b312-a56b0d84caae service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:07.677117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4eddffb7-6770-4d24-a0f1-5bc34eda987a req-21c2d9b6-29b8-4055-b312-a56b0d84caae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:07.683776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4eddffb7-6770-4d24-a0f1-5bc34eda987a req-21c2d9b6-29b8-4055-b312-a56b0d84caae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:07.715302 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4eddffb7-6770-4d24-a0f1-5bc34eda987a req-21c2d9b6-29b8-4055-b312-a56b0d84caae service nova] Creating event network-changed:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:13:07.728156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:07.729044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4eddffb7-6770-4d24-a0f1-5bc34eda987a req-21c2d9b6-29b8-4055-b312-a56b0d84caae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111883 Sep 16 14:13:07.730275 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1761/3509] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:07.736971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad3044d0-5943-4e16-aa80-f24baeb6f238 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:07.743605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1fca5ac-7535-43d9-abba-dd7c15a46861 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 0.719302 Sep 16 14:13:07.744925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad3044d0-5943-4e16-aa80-f24baeb6f238 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:07.745583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1749/3510] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:07 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:07.766625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c85b66a1-e797-47a1-b422-092bd1bf9a6f tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f7251769550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:07.996821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c85b66a1-e797-47a1-b422-092bd1bf9a6f tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6" status: 202 len: 0 microversion: 2.1 time: 0.249414 Sep 16 14:13:07.997232 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1750/3511] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Sep 16 14:13:07 2022] DELETE /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:13:08.002165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:08.002829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:08.021084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:08.021597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:08.022043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:08.022787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:08.023247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:08.023677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:08.048647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad3044d0-5943-4e16-aa80-f24baeb6f238 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:08.064812 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad3044d0-5943-4e16-aa80-f24baeb6f238 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 200 len: 1215 microversion: 2.1 time: 0.332236 Sep 16 14:13:08.067236 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1762/3512] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:07 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:08.073460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:08.074385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:08.086713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:08.087824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:08.088476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:08.089379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:08.090166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:08.090805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.038129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:09.052626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-921e5dc4-7afd-4e92-9953-82125cde1749 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1403 microversion: 2.1 time: 0.982816 Sep 16 14:13:09.068587 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1763/3513] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:08 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1403 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:09.073361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:09.082743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1ac29ac-e35b-4a41-929a-ac2ab6eabaf9 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724c557280>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:09.122066 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-243d7e74-d10d-420d-8bd2-3d1db6c3ddcd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 1.123320 Sep 16 14:13:09.144053 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1751/3514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:07 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:09.189931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:09.224247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:09.281937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:09.283560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:09.284355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.285334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:09.289256 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1ac29ac-e35b-4a41-929a-ac2ab6eabaf9 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6" status: 200 len: 287 microversion: 2.1 time: 0.219266 Sep 16 14:13:09.289867 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1764/3515] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 14:13:09 2022] GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 => generated 287 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:09.295426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:09.296852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:09.311293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:09.312726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.320883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:09.323387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:09.333081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.334009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:09.334538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:09.335187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.379116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:13:09.609865 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82744f6c-30c8-4e99-a845-9ce5bf95167c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 204 len: 0 microversion: 2.1 time: 0.462291 Sep 16 14:13:09.611964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1752/3516] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:13:09 2022] DELETE /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:13:09.633910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:09.637164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:09.642630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:09.652457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:09.652984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:09.655516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.658007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:09.658549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:09.660532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:09.996655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:10.047054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:10.056207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:10.063053 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-66faf5ad-8372-4796-9279-284079b5c557 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1662 microversion: 2.42 time: 0.771458 Sep 16 14:13:10.069651 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1765/3517] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:09 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1662 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:10.086610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:10.098716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:10.124483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:10.125741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:10.127382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:10.131836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:10.135762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:10.137919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:10.403845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:10.433787 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdc8f41b-2cc3-4c86-bde0-188080858a62 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1308 microversion: 2.1 time: 0.817524 Sep 16 14:13:10.437955 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1753/3518] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:09 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1308 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:10.452319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:10.454594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:10.472276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:10.478779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:10.479576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:10.480818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:10.481451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:10.482239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:10.487299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:10.651967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:10.666610 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8dbcf86-e60d-4e6a-b0f6-88d87f3a10b1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 200 len: 1273 microversion: 2.1 time: 0.593632 Sep 16 14:13:10.672161 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1766/3519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:10 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 1273 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:10.694218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:10.695142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:10.718013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:10.720962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:10.721803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:10.728132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:10.728730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:10.731792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:11.167069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:11.180421 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3ad2a9ff-ee9d-442c-a94a-3e2e49bdde72 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 0.499885 Sep 16 14:13:11.185607 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1767/3520] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:10 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:11.204339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4ca0086a-214d-4a1e-88cd-ef53bf573bc5 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724c50d430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:11.307657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4ca0086a-214d-4a1e-88cd-ef53bf573bc5 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6" status: 200 len: 287 microversion: 2.1 time: 0.119919 Sep 16 14:13:11.309409 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1768/3521] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 14:13:11 2022] GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:11.337840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:11.344075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:11.363042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:11.363906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:11.365280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:11.367001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:11.368166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:11.369216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:11.651452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:11.670360 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92efacec-6246-4802-addc-bc86a771d3e6 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1403 microversion: 2.1 time: 1.230858 Sep 16 14:13:11.687353 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1754/3522] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:10 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1403 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:11.697085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:11.707435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:11.721873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:11.732341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:11.743236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:11.744462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:11.745241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:11.745963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:12.696804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:12.747396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:12.757110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:12.764767 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e69934d2-05b6-470e-9f7c-8e8bfc2b6180 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1709 microversion: 2.42 time: 1.443895 Sep 16 14:13:12.768106 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1769/3523] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:11 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1709 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:12.794187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:12.797608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:12.823606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:12.825290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:12.826379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:12.832234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:12.834776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:12.836049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:12.843538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:12.886697 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-376fd8d3-a071-4fc2-bc48-f620f21f7427 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1490 microversion: 2.1 time: 1.197447 Sep 16 14:13:12.888605 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1755/3524] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:11 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1490 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:12.903650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:12.909537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:12.931575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:12.938730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:12.940791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:12.948169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:12.949689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:12.967502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:13.514629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:13.560580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5485788f-7596-4a30-90d0-d48575567560 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 200 len: 1217 microversion: 2.1 time: 0.788347 Sep 16 14:13:13.565200 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1770/3525] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:12 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 1217 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:13.593048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f2f6dd1-54da-4c3e-a72d-fddd72a586af tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724cf8f310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:13.706093 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6f2f6dd1-54da-4c3e-a72d-fddd72a586af tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] HTTP exception thrown: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f2f6dd1-54da-4c3e-a72d-fddd72a586af tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Request method failure captured: Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 HTTP/1.1 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIRpj-qTeiTUNv0uCI8AdnehMPTILoxr_0x8V2Or2ig4lbhhVuoUAhu9Abci7hi6tHMj-SfLXHFfg0lom1GpImIgoi_kUYzF98zmTvwmTtVk05U64iU92jiGJXgGZU3QACA8JVLI4Q1RWkFyf2vcOzxksagHljcDBh51TA0xQPramls Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29d73272ae2d4519bcd479b2e71a12f0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}] Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: dce8d15293ca4ae3945a558b496109a3 Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: exception: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f662d601-0dee-4e74-a38f-26aaa7274aa6'} Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. (HTTP 404) (Request-ID: req-19e18230-52c2-4c0d-9266-77f5b5657960) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:13:13.721324 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. Sep 16 14:13:13.725997 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:13.732165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f2f6dd1-54da-4c3e-a72d-fddd72a586af tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Returning 404 to user: Snapshot f662d601-0dee-4e74-a38f-26aaa7274aa6 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:13.738048 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6f2f6dd1-54da-4c3e-a72d-fddd72a586af tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6" status: 404 len: 111 microversion: 2.1 time: 0.167654 Sep 16 14:13:13.742815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1771/3526] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 14:13:13 2022] GET /compute/v2.1/os-snapshots/f662d601-0dee-4e74-a38f-26aaa7274aa6 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:13.771453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:13.772702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:13.823248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:13.828471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:13.836547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:13.844565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:13.846276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:13.857061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:14.608436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:14.639025 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f6ea0d71-af1e-4d49-902d-14bebbd7d765 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1403 microversion: 2.1 time: 0.893838 Sep 16 14:13:14.675980 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1772/3527] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:13 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1403 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:14.675980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-274028094", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:14.736293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:14.756306 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-15f8808b-47a7-40c4-a883-83f5bbd685e7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 1.863404 Sep 16 14:13:14.759671 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1756/3528] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:12 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:14.770961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85dda4dc-85f3-488d-964e-739484c65b1e tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724ce633a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:14.853965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:13:14.987452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85dda4dc-85f3-488d-964e-739484c65b1e tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 202 len: 0 microversion: 2.1 time: 0.226613 Sep 16 14:13:14.988487 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1757/3529] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:13:14 2022] DELETE /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:13:14.999364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:15.000463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:15.025534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:15.026447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:15.027104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:15.028033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:15.030266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:15.030975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:15.628073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:15.645176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:15.646694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:15.647913 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6809609-495c-4ac5-960e-25a4f0c58abd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1709 microversion: 2.42 time: 0.658187 Sep 16 14:13:15.648506 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1758/3530] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:14 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1709 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:15.685471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:15.693350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:15.721802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:15.722334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:15.728284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:15.729095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:15.729592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:15.730045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:16.393365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:16.413472 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-10bb7141-2167-494b-84a7-05b53748c503 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 200 len: 1219 microversion: 2.1 time: 0.737019 Sep 16 14:13:16.414607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1759/3531] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:15 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 1219 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:16.420372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27e5be05-a53d-480f-bd69-715d267ca064 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724ce63160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:16.496689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27e5be05-a53d-480f-bd69-715d267ca064 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 200 len: 345 microversion: 2.1 time: 0.080484 Sep 16 14:13:16.497910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1760/3532] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:13:16 2022] GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:16.503750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-aca2a8c3-80e1-4a31-b5af-8b2a9f7ffa44 req-854713d6-b1fe-494e-a165-8040e399ba0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28da2ac1-41aa-4662-9e58-f77953c6e8b6", "name": "network-vif-plugged", "status": "completed", "tag": "2ca58b8f-9a7a-4d79-91e1-75dfad7504bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:16.521339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-aca2a8c3-80e1-4a31-b5af-8b2a9f7ffa44 req-854713d6-b1fe-494e-a165-8040e399ba0e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:16.521836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-aca2a8c3-80e1-4a31-b5af-8b2a9f7ffa44 req-854713d6-b1fe-494e-a165-8040e399ba0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:16.522277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-aca2a8c3-80e1-4a31-b5af-8b2a9f7ffa44 req-854713d6-b1fe-494e-a165-8040e399ba0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:16.537160 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-aca2a8c3-80e1-4a31-b5af-8b2a9f7ffa44 req-854713d6-b1fe-494e-a165-8040e399ba0e service nova] Creating event network-vif-plugged:2ca58b8f-9a7a-4d79-91e1-75dfad7504bc for instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 on n-h2-858129-2 Sep 16 14:13:16.542895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-aca2a8c3-80e1-4a31-b5af-8b2a9f7ffa44 req-854713d6-b1fe-494e-a165-8040e399ba0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043378 Sep 16 14:13:16.543569 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1761/3533] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:16.549665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:16.550391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:16.575755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:16.576634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=24 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:16.578511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:16.579060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:16.579562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:16.580302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:16.580771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:16.581209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.008428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:17.018736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2af91067-386d-45b9-b662-ac12419bbd64 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1403 microversion: 2.1 time: 0.473866 Sep 16 14:13:17.031173 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1762/3534] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:16 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1403 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:17.037285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:17.038333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:17.067033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.068308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.073789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.075136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.076782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.077667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.107485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:13:17.108073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:13:17.108572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:13:17.108995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:13:17.109413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:13:17.130199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.130724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.131169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.131921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.132385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.132816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.192443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:13:17.201321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:13:17.233320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:13:17.239539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:13:17.350725 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6edfa585-b73b-4a59-834a-1730609ec11b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.683316 Sep 16 14:13:17.352896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1773/3535] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:13:17.367097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:17.367957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:17.378748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.381057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.384070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.385061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.385723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.386372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.572321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:17.582536 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3da86093-d616-4320-b97f-fa736b082efb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 0.549647 Sep 16 14:13:17.587672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1763/3536] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:17 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:17.599971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-215f9dee-5fff-4656-aaef-e892587f42b1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:17.600995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-215f9dee-5fff-4656-aaef-e892587f42b1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:17.838997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-215f9dee-5fff-4656-aaef-e892587f42b1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:17.847565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-215f9dee-5fff-4656-aaef-e892587f42b1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1208 microversion: 2.1 time: 0.258425 Sep 16 14:13:17.851232 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1764/3537] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:17 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1208 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:17.858892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:17.859517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:17.881464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.881978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.882449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:17.883224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:17.885716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:17.889974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:18.045101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:18.077670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:18.091639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55efa7bc-5975-4754-86a5-decb47c0a80b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 200 len: 1219 microversion: 2.1 time: 0.239162 Sep 16 14:13:18.092880 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1765/3538] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:17 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 1219 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:18.095983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:18.102497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ee977c7-62c0-4e28-b3b2-026ec0ab1787 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724d2afb80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:18.106378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:18.116270 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-576dae54-f556-43f0-89d1-46c0acb8e5f7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1756 microversion: 2.42 time: 0.761741 Sep 16 14:13:18.131003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1774/3539] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:17 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1756 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:18.155116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:18.158540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:18.207216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:18.208408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:18.209220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:18.218587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:18.219654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:18.220483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:18.240310 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ee977c7-62c0-4e28-b3b2-026ec0ab1787 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 200 len: 345 microversion: 2.1 time: 0.145858 Sep 16 14:13:18.241203 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1766/3540] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:13:18 2022] GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:18.560939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f48c9729-f174-455c-891d-b2f1ffe2b5cd req-2983ecb6-52c7-4be0-8198-0c24f570a587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-plugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:18.598316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f48c9729-f174-455c-891d-b2f1ffe2b5cd req-2983ecb6-52c7-4be0-8198-0c24f570a587 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:18.599417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f48c9729-f174-455c-891d-b2f1ffe2b5cd req-2983ecb6-52c7-4be0-8198-0c24f570a587 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:18.599417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f48c9729-f174-455c-891d-b2f1ffe2b5cd req-2983ecb6-52c7-4be0-8198-0c24f570a587 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:18.625660 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f48c9729-f174-455c-891d-b2f1ffe2b5cd req-2983ecb6-52c7-4be0-8198-0c24f570a587 service nova] Creating event network-vif-plugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:13:18.655551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f48c9729-f174-455c-891d-b2f1ffe2b5cd req-2983ecb6-52c7-4be0-8198-0c24f570a587 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098413 Sep 16 14:13:18.676684 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1767/3541] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:13:18.695052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:18.700996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:18.722454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:18.724462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:18.725874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:18.730497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:18.736868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:18.738174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:19.118967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:19.166330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:19.176220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb3db586-8237-4ba9-be5b-2c8c5eb8a910 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1403 microversion: 2.1 time: 1.037229 Sep 16 14:13:19.180032 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-529e5256-0705-4580-a303-794eb0859e7d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1364 microversion: 2.1 time: 0.500525 Sep 16 14:13:19.181262 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1768/3542] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:18 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:19.186357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:19.195193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:19.200287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1775/3543] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:18 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1403 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:19.204299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:19.215240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:19.216046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:19.216789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:19.217307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:19.217708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:19.223812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:19.225590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:19.233112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:19.234091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:19.234674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:19.236041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:19.236761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:19.237256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:19.254885 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b HTTP/1.1 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b'} Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:19.257673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:13:19.262428 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:19.264578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:19.265773 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b264a3cd-3af1-4dd9-8852-7bd82cbaad89 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 404 len: 111 microversion: 2.1 time: 0.062681 Sep 16 14:13:19.267572 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1776/3544] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:19 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:19.277124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:19.278149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:19.284777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:19.304241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:19.304891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:19.305665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:19.307488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:19.308244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:19.309077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:20.241542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:20.250580 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36798ccf-2393-4b19-8ee7-efae8079590c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1204 microversion: 2.1 time: 1.067890 Sep 16 14:13:20.255820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1769/3545] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:19 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1204 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:20.274282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb6d8ee6-0fac-4eb2-995c-0adfb693f728 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f7251691310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:20.406454 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-eb6d8ee6-0fac-4eb2-995c-0adfb693f728 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] HTTP exception thrown: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb6d8ee6-0fac-4eb2-995c-0adfb693f728 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Request method failure captured: Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 HTTP/1.1 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIRpj-qTeiTUNv0uCI8AdnehMPTILoxr_0x8V2Or2ig4lbhhVuoUAhu9Abci7hi6tHMj-SfLXHFfg0lom1GpImIgoi_kUYzF98zmTvwmTtVk05U64iU92jiGJXgGZU3QACA8JVLI4Q1RWkFyf2vcOzxksagHljcDBh51TA0xQPramls Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29d73272ae2d4519bcd479b2e71a12f0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}] Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: dce8d15293ca4ae3945a558b496109a3 Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: exception: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'd0e57733-2fe9-4829-b6e5-dcaf2ff92937'} Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. (HTTP 404) (Request-ID: req-4d02961c-63ae-4f62-8333-d4d9d146abd4) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:13:20.410137 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:20.417552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:20.424894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb6d8ee6-0fac-4eb2-995c-0adfb693f728 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Returning 404 to user: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:20.426116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb6d8ee6-0fac-4eb2-995c-0adfb693f728 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 404 len: 109 microversion: 2.1 time: 0.164395 Sep 16 14:13:20.427641 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1770/3546] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:13:20 2022] GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:20.437162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-571174349", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:20.607374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:13:21.304611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:21.322365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:21.325106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:21.326863 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d9d5412-97c3-4a6f-94d6-491a79e35b30 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1756 microversion: 2.42 time: 2.057778 Sep 16 14:13:21.328035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1777/3547] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:19 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1756 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:21.334325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:21.335284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:21.346060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:21.347513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:21.348022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:21.348942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:21.349423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:21.349858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:21.994659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:22.008811 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30784b23-1587-4718-bcf4-713c4276c00f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1590 microversion: 2.1 time: 0.679315 Sep 16 14:13:22.027883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1778/3548] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:21 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1590 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:22.027883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:22.027883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:22.041241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:22.041454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:22.043274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:22.044125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:22.044829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:22.045278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:22.623835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:22.637355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28cdc555-3253-4bef-8633-bca1695fa44f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1550 microversion: 2.1 time: 0.622179 Sep 16 14:13:22.668657 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1779/3549] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:22 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1550 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:22.682701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:22.683603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:22.700836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:22.701658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:22.709316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:22.710369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:22.711072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:22.711688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:22.890385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:13:22.936398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:13:22.949598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:13:22.961650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:13:22.963162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:13:23.062622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.071529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.078731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.084924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.112099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.116701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.143859 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4cef2754-3dd3-49cb-a357-a8d94dfd0d9c tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1812 microversion: 2.1 time: 0.468283 Sep 16 14:13:23.162539 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1780/3550] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:22 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1812 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:23.172420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74d9531a-e54a-4b58-80ab-f95fc30d3f5a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724c4c00d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:23.243356 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-74d9531a-e54a-4b58-80ab-f95fc30d3f5a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] HTTP exception thrown: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74d9531a-e54a-4b58-80ab-f95fc30d3f5a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Request method failure captured: Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 HTTP/1.1 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIRpj-qTeiTUNv0uCI8AdnehMPTILoxr_0x8V2Or2ig4lbhhVuoUAhu9Abci7hi6tHMj-SfLXHFfg0lom1GpImIgoi_kUYzF98zmTvwmTtVk05U64iU92jiGJXgGZU3QACA8JVLI4Q1RWkFyf2vcOzxksagHljcDBh51TA0xQPramls Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29d73272ae2d4519bcd479b2e71a12f0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}] Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: dce8d15293ca4ae3945a558b496109a3 Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: exception: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'd0e57733-2fe9-4829-b6e5-dcaf2ff92937'} Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. (HTTP 404) (Request-ID: req-de6fca44-6fb5-4bee-9351-00975b122a75) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:13:23.245604 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74d9531a-e54a-4b58-80ab-f95fc30d3f5a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Returning 404 to user: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-74d9531a-e54a-4b58-80ab-f95fc30d3f5a tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 404 len: 109 microversion: 2.1 time: 0.085276 Sep 16 14:13:23.252944 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1781/3551] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:13:23 2022] DELETE /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:23.261897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:23.264273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:13:23.265969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:23.283951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:13:23.286353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.287152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.287672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.288431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.289972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.290435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.321471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:13:23.327780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:13:23.512813 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d534fa2b-e1dc-423f-8bf5-8f36bac3c443 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.083379 Sep 16 14:13:23.519850 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1771/3552] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:13:23.541852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:23.552466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:23.555121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:23.582816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.583652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.585872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.586329 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d38af58c-9fe2-477f-827e-66ecf823ed1c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1266 microversion: 2.1 time: 0.333834 Sep 16 14:13:23.586976 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1782/3553] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:23 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:23.588444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.589370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.590708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.594226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:23.608782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:23.620973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.623443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.624121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.625552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.637366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.637953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.825538 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f19dbef1-c386-4c35-887c-f54a9f6cceae tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.303986 Sep 16 14:13:23.826432 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1772/3554] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:13:23 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:23.833419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:23.834250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:23.848538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.852717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.853419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:23.857841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:23.861330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:23.865333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:24.245979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ec0369a-8a82-4266-9494-a5587fa1262e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.418225 Sep 16 14:13:24.246953 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1773/3555] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:13:23 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/os-interface => generated 284 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:24.259404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:24.268589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:24.269904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:24.274058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:24.277972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:24.295505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:24.304346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:24.400151 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f8da7da-52da-4f92-8371-89c46186d700 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.151780 Sep 16 14:13:24.409555 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1774/3556] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 14:13:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:24.416576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d223389-3fa3-4746-b160-61714b79fed8 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Calling method '.version_select at 0x7f724d197820>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:24.930065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:24.948491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:24.955880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:24.958111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4cbb0e16-9cac-4c4e-aa99-43e89f4a603c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1803 microversion: 2.42 time: 1.369689 Sep 16 14:13:24.972052 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1783/3557] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:23 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1803 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:24.987608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:24.988250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:24.997984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:24.999182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:24.999839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:25.001945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:25.002753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:25.004821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:25.039233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:25.133771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3d223389-3fa3-4746-b160-61714b79fed8 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] HTTP exception thrown: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d223389-3fa3-4746-b160-61714b79fed8 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Request method failure captured: Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 HTTP/1.1 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIRpj-qTeiTUNv0uCI8AdnehMPTILoxr_0x8V2Or2ig4lbhhVuoUAhu9Abci7hi6tHMj-SfLXHFfg0lom1GpImIgoi_kUYzF98zmTvwmTtVk05U64iU92jiGJXgGZU3QACA8JVLI4Q1RWkFyf2vcOzxksagHljcDBh51TA0xQPramls Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29d73272ae2d4519bcd479b2e71a12f0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29d73272ae2d4519bcd479b2e71a12f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29d73272ae2d4519bcd479b2e71a12f0"}]}] Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 29d73272ae2d4519bcd479b2e71a12f0 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468380391 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: dce8d15293ca4ae3945a558b496109a3 Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468380391-project Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: exception: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'd0e57733-2fe9-4829-b6e5-dcaf2ff92937'} Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. (HTTP 404) (Request-ID: req-a883f152-02e4-4b47-8f47-92a4deea654f) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:13:25.137162 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. Sep 16 14:13:25.144244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:25.149431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d223389-3fa3-4746-b160-61714b79fed8 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] Returning 404 to user: Volume d0e57733-2fe9-4829-b6e5-dcaf2ff92937 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:25.150616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d223389-3fa3-4746-b160-61714b79fed8 tempest-VolumesSnapshotsTestJSON-1468380391 tempest-VolumesSnapshotsTestJSON-1468380391-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937" status: 404 len: 109 microversion: 2.1 time: 0.739609 Sep 16 14:13:25.153357 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1775/3558] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:13:24 2022] GET /compute/v2.1/os-volumes/d0e57733-2fe9-4829-b6e5-dcaf2ff92937 => generated 109 bytes in 743 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:25.171030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:25.173140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:25.194872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:25.195485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:25.195944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:25.197180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:25.197859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:25.200604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:25.265021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:25.286667 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0cc5b036-3595-426b-99ef-dd85d8656be9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1218 microversion: 2.1 time: 0.312823 Sep 16 14:13:25.288456 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1784/3559] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:24 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1218 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:25.993866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:25.999129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:26.023244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:26.029688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:26.031795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:26.033457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:26.040244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:26.041411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:26.042507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:26.048341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4358a234-9d12-4c61-812f-1a663c1d10e8 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 0.889125 Sep 16 14:13:26.059041 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1776/3560] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:25 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:26.325304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:26.326335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:26.363710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:26.364850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:26.365503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:26.366572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:26.369227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:26.370040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:27.076280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:27.094617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d738e501-f05e-4129-b88f-55fbca0c332c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1274 microversion: 2.1 time: 0.773188 Sep 16 14:13:27.096679 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1777/3561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:26 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1274 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:13:27.109942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:27.112283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:27.130503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:27.131366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:27.132010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:27.133193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:27.133470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:27.136400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:27.158229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:27.226044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:27.794393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:27.812923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:27.818139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:27.820242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-702ef256-da55-4a30-aa74-6d7c03d96000 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1850 microversion: 2.42 time: 1.833700 Sep 16 14:13:27.823440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1785/3562] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:25 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1850 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:27.831607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f1a8f2d-d461-4e8b-9807-4ba7c312e533", "device": "/dev/xvdb"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:27.836264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:27.846965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:27.848631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:27.849366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:27.865575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:27.869539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:27.871797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:28.061037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:28.122702 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-33318f49-138d-4da5-940b-3aca9e2515f3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 1.022271 Sep 16 14:13:28.153657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1778/3563] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:27 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:28.176953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:28.178631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:28.192669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:28.194218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:28.195733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:28.197408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:28.199358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:28.201067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:28.369784 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a71898d4-08c5-4162-be1c-f83f72e27bf2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "POST /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544185 Sep 16 14:13:28.371578 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1786/3564] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:13:27 2022] POST /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:28.413786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:28.430219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98bd6337-c273-4e2a-a1af-0eafd4414a5c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1272 microversion: 2.1 time: 0.270606 Sep 16 14:13:28.431441 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1779/3565] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:28 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:28.875813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:28.877025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:28.902825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:28.904001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:28.904666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:28.905611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:28.906300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:28.907882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:28.913968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:29.413284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3da1bf96-917f-405f-9422-b9feee42dec3 req-322bfde8-09e8-4692-bd9d-e1bb67cf7062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:29.445691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3da1bf96-917f-405f-9422-b9feee42dec3 req-322bfde8-09e8-4692-bd9d-e1bb67cf7062 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:29.446568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3da1bf96-917f-405f-9422-b9feee42dec3 req-322bfde8-09e8-4692-bd9d-e1bb67cf7062 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:29.447221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3da1bf96-917f-405f-9422-b9feee42dec3 req-322bfde8-09e8-4692-bd9d-e1bb67cf7062 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:29.466387 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3da1bf96-917f-405f-9422-b9feee42dec3 req-322bfde8-09e8-4692-bd9d-e1bb67cf7062 service nova] Creating event network-changed:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:13:29.480881 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3da1bf96-917f-405f-9422-b9feee42dec3 req-322bfde8-09e8-4692-bd9d-e1bb67cf7062 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.628962 Sep 16 14:13:29.482256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1787/3566] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:29.493191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:29.497357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:29.517162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:29.518028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:29.518731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:29.519681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:29.520351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:29.520978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:30.586183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:30.599646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:30.604219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:30.611615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c55f292-0409-450e-bb21-8eeb38b86e65 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1850 microversion: 2.42 time: 1.739680 Sep 16 14:13:30.616606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1780/3567] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:28 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1850 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:13:30.631118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:30.638768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:30.658812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:30.662345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:30.675047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:30.676235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:30.676835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:30.677381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:31.961148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:31.989083 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-146889b4-9966-48f9-aad6-b17ff086c35d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 2.504527 Sep 16 14:13:32.006259 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1788/3568] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:29 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:32.014358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:32.019714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:32.038229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:32.039394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:32.040094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:32.041251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:32.042066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:32.042840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:32.275005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:32.285811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa69068a-871c-4b25-a18d-49a6bb3c47d1 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 1.664008 Sep 16 14:13:32.290541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1781/3569] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:30 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:32.310460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-be4224c2-46bc-4536-8727-07a34c60201b req-652de8b8-5a28-40d5-b2f4-a852cc825ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78169dc-14a1-479e-b95f-6bab772aacce", "tag": "81116668-fcee-4dba-9d8f-17900ba2263a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:32.349819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-be4224c2-46bc-4536-8727-07a34c60201b req-652de8b8-5a28-40d5-b2f4-a852cc825ca7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:32.353278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-be4224c2-46bc-4536-8727-07a34c60201b req-652de8b8-5a28-40d5-b2f4-a852cc825ca7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:32.354140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-be4224c2-46bc-4536-8727-07a34c60201b req-652de8b8-5a28-40d5-b2f4-a852cc825ca7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:32.385563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-be4224c2-46bc-4536-8727-07a34c60201b req-652de8b8-5a28-40d5-b2f4-a852cc825ca7 service nova] Creating event network-changed:81116668-fcee-4dba-9d8f-17900ba2263a for instance c78169dc-14a1-479e-b95f-6bab772aacce on n-h2-858129-2 Sep 16 14:13:32.408650 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-be4224c2-46bc-4536-8727-07a34c60201b req-652de8b8-5a28-40d5-b2f4-a852cc825ca7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108011 Sep 16 14:13:32.409884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1782/3570] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:32.426787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:32.427723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:32.446379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:32.447322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:32.448007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:32.449133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:32.449870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:32.450649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:33.302294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:33.705961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:33.723907 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38edf3a4-929c-4628-89f3-e19b7e1b9029 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1590 microversion: 2.1 time: 1.715912 Sep 16 14:13:33.726640 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1789/3571] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:32 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1590 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:33.740616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-53e0913d-a53c-4c96-9234-91a47744b680 req-7e1cbdba-6f74-4b38-9e70-6211e1ced6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28da2ac1-41aa-4662-9e58-f77953c6e8b6", "tag": "2ca58b8f-9a7a-4d79-91e1-75dfad7504bc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:33.779056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:33.799789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:33.801378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:33.802838 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-998e7487-f203-4abf-bce4-a5c666b6be26 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1850 microversion: 2.42 time: 1.391572 Sep 16 14:13:33.803472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1783/3572] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:32 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1850 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:33.810735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-53e0913d-a53c-4c96-9234-91a47744b680 req-7e1cbdba-6f74-4b38-9e70-6211e1ced6df service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:33.817109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-53e0913d-a53c-4c96-9234-91a47744b680 req-7e1cbdba-6f74-4b38-9e70-6211e1ced6df service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:33.818131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-53e0913d-a53c-4c96-9234-91a47744b680 req-7e1cbdba-6f74-4b38-9e70-6211e1ced6df service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:33.824007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:33.824970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:33.862601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:33.863117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:33.863559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:33.864574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:33.865037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:33.865468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:33.906915 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-53e0913d-a53c-4c96-9234-91a47744b680 req-7e1cbdba-6f74-4b38-9e70-6211e1ced6df service nova] Creating event network-changed:2ca58b8f-9a7a-4d79-91e1-75dfad7504bc for instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 on n-h2-858129-2 Sep 16 14:13:33.925105 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-53e0913d-a53c-4c96-9234-91a47744b680 req-7e1cbdba-6f74-4b38-9e70-6211e1ced6df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195664 Sep 16 14:13:33.931026 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1790/3573] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:33.936134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:33.936856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:33.944333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:33.944832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:33.945263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:33.945976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:33.946453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:33.946879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:34.340678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:34.711595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:34.737355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1378cb8c-c5be-4ef5-ba77-a132cb8e5807 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 0.932769 Sep 16 14:13:34.741243 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1784/3574] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:33 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:34.747312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ea47387b-b0e0-4dbf-a9cb-56b7255427e5 req-a6ed8e03-25e1-4b65-9586-6eba221d4892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "6b9c8884-6bcf-4183-b37c-a27f8e5836cc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:34.802715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea47387b-b0e0-4dbf-a9cb-56b7255427e5 req-a6ed8e03-25e1-4b65-9586-6eba221d4892 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:34.813030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea47387b-b0e0-4dbf-a9cb-56b7255427e5 req-a6ed8e03-25e1-4b65-9586-6eba221d4892 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:34.819477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea47387b-b0e0-4dbf-a9cb-56b7255427e5 req-a6ed8e03-25e1-4b65-9586-6eba221d4892 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:34.884698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ea47387b-b0e0-4dbf-a9cb-56b7255427e5 req-a6ed8e03-25e1-4b65-9586-6eba221d4892 service nova] Creating event network-changed:6b9c8884-6bcf-4183-b37c-a27f8e5836cc for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:13:34.904998 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ea47387b-b0e0-4dbf-a9cb-56b7255427e5 req-a6ed8e03-25e1-4b65-9586-6eba221d4892 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161283 Sep 16 14:13:34.911385 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1785/3575] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:34.942592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:34.946758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:34.997683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:34.999888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:35.002213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:35.014817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:35.016240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:35.017476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:35.406934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:35.425064 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d24c4643-4ef6-405d-ba70-819be1e9f32d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 1.492916 Sep 16 14:13:35.440949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1791/3576] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:33 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:35.781957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:35.783278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:35.802673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:35.803702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:35.804396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:35.805476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:35.806274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:35.807013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:36.201331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:36.231966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:36.247460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:36.250227 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bb2d8519-c104-4aa0-b78b-50fb6d1b63a3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1838 microversion: 2.42 time: 1.336719 Sep 16 14:13:36.252224 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1786/3577] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:34 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1838 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:36.454507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:36.455645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:36.479119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:36.480101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:36.481351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:36.483821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:36.492891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:36.493888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:36.795439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:36.810109 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5882b9ee-368b-4b9e-831f-110c8e11650c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 1.029330 Sep 16 14:13:36.813721 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1792/3578] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:35 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:13:37.033731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:37.068036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-586d9ee9-52a6-4a64-bb5c-97f1e6f69212 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 0.618991 Sep 16 14:13:37.087595 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1787/3579] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:36 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:13:37.295577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:37.296096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:37.312029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:37.313779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:37.313779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:37.314230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:37.314919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:37.315866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:37.451164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-73cb97f3-5d24-4006-aad1-0c782aabe9a2 req-72d6b68c-0678-4ef3-ada7-a9c529b3383f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c68eb4-4905-44be-8e97-db747fa50b6e", "tag": "06e2eac2-4a5a-4d39-bcaf-7ec76b5306c7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:37.470421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-73cb97f3-5d24-4006-aad1-0c782aabe9a2 req-72d6b68c-0678-4ef3-ada7-a9c529b3383f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:37.471240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-73cb97f3-5d24-4006-aad1-0c782aabe9a2 req-72d6b68c-0678-4ef3-ada7-a9c529b3383f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:37.483230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-73cb97f3-5d24-4006-aad1-0c782aabe9a2 req-72d6b68c-0678-4ef3-ada7-a9c529b3383f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:37.509148 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-73cb97f3-5d24-4006-aad1-0c782aabe9a2 req-72d6b68c-0678-4ef3-ada7-a9c529b3383f service nova] Creating event network-changed:06e2eac2-4a5a-4d39-bcaf-7ec76b5306c7 for instance 30c68eb4-4905-44be-8e97-db747fa50b6e on n-h1-858129-2 Sep 16 14:13:37.514986 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-73cb97f3-5d24-4006-aad1-0c782aabe9a2 req-72d6b68c-0678-4ef3-ada7-a9c529b3383f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067725 Sep 16 14:13:37.516314 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1788/3580] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:37.868893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:37.876276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:37.908207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:37.909269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:37.914029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:37.915488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:37.917860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:37.924885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:38.694131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:38.713244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:38.716783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:38.725326 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-adbaf2a2-9890-476f-9135-746c2f137d7f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1859 microversion: 2.42 time: 1.433740 Sep 16 14:13:38.738450 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1793/3581] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:37 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1859 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:13:38.738450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:38.738450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:38.754177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:38.754700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:38.755134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:38.755872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:38.759757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:38.760259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:38.811187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:38.821781 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a9c9874-d89d-416a-9d0f-efeff077a485 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 0.967519 Sep 16 14:13:38.822421 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1789/3582] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:37 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:39.413676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:39.426637 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4312e37-9d70-42da-aedc-93df801019eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 0.698409 Sep 16 14:13:39.427254 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1794/3583] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:38 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:39.544956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7b7560fd-43c2-4917-80a1-5faa89a0b87e req-bc1dd9fb-83d0-4197-aece-3c4a15d9160f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "2aff764a-ab44-46a9-85e7-d790dbbf7730"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:39.561304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7b7560fd-43c2-4917-80a1-5faa89a0b87e req-bc1dd9fb-83d0-4197-aece-3c4a15d9160f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:39.565335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7b7560fd-43c2-4917-80a1-5faa89a0b87e req-bc1dd9fb-83d0-4197-aece-3c4a15d9160f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:39.568871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7b7560fd-43c2-4917-80a1-5faa89a0b87e req-bc1dd9fb-83d0-4197-aece-3c4a15d9160f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:39.594210 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7b7560fd-43c2-4917-80a1-5faa89a0b87e req-bc1dd9fb-83d0-4197-aece-3c4a15d9160f service nova] Creating event network-changed:2aff764a-ab44-46a9-85e7-d790dbbf7730 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:13:39.604893 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7b7560fd-43c2-4917-80a1-5faa89a0b87e req-bc1dd9fb-83d0-4197-aece-3c4a15d9160f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063591 Sep 16 14:13:39.606261 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1790/3584] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:39.756906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:39.757523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:39.770162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:39.770826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:39.771129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:39.771881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:39.772349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:39.775669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:39.879809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:39.880543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:39.884610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:39.896223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:39.896737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:39.897186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:39.897936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:39.898446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:39.898883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:41.230275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:41.239872 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27af71b5-91eb-4492-baf4-e994d50876d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 1.364715 Sep 16 14:13:41.244713 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1791/3585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:39 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:41.250081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:41.255925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:41.274538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:41.275153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:41.275717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:41.276631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:41.280397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:41.280964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:41.298142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:41.339199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:41.343698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:41.346589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0cb5efec-de05-4173-9ccf-86322e6f8713 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1859 microversion: 2.42 time: 1.593381 Sep 16 14:13:41.348729 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1795/3586] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:39 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1859 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:41.359164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f8a5f163-67ac-4bad-a812-01c3f97e7ec2 req-152d736c-cf59-4da5-b0f1-2afbcc085db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78169dc-14a1-479e-b95f-6bab772aacce", "name": "network-vif-plugged", "status": "completed", "tag": "81116668-fcee-4dba-9d8f-17900ba2263a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:41.372682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f8a5f163-67ac-4bad-a812-01c3f97e7ec2 req-152d736c-cf59-4da5-b0f1-2afbcc085db4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:41.373530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f8a5f163-67ac-4bad-a812-01c3f97e7ec2 req-152d736c-cf59-4da5-b0f1-2afbcc085db4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:41.374172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f8a5f163-67ac-4bad-a812-01c3f97e7ec2 req-152d736c-cf59-4da5-b0f1-2afbcc085db4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:41.402187 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f8a5f163-67ac-4bad-a812-01c3f97e7ec2 req-152d736c-cf59-4da5-b0f1-2afbcc085db4 service nova] Creating event network-vif-plugged:81116668-fcee-4dba-9d8f-17900ba2263a for instance c78169dc-14a1-479e-b95f-6bab772aacce on n-h2-858129-2 Sep 16 14:13:41.416068 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f8a5f163-67ac-4bad-a812-01c3f97e7ec2 req-152d736c-cf59-4da5-b0f1-2afbcc085db4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064511 Sep 16 14:13:41.417051 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1796/3587] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:41.528789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:41.541567 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7618b33-2000-48d6-a9aa-83e57aa8e249 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 0.294910 Sep 16 14:13:41.559703 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1792/3588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:41 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:42.026495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d45c1230-2d00-437e-a5d9-69c9894c9030 req-869f088e-81ae-497f-8d36-f95dad0e0479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "a16fb69b-f2c7-4b30-905c-5df0a528462b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:42.046387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d45c1230-2d00-437e-a5d9-69c9894c9030 req-869f088e-81ae-497f-8d36-f95dad0e0479 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.047254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d45c1230-2d00-437e-a5d9-69c9894c9030 req-869f088e-81ae-497f-8d36-f95dad0e0479 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.048599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d45c1230-2d00-437e-a5d9-69c9894c9030 req-869f088e-81ae-497f-8d36-f95dad0e0479 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.064167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d45c1230-2d00-437e-a5d9-69c9894c9030 req-869f088e-81ae-497f-8d36-f95dad0e0479 service nova] Creating event network-changed:a16fb69b-f2c7-4b30-905c-5df0a528462b for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:13:42.070613 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d45c1230-2d00-437e-a5d9-69c9894c9030 req-869f088e-81ae-497f-8d36-f95dad0e0479 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050221 Sep 16 14:13:42.071326 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1797/3589] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:42.288912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:42.291325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:42.308470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.309694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.311774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.314324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.316140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.317199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.414157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:42.415633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:42.429472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.431100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.432294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.435524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.436589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.437520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.845898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:42.867828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:42.869486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:42.871462 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aafdbf18-b204-42c8-b4c7-7d8859539437 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.468091 Sep 16 14:13:42.887567 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1798/3590] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:42 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:42.892124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:42.896116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:42.899115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:42.908056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.908925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.909546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.910843 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c1191fb-e362-4bf3-b603-d3d913a3ad53 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1308 microversion: 2.1 time: 0.632716 Sep 16 14:13:42.911085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:42.911405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:42.911846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:42.913542 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1793/3591] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:42 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1308 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:43.410095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:43.420751 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dd0890b4-04c7-426c-918b-22ce8d5a3227 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 0.531784 Sep 16 14:13:43.423852 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1799/3592] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:42 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:43.920929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:43.921959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:43.932197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:43.933983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:43.934619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:43.935706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:43.936279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:43.936789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:43.956676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:43.960693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:44.002730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:44.005734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:44.007151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:44.011756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:44.012746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:44.020136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:45.475024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:45.499961 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-293c2816-4414-4413-b803-517dc0a3dc5d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1490 microversion: 2.1 time: 1.552909 Sep 16 14:13:45.508378 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1800/3593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:43 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1490 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:45.527534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:45.529147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:45.553849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:45.555247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:45.558928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:45.559977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:45.560612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:45.561289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:45.925081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:45.978800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:45.985783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:45.995722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46dfc4ca-f2e1-4257-8169-a6c3e6f7eb4f tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 2.084678 Sep 16 14:13:46.020374 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1794/3594] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:43 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:46.044252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:46.045990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:46.062985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:46.064249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:46.065333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:46.066941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:46.068034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:46.069051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:46.716454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:46.743316 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93defc33-d245-4610-85d4-2a61ca2fb44e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 1.231551 Sep 16 14:13:46.752625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1801/3595] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:45 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:47.033149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:47.087980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:47.090250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:47.100381 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c989674b-5e11-486a-807f-adf1f9edd0ce tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1490 microversion: 2.1 time: 1.077298 Sep 16 14:13:47.119342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1795/3596] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:46 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1490 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:47.132394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:47.138731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:47.143720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:47.196796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:47.205929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:47.206886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:47.211429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:47.214735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:47.307698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:47.316980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:47.320037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:47.322471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:47.347029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:47.354449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:47.510957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:48.276503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:48.296171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:48.300076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:48.304975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:48.308036 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d40bb06-3360-4ac4-a73b-f817fffb9324 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.245655 Sep 16 14:13:48.310642 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1802/3597] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:47 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:48.323083 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94551a88-6ce1-4f61-9974-81d8b6430305 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1490 microversion: 2.1 time: 1.174158 Sep 16 14:13:48.326420 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1796/3598] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:47 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1490 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:48.331734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-43e72454-91cf-487c-8ff4-70ef98ae6056 req-a7d5ed61-4552-4206-9939-2280a630f7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:48.340227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3a3ab25a-521f-48c1-9313-490f97f36856 req-b9711c76-dc21-404d-9e80-583c84325ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c68eb4-4905-44be-8e97-db747fa50b6e", "name": "network-vif-plugged", "status": "completed", "tag": "06e2eac2-4a5a-4d39-bcaf-7ec76b5306c7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:48.363771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3a3ab25a-521f-48c1-9313-490f97f36856 req-b9711c76-dc21-404d-9e80-583c84325ee9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.365624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3a3ab25a-521f-48c1-9313-490f97f36856 req-b9711c76-dc21-404d-9e80-583c84325ee9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.367326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3a3ab25a-521f-48c1-9313-490f97f36856 req-b9711c76-dc21-404d-9e80-583c84325ee9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.373373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-43e72454-91cf-487c-8ff4-70ef98ae6056 req-a7d5ed61-4552-4206-9939-2280a630f7c5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.374268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-43e72454-91cf-487c-8ff4-70ef98ae6056 req-a7d5ed61-4552-4206-9939-2280a630f7c5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.375111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-43e72454-91cf-487c-8ff4-70ef98ae6056 req-a7d5ed61-4552-4206-9939-2280a630f7c5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.399103 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3a3ab25a-521f-48c1-9313-490f97f36856 req-b9711c76-dc21-404d-9e80-583c84325ee9 service nova] Creating event network-vif-plugged:06e2eac2-4a5a-4d39-bcaf-7ec76b5306c7 for instance 30c68eb4-4905-44be-8e97-db747fa50b6e on n-h1-858129-2 Sep 16 14:13:48.404807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-43e72454-91cf-487c-8ff4-70ef98ae6056 req-a7d5ed61-4552-4206-9939-2280a630f7c5 service nova] Creating event network-changed:a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:13:48.412051 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3a3ab25a-521f-48c1-9313-490f97f36856 req-b9711c76-dc21-404d-9e80-583c84325ee9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080329 Sep 16 14:13:48.414284 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1797/3599] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:48.419933 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-43e72454-91cf-487c-8ff4-70ef98ae6056 req-a7d5ed61-4552-4206-9939-2280a630f7c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106520 Sep 16 14:13:48.421413 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1803/3600] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:48.430429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:48.433023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:48.434060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:48.434504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:48.446393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.447506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.448251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.449565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.450714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.451465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.453771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.457641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.460115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.462143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.463446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.465628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.526678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:13:48.688522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fce04d79-87ad-4e09-a73e-593c49bf42e3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 204 len: 0 microversion: 2.1 time: 0.264648 Sep 16 14:13:48.695387 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1804/3601] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:13:48 2022] DELETE /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:13:48.701877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:48.703014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:48.713291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.714382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.715274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:48.716483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:48.717351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:48.717929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:49.394647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:49.424263 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75cf1bf8-9742-449b-a13c-96c63853d9dc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 1.008493 Sep 16 14:13:49.430266 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1798/3602] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:48 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:49.455047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:49.458115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:49.487633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:49.489584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:49.493150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:49.495340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:49.496485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:49.497508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:49.691681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:49.706364 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f845dba9-4d4f-41fb-a782-f055ec0f95c2 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1496 microversion: 2.1 time: 1.008846 Sep 16 14:13:49.708832 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1805/3603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:48 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1496 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:49.722192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:49.726423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:49.728887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:49.746316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:49.747063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:49.747787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:49.748807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:49.749505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:49.750032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:50.284862 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-592ec570-9406-4786-9a9f-b4ae32a452b6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1858 microversion: 2.1 time: 0.848325 Sep 16 14:13:50.286779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1799/3604] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:49 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1858 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:50.330981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858129-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:50.338058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:50.358498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:50.360769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:50.362109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:50.365053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:50.366368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:50.367545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:50.423235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:50.441238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lazy-loading 'flavor' on Instance uuid e8d141f3-2891-487a-861e-ccaf4b2d5cbe {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:13:50.475845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Going to try to live migrate instance to n-h1-858129-2 {{(pid=128642) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:13:50.643670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:50.662309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:50.665660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:50.667745 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26808e4a-5f59-4d9b-8dc2-1020be3a4e5b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.953818 Sep 16 14:13:50.668877 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1806/3605] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:49 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:50.688450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:50.690049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:50.705791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:50.711556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:50.713519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:50.714869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:50.721103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:50.722537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:52.123791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:52.151380 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67100c5a-2f51-4109-b3da-8117404222ff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1314 microversion: 2.1 time: 1.480699 Sep 16 14:13:52.155369 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1807/3606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:50 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1314 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:52.175253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:52.187832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:52.201500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:52.203067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:52.204098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:52.205598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:52.206717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:52.207545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:52.804906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:52.822084 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e91df9f-00f9-4c7f-a1df-0b24733a9927 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1496 microversion: 2.1 time: 0.663876 Sep 16 14:13:52.823896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1808/3607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:52 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1496 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:52.835558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:52.836926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:52.848519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:52.849813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:52.851117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:52.853221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:52.854273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:52.856148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:53.443118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:53.487357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:53.496797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:53.504551 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5431807-ccd1-4a58-8df0-52f0b19a5d04 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.677563 Sep 16 14:13:53.506772 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1809/3608] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:52 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:53.530860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c8bf0d7c-3fec-4166-968f-61dfe5f1350c req-2bb326ee-e91d-4c2e-a715-9f436e573ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "b78ea35a-15e5-4d5c-87e9-1d548568d455"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:53.570608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8bf0d7c-3fec-4166-968f-61dfe5f1350c req-2bb326ee-e91d-4c2e-a715-9f436e573ec1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:53.579726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8bf0d7c-3fec-4166-968f-61dfe5f1350c req-2bb326ee-e91d-4c2e-a715-9f436e573ec1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:53.580266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8bf0d7c-3fec-4166-968f-61dfe5f1350c req-2bb326ee-e91d-4c2e-a715-9f436e573ec1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:53.597004 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c8bf0d7c-3fec-4166-968f-61dfe5f1350c req-2bb326ee-e91d-4c2e-a715-9f436e573ec1 service nova] Creating event network-changed:b78ea35a-15e5-4d5c-87e9-1d548568d455 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:13:53.605049 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c8bf0d7c-3fec-4166-968f-61dfe5f1350c req-2bb326ee-e91d-4c2e-a715-9f436e573ec1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094648 Sep 16 14:13:53.606756 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1810/3609] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:53.614278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:53.616368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:53.624304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:53.625195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:53.627284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:53.628324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:53.629066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:53.629715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:54.347795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:54.379650 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d05c0af4-aa85-4b4e-89c6-84a61039a1e4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1501 microversion: 2.1 time: 0.770822 Sep 16 14:13:54.381136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1811/3610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:53 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1501 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:54.408136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:54.409297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:54.444471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:54.445448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:54.445970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:54.447388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:54.448230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:54.449020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:54.797085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:54.848685 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-defbd604-a70e-45fb-8edd-35e675337960 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1454 microversion: 2.1 time: 0.465004 Sep 16 14:13:54.849673 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1812/3611] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:54 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1454 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:54.861319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:54.863308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:54.895705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:54.898520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:54.900181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:54.901922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:54.903643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:54.904793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:55.042616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5bc278e6-2922-4b2e-b881-8c894e139109 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/action" status: 202 len: 0 microversion: 2.1 time: 4.720680 Sep 16 14:13:55.043654 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1800/3612] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:13:50 2022] POST /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/action => generated 0 bytes in 4723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:13:55.061828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:55.066621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:55.090323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:55.092662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:55.093885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:55.097556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:55.098318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:55.099071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:55.152749 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-100f0ea1-c3af-4edb-ad16-2481f7b6332f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e/action" status: 202 len: 0 microversion: 2.1 time: 0.297139 Sep 16 14:13:55.170933 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1813/3613] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:13:54 2022] POST /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:13:55.200015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:55.201975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:55.237936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:55.238859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:55.239763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:55.240880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:55.241697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:55.242483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:55.942160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:55.964430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:55.971556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:55.972994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:55.977695 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0984b38e-737a-4da7-bb71-3f7dce15b404 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.920767 Sep 16 14:13:55.978621 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1801/3614] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:55 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:55.993697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:55.994823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:56.001634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f0f54009-7e52-4964-9945-2194b0fdc761 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.825188 Sep 16 14:13:56.006237 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1814/3615] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:55 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:56.022087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0b79beb2-9efa-4fed-884c-1686c02a44dd req-87259d08-f51c-48be-a82e-a6f722e3d30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78169dc-14a1-479e-b95f-6bab772aacce", "name": "network-vif-deleted", "tag": "81116668-fcee-4dba-9d8f-17900ba2263a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:56.032664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.033195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.033644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.037671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.039914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.041302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.050396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0b79beb2-9efa-4fed-884c-1686c02a44dd req-87259d08-f51c-48be-a82e-a6f722e3d30c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.051268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0b79beb2-9efa-4fed-884c-1686c02a44dd req-87259d08-f51c-48be-a82e-a6f722e3d30c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.051976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0b79beb2-9efa-4fed-884c-1686c02a44dd req-87259d08-f51c-48be-a82e-a6f722e3d30c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.073420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0b79beb2-9efa-4fed-884c-1686c02a44dd req-87259d08-f51c-48be-a82e-a6f722e3d30c service nova] Creating event network-vif-deleted:81116668-fcee-4dba-9d8f-17900ba2263a for instance c78169dc-14a1-479e-b95f-6bab772aacce on n-h2-858129-2 Sep 16 14:13:56.088496 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0b79beb2-9efa-4fed-884c-1686c02a44dd req-87259d08-f51c-48be-a82e-a6f722e3d30c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079861 Sep 16 14:13:56.089126 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1815/3616] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:56.097720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:56.104020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:56.141433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.142479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.142955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.143719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.144189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.146309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.211535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.212325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.212954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.213602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'fault' on Instance uuid c78169dc-14a1-479e-b95f-6bab772aacce {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:13:56.462658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:56.478322 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70a14050-5e2d-4de4-bb7d-5cddf625efdd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 200 len: 1298 microversion: 2.1 time: 0.387554 Sep 16 14:13:56.511212 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1816/3617] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:56 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 1298 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:56.822007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:56.875842 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e51a342-5d4d-4988-beda-c384b4529f3d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1486 microversion: 2.1 time: 0.894154 Sep 16 14:13:56.876257 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1802/3618] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:55 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1486 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:56.933677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:56.938603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:56.980786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.984812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.987076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:56.988076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:56.991472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:56.992342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:57.008275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:57.008916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:57.022005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:57.022892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:57.023549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:57.024944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:57.025670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:57.026307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:57.055085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:13:57.071542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:13:57.274425 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-230ddf46-add4-4d63-9b0e-a7bb30b10731 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 204 len: 0 microversion: 2.1 time: 0.352938 Sep 16 14:13:57.276596 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1817/3619] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:13:56 2022] DELETE /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:13:57.307212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:57.309247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:57.336987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:57.340947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:57.342349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:57.345007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:57.346377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:57.347443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:57.861603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:57.890178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:57.947712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:57.960113 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3c9c7319-65b3-4a97-8b4c-e7246a60b931 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.680517 Sep 16 14:13:57.961293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1818/3620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:57 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:57.961883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:57.969898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59afd1b6-34b3-4c44-adb4-ee630365a400 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.965973 Sep 16 14:13:57.973462 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1803/3621] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:57 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:13:57.982013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:57.983171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:57.988464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:57.991705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:58.006205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.007088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.007317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.007825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.009023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.009643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.010376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.011125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.012153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.014302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.015260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.016615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.055905 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce HTTP/1.1 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c78169dc-14a1-479e-b95f-6bab772aacce'} Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:58.059915 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:13:58.070967 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:13:58.070967 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:13:58.070967 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:13:58.070967 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:13:58.070967 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:13:58.070967 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:13:58.076811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:13:58.076811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-23229f5e-f2e7-4a0a-bb34-043bad771a49 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 404 len: 111 microversion: 2.1 time: 0.099936 Sep 16 14:13:58.077954 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1804/3622] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:57 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:13:58.095252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:58.096582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:58.110842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.112187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.113144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.115359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.116116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.116569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.174304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:13:58.270054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:58.294884 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e95feb7-2a48-4ee3-bfe1-873c4fbca5eb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1492 microversion: 2.1 time: 0.320229 Sep 16 14:13:58.304806 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1819/3623] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:57 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1492 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:58.318429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1c233806-9dec-4a55-b57c-76eac446423b req-a863a2e0-72c0-423f-95bd-d1a3e0b043d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "0974b5ba-47a8-4c90-9f21-37e8ba95c23e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:13:58.347852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1c233806-9dec-4a55-b57c-76eac446423b req-a863a2e0-72c0-423f-95bd-d1a3e0b043d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.348342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1c233806-9dec-4a55-b57c-76eac446423b req-a863a2e0-72c0-423f-95bd-d1a3e0b043d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.348769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1c233806-9dec-4a55-b57c-76eac446423b req-a863a2e0-72c0-423f-95bd-d1a3e0b043d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.378052 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1c233806-9dec-4a55-b57c-76eac446423b req-a863a2e0-72c0-423f-95bd-d1a3e0b043d6 service nova] Creating event network-changed:0974b5ba-47a8-4c90-9f21-37e8ba95c23e for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:13:58.388021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1c233806-9dec-4a55-b57c-76eac446423b req-a863a2e0-72c0-423f-95bd-d1a3e0b043d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081534 Sep 16 14:13:58.393650 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1820/3624] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:13:58.471967 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6eff41ad-bdc1-46e1-8868-360dab6d3d7e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 204 len: 0 microversion: 2.1 time: 0.386509 Sep 16 14:13:58.479834 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1805/3625] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:13:58 2022] DELETE /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:13:58.488145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:58.489294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:58.508666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.513602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.514523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.522640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:58.523139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:58.523669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:58.989661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:58.991200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:59.006513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:59.007281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:59.007928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:59.008892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:59.009569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:59.010192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:59.590774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:59.615153 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c8fc47c-2041-411e-b397-260e9e09241e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1496 microversion: 2.1 time: 1.131712 Sep 16 14:13:59.616997 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1821/3626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:58 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1496 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:59.631820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:59.634299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:59.651843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:59.653766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:59.655320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:59.659969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:59.661336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:59.662453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:59.768332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:13:59.806234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bfb77e14-d37d-4ec1-acf8-9503e4de3eff tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.821158 Sep 16 14:13:59.809019 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1806/3627] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:58 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:13:59.832009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:13:59.833557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:13:59.854349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:59.857652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:59.859137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:13:59.865278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:13:59.868310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:13:59.869606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:00.654290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:00.669059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6731cdd-a8d3-4c13-8c87-a7a63aa107d3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1492 microversion: 2.1 time: 0.852844 Sep 16 14:14:00.669963 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1807/3628] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:13:59 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1492 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:00.697009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f99bec30-a198-4561-919c-8212805de56a req-84a15264-6d16-4833-9b8c-dcb6261b7faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "d8a97c77-7fda-479d-aba9-21750aa99c16"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:00.717266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f99bec30-a198-4561-919c-8212805de56a req-84a15264-6d16-4833-9b8c-dcb6261b7faa service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:00.717807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f99bec30-a198-4561-919c-8212805de56a req-84a15264-6d16-4833-9b8c-dcb6261b7faa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:00.718264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f99bec30-a198-4561-919c-8212805de56a req-84a15264-6d16-4833-9b8c-dcb6261b7faa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:00.748835 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f99bec30-a198-4561-919c-8212805de56a req-84a15264-6d16-4833-9b8c-dcb6261b7faa service nova] Creating event network-changed:d8a97c77-7fda-479d-aba9-21750aa99c16 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:14:00.769615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f99bec30-a198-4561-919c-8212805de56a req-84a15264-6d16-4833-9b8c-dcb6261b7faa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074554 Sep 16 14:14:00.770881 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1808/3629] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:00.786816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:00.787986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:00.809189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:00.810010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:00.812430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:00.813951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:00.816937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:00.821177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:01.095753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:01.169906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:01.185679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:01.198158 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82764189-9db3-4a96-91ac-6388d69acdaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.569170 Sep 16 14:14:01.199962 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1822/3630] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:13:59 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:01.238863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:01.243191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:01.282169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:01.289280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:01.291834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:01.300974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:01.312186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:01.316699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.214187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:02.234783 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6344a5f3-8791-468c-845b-af90f9858976 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1496 microversion: 2.1 time: 1.462274 Sep 16 14:14:02.235447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1809/3631] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:00 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1496 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:02.251814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-38022eb5-f3c8-4c64-866b-7eb0e7fbe124 req-d58a0b18-3aea-4fe3-b8ef-88eb84ce006e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c68eb4-4905-44be-8e97-db747fa50b6e", "name": "network-vif-deleted", "tag": "06e2eac2-4a5a-4d39-bcaf-7ec76b5306c7"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:02.277956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38022eb5-f3c8-4c64-866b-7eb0e7fbe124 req-d58a0b18-3aea-4fe3-b8ef-88eb84ce006e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:02.278480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38022eb5-f3c8-4c64-866b-7eb0e7fbe124 req-d58a0b18-3aea-4fe3-b8ef-88eb84ce006e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:02.278928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38022eb5-f3c8-4c64-866b-7eb0e7fbe124 req-d58a0b18-3aea-4fe3-b8ef-88eb84ce006e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.316733 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-38022eb5-f3c8-4c64-866b-7eb0e7fbe124 req-d58a0b18-3aea-4fe3-b8ef-88eb84ce006e service nova] Creating event network-vif-deleted:06e2eac2-4a5a-4d39-bcaf-7ec76b5306c7 for instance 30c68eb4-4905-44be-8e97-db747fa50b6e on n-h1-858129-2 Sep 16 14:14:02.322311 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-38022eb5-f3c8-4c64-866b-7eb0e7fbe124 req-d58a0b18-3aea-4fe3-b8ef-88eb84ce006e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083051 Sep 16 14:14:02.322975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1810/3632] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:02.342881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:02.343495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:02.356450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:02.368985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:02.369493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:02.369935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.370818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:02.371133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:02.371559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.372752 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d9182815-ea73-4a64-8b66-cdc08a03d253 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.165918 Sep 16 14:14:02.376924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1823/3633] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:01 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:02.387462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:02.388429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:02.409568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:02.410130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:02.412268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.414796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:02.415600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:02.419093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.480818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:02.482013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:02.485183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:02.492159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'fault' on Instance uuid 30c68eb4-4905-44be-8e97-db747fa50b6e {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:14:02.667325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:02.681836 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6da2b7d9-242e-40ef-8b45-45e9b5bc3e72 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 200 len: 1304 microversion: 2.1 time: 0.353776 Sep 16 14:14:02.698825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1811/3634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:02 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:03.262113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:03.262861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:03.277451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:03.278074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:03.278625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:03.279493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:03.280054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:03.280779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:03.684988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:03.716278 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9f651a7-ab7f-4bae-a4aa-b1d0d51ef5a5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1454 microversion: 2.1 time: 0.457641 Sep 16 14:14:03.722849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1812/3635] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:03 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1454 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:03.746911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:03.748275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:03.773267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:03.774161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:03.775073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:03.778853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:03.780474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:03.782311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:04.431247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:04.468080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:04.479850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:04.481942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-116fde8d-81f0-48d5-9bb3-a1195191889c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 2.102959 Sep 16 14:14:04.518918 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1824/3636] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:02 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:04.542204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:04.559050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:04.573277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:04.574923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:04.576229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:04.577729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:04.579447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:04.580704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:04.614149 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e HTTP/1.1 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '30c68eb4-4905-44be-8e97-db747fa50b6e'} Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:04.619575 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:14:04.633126 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:14:04.640697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:14:04.640697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2dfde030-63c6-4a65-8fb3-aa6996948c0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 404 len: 111 microversion: 2.1 time: 0.116286 Sep 16 14:14:04.651876 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1825/3637] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:04 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:14:04.680894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2da1f5aa-8e7f-453a-a9e9-b84155124558 req-dade4d94-36f8-4562-a38a-9d0fa118b3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0737b8b6-face-435b-b259-34523816febb", "name": "network-vif-deleted", "tag": "ffbf4812-c86b-45ae-86c0-8b613cec19a7"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:04.749723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2da1f5aa-8e7f-453a-a9e9-b84155124558 req-dade4d94-36f8-4562-a38a-9d0fa118b3ec service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:04.753687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2da1f5aa-8e7f-453a-a9e9-b84155124558 req-dade4d94-36f8-4562-a38a-9d0fa118b3ec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:04.754616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2da1f5aa-8e7f-453a-a9e9-b84155124558 req-dade4d94-36f8-4562-a38a-9d0fa118b3ec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:04.802743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:04.837976 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2da1f5aa-8e7f-453a-a9e9-b84155124558 req-dade4d94-36f8-4562-a38a-9d0fa118b3ec service nova] Creating event network-vif-deleted:ffbf4812-c86b-45ae-86c0-8b613cec19a7 for instance 0737b8b6-face-435b-b259-34523816febb on n-h2-858129-2 Sep 16 14:14:04.849227 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab050fb6-0d32-4163-8832-b472a91828a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.120277 Sep 16 14:14:04.854657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1813/3638] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:03 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:04.875286 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2da1f5aa-8e7f-453a-a9e9-b84155124558 req-dade4d94-36f8-4562-a38a-9d0fa118b3ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204141 Sep 16 14:14:04.876698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:04.878608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:04.878952 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1826/3639] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:04.898061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:04.900127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:04.901409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:04.903296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:04.906279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:04.910536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:05.033893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:05.035546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:05.036652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:05.037793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'fault' on Instance uuid 0737b8b6-face-435b-b259-34523816febb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:14:05.044582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:05.084442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-220451696", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:05.186897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:14:05.195785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:05.210671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-869cba69-ec4c-4516-97ca-d424d8ed4d1f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 200 len: 1298 microversion: 2.1 time: 0.352546 Sep 16 14:14:05.235335 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1814/3640] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:04 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 1298 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:05.535780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:05.537183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:05.567455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:05.567985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:05.568653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:05.569675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:05.570667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:05.571535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:06.318515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:06.333895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:06.336846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:06.338468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77e03f7f-db11-4866-89ae-358c0b1f0106 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.808072 Sep 16 14:14:06.339646 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1815/3641] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:05 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:06.348243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:06.349384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:06.359758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:06.360560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:06.361555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:06.363272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:06.364026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:06.365191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:06.863073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:14:06.863820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:14:06.864908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:14:06.865630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:14:06.866360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:14:06.911742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:06.912616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:06.913378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:06.920461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:06.921438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:06.922777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:06.995563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:14:07.010189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:14:07.069659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:14:07.077253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:14:07.213982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:07.236686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b650d14-43b2-42cd-bec8-7d3a058b11cb tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.893341 Sep 16 14:14:07.238223 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1816/3642] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:06 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:07.256073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:07.263408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:07.269493 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-380e5017-294d-4db1-b923-5c7e7435d092 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190813 Sep 16 14:14:07.279173 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1827/3643] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:14:07.296881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:07.305314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:07.308250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4192037b-d164-4608-9a99-d12311ec3d8b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:07.308981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:07.310565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:07.312503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:07.314544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4192037b-d164-4608-9a99-d12311ec3d8b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:07.321841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:07.387430 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb HTTP/1.1 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0737b8b6-face-435b-b259-34523816febb'} Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:07.398649 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:07.403736 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:07.403736 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:07.403736 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:14:07.403736 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:14:07.403736 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:14:07.403736 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:07.404393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:14:07.405180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ff18aa2-afea-4b37-b202-34cfc8e24a33 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 404 len: 111 microversion: 2.1 time: 0.164364 Sep 16 14:14:07.407788 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1817/3644] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:07 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:14:07.426190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:07.429520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:07.463966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:07.466540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:07.467996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:07.469909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:07.472329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:07.473133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:07.498599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4192037b-d164-4608-9a99-d12311ec3d8b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:07.526350 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4192037b-d164-4608-9a99-d12311ec3d8b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1214 microversion: 2.1 time: 0.235094 Sep 16 14:14:07.543512 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1828/3645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:07 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:07.769206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-290153451", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:07.933367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:14:08.492124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:08.528363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:08.534464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:08.536856 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1e5286d-8e08-4d4f-91f9-e4dcee712bfa tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.127565 Sep 16 14:14:08.538126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1818/3646] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:07 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:08.563306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:08.564490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:08.601038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:08.601976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:08.606286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:08.608368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:08.610909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:08.612039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:09.638207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:09.679804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5e5346e-faf9-43fe-a784-45cef5177508 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.128297 Sep 16 14:14:09.682941 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1819/3647] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:08 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:09.705894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:09.707575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:09.731774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:09.733247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:09.734382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:09.737759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:09.740785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:09.743460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:09.944998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:09.986701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1af65c66-702f-485b-a116-4cc334ded2e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1266 microversion: 2.1 time: 0.290505 Sep 16 14:14:09.988371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1820/3648] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:09 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:10.008279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:10.009859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:10.039571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:10.042743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:10.047759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:10.048852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:10.067978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:10.069134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:10.070192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:11.448209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:14:11.449328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:14:11.451693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:14:11.454684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:14:11.458789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:14:11.461107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:11.497119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:11.499411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:11.502732 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2341b1e0-376a-4387-9b76-68d6d473d970 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.511477 Sep 16 14:14:11.503761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:11.504888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:11.505765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1821/3649] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:09 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:11.506473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:11.508234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:11.509715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:11.511349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:11.517478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:11.523149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:11.536185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:11.545432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:11.546322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:11.547910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:11.548642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:11.549354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:11.596791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:14:11.619687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:14:11.657462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:14:11.664780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:14:11.821542 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af166d58-ed1c-432c-b3f6-6f03cef9c9e0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.065819 Sep 16 14:14:11.838925 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1829/3650] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:14:11.862899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:11.864379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:11.894095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:11.894939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:11.895743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:11.897037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:11.897873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:11.902356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:12.166163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:12.188496 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b97f7b43-bc31-44e4-a177-a8542e8d1508 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1272 microversion: 2.1 time: 0.350497 Sep 16 14:14:12.191369 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1830/3651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:11 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1272 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:12.202802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:12.209687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0146f53f-3cca-4bea-bb13-48312b8192e4 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.701789 Sep 16 14:14:12.222647 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1822/3652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:11 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:12.241523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8abb9a39-166e-49c3-87d2-a797d073fe0a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:12.243015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8abb9a39-166e-49c3-87d2-a797d073fe0a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:12.469420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8abb9a39-166e-49c3-87d2-a797d073fe0a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:12.485679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8abb9a39-166e-49c3-87d2-a797d073fe0a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1208 microversion: 2.1 time: 0.267730 Sep 16 14:14:12.486620 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1831/3653] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:12 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1208 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:12.567191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:12.569550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:12.595999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:12.597355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:12.598432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:12.600126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:12.601234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:12.602347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:13.230091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:13.232623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:13.256547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:13.257058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:13.257500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:13.258342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:13.258846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:13.259278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:13.326893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:13.345109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:13.361043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:13.362682 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0496e25-9bdf-4688-8727-cd6102d37b03 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.809558 Sep 16 14:14:13.364399 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1823/3654] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:12 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:13.370021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:13.370954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:13.377740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:13.378951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:13.379736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:13.380649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:13.381301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:13.381935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:14.083504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:14.096818 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f8815ef-4da5-4ec8-ad45-29952aa0a021 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.870519 Sep 16 14:14:14.097431 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1832/3655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:13 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:14.108696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:14.117573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:14.124565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56ca18c4-91e8-4fa4-b624-df39d1ad72fc tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.758520 Sep 16 14:14:14.127437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:14.134025 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1824/3656] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:13 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:14.157219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:14.159574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:14.164876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:14.167685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:14.168611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:14.169597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:14.309655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:14.321841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c53f353b-34bf-4115-b4c6-939498d7dcb0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1260 microversion: 2.1 time: 0.223323 Sep 16 14:14:14.323180 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1833/3657] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:14 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:14.420680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:14.421308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:14.443705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:14.444227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:14.444686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:14.445438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:14.451255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:14.452054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:15.147421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:15.149099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:15.164389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:15.167762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:15.172391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:15.176322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:15.177221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:15.178833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:15.241629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:15.265182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:15.269748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:15.271070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-994ad97e-20da-439b-8e4a-dfcc7191f795 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.854542 Sep 16 14:14:15.277749 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1825/3658] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:14 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:14:15.305128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:15.306105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:15.331614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:15.332131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:15.332587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:15.333338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:15.344635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:15.345206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:15.837155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:15.854242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e5156c1-30fe-4183-bdaa-c2855c8a4108 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.715762 Sep 16 14:14:15.858768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1834/3659] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:15 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:15.866756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:15.867640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:15.899030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:15.899578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:15.900239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:15.901171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:15.901652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:15.902087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:16.577314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:16.583948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:16.592970 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74f15061-cb01-4d47-87ee-0cf416cb69b0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.313974 Sep 16 14:14:16.598123 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1826/3660] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:15 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:16.606236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:16.612624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:16.617048 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9cda6de7-7dca-43b3-b644-12898247c6e1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1266 microversion: 2.1 time: 0.755310 Sep 16 14:14:16.622488 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1835/3661] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:15 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1266 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:16.648156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:16.648978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:16.649608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:16.650605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:16.651251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:16.651857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:16.914142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:16.916609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:16.927002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:16.955931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:16.957125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:16.961102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:16.966949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:16.968303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:16.970161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:17.690596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:17.706333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:17.725563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:17.730272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa3b8513-7f67-46b9-aa8f-e3751b70cb6a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.129196 Sep 16 14:14:17.733652 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1827/3662] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:16 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:17.759282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:17.759929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:17.782037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:17.785369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:17.785880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:17.786700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:17.787183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:17.787681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:17.823648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:17.836398 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6beaecf-9012-498e-8710-89c414fa3e0b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.937484 Sep 16 14:14:17.837559 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1836/3663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:16 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:17.853169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:17.854521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:17.864325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:17.864966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:17.865823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:17.866863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:17.867521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:17.867969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:18.201318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:18.218301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d6a0111-d9ad-457e-b51e-b997273f8348 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.481248 Sep 16 14:14:18.220111 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1828/3664] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:17 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:18.354602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:18.369034 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc7ae441-048f-4d61-ac69-ca453e129073 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.529443 Sep 16 14:14:18.372965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1837/3665] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:17 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:18.769476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:18.770370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:18.783225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f14452eb-5bb9-49da-bea2-75e03ec76770 req-8a072497-91b6-48b5-a0ed-d787a9341925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9", "tag": "280e464f-8eb1-4a08-81ff-d6817bececa2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:18.791563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:18.792303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:18.795113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:18.796164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:18.798007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:18.800920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f14452eb-5bb9-49da-bea2-75e03ec76770 req-8a072497-91b6-48b5-a0ed-d787a9341925 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:18.801874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f14452eb-5bb9-49da-bea2-75e03ec76770 req-8a072497-91b6-48b5-a0ed-d787a9341925 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:18.802590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f14452eb-5bb9-49da-bea2-75e03ec76770 req-8a072497-91b6-48b5-a0ed-d787a9341925 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:18.804106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:18.842124 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f14452eb-5bb9-49da-bea2-75e03ec76770 req-8a072497-91b6-48b5-a0ed-d787a9341925 service nova] Creating event network-changed:280e464f-8eb1-4a08-81ff-d6817bececa2 for instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 on n-h2-858129-2 Sep 16 14:14:18.863876 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f14452eb-5bb9-49da-bea2-75e03ec76770 req-8a072497-91b6-48b5-a0ed-d787a9341925 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.642358 Sep 16 14:14:18.872964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1829/3666] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:18.881027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:18.887844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:18.888883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:18.911764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:18.912718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:18.915617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:18.922627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:18.928073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:18.928969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:19.207808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:19.221162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:19.223433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:19.225428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7ac788e0-d83c-4b58-b5ab-c34dd931e85d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.461797 Sep 16 14:14:19.227183 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1838/3667] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:18 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:19.267191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:19.268260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:19.277744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:19.278741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:19.279749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:19.280791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:19.282509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:19.283934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:19.296865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:19.333054 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd53eef2-d3c8-46b7-b92a-f5d919926798 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.456927 Sep 16 14:14:19.350444 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1830/3668] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:18 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:19.397118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:19.397904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:19.404555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:19.405202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:19.405763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:19.407176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:19.407743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:19.408268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:19.721295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:19.737646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-759d8f78-5449-45bd-8930-81b41bebdbc6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.476354 Sep 16 14:14:19.738253 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1839/3669] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:19 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:19.787987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:19.797549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7907b549-f614-455d-a8ea-a8e3f1b7f88c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.404082 Sep 16 14:14:19.799986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1831/3670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:19 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:20.258519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:20.259148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:20.277262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:20.277262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:20.277262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:20.277262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:20.285329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:20.286874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:20.380678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:20.391093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:20.461267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:20.461911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:20.462266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:20.463098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:20.463630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:20.464070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:20.505672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:21.354651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:21.371425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:21.388695 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-078e605d-1b68-41ee-b0fb-4621afa555bf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 1.012334 Sep 16 14:14:21.392481 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1832/3671] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:20 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:21.397255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:21.400596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:21.411042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-17ab9985-cdf8-4bf5-93e1-c19b7973dbce req-8ca060b4-c10b-410f-862d-9c28d785df0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0f8c0f-d966-4249-b803-53fd9115d63f", "tag": "6fc80640-7b4b-4a7f-9409-231749b10b1c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:21.415610 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-195bc94b-dcf2-4405-a99e-25ceec92f2fb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.149483 Sep 16 14:14:21.419462 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1840/3672] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:20 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:21.436862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:21.440742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:21.466015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17ab9985-cdf8-4bf5-93e1-c19b7973dbce req-8ca060b4-c10b-410f-862d-9c28d785df0b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:21.469517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:21.470367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17ab9985-cdf8-4bf5-93e1-c19b7973dbce req-8ca060b4-c10b-410f-862d-9c28d785df0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:21.472831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17ab9985-cdf8-4bf5-93e1-c19b7973dbce req-8ca060b4-c10b-410f-862d-9c28d785df0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:21.474277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:21.475385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:21.477751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:21.478631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:21.479388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:21.535700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-17ab9985-cdf8-4bf5-93e1-c19b7973dbce req-8ca060b4-c10b-410f-862d-9c28d785df0b service nova] Creating event network-changed:6fc80640-7b4b-4a7f-9409-231749b10b1c for instance 7f0f8c0f-d966-4249-b803-53fd9115d63f on n-h1-858129-2 Sep 16 14:14:21.549056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-17ab9985-cdf8-4bf5-93e1-c19b7973dbce req-8ca060b4-c10b-410f-862d-9c28d785df0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153097 Sep 16 14:14:21.551074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1833/3673] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:21.587406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:21.589516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:21.601553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:21.638178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:21.639515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:21.640652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:21.646858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:21.648472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:21.651037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:22.475453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:23.322088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:23.335044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b877ff03-4468-4043-9de7-a8e403e61ed3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.913574 Sep 16 14:14:23.347388 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1841/3674] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:21 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:23.353161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:23.354246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:23.365656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:23.371941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:23.372784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:23.373801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:23.374682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:23.375444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:23.869023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:23.886176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6234730c-66e1-4232-8391-b10dbd1e41c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 2.332362 Sep 16 14:14:23.887247 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1834/3675] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:21 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:23.894796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:23.902756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:23.913320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:23.914425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:23.915303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:23.916479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:23.917391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:23.923266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:24.204885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:24.236041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0bf68b73-e7c8-4ca2-9d7d-99c2519493ee tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.880192 Sep 16 14:14:24.237294 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1842/3676] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:23 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:24.279269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9582769e-4fd1-4136-9cdf-c351b0bfa70a req-d2650b31-b8c4-4640-ba0a-a3004139d290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d141f3-2891-487a-861e-ccaf4b2d5cbe", "name": "network-vif-unplugged", "status": "completed", "tag": "20061ac3-c0ee-4011-9ba3-ecd56514297d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:24.310195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9582769e-4fd1-4136-9cdf-c351b0bfa70a req-d2650b31-b8c4-4640-ba0a-a3004139d290 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:24.323227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9582769e-4fd1-4136-9cdf-c351b0bfa70a req-d2650b31-b8c4-4640-ba0a-a3004139d290 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:24.324063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9582769e-4fd1-4136-9cdf-c351b0bfa70a req-d2650b31-b8c4-4640-ba0a-a3004139d290 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:24.401197 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9582769e-4fd1-4136-9cdf-c351b0bfa70a req-d2650b31-b8c4-4640-ba0a-a3004139d290 service nova] Creating event network-vif-unplugged:20061ac3-c0ee-4011-9ba3-ecd56514297d for instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe on n-h2-858129-2 Sep 16 14:14:24.413519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9582769e-4fd1-4136-9cdf-c351b0bfa70a req-d2650b31-b8c4-4640-ba0a-a3004139d290 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159549 Sep 16 14:14:24.414096 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1843/3677] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:24.428216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:24.429050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:24.457995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:24.459200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:24.459677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:24.461007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:24.464411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:24.464411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:24.534252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:24.557555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:24.566665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:24.569750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1390780-05fd-44f2-8454-6ec5d96f5686 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.680781 Sep 16 14:14:24.574602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1835/3678] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:23 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:24.950492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:24.955431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:24.993581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:24.996922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:25.000672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:25.007877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:25.010275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:25.013759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:25.051889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:25.061426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3b1d8f1-17e0-4460-bf31-c3cdd9cb252f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.642773 Sep 16 14:14:25.066448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1844/3679] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:24 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:25.287641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:25.289222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:25.305723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:25.309345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:25.310079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:25.311060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:25.313638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:25.315240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:25.342160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:25.367788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7998e226-9425-4399-9b3b-11589e4e35ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.437609 Sep 16 14:14:25.383218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1836/3680] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:24 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:25.628502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:25.629399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:25.652561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:25.653425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:25.654203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:25.655504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:25.656354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:25.661845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:25.987997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:25.997640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70a5fc08-fa7c-499f-8eea-d5179b64493c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.715988 Sep 16 14:14:25.998953 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1845/3681] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:25 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:26.074245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:26.085368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:26.087452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:26.088778 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca027f0a-b9f5-46ab-837d-3cbaea50c631 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.466990 Sep 16 14:14:26.089390 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1837/3682] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:25 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:14:26.104162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:26.105419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:26.115254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:26.115923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:26.116518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:26.118061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:26.118061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:26.118590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:26.407385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:26.408518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:26.421792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:26.422818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:26.431750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:26.432971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:26.434168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:26.435035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:26.669390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:26.714396 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c7bbc31-27f6-43ec-8e8c-a72b48a2b965 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.610392 Sep 16 14:14:26.716304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1846/3683] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:26 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:26.736344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8e4f7896-ae76-4c4b-b997-178fffb6dce8 req-187b3f71-685a-425a-b996-71f102a013fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d141f3-2891-487a-861e-ccaf4b2d5cbe", "tag": "20061ac3-c0ee-4011-9ba3-ecd56514297d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:26.746014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:26.754716 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7d45514-e685-4eac-8a5d-d8b6d5d895fd tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.352323 Sep 16 14:14:26.757237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8e4f7896-ae76-4c4b-b997-178fffb6dce8 req-187b3f71-685a-425a-b996-71f102a013fb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:26.757877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8e4f7896-ae76-4c4b-b997-178fffb6dce8 req-187b3f71-685a-425a-b996-71f102a013fb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:26.758385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8e4f7896-ae76-4c4b-b997-178fffb6dce8 req-187b3f71-685a-425a-b996-71f102a013fb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:26.759893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1838/3684] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:26 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:26.774362 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8e4f7896-ae76-4c4b-b997-178fffb6dce8 req-187b3f71-685a-425a-b996-71f102a013fb service nova] Creating event network-changed:20061ac3-c0ee-4011-9ba3-ecd56514297d for instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe on n-h2-858129-2 Sep 16 14:14:26.784262 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8e4f7896-ae76-4c4b-b997-178fffb6dce8 req-187b3f71-685a-425a-b996-71f102a013fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065811 Sep 16 14:14:26.798066 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1847/3685] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:27.039228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:27.039987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:27.058991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:27.063661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:27.064527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:27.067239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:27.073642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:27.074689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:27.121888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:27.122990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:27.146713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:27.147240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:27.162184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:27.164765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:27.168857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:27.179901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:27.926626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:27.946545 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f075b486-e64d-4221-844e-a3f7a9169bbe tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.913354 Sep 16 14:14:27.953986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1839/3686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:27 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:27.962032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:27.962771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:27.977697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:27.978198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:27.978822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:27.979847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:27.980530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:27.981054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:28.058985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:28.083941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:28.087278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:28.089590 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf0761f1-37cc-4380-a186-34e826d50816 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.972448 Sep 16 14:14:28.090245 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1848/3687] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:27 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:28.099353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:28.100292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:28.124327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:28.127601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:28.130501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:28.132626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:28.133129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:28.133582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:29.478040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:29.494580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80803afe-f40d-413e-a69a-524cdf42c90b tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 1.395445 Sep 16 14:14:29.511364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:29.512811 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1849/3688] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:28 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:29.556477 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f5af09d-99c0-47da-a5fd-6d27a3f7af34 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.607293 Sep 16 14:14:29.575628 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1840/3689] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:27 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:29.589163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:29.602159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:29.620304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:29.621142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:29.621873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:29.623137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:29.630166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:29.633153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:29.814681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-396c96b1-8dde-4da8-b505-91607565a729 req-5d4d2c5d-2f9b-4d55-b329-6b9e29814cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9", "name": "network-vif-plugged", "status": "completed", "tag": "280e464f-8eb1-4a08-81ff-d6817bececa2"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:29.841012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-396c96b1-8dde-4da8-b505-91607565a729 req-5d4d2c5d-2f9b-4d55-b329-6b9e29814cd6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:29.841516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-396c96b1-8dde-4da8-b505-91607565a729 req-5d4d2c5d-2f9b-4d55-b329-6b9e29814cd6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:29.841964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-396c96b1-8dde-4da8-b505-91607565a729 req-5d4d2c5d-2f9b-4d55-b329-6b9e29814cd6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:29.887398 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-396c96b1-8dde-4da8-b505-91607565a729 req-5d4d2c5d-2f9b-4d55-b329-6b9e29814cd6 service nova] Creating event network-vif-plugged:280e464f-8eb1-4a08-81ff-d6817bececa2 for instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 on n-h2-858129-2 Sep 16 14:14:29.901889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-396c96b1-8dde-4da8-b505-91607565a729 req-5d4d2c5d-2f9b-4d55-b329-6b9e29814cd6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387650 Sep 16 14:14:29.902895 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1850/3690] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:29.914044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:29.917890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:29.932665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:29.933169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:29.933616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:29.934356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:29.934866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:29.935296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:30.065371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:30.091377 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa523b1b-d737-497a-8e3a-997bade7faca tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.506517 Sep 16 14:14:30.093989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1841/3691] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:29 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:30.519241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:30.521695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:30.533543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:30.535135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:30.536210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:30.537706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:30.538511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:30.539785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:30.540843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:30.561293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:30.565156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:30.567667 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e74c4135-5dfe-430a-b862-a288d62b6488 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.663277 Sep 16 14:14:30.569070 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1851/3692] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:29 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:30.611942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:30.613322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:30.623284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:30.624011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:30.625316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:30.626972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:30.627886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:30.628958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:30.881325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:30.901794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1a4db5e-df26-4463-b2db-5afbbbfb0632 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.390016 Sep 16 14:14:30.930763 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1842/3693] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:30 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:30.934113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:30.943940 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81ac5f12-e70f-46be-b6b8-50e9fd69d7d5 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.339912 Sep 16 14:14:30.952357 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1852/3694] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:30 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:31.124148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:31.124781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:31.133095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:31.133590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:31.134283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:31.135061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:31.136401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:31.136872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:31.623288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:31.626572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:31.645578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:31.646968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:31.647838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:31.649916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:31.650904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:31.651754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:31.725287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:31.737451 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f394948-a148-4603-b38a-dc6173e1a1fc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1314 microversion: 2.1 time: 0.616984 Sep 16 14:14:31.751312 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1843/3695] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:31 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:31.932507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-812c689f-1558-454a-9ee9-2a89c96206c9 req-dc9b6a3f-f7c2-4452-83f4-a9ad81894a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0f8c0f-d966-4249-b803-53fd9115d63f", "name": "network-vif-plugged", "status": "completed", "tag": "6fc80640-7b4b-4a7f-9409-231749b10b1c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:31.951293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-812c689f-1558-454a-9ee9-2a89c96206c9 req-dc9b6a3f-f7c2-4452-83f4-a9ad81894a40 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:31.952584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-812c689f-1558-454a-9ee9-2a89c96206c9 req-dc9b6a3f-f7c2-4452-83f4-a9ad81894a40 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:31.953731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-812c689f-1558-454a-9ee9-2a89c96206c9 req-dc9b6a3f-f7c2-4452-83f4-a9ad81894a40 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:31.997276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-812c689f-1558-454a-9ee9-2a89c96206c9 req-dc9b6a3f-f7c2-4452-83f4-a9ad81894a40 service nova] Creating event network-vif-plugged:6fc80640-7b4b-4a7f-9409-231749b10b1c for instance 7f0f8c0f-d966-4249-b803-53fd9115d63f on n-h1-858129-2 Sep 16 14:14:32.006144 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-812c689f-1558-454a-9ee9-2a89c96206c9 req-dc9b6a3f-f7c2-4452-83f4-a9ad81894a40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079271 Sep 16 14:14:32.006990 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1844/3696] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:14:32.014480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:32.015210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:32.023404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:32.023908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:32.024347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:32.025312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:32.025782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:32.026210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:32.033671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:32.044956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:32.047000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:32.050031 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8aeb73d8-d47b-478c-955a-68f18990ca44 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.435020 Sep 16 14:14:32.050724 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1853/3697] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:31 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:32.059185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:32.060378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:32.068129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:32.069018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:32.069894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:32.070914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:32.071583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:32.072213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:32.399369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:32.410099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd481891-71bc-4ae5-b028-9389631c1902 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.401760 Sep 16 14:14:32.426318 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1845/3698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:32 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:32.520445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:32.530334 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55ce016b-3d78-40df-8f7e-46738373af7d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.478281 Sep 16 14:14:32.532183 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1854/3699] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:32 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:32.768885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:32.769946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:32.782065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:32.782927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:32.783652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:32.785096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:32.785909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:32.787236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.007934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:33.024955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-646e1772-10aa-4c60-a3d6-a1d2b6e76c12 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1502 microversion: 2.1 time: 0.263501 Sep 16 14:14:33.026471 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1846/3700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:32 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:33.049722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:33.051043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:33.059527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.060391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.061089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.062075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.066732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.067835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.100188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'flavor' on Instance uuid 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:14:33.109990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:33.111425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:33.125957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.130526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.131248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.135225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.136826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.138132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.191758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:33.442091 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83bf1083-0563-41d5-9ae4-3fe9d3f3b00b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9/action" status: 202 len: 0 microversion: 2.1 time: 0.397020 Sep 16 14:14:33.444085 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1855/3701] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:14:33 2022] POST /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:14:33.475550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:33.476271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:33.485941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.486472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.487836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.488594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.489067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.489498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.635575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:33.651034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:33.652622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:33.654493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c5e6b51-3197-49ab-8ad8-001fa7d25dd4 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.558094 Sep 16 14:14:33.667606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1847/3702] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:33 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:33.680976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:33.681629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:33.688772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.689562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.690228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.691185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.691859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.692296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.800106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:33.810004 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80e4b3fc-1316-4ab2-8ed0-440cf559d454 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.344041 Sep 16 14:14:33.811003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1856/3703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:33 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:33.818088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:33.819195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:33.827375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.828869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.829573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:33.831798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:33.832244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:33.832859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:34.025887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:34.042828 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9710c8f-0e9d-4656-b730-5d88c185f80d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.373877 Sep 16 14:14:34.043689 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1848/3704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:33 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:34.110914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:34.123328 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f4acf73-7f61-4683-b2de-c31f34cbf0d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.310899 Sep 16 14:14:34.125384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1857/3705] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:33 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:34.691344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:34.694105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:34.709311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:34.710694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:34.711526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:34.712875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:34.714222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:34.716971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:34.860771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:34.862969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:34.884323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:34.887193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:34.888424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:34.891743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:34.893023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:34.894129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:35.111080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:35.125381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:35.129271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:35.135129 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a4b61786-b9be-4b8a-88cb-a9319c5aea66 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.448440 Sep 16 14:14:35.136430 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1849/3706] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:34 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:35.157572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:35.168113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:35.185385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:35.186665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:35.188744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:35.190626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:35.191795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:35.192828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:35.247402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:35.651827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:35.673137 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3e9bf3b-3b5d-4af6-a087-a5a056b85e73 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1308 microversion: 2.1 time: 0.827251 Sep 16 14:14:35.674464 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1858/3707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:34 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1308 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:35.679367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:35.679993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:35.698705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:35.699406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:35.699869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:35.700607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:35.701133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:35.701493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:35.912278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:36.023075 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0fcfdbc-720d-480d-8397-69324b003388 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.876700 Sep 16 14:14:36.028319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1850/3708] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:35 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:36.186247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:36.189108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:36.226661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:36.240432 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-afce80ce-c9a5-441e-b73c-2d45f2e93da8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.562438 Sep 16 14:14:36.242936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1859/3709] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:35 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:36.269753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:36.270723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:36.276098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:36.288863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:36.289889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:36.293940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:36.720107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:36.721324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:36.741407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:36.742290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:36.743108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:36.744403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:36.745252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:36.746025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:37.239400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:37.280656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:37.284260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:37.316600 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bdc04f17-adfd-40a1-a642-ebea2ffc7759 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.137537 Sep 16 14:14:37.317619 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1851/3710] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:36 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:37.340078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:37.341671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:37.354089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:37.358098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:37.360056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:37.361857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:37.363034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:37.364086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:37.486623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:37.509056 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8899917-ee94-4385-a33c-8449a9cbd6d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1490 microversion: 2.1 time: 0.796504 Sep 16 14:14:37.510284 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1860/3711] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:36 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1490 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:37.515908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:37.517821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:37.532680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:37.540628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:37.541702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:37.543557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:37.547386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:37.548156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:38.020175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:38.044999 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dea8a99c-fdbb-4432-b3c4-b33c137bb8b0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.713401 Sep 16 14:14:38.059963 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1852/3712] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:37 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:38.068126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:38.071373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:38.079839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:38.080449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:38.080918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:38.081681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:38.082172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:38.082675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:38.183789 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0d222d3-dc2e-43bb-a3ee-c31f0ae77a76 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "PUT /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1085 microversion: 2.1 time: 0.122296 Sep 16 14:14:38.184702 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1853/3713] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:14:38 2022] PUT /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1085 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:38.207808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:38.209280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:38.219576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:38.221014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:38.221812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:38.223244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:38.224045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:38.225918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:38.722828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:38.763737 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4acbbf2-5cdc-43aa-be19-3421bcb7ee59 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 1.251592 Sep 16 14:14:38.780233 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1861/3714] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:37 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:38.791151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:38.791774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:38.800538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:38.801043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:38.801707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:38.802716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:38.803376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:38.805080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.048973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:39.075753 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f3f4b2f-1973-48b0-9cf3-5b54f8249546 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1511 microversion: 2.1 time: 0.873550 Sep 16 14:14:39.086917 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1854/3715] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:38 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1511 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:39.098609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:39.099752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:39.138660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.139526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.141274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.142906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.144080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.147622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.157649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:39.178968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:39.180498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:39.181763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4da9958e-c539-4927-90bd-c61226b6f7ae tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.395220 Sep 16 14:14:39.182345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1862/3716] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:38 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:39.199046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:39.200623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:39.209802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.210694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.211320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.212288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.212943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.213545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.493046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:39.502803 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-071b4ece-a164-4b20-96b4-852cd02c1221 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1511 microversion: 2.1 time: 0.309669 Sep 16 14:14:39.510064 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1863/3717] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:39 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:39.540403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:39.540916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:39.561126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.561649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.562734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.563484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.563951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.564381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.611606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:39.644438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:14:39.644786 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c34b667-930a-48fb-9719-377820107c54 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.555031 Sep 16 14:14:39.648687 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1855/3718] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:39 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:39.810628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:39.816183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:39.824850 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0468346b-3e00-4c8c-a809-53449252a2ef tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 204 len: 0 microversion: 2.1 time: 0.287952 Sep 16 14:14:39.834064 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1864/3719] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:14:39 2022] DELETE /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:14:39.843166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:39.851534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:39.852541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.853815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.855025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.856793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.858248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.859703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.860976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.870052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.871024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:39.872503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:39.872785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:39.873328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:40.299467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:40.307951 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75b7a427-b6dd-4a2e-8923-7295e2ffe49f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1517 microversion: 2.1 time: 0.472027 Sep 16 14:14:40.308569 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1865/3720] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:39 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1517 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:40.330260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:40.331193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:40.335633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:40.345737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca4025cb-d87c-4d4b-98db-37f48fed131a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.557785 Sep 16 14:14:40.351550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1856/3721] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:39 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:14:40.353646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:40.354720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:40.355439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:40.356347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:40.356984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:40.357604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:40.675795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:40.676415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:40.679131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=72 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:40.686290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:40.687719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:40.688733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:40.690279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:40.691468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:40.692238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:40.809128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:40.830587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:40.833668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:40.835262 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d047d461-6bb5-4833-be75-c3573c38a178 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.510045 Sep 16 14:14:40.836119 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1866/3722] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:40 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:40.996680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:41.018522 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a10789e-cea4-4379-9fb7-a4c90ac80130 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.348958 Sep 16 14:14:41.019564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1857/3723] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:40 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:41.341793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:41.344077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:41.365691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:41.367061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:41.368365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:41.369855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:41.371002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:41.372131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:41.387247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:41.390835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:41.421971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:41.423212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:41.424150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:41.425764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:41.431341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:41.432426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:42.056689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:42.080081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:42.091032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-948278ad-176b-4e0b-82c0-0f08f0cfa37c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1517 microversion: 2.1 time: 0.760757 Sep 16 14:14:42.092545 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1867/3724] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:41 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1517 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:42.095620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4361f475-d1dc-4774-947e-20183da8b236 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.720422 Sep 16 14:14:42.099384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:42.100564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:42.110149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:42.111103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:42.111826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:42.113300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:42.114107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:42.114822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:42.125125 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1858/3725] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:41 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:42.155499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:42.165696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:42.188255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:42.189386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:42.193231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:42.199467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:42.200642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:42.201723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:42.938880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:42.977124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:42.980851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:42.983757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d522da84-297e-4062-8d44-9613df77aeaf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.854086 Sep 16 14:14:43.007651 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1859/3726] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:42 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:43.033705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:43.035472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:43.056857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:43.057725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:43.059247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:43.060662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:43.061490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:43.062535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:43.279045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:43.321023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bd1ef0d-e41c-4a15-a0b5-5fa422cfdd47 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.225748 Sep 16 14:14:43.334778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1868/3727] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:42 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:43.351928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:43.356002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:43.389571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:43.394377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:43.396211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:43.400077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:43.401515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:43.403191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:44.154841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:44.157665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:44.181131 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26099ee4-de20-49f0-83a2-4411f43b7ff1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1517 microversion: 2.1 time: 0.847901 Sep 16 14:14:44.181754 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1869/3728] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:43 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1517 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:44.208299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:44.209241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:44.219435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:44.220639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:44.221295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:44.222238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:44.227050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:44.235128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:44.235659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:44.261147 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2712d1cb-8d3c-4b0b-ad48-cfc923aec98f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 1.247238 Sep 16 14:14:44.263362 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1860/3729] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:43 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:44.340239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:44.343373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:44.373156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:44.376502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:44.379258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:44.384116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:44.386564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:44.389201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.021341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:45.074648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:45.108591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41122876-9b81-4890-b3a4-35ba76e51978 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1717 microversion: 2.1 time: 0.902196 Sep 16 14:14:45.112196 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08c0cb41-62d2-4f40-b7ea-036b46042011 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.805096 Sep 16 14:14:45.112454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1870/3730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:44 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1717 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:45.124315 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1861/3731] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:44 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:45.141616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c329cfe3-48f9-4515-be1c-cb9e6c83ef34 req-f68affbb-b159-4a4b-b819-f24163818474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0f8c0f-d966-4249-b803-53fd9115d63f", "name": "network-vif-deleted", "tag": "6fc80640-7b4b-4a7f-9409-231749b10b1c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:45.151327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:45.158912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:45.172220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c329cfe3-48f9-4515-be1c-cb9e6c83ef34 req-f68affbb-b159-4a4b-b819-f24163818474 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.173025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c329cfe3-48f9-4515-be1c-cb9e6c83ef34 req-f68affbb-b159-4a4b-b819-f24163818474 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.173799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c329cfe3-48f9-4515-be1c-cb9e6c83ef34 req-f68affbb-b159-4a4b-b819-f24163818474 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.175825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.177168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.178330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.179778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.180876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.181965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.201773 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c329cfe3-48f9-4515-be1c-cb9e6c83ef34 req-f68affbb-b159-4a4b-b819-f24163818474 service nova] Creating event network-vif-deleted:6fc80640-7b4b-4a7f-9409-231749b10b1c for instance 7f0f8c0f-d966-4249-b803-53fd9115d63f on n-h1-858129-2 Sep 16 14:14:45.218028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c329cfe3-48f9-4515-be1c-cb9e6c83ef34 req-f68affbb-b159-4a4b-b819-f24163818474 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088381 Sep 16 14:14:45.221584 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1862/3732] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:45.229065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:45.230789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:45.256199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.257023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.257701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.259176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.259954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.260619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.898687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:45.924853 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-03561542-53d7-4d26-81a6-0079e0167bd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.700912 Sep 16 14:14:45.943054 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1863/3733] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:45 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:45.969516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:45.970034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:45.971142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:45.980810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.981548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.982233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.983318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:45.984069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:45.984666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:45.984883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:45.994886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:45.996611 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0ea48fe6-e6cb-4234-a4e7-2a65ad2b9927 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.881564 Sep 16 14:14:45.997746 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1871/3734] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:45 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:46.005470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:46.006465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:46.024371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.025773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.028616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:46.033392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.034678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.035469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:46.094810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.095657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.105369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:46.106620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lazy-loading 'fault' on Instance uuid 7f0f8c0f-d966-4249-b803-53fd9115d63f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:14:46.427890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:46.451698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4fbb52da-396e-4f28-97fe-cec81733107f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 200 len: 1319 microversion: 2.1 time: 0.506508 Sep 16 14:14:46.456668 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1864/3735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:45 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:46.475612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-544126854"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:46.482031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:46.503442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.504589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.505550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:46.507609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.508839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.509849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:46.730099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:46.775645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-47f22a35-be02-4cc3-a167-59913c94f12e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.776115 Sep 16 14:14:46.797488 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1872/3736] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:45 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:46.814534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:46.819981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:46.839101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.841485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.841975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:46.844001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:46.845756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:46.847295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.076920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:47.114840 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c558195-897b-41d0-a386-83e20bdd3b37 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.655516 Sep 16 14:14:47.121834 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1865/3737] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:14:46 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 16 14:14:47.129556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:47.143106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:47.146762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Searching by: {'deleted': False, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:14:47.160527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.162578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.163794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.165665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.166736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.167858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.210643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:14:47.270150 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08634578-5771-414e-a338-d267dad8ca9c tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.151151 Sep 16 14:14:47.271343 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1866/3738] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:14:47 2022] GET /compute/v2.1/servers => generated 340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:47.280794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:47.282806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:47.328602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.331852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.333105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.337486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.340320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.344264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.344567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:47.366203 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9db87997-bfe1-4fb2-8cd0-2931497b3087 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1707 microversion: 2.1 time: 0.568380 Sep 16 14:14:47.368189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1873/3739] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:46 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1707 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:47.390947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:47.414662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:47.417850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Searching by: {'deleted': False, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:14:47.435849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:47.441266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.449617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.450973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.452779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.457014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.460167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.544065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:14:47.620406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:47.633012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:47.634349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:47.635635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:47.975590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:48.027689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:48.038475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:48.039253 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d560837-0f9c-49ad-a5a5-7213ae26ac90 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.668607 Sep 16 14:14:48.040345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1874/3740] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:14:47 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:48.050055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d248b015-fbc1-4a06-9e7c-39243f2bd824 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '.version_select at 0x7f724c491790>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:48.057087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d248b015-fbc1-4a06-9e7c-39243f2bd824 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.057490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-26b59df0-a951-4ffc-9a76-321f609c913b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.767674 Sep 16 14:14:48.058058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d248b015-fbc1-4a06-9e7c-39243f2bd824 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.059305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d248b015-fbc1-4a06-9e7c-39243f2bd824 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.067202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1867/3741] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:47 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:48.083751 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d248b015-fbc1-4a06-9e7c-39243f2bd824 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.041695 Sep 16 14:14:48.088590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:48.090048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:48.090719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1875/3742] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 14:14:48 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:48.103671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.105147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.106305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.108499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.109619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.110973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.117079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:48.120532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:48.137061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.138326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.139390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.141526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.142586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.143572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.147212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f HTTP/1.1 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7f0f8c0f-d966-4249-b803-53fd9115d63f'} Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:48.150819 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-742502d4-99b4-4489-875f-fbb9efc29445 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 404 len: 111 microversion: 2.1 time: 0.084295 Sep 16 14:14:48.161003 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1868/3743] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:48 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:14:48.175977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ecb223e8-49f2-4ddd-9d59-110e488e4f6d tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:48.193234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ecb223e8-49f2-4ddd-9d59-110e488e4f6d tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035656 Sep 16 14:14:48.194694 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1869/3744] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:14:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:48.208452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:48.210154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:48.227259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.229570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.230693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.232316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.233427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.235108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.814268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-580685a1-be6d-469a-956d-d4c663bf0577 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1858 microversion: 2.1 time: 0.610024 Sep 16 14:14:48.816830 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1870/3745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:48 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1858 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:48.824814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-663773089", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "c48d3821-d2e5-425d-8cda-c9c3faa7aaca"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:48.828345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:48.851707 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eece0bf8-e497-4e0a-b3f3-a5f5d43d1c26 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.747637 Sep 16 14:14:48.871208 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1876/3746] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:48 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:48.905348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] validate_networks() for [('c48d3821-d2e5-425d-8cda-c9c3faa7aaca', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:14:48.906812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:48.907788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:48.936297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.937581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.938493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:48.938715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:48.939175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:48.939525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:49.014534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:14:49.175496 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6eedefbd-c913-46be-a295-7b0d755acdd5 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "DELETE /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 204 len: 0 microversion: 2.1 time: 0.301904 Sep 16 14:14:49.181927 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1877/3747] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:14:48 2022] DELETE /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:14:49.194507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:49.195564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:49.211309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:49.212160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:49.212991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:49.214262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:49.215141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:49.215911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:49.465169 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f1c8054-0acb-42bb-a00f-3882d2e64ee7 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1858 microversion: 2.1 time: 0.280693 Sep 16 14:14:49.481267 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1878/3748] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:49 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1858 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:49.520428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:49.522709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:49.537222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:49.538645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:49.544102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:49.551530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:49.552284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:49.552995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.004966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:50.022944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:50.026173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:50.028704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b4ef0fd-a0d5-490f-aef4-979c65645c3a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.544387 Sep 16 14:14:50.035590 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1879/3749] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:49 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:50.055209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:50.065191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:50.076933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.078856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.079780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.081278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.082074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.082836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.273708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:14:50.274509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:14:50.275292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:14:50.276012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:14:50.276717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:14:50.293474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.294764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.296073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.298079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.299075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.300035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.335428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:14:50.370356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Getting quotas for user 1d5e085f9c0f498c93a22c1e7417fdef and project e1579fb25c9f4456b1b9fec1b34fb96e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:14:50.385392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:50.399442 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-079c2413-1963-4d68-9e57-cc61b79e49e4 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1715 microversion: 2.1 time: 0.361307 Sep 16 14:14:50.400628 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1880/3750] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:50 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1715 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:50.415333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:14:50.415333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:14:50.428198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:50.429425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:50.436999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.437785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.438477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.439390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.440164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.440770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.544100 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8542822f-a553-41d6-9efd-1360bb8409b7 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725372 Sep 16 14:14:50.545384 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1871/3751] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:14:50.556954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:50.558774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:50.573523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.576228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.584333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.586116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.587449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.588586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.605615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lazy-loading 'services' on Instance uuid e8d141f3-2891-487a-861e-ccaf4b2d5cbe {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:14:50.818245 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa68f497-eb76-402d-9f48-51394ae271fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments/8f1a8f2d-d461-4e8b-9807-4ba7c312e533" status: 202 len: 0 microversion: 2.1 time: 0.400310 Sep 16 14:14:50.820240 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1881/3752] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:14:50 2022] DELETE /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments/8f1a8f2d-d461-4e8b-9807-4ba7c312e533 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:14:50.827037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c36f705-a7c0-4245-b56c-10c2ce5b3cb5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:50.827960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c36f705-a7c0-4245-b56c-10c2ce5b3cb5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:50.952332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c36f705-a7c0-4245-b56c-10c2ce5b3cb5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:50.966660 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c36f705-a7c0-4245-b56c-10c2ce5b3cb5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1208 microversion: 2.1 time: 0.143937 Sep 16 14:14:50.967441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1882/3753] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:50 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:50.973140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:50.978534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:50.988616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.989525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.990851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:50.991890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:50.992986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:50.993692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:51.065885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:51.068544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1f5fd7d-183d-4639-bbac-d2793a7af2a9 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099688 Sep 16 14:14:51.070114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1883/3754] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:14:50 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:51.077030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:51.078514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:51.079805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97f89f45-45eb-47ef-b57f-672b34210281 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.531862 Sep 16 14:14:51.082788 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1872/3755] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:50 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:51.086678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:51.087231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:51.087667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:51.088432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:51.088881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:51.089356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:51.453534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:51.458810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:51.486639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:51.487140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:51.487579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:51.488347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:51.494822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:51.495926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:51.587703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:51.602133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:51.605422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:51.608232 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc9f6d6b-9d98-467a-9120-bffae34b3fb7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.535677 Sep 16 14:14:51.609818 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1884/3756] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:51 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:52.007224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:52.013518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:52.033271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:52.048921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:52.050061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:52.058482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:52.066036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:52.067027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:52.089654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:52.708841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:52.746515 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7d4c945f-7ae7-4dae-9776-a5e1944acbe3 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1204 microversion: 2.1 time: 0.757302 Sep 16 14:14:52.750126 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1885/3757] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:51 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1204 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:52.773113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:52.790150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:52.857311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:52.863587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:52.866609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:52.878338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:52.879362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:52.886669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:53.129020 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee7d1992-1879-4ccf-a0e3-e1d86efd3d32 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.370020 Sep 16 14:14:53.142724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:53.151337 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1886/3758] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:14:52 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 197 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:53.195922 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4963ed6e-ae13-4c32-96ad-46001727bbc0 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1715 microversion: 2.1 time: 1.765879 Sep 16 14:14:53.201382 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1873/3759] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:51 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1715 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:53.212315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:53.213962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:53.243531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a05db998-bc6a-40d2-96bf-602d021b3759 req-93780bbe-3d4b-4635-90d4-12fe3e23f6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "0974b5ba-47a8-4c90-9f21-37e8ba95c23e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:53.262912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:53.268617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:53.270170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:53.271899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:53.274844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:53.276066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:53.330883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a05db998-bc6a-40d2-96bf-602d021b3759 req-93780bbe-3d4b-4635-90d4-12fe3e23f6ed service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:53.332577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a05db998-bc6a-40d2-96bf-602d021b3759 req-93780bbe-3d4b-4635-90d4-12fe3e23f6ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:53.337381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a05db998-bc6a-40d2-96bf-602d021b3759 req-93780bbe-3d4b-4635-90d4-12fe3e23f6ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:53.407431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a05db998-bc6a-40d2-96bf-602d021b3759 req-93780bbe-3d4b-4635-90d4-12fe3e23f6ed service nova] Creating event network-vif-plugged:0974b5ba-47a8-4c90-9f21-37e8ba95c23e for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:14:53.440520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a05db998-bc6a-40d2-96bf-602d021b3759 req-93780bbe-3d4b-4635-90d4-12fe3e23f6ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227026 Sep 16 14:14:53.448161 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1874/3760] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:53.493092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:53.497437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:53.518056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:53.520912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:53.521759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:53.525474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:53.526389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:53.527179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:54.642811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:54.656046 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d8ac115-1681-4727-b506-cf02a0c0efa4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 1.501661 Sep 16 14:14:54.657705 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1887/3761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:53 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:54.673785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:54.673785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:54.691284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:54.693503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:54.693982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:54.695886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:54.697273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:54.697735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:54.930278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:54.958039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:54.963513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:54.967077 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fb4985c-5600-4471-b0a4-db5b22d279f1 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.508584 Sep 16 14:14:54.967887 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1875/3762] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:53 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:14:54.982147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:54.986167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:55.008333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.008889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.009350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.010116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.010633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.011089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.058635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:55.075436 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed3a5f37-b68f-455b-b7fb-a2093e195ad5 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1266 microversion: 2.1 time: 0.413751 Sep 16 14:14:55.079219 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1888/3763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:54 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:55.089205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:55.092289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:55.109107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.123172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.124016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.129865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.131097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.131589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.132352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ffe0eae-d7a7-4322-9b93-0ffaf45a8c10 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160033 Sep 16 14:14:55.133596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1876/3764] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:14:54 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:55.145613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-801f50fe-caef-4a8a-94e5-d0f01653000f req-74bed84f-5ba2-4952-9dc7-e8bd3ad80087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28da2ac1-41aa-4662-9e58-f77953c6e8b6", "name": "network-vif-deleted", "tag": "2ca58b8f-9a7a-4d79-91e1-75dfad7504bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:55.174579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-801f50fe-caef-4a8a-94e5-d0f01653000f req-74bed84f-5ba2-4952-9dc7-e8bd3ad80087 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.175239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-801f50fe-caef-4a8a-94e5-d0f01653000f req-74bed84f-5ba2-4952-9dc7-e8bd3ad80087 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.176912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-801f50fe-caef-4a8a-94e5-d0f01653000f req-74bed84f-5ba2-4952-9dc7-e8bd3ad80087 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.211054 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-801f50fe-caef-4a8a-94e5-d0f01653000f req-74bed84f-5ba2-4952-9dc7-e8bd3ad80087 service nova] Creating event network-vif-deleted:2ca58b8f-9a7a-4d79-91e1-75dfad7504bc for instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 on n-h2-858129-2 Sep 16 14:14:55.224839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-801f50fe-caef-4a8a-94e5-d0f01653000f req-74bed84f-5ba2-4952-9dc7-e8bd3ad80087 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089556 Sep 16 14:14:55.229978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1877/3765] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:55.258089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.261381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.270914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.271754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lazy-loading 'fault' on Instance uuid 28da2ac1-41aa-4662-9e58-f77953c6e8b6 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:14:55.427973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f2a892f02f452b96a306b6b009e3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11c1fa51ebe4326969ca9748602b95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:55.446054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-702cea46-13b5-4031-b67e-fdb2af7b564a tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 200 len: 1367 microversion: 2.1 time: 0.362721 Sep 16 14:14:55.449036 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1889/3766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:55 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:55.513440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "a16fb69b-f2c7-4b30-905c-5df0a528462b"}, {"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "2aff764a-ab44-46a9-85e7-d790dbbf7730"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:55.536765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.537511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.538031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.563851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] Creating event network-vif-plugged:a16fb69b-f2c7-4b30-905c-5df0a528462b for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:14:55.564734 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] Creating event network-vif-plugged:2aff764a-ab44-46a9-85e7-d790dbbf7730 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:14:55.573679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8ce16ef8-eeeb-40e2-890f-444ccf1c65cf req-ecbf2009-90b1-4034-9a95-7ff956f5b558 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064113 Sep 16 14:14:55.575705 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1878/3767] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:14:55.682446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:55.683322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:55.695014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.695521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.695967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.696712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:55.697185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:55.697616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:55.959849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:55.976132 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b6ee36b-7ab4-43ec-83ac-f4033e85a280 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.298166 Sep 16 14:14:55.978794 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1890/3768] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:55 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:56.032705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:56.035144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:56.053382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.053896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.057844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.058910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.062762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.064085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.119303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:56.119687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:56.141668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.142263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.142797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.143542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.144008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.144446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.805781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:56.816237 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8ded36a-83af-414e-a732-38747dc01022 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 0.701915 Sep 16 14:14:56.817579 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1891/3769] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:56 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:56.819233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:56.829427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:56.833923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:56.837974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:56.847366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:56.851350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6e6dc1e-8516-4c42-b3e4-d9ff98bc3c5d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 0.822692 Sep 16 14:14:56.857403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.858185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.865739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.867133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.867814 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1879/3770] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:56 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:14:56.869294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.871140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.884506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:56.885150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] [instance: 28da2ac1-41aa-4662-9e58-f77953c6e8b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:56.896510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.906497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.907629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.909162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:56.910310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:56.911205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:56.987545 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] HTTP exception thrown: Instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 could not be found. Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Request method failure captured: Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 HTTP/1.1 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIRdkB7ZFHruNH69W6CKQZFGugb2ojkEQy0HylJdA-C03YT6shF7tFb7t8GeFe0uomeDlwhaMygB1EAefz7Swv5G9GwJkfIDwWZBRD1-VfLLT7uCqusYYYqmagG2UhzF-i1bijKjGhvQqlyfxN5miiVbfYEolnqPSu88zXfsXcl3gxM Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e11c1fa51ebe4326969ca9748602b95d Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestManualDisk-668877656 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e11c1fa51ebe4326969ca9748602b95d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e11c1fa51ebe4326969ca9748602b95d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e11c1fa51ebe4326969ca9748602b95d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e11c1fa51ebe4326969ca9748602b95d"}]}] Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestManualDisk-668877656 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e11c1fa51ebe4326969ca9748602b95d Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestManualDisk-668877656 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestManualDisk-668877656-project Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2f2a892f02f452b96a306b6b009e3b4 Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestManualDisk-668877656-project Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 could not be found. Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '28da2ac1-41aa-4662-9e58-f77953c6e8b6'} Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 could not be found. Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 could not be found. Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:14:56.996945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 could not be found. Sep 16 14:14:57.006899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:14:57.011363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Returning 404 to user: Instance 28da2ac1-41aa-4662-9e58-f77953c6e8b6 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:14:57.012256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2b66ab7-a411-4a11-bd8b-c60176395091 tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6" status: 404 len: 111 microversion: 2.1 time: 0.143369 Sep 16 14:14:57.017384 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1880/3771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:56 2022] GET /compute/v2.1/servers/28da2ac1-41aa-4662-9e58-f77953c6e8b6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:14:57.027040 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6924f4a4-5f29-48ee-a0e5-8043159e2a99 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206381 Sep 16 14:14:57.031888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c35f63c5-1b83-41fb-a72a-e9e44e3a436f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] Calling method '.version_select at 0x7f724c2b80d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:57.033923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1892/3772] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:14:56 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:14:57.049218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:57.064703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:57.084681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:57.085944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:57.087160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:57.088953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:57.090022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:57.091105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:57.093418 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c35f63c5-1b83-41fb-a72a-e9e44e3a436f tempest-ServersTestManualDisk-668877656 tempest-ServersTestManualDisk-668877656-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443792697" status: 202 len: 0 microversion: 2.1 time: 0.074678 Sep 16 14:14:57.094200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1881/3773] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443792697 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:14:57.517318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:14:57.647385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f737ef39-40d9-4d92-ad25-9a6aa4e6cb32 req-167e0177-b10b-48d8-9f6f-dcef16348476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "b78ea35a-15e5-4d5c-87e9-1d548568d455"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:14:57.700319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f737ef39-40d9-4d92-ad25-9a6aa4e6cb32 req-167e0177-b10b-48d8-9f6f-dcef16348476 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:57.701390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f737ef39-40d9-4d92-ad25-9a6aa4e6cb32 req-167e0177-b10b-48d8-9f6f-dcef16348476 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:57.702127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f737ef39-40d9-4d92-ad25-9a6aa4e6cb32 req-167e0177-b10b-48d8-9f6f-dcef16348476 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:57.753662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f737ef39-40d9-4d92-ad25-9a6aa4e6cb32 req-167e0177-b10b-48d8-9f6f-dcef16348476 service nova] Creating event network-vif-plugged:b78ea35a-15e5-4d5c-87e9-1d548568d455 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:14:57.785924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f737ef39-40d9-4d92-ad25-9a6aa4e6cb32 req-167e0177-b10b-48d8-9f6f-dcef16348476 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144218 Sep 16 14:14:57.790328 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1882/3774] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:14:57.886427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:57.896090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:57.927775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:57.928777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:57.930294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:57.932846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:57.938727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:57.939529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:58.271795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:14:58.291322 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e06ee87e-2781-48ab-9ce3-cabc1867edaa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 1.254987 Sep 16 14:14:58.301998 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1893/3775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:57 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:14:58.310542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:14:58.319811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:14:58.341833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:58.344317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:58.350834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:14:58.354432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:14:58.356200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:14:58.357365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:00.104661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:00.122065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c8e22a6f-22c3-43f7-bd20-a716ccde1441 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 2.246969 Sep 16 14:15:00.123921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1883/3776] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:14:57 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:00.147317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:00.152689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:00.192258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:00.193566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:00.194045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:00.194532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:00.205698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:00.206691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:00.207280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:00.238997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:00.248886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:00.255531 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe8df6bd-f532-4a0a-b88a-9c39a524d929 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.948889 Sep 16 14:15:00.258067 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1894/3777] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:14:58 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:15:00.308330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:00.309088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:00.328420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:00.331367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:00.332073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:00.336279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:00.337646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:00.338446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:00.340746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:00.394739 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1729212c-f19e-49b1-b4a3-87260443f6e2 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.264274 Sep 16 14:15:00.399403 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1884/3778] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:15:00 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:00.426121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "d8a97c77-7fda-479d-aba9-21750aa99c16"}, {"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:00.487031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:00.505779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:00.506299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:00.513190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:00.585591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] Creating event network-vif-plugged:d8a97c77-7fda-479d-aba9-21750aa99c16 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:15:00.586158 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] Creating event network-vif-plugged:a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:15:00.618572 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-48881722-9e92-4107-9651-00dfbf4b1dcf req-fc7f8ae4-286a-4cc4-9876-bbce2eb29da3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.214512 Sep 16 14:15:00.630471 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1885/3779] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:00.959391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:01.067310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:01.085531 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a31b129-7fc8-4fbe-bf29-cd28b811a6ce tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.822459 Sep 16 14:15:01.102955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1895/3780] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:00 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:01.161363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-964df457-585f-4191-a4d8-c2b15b58a859 req-3d26e94a-03ba-445b-a14e-7deeb2fa9b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea8ca13-617d-4407-9832-09eca69ec983", "tag": "db6c780b-3adc-40d9-bf33-33aba13091ef"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:01.180660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:01.182056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:01.219942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:01.221313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:01.222056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:01.223145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:01.223927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:01.225800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:01.267782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-964df457-585f-4191-a4d8-c2b15b58a859 req-3d26e94a-03ba-445b-a14e-7deeb2fa9b2f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:01.270692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-964df457-585f-4191-a4d8-c2b15b58a859 req-3d26e94a-03ba-445b-a14e-7deeb2fa9b2f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:01.273445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-964df457-585f-4191-a4d8-c2b15b58a859 req-3d26e94a-03ba-445b-a14e-7deeb2fa9b2f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:01.385579 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-964df457-585f-4191-a4d8-c2b15b58a859 req-3d26e94a-03ba-445b-a14e-7deeb2fa9b2f service nova] Creating event network-changed:db6c780b-3adc-40d9-bf33-33aba13091ef for instance 2ea8ca13-617d-4407-9832-09eca69ec983 on n-h2-858129-2 Sep 16 14:15:01.406750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-964df457-585f-4191-a4d8-c2b15b58a859 req-3d26e94a-03ba-445b-a14e-7deeb2fa9b2f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253599 Sep 16 14:15:01.408683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1886/3781] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:01.449993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:01.453913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:01.487579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:01.494216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:01.497072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:01.501206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:01.505572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:01.507566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:02.258052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:02.287108 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c31abd0d-331f-40f3-8353-d6dbb453c793 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 1.111760 Sep 16 14:15:02.300239 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1896/3782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:01 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:02.319879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:02.329320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:02.369279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:02.370595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:02.371707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:02.373262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:02.375046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:02.376319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:02.505941 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c9776c5-9bda-473f-b91f-4c5b4024d752 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203440 Sep 16 14:15:02.517359 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1897/3783] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:15:02 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:02.523902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:02.524954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:02.533259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:02.546695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:02.549434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:02.552775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:02.553686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:02.555527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:03.193133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:03.240539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:03.248666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:03.252215 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8659f30a-cb75-4fb5-8153-ebe92e6c9cd6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.833475 Sep 16 14:15:03.254328 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1887/3784] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:15:01 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:15:03.267490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-plugged", "status": "completed", "tag": "6b9c8884-6bcf-4183-b37c-a27f8e5836cc"}, {"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-plugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:03.306012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:03.307350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:03.308315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:03.322614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:03.331721 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e292a905-4db7-4f61-9c58-d6d1b09c46b6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.812767 Sep 16 14:15:03.335747 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1898/3785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:02 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:03.338264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] Creating event network-vif-plugged:6b9c8884-6bcf-4183-b37c-a27f8e5836cc for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:15:03.339610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] Creating event network-vif-plugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:15:03.354231 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e02ed4b7-349d-4c7d-98f6-986e174c2ab5 req-dc227453-1ca6-423d-b4a6-8d14263069b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097141 Sep 16 14:15:03.355569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:03.356201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:03.363968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1888/3786] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:03.379145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:03.379645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:03.380278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:03.381223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:03.381678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:03.382349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:03.535650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:03.540318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:03.560150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:03.562970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:03.564306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:03.565901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:03.567082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:03.568139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:03.678486 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-898854e9-2cea-4950-b4db-e2581ca7404b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.156078 Sep 16 14:15:03.699857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1889/3787] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:15:03 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:15:04.165857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:04.177731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d474b102-b840-443d-8591-f6d618a2293c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 0.826265 Sep 16 14:15:04.179322 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1899/3788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:03 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:04.310230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:04.312248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:04.351742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:04.365026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:04.373690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:04.378755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:04.379455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:04.380236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:04.386379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:04.389850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:04.396632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:04.401525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:04.401994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:04.402824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:04.403305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:04.404753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:04.568721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:04.947877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:04.964993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-630a1c95-754e-4d76-9b74-7669a6416b3a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 0.590728 Sep 16 14:15:04.971262 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1900/3789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:04 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:05.221169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:05.222115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:05.244324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:05.244885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:05.246055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:05.250074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:05.250613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:05.251061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:05.323191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:05.542924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:05.557952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:05.566288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:05.567938 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8adb0565-5a8b-47dd-bb3c-8394e804197a tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1880 microversion: 2.42 time: 1.268491 Sep 16 14:15:05.572304 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1890/3790] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:15:04 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1880 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:15:06.023388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:06.024469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:06.033647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:06.043614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:06.048986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:06.050141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:06.055474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:06.064135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:06.066457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:06.077590 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed7428f3-08a5-4c04-859c-ae4afc874c71 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 0.861893 Sep 16 14:15:06.083262 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1901/3791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:05 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:06.629111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:06.629751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:06.655942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:06.656465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:06.656921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:06.661563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:06.662061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:06.662547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:07.248041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:07.271621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cbbc742b-5fb4-4f4d-a878-8b31bfcb657d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1508 microversion: 2.1 time: 1.257452 Sep 16 14:15:07.285852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1891/3792] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:06 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1508 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:07.285852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:07.285852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:07.294527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:07.295349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:07.296605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:07.298335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:07.300201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:07.308522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:07.458082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:07.495829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:07.497588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:07.508715 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de9ae462-e3d5-40c6-8cc0-fe92921af67d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2839 microversion: 2.42 time: 0.874785 Sep 16 14:15:07.509593 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1902/3793] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:15:06 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2839 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:15:07.542055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:07.542055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:07.556875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:07.560986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:07.564430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:07.568789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:07.570996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:07.574018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:07.679674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:07.692883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed465749-fef6-47e2-ac0d-7d5f1e2a3131 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 0.419184 Sep 16 14:15:07.694273 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1892/3794] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:07 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:08.034955 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-489c4a50-6d25-485a-982e-48f33c62cdda tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.498263 Sep 16 14:15:08.035815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1903/3795] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 14:15:07 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38/os-interface => generated 1832 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:15:08.327546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:08.328197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:08.341143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:08.346048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:08.346765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:08.347723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:08.348209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:08.348647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:08.745843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:08.748105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:08.761259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:08.761766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:08.762207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:08.762968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:08.763432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:08.770719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:10.685918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:10.734422 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1831051b-48a3-4df4-a340-cc74f4f656ec tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1529 microversion: 2.1 time: 2.407274 Sep 16 14:15:10.735906 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1893/3796] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:08 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1529 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:11.056741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:11.084967 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7897b994-a641-41de-980e-dc761ce4fdee tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 2.344524 Sep 16 14:15:11.086043 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1904/3797] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:08 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:11.787868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:11.788766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:11.793635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:11.819757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:11.822750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:11.826065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:11.829603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:11.831428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:11.832110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:12.138999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:12.141951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:12.162466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:12.164747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:12.166608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:12.168822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:12.171416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:12.173219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:12.538150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:12.608339 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-478a203a-2b67-4b13-bd1a-38099825d82f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1529 microversion: 2.1 time: 0.824148 Sep 16 14:15:12.615655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1894/3798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:11 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1529 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:12.638444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4bc171d2-56d6-4c6d-9a04-211f18186383 req-77051c6c-ec0f-498e-8c3b-372e3c4245ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea8ca13-617d-4407-9832-09eca69ec983", "name": "network-vif-plugged", "status": "completed", "tag": "db6c780b-3adc-40d9-bf33-33aba13091ef"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:12.707036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4bc171d2-56d6-4c6d-9a04-211f18186383 req-77051c6c-ec0f-498e-8c3b-372e3c4245ec service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:12.711563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4bc171d2-56d6-4c6d-9a04-211f18186383 req-77051c6c-ec0f-498e-8c3b-372e3c4245ec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:12.718289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4bc171d2-56d6-4c6d-9a04-211f18186383 req-77051c6c-ec0f-498e-8c3b-372e3c4245ec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:12.800703 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4bc171d2-56d6-4c6d-9a04-211f18186383 req-77051c6c-ec0f-498e-8c3b-372e3c4245ec service nova] Creating event network-vif-plugged:db6c780b-3adc-40d9-bf33-33aba13091ef for instance 2ea8ca13-617d-4407-9832-09eca69ec983 on n-h2-858129-2 Sep 16 14:15:12.841128 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4bc171d2-56d6-4c6d-9a04-211f18186383 req-77051c6c-ec0f-498e-8c3b-372e3c4245ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220441 Sep 16 14:15:12.846575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1895/3799] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:13.165379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:13.200911 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-64ae0f6e-f2f4-49f5-a871-e5e13463ef3f tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 1.070611 Sep 16 14:15:13.242215 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1905/3800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:12 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:13.669401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:13.691760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:13.736777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:13.739842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:13.741628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:13.745050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:13.748846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:13.750958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:13.915982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1c94b0ad-087c-46b4-bcd7-f99a5276b658 req-b47e6fdd-f9ff-451a-8fc2-7839b03a53e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "tag": "6b9c8884-6bcf-4183-b37c-a27f8e5836cc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:13.997339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1c94b0ad-087c-46b4-bcd7-f99a5276b658 req-b47e6fdd-f9ff-451a-8fc2-7839b03a53e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:14.015197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1c94b0ad-087c-46b4-bcd7-f99a5276b658 req-b47e6fdd-f9ff-451a-8fc2-7839b03a53e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:14.016009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1c94b0ad-087c-46b4-bcd7-f99a5276b658 req-b47e6fdd-f9ff-451a-8fc2-7839b03a53e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:14.127316 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1c94b0ad-087c-46b4-bcd7-f99a5276b658 req-b47e6fdd-f9ff-451a-8fc2-7839b03a53e2 service nova] Creating event network-changed:6b9c8884-6bcf-4183-b37c-a27f8e5836cc for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:15:14.170315 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1c94b0ad-087c-46b4-bcd7-f99a5276b658 req-b47e6fdd-f9ff-451a-8fc2-7839b03a53e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263893 Sep 16 14:15:14.195819 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1906/3801] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:15:14.257534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:14.258719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:14.322987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:14.324215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:14.325263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:14.326766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:14.328517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:14.330955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:15.515778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:15.537939 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0a1b71c-54cd-47a4-a04d-1874895eb1ef tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.876868 Sep 16 14:15:15.551332 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1896/3802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:13 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:15.567932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1a488a6f-93bd-426c-9b03-33ba4f3ad135 req-e6cdbe0b-8f36-419c-ad84-7fbf4ec68dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9", "name": "network-vif-plugged", "status": "completed", "tag": "280e464f-8eb1-4a08-81ff-d6817bececa2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:15.620428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1a488a6f-93bd-426c-9b03-33ba4f3ad135 req-e6cdbe0b-8f36-419c-ad84-7fbf4ec68dc6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:15.624824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1a488a6f-93bd-426c-9b03-33ba4f3ad135 req-e6cdbe0b-8f36-419c-ad84-7fbf4ec68dc6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:15.626672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1a488a6f-93bd-426c-9b03-33ba4f3ad135 req-e6cdbe0b-8f36-419c-ad84-7fbf4ec68dc6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:15.713032 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1a488a6f-93bd-426c-9b03-33ba4f3ad135 req-e6cdbe0b-8f36-419c-ad84-7fbf4ec68dc6 service nova] Creating event network-vif-plugged:280e464f-8eb1-4a08-81ff-d6817bececa2 for instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 on n-h2-858129-2 Sep 16 14:15:15.737458 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1a488a6f-93bd-426c-9b03-33ba4f3ad135 req-e6cdbe0b-8f36-419c-ad84-7fbf4ec68dc6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183823 Sep 16 14:15:15.743211 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1897/3803] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:16.597716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:16.608439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:16.646906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:16.664582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:16.672573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:16.676753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:16.681955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:16.684083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:16.688824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:16.751381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32969dbb-df2b-40d4-855a-ac4548178335 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1308 microversion: 2.1 time: 2.484506 Sep 16 14:15:16.762345 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1907/3804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:14 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1308 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:17.819293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:17.823858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:17.841394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:17.857342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:17.859549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:17.860234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:17.861766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:17.864587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:17.866568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:17.979831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:17.997547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c3e7321-321e-4419-9ace-bba4952f2c08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.416044 Sep 16 14:15:17.998150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1898/3805] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:16 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:18.340011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:18.352008 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfc31c60-1f5d-40bf-8a05-9d52e60c2fe9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1490 microversion: 2.1 time: 0.545939 Sep 16 14:15:18.353427 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1908/3806] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:17 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1490 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:18.399414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1105664212"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:18.402797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:18.430537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:18.437022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:18.438107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:18.439165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:18.443218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:18.443933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:18.747414 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c70869e1-0277-4744-b994-9d94ab0d2642 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "PUT /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1076 microversion: 2.1 time: 0.336784 Sep 16 14:15:18.752923 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1899/3807] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:15:18 2022] PUT /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1076 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:18.835439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:18.838500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:18.903499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:18.906921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:18.908334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:18.913165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:18.916288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:18.918606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:19.049160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:19.049784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:19.058569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:19.075302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:19.076001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:19.078602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:19.079317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:19.079656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:19.585811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:19.607355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3ee0ff70-f270-470f-acb0-5833064bd54a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1502 microversion: 2.1 time: 0.789881 Sep 16 14:15:19.608984 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1909/3808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:18 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1502 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:19.630697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:19.631994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:19.645816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:19.649009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:19.651052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:19.652004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:19.654254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:19.656552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:20.192860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:20.245168 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49d967c4-ab7f-4757-a97a-4b957b7f057b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.187988 Sep 16 14:15:20.266486 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1900/3809] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:19 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:20.709065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:20.748575 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93c9a9b8-3dcd-4bfa-880d-9e3fd66f9b4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1502 microversion: 2.1 time: 1.121362 Sep 16 14:15:20.759652 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1910/3810] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:19 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1502 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:20.800391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0c8b0d50-4526-43ae-a16b-b5ddcbb71507 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:20.822225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c8b0d50-4526-43ae-a16b-b5ddcbb71507 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:20.823730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c8b0d50-4526-43ae-a16b-b5ddcbb71507 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:20.824770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c8b0d50-4526-43ae-a16b-b5ddcbb71507 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:20.934752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0c8b0d50-4526-43ae-a16b-b5ddcbb71507 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Going to try to stop instance {{(pid=128642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:15:21.028801 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0c8b0d50-4526-43ae-a16b-b5ddcbb71507 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "POST /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983/action" status: 202 len: 0 microversion: 2.1 time: 0.246119 Sep 16 14:15:21.029390 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1901/3811] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:15:20 2022] POST /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:15:21.038749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:21.039633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:21.052347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:21.053103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:21.053785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:21.062786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:21.063082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:21.063661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:21.292958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:21.293791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:21.312808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:21.327909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:21.328648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:21.329634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:21.330333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:21.330987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:22.208967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:22.239519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29992f4b-8d77-4d54-8458-2726ca3e501b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.950756 Sep 16 14:15:22.245610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:22.271834 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1902/3812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:21 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:22.282018 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-372a46e5-2be6-4b76-a21c-c8fb6ab84372 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 1.246886 Sep 16 14:15:22.283132 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1911/3813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:21 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:23.338313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:23.343541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:23.344404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:23.350208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:23.383893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:23.384406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:23.392475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:23.394377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:23.396315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:23.398928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:23.420402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:23.423578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:23.429276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:23.433661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:23.436706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:23.439391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:23.750061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:23.759983 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f187c0e-f8ef-42aa-90a8-38e71628659b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.445730 Sep 16 14:15:23.778907 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1903/3814] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:23 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:24.124382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:24.184018 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60606cc7-1984-48ed-8863-4a592843c912 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 0.849962 Sep 16 14:15:24.184899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1912/3815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:23 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:24.794838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:24.795626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:24.819388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:24.823618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:24.824333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:24.825666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:24.829219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:24.830162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:25.251816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:25.255599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:25.330439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:25.335729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:25.342797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:25.343991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:25.345363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:25.346311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:26.248756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:26.285379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3f5d320-377c-4e44-a951-ebd6b4f645e8 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.496786 Sep 16 14:15:26.313120 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1904/3816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:24 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:26.422965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:26.441679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9975e53d-f889-42a8-a363-6b57ec58a1de tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 1.211250 Sep 16 14:15:26.449448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1913/3817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:25 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:27.324797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:27.325519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:27.358902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:27.359704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:27.360352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:27.361294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:27.362001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:27.362774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:27.489696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:27.491978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:27.501761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:27.502695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:27.503382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:27.504790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:27.505549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:27.506655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:27.753577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:27.765926 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09ffa711-1888-42b9-9d36-37443e561ec3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.446001 Sep 16 14:15:27.771350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1905/3818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:27 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:28.054935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:28.073150 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3adf0e9b-7372-4100-9d41-339573e9d879 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 0.579860 Sep 16 14:15:28.075790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1914/3819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:27 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:28.824580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:28.826243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:28.847918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:28.848935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:28.850274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:28.851308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:28.851962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:28.852571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:29.101381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:29.102703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:29.117325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:29.125285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:29.126304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:29.130396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:29.131164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:29.131943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:29.329842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:29.336025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:29.359645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4b376849-d6f2-4bed-bdc8-30f033816086 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.542672 Sep 16 14:15:29.368849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1906/3820] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:28 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:29.536048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:29.561899 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d14fb8c-6924-4495-9a5f-861230665ed0 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 0.456596 Sep 16 14:15:29.564467 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1915/3821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:29 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:30.398658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:30.399842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:30.464401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:30.466087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:30.467971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:30.469957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:30.470648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:30.471318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:30.616743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:30.620839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:30.645433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:30.646336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:30.647096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:30.649380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:30.652816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:30.652816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:30.957213 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:15:30.957758 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:15:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 (ip 10.222.0.60) !!! Sep 16 14:15:31.022822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:31.060494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61b52738-ddf7-47a8-8ed6-fd6c4e6e6b02 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.668211 Sep 16 14:15:31.061733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1907/3822] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:30 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:31.286232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:31.340351 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2d5b01f-4fb9-4775-9181-93dc920fc0c1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 0.733471 Sep 16 14:15:31.344033 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1916/3823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:30 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:32.130986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:32.132313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:32.177240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:32.181711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:32.202306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:32.206674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:32.207551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:32.208358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:32.375696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:32.381844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:32.423911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:32.427475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:32.430242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:32.439495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:32.440802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:32.450269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:32.967004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:32.984385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f799e06-2684-46b4-8a6f-5b2a97e887a7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.882960 Sep 16 14:15:32.985180 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1908/3824] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:32 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:33.003441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:33.071168 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c235eee-a482-4dce-868a-095efddc40f1 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 0.705328 Sep 16 14:15:33.074803 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1917/3825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:32 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:33.489300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-225870512", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "55745911-4ef9-4717-8941-e4cf0b5f6430"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:33.766292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:33.767518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:33.796766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:33.799680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:33.800355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:33.801316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:33.801869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:33.802317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:34.064850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:34.082498 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19f95b1e-f196-401a-9cb4-3bb2e086e374 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.324875 Sep 16 14:15:34.085677 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1918/3826] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:33 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:34.103731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:34.104872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:34.125679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:34.126202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:34.129212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:34.130191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:34.130774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:34.131262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:34.146950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:34.359057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:34.370078 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d07188b5-93c1-46ae-99d3-06ec8d348764 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.282667 Sep 16 14:15:34.371374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1919/3827] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:34 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:34.396071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:34.396961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:34.412159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:34.415332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:34.415789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:34.419713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:34.420496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:34.421340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:34.733627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:34.746523 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-710f23cb-d00a-493a-b167-60d1782ad7fa tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1512 microversion: 2.1 time: 0.373699 Sep 16 14:15:34.747799 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1920/3828] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:34 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:34.965926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] validate_networks() for [('55745911-4ef9-4717-8941-e4cf0b5f6430', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:15:35.124833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:35.125791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:35.140390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:35.140390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:35.141058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:35.142086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:35.144812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:35.146389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:35.685497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:35.709766 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-535180cb-a310-4f81-a503-34e2da4b5152 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.590418 Sep 16 14:15:35.711693 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1921/3829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:35 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:35.721872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:35.723505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:35.735517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:35.736704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:35.737694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:35.750321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:35.754845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:35.758317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:37.213807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:37.245247 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e58de34e-a69c-4c85-94b9-01207ea2931d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.531427 Sep 16 14:15:37.251684 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1922/3830] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:35 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:37.652559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:15:37.653363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:15:37.653947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:15:37.654722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:15:37.655920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:15:37.699085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:37.700159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:37.702668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:37.706146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:37.709286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:37.712547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:37.782121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Getting quotas for project 88869642aeff4b1a991a8975dddecbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:15:37.797326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Getting quotas for user 69468bb491204f15b5afaa71b5c66837 and project 88869642aeff4b1a991a8975dddecbaf. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:15:37.831949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:15:37.837817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:15:37.982008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b2c5365-ebe3-4cde-8d39-6495aba1cf1f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.825966 Sep 16 14:15:37.983460 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1909/3831] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:15:37.997329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:37.997957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:38.036422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:38.043191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:38.045041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:38.047469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:38.048480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:38.050330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:38.584495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:38.607028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d404bd8-1a0b-4796-a778-44ebf9d8033b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.621593 Sep 16 14:15:38.609074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1910/3832] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:37 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:38.619044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db232597-6a24-44dd-acb6-3dd6c957774a tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:38.620122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-db232597-6a24-44dd-acb6-3dd6c957774a tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:38.654161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:38.658281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:38.710791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:38.711437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:38.711961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:38.714446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:38.717045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:38.717650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:38.875013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-db232597-6a24-44dd-acb6-3dd6c957774a tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:38.900568 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db232597-6a24-44dd-acb6-3dd6c957774a tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1224 microversion: 2.1 time: 0.289657 Sep 16 14:15:38.911973 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1911/3833] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:38 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1224 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:38.934797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:38.938932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:38.970032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:38.976376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:38.980081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:38.981179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:38.985732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:38.989201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:39.193999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:39.209805 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-536921e1-a376-4e66-b323-e8cf3e875c45 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1489 microversion: 2.1 time: 1.953697 Sep 16 14:15:39.217737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1923/3834] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:37 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1489 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:39.234165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-191282162"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:39.247643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:39.268854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:39.270169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:39.270890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:39.273462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:39.275496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:39.276243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:39.602265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:39.612870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e284089b-3795-49ab-9951-1f8caa71f839 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.699452 Sep 16 14:15:39.622898 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1912/3835] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:38 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:39.651717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1391153399"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:39.665019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:39.693959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:39.694463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:39.703835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:39.711145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:39.712768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:39.713247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:39.919679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d9d7e37-1a23-496e-8fd2-896160e14c58 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "PUT /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1062 microversion: 2.1 time: 0.294115 Sep 16 14:15:39.952676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1913/3836] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:15:39 2022] PUT /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1062 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:39.961915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:39.963556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:39.981402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:39.982310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:39.984010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:39.987972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:39.989042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:39.991071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:40.382967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:40.402798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-117db40c-2f37-49fd-b638-7db4c7930892 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1228 microversion: 2.1 time: 0.448475 Sep 16 14:15:40.410443 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be03e790-b275-4961-9045-b28728fdf143 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 1.190463 Sep 16 14:15:40.412608 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1914/3837] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:39 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1228 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:40.413302 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1924/3838] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:15:39 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 16 14:15:40.426348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:40.427181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:40.451739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c87fb3e7-b27c-42d6-ad0e-47fc211d47ea req-46ac11ee-9e6d-40ee-a68a-ef246c6c47b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-unplugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:40.484422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:40.491323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:40.491946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:40.501276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:40.501996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:40.502234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:40.513063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c87fb3e7-b27c-42d6-ad0e-47fc211d47ea req-46ac11ee-9e6d-40ee-a68a-ef246c6c47b5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:40.513258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c87fb3e7-b27c-42d6-ad0e-47fc211d47ea req-46ac11ee-9e6d-40ee-a68a-ef246c6c47b5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:40.521498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c87fb3e7-b27c-42d6-ad0e-47fc211d47ea req-46ac11ee-9e6d-40ee-a68a-ef246c6c47b5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:40.568564 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c87fb3e7-b27c-42d6-ad0e-47fc211d47ea req-46ac11ee-9e6d-40ee-a68a-ef246c6c47b5 service nova] Creating event network-vif-unplugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:15:40.609061 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c87fb3e7-b27c-42d6-ad0e-47fc211d47ea req-46ac11ee-9e6d-40ee-a68a-ef246c6c47b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186023 Sep 16 14:15:40.611163 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1915/3839] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:40.648401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:40.650660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:40.687365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:40.695272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:40.699677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:40.707683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:40.715819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:40.722043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:41.288808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:41.317983 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f5a6e18-f1d0-45f5-84ca-25666c1221cc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1489 microversion: 2.1 time: 0.903067 Sep 16 14:15:41.328179 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1925/3840] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:40 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1489 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:41.353667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:41.354661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:41.362826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:41.363945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:41.364597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:41.365864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:41.366524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:41.367139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:41.562004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:41.578759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-acb70ab6-364a-451c-a87f-487ba1a5787a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.932936 Sep 16 14:15:41.580150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1916/3841] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:40 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:41.609369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:41.613021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:41.628933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:41.646059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:41.649756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:41.652272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:41.658881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:41.659798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:41.789186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:41.802392 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f344b263-ac4d-4c50-a2d2-417ca2e37e7f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1276 microversion: 2.1 time: 0.220800 Sep 16 14:15:41.804751 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1917/3842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:41 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:42.220467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:42.271009 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f4aa354-2453-4c98-869f-b8e35b0ed6cf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1489 microversion: 2.1 time: 0.916600 Sep 16 14:15:42.304143 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1926/3843] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:41 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1489 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:42.333256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:42.333769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:42.337285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:42.344899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:42.345717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:42.346329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:42.347269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:42.348043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:42.348643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:42.387464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:15:42.590796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8170af26-b4a1-45ec-85f2-100e8f7f3127 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 204 len: 0 microversion: 2.1 time: 0.261981 Sep 16 14:15:42.598276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1918/3844] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:42 2022] DELETE /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:15:42.605284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:42.605989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:42.627088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:42.627600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:42.634665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:42.635616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:42.642604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:42.646321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:42.646871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:42.647329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:42.671066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:42.671760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:42.682954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:42.690358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:42.698699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:42.699259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:44.062101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:44.093857 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3853822-5f72-49dd-bb11-1e714bc36c6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.463506 Sep 16 14:15:44.095827 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1919/3845] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:42 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:44.116162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:44.118510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:44.152622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:44.153461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:44.154064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:44.155015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:44.155640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:44.156341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:44.456616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:44.463742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:44.488072 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d173cb2b-57d1-4291-922c-d8d3440d8182 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1282 microversion: 2.1 time: 0.387424 Sep 16 14:15:44.496494 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1920/3846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:44 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1282 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:44.523842 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fcead23-26b4-4076-8036-0d97e19af4eb tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1495 microversion: 2.1 time: 1.923628 Sep 16 14:15:44.563522 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1927/3847] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:42 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1495 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:45.143983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:45.145075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:45.158997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:45.159926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:45.160603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:45.169876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:45.171627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:45.172277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:45.523264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:45.523891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:45.535203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:45.543411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:45.544804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:45.545993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:45.546687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:45.547296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:46.023514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:46.053617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cce60489-c7f7-49ca-aa49-b9e197eefe6e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.917143 Sep 16 14:15:46.066631 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1921/3848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:45 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:46.083072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:46.087631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:46.128161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:46.128708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:46.129157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:46.129887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:46.130358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:46.130818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:46.403438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:46.416727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-465765b0-e3d4-4d8f-9ecd-5bb5d8c17813 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 200 len: 1292 microversion: 2.1 time: 0.348579 Sep 16 14:15:46.417376 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1922/3849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:46 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 1292 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:46.436866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f125a2ef-726a-45a5-9250-a19805aaf5f8 req-52f0585f-b63a-4c6f-a925-f36fd77bf8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea8ca13-617d-4407-9832-09eca69ec983", "name": "network-vif-deleted", "tag": "db6c780b-3adc-40d9-bf33-33aba13091ef"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:46.483819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f125a2ef-726a-45a5-9250-a19805aaf5f8 req-52f0585f-b63a-4c6f-a925-f36fd77bf8ab service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:46.484850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f125a2ef-726a-45a5-9250-a19805aaf5f8 req-52f0585f-b63a-4c6f-a925-f36fd77bf8ab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:46.485468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f125a2ef-726a-45a5-9250-a19805aaf5f8 req-52f0585f-b63a-4c6f-a925-f36fd77bf8ab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:46.500469 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f125a2ef-726a-45a5-9250-a19805aaf5f8 req-52f0585f-b63a-4c6f-a925-f36fd77bf8ab service nova] Creating event network-vif-deleted:db6c780b-3adc-40d9-bf33-33aba13091ef for instance 2ea8ca13-617d-4407-9832-09eca69ec983 on n-h2-858129-2 Sep 16 14:15:46.514491 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f125a2ef-726a-45a5-9250-a19805aaf5f8 req-52f0585f-b63a-4c6f-a925-f36fd77bf8ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082146 Sep 16 14:15:46.515456 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1923/3850] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:46.565045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:46.597052 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-917561b4-1d91-4a9c-9cba-d2dda69c64fe tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.077662 Sep 16 14:15:46.597734 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1928/3851] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:45 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:47.086312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:47.087357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:47.105184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.107404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.109871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.112860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.117686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.118578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.185447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:47.445202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:47.446350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:47.464245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.467172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.469785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.472142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.474650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.475567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.526834 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 HTTP/1.1 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2ea8ca13-617d-4407-9832-09eca69ec983'} Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.533701 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:47.541966 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-560d1305-0f40-4b1d-8570-05dd304eaa06 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 404 len: 111 microversion: 2.1 time: 0.099495 Sep 16 14:15:47.548860 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1929/3852] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:47 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:47.567891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:47.568938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:47.578430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.584768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.585778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.588752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.599786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.600559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.649837 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 HTTP/1.1 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2ea8ca13-617d-4407-9832-09eca69ec983'} Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:47.651991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:47.655962 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:15:47.658118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:47.659387 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5066adb9-4563-43ad-8c8a-470ef8fccf28 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 404 len: 111 microversion: 2.1 time: 0.100615 Sep 16 14:15:47.660582 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1930/3853] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:47 2022] DELETE /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:15:47.688356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:47.692086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:47.734761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.734761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.734761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.734761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.734761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.734761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.758368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:47.840977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:47.871522 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8ccc6e94-c178-49e5-bd30-d4c16577ff5a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.790029 Sep 16 14:15:47.881278 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1924/3854] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:47 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:47.912947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:47.917808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 2ea8ca13-617d-4407-9832-09eca69ec983] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:47.956165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.963531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.968045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:47.969878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:47.971138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:47.998851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.082861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 HTTP/1.1 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '2ea8ca13-617d-4407-9832-09eca69ec983'} Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.087864 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.091678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.091678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.091678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.091678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.091678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. Sep 16 14:15:48.091678 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.094264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 2ea8ca13-617d-4407-9832-09eca69ec983 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.099317 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2feb431-3fb3-4ced-8f13-3df766ac2300 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983" status: 404 len: 111 microversion: 2.1 time: 0.213765 Sep 16 14:15:48.100321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1925/3855] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:47 2022] GET /compute/v2.1/servers/2ea8ca13-617d-4407-9832-09eca69ec983 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:48.115023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.117833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.146630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.152212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.159776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.162069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.163372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.166020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.247847 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f HTTP/1.1 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7f0f8c0f-d966-4249-b803-53fd9115d63f'} Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.251818 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.259095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.264491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.270500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17f0cc2d-1074-4058-be20-ce629304f38d tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 404 len: 111 microversion: 2.1 time: 0.162095 Sep 16 14:15:48.272202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1926/3856] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:48 2022] DELETE /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:15:48.283353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.283990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7f0f8c0f-d966-4249-b803-53fd9115d63f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.315074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.315589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.316061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.316810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.317283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.317816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.360834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f HTTP/1.1 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7f0f8c0f-d966-4249-b803-53fd9115d63f'} Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.379640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.383133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.383133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.383133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.383133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.383133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. Sep 16 14:15:48.383133 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.387442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 7f0f8c0f-d966-4249-b803-53fd9115d63f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.390829 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-874764ee-3fcf-4f6e-b1c6-3455696cd1d9 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f" status: 404 len: 111 microversion: 2.1 time: 0.114273 Sep 16 14:15:48.399771 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1927/3857] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:48 2022] GET /compute/v2.1/servers/7f0f8c0f-d966-4249-b803-53fd9115d63f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:48.405239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.418734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.448112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.452697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.456342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.463355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.465532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.466235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.509766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce HTTP/1.1 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c78169dc-14a1-479e-b95f-6bab772aacce'} Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.513791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.517229 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.519699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.521932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08fa2581-1092-45f9-b1cf-cd94d8fbf4ed tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 404 len: 111 microversion: 2.1 time: 0.120738 Sep 16 14:15:48.525782 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1928/3858] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:48 2022] DELETE /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:48.549128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.557882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: c78169dc-14a1-479e-b95f-6bab772aacce] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.578490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.587939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.590337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.592961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.599206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.601881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.633304 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce HTTP/1.1 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c78169dc-14a1-479e-b95f-6bab772aacce'} Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.640087 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.645152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.645152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.645152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.645152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.645152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. Sep 16 14:15:48.645152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.646023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance c78169dc-14a1-479e-b95f-6bab772aacce could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.648176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bed4cb95-1f32-47c8-9a57-165e61b05e55 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce" status: 404 len: 111 microversion: 2.1 time: 0.116251 Sep 16 14:15:48.655981 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1929/3859] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:48 2022] GET /compute/v2.1/servers/c78169dc-14a1-479e-b95f-6bab772aacce => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:48.662500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.663247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.664932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:48.671182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.672094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.672661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.673589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.674181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.674798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.710616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb HTTP/1.1 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0737b8b6-face-435b-b259-34523816febb'} Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.712514 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.717861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.720584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-742eda49-c553-4016-b1e2-9b363144dbaf tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 404 len: 111 microversion: 2.1 time: 0.063164 Sep 16 14:15:48.727296 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1930/3860] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:48 2022] DELETE /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:48.729801 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ab8e22c-f8d3-4366-a2e6-459c58d355cc tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.061210 Sep 16 14:15:48.737090 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1931/3861] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:47 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:48.754157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.767716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 0737b8b6-face-435b-b259-34523816febb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.788646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.794908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.798834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.802834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.806988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.810315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.873036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb HTTP/1.1 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0737b8b6-face-435b-b259-34523816febb'} Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.875805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:48.879174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:48.879174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:48.879174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:48.879174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:48.879174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. Sep 16 14:15:48.879174 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:48.886016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 0737b8b6-face-435b-b259-34523816febb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:48.890367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9bf9e176-070e-4844-823e-77f1fc65a038 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb" status: 404 len: 111 microversion: 2.1 time: 0.161718 Sep 16 14:15:48.915539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.916934 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1931/3862] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:48 2022] GET /compute/v2.1/servers/0737b8b6-face-435b-b259-34523816febb => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:48.918251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.937073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:48.945290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:48.953185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=48 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:48.964106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.968059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.971709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.973007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:48.976536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.979026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.982000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.987571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.989622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:48.992431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:48.997805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:48.998820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.006226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.103076 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 HTTP/1.1 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '338a3ce1-f2bc-46c9-80de-52601116e911'} Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:49.122823 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.130699 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.137326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:49.139654 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13d5fecd-5a23-4b74-96a1-a2fd05a6147c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 404 len: 111 microversion: 2.1 time: 0.221128 Sep 16 14:15:49.143581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1932/3863] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:48 2022] DELETE /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:49.158997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:49.160276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 338a3ce1-f2bc-46c9-80de-52601116e911] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:49.202776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.204144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.206937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.210201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.214162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.215574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.272071 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 HTTP/1.1 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '338a3ce1-f2bc-46c9-80de-52601116e911'} Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.276218 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.285641 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.285641 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.285641 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:49.285641 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:49.285641 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. Sep 16 14:15:49.285641 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.302886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 338a3ce1-f2bc-46c9-80de-52601116e911 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:49.314438 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-95f2a2ed-532b-48bf-b604-fb8c10003fcc tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911" status: 404 len: 111 microversion: 2.1 time: 0.165518 Sep 16 14:15:49.332613 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1933/3864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:49 2022] GET /compute/v2.1/servers/338a3ce1-f2bc-46c9-80de-52601116e911 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:49.347684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:49.348804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:49.377589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.378456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.379225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.380564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.389931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.391209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.458813 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 HTTP/1.1 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '05b5d40f-084a-4cda-b2f8-5cf865da2df1'} Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:49.491599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.499900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:49.503169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff7388e1-2c6e-4136-99f0-7da935eddd50 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 404 len: 111 microversion: 2.1 time: 0.166479 Sep 16 14:15:49.504192 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1934/3865] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:49 2022] DELETE /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:49.530573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:49.532564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 05b5d40f-084a-4cda-b2f8-5cf865da2df1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:49.567946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.570871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.573437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.578520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.580752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.588947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.737328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:49.753098 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7451e087-55dd-4b04-a2af-5d94d7ed6370 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.847230 Sep 16 14:15:49.755984 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1932/3866] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:48 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:49.769871 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.773879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:49.780186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 HTTP/1.1 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '05b5d40f-084a-4cda-b2f8-5cf865da2df1'} Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.793377 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:49.806244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:49.806244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:49.806244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:49.806244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:49.806244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. Sep 16 14:15:49.806244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:49.813656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 05b5d40f-084a-4cda-b2f8-5cf865da2df1 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:49.815812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.824616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.826699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.829820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.830585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.830917 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f77b0fe6-b327-41c6-8251-d65d04198a2a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1" status: 404 len: 111 microversion: 2.1 time: 0.313249 Sep 16 14:15:49.831251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.839143 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1935/3867] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:49 2022] GET /compute/v2.1/servers/05b5d40f-084a-4cda-b2f8-5cf865da2df1 => generated 111 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:49.899681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:49.903025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7dd6d593-fd41-48d0-a9dc-dedaaceafba9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:49.940583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.942194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.943419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:49.951071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:49.953302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:49.956054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.007640 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 HTTP/1.1 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7dd6d593-fd41-48d0-a9dc-dedaaceafba9'} Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:50.015070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.028175 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.031021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:50.033341 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e42798e-43dd-49d8-8c3c-ce09a74139ac tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9" status: 404 len: 111 microversion: 2.1 time: 0.188116 Sep 16 14:15:50.037695 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1936/3868] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:49 2022] DELETE /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:50.057077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:50.057861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: 7dd6d593-fd41-48d0-a9dc-dedaaceafba9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:50.066068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.066628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.067220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.068003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.068555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.069049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.104344 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 HTTP/1.1 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7dd6d593-fd41-48d0-a9dc-dedaaceafba9'} Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.109594 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:50.118193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance 7dd6d593-fd41-48d0-a9dc-dedaaceafba9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:50.122505 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a0b64cd-f472-4155-8a6c-db7bfd0f602e tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9" status: 404 len: 111 microversion: 2.1 time: 0.070834 Sep 16 14:15:50.122505 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1937/3869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:50 2022] GET /compute/v2.1/servers/7dd6d593-fd41-48d0-a9dc-dedaaceafba9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:50.136106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:50.137178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:50.151783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.152727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.153413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.154736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.155751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.156379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.193797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:15:50.440651 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1bf8bb7a-eb26-41e2-8cfe-8ea5ddf45163 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 204 len: 0 microversion: 2.1 time: 0.309951 Sep 16 14:15:50.447166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1938/3870] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:15:50 2022] DELETE /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:15:50.464569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:50.466946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:50.484485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.486077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.487378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.501274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.503412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.509071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.621067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:50.663708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-407c57b8-7395-4506-84c6-e2377dad2866 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 0.900045 Sep 16 14:15:50.679144 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1933/3871] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:49 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:50.702696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-204d7910-8bf6-4519-a43d-bbaddb87b76b req-b5e5fb66-5fbc-4c5d-bc42-243805afe9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b557d2b-a03d-4ae9-9ac0-e7622662ea70", "tag": "47224649-fdcf-4799-972f-47b3715870d1"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:50.735254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-204d7910-8bf6-4519-a43d-bbaddb87b76b req-b5e5fb66-5fbc-4c5d-bc42-243805afe9a1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.736040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-204d7910-8bf6-4519-a43d-bbaddb87b76b req-b5e5fb66-5fbc-4c5d-bc42-243805afe9a1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.736647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-204d7910-8bf6-4519-a43d-bbaddb87b76b req-b5e5fb66-5fbc-4c5d-bc42-243805afe9a1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.758816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-204d7910-8bf6-4519-a43d-bbaddb87b76b req-b5e5fb66-5fbc-4c5d-bc42-243805afe9a1 service nova] Creating event network-changed:47224649-fdcf-4799-972f-47b3715870d1 for instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 on n-h2-858129-2 Sep 16 14:15:50.776893 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-204d7910-8bf6-4519-a43d-bbaddb87b76b req-b5e5fb66-5fbc-4c5d-bc42-243805afe9a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096128 Sep 16 14:15:50.778187 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1934/3872] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:50.802960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:50.803963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:50.815163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.819210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.819939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:50.820921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:50.822921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:50.831216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:51.423432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:51.463701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c24ac92-6e13-4d0f-a52a-6023e71ea983 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1479 microversion: 2.1 time: 1.012932 Sep 16 14:15:51.487016 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1939/3873] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:50 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1479 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:15:51.664711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b69ece66-825b-44e0-a86a-4eba2d1d136e req-5380305c-02fc-4377-a92f-59a8e10ce76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-plugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:51.720948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b69ece66-825b-44e0-a86a-4eba2d1d136e req-5380305c-02fc-4377-a92f-59a8e10ce76c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:51.722249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b69ece66-825b-44e0-a86a-4eba2d1d136e req-5380305c-02fc-4377-a92f-59a8e10ce76c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:51.723495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b69ece66-825b-44e0-a86a-4eba2d1d136e req-5380305c-02fc-4377-a92f-59a8e10ce76c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:51.776208 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b69ece66-825b-44e0-a86a-4eba2d1d136e req-5380305c-02fc-4377-a92f-59a8e10ce76c service nova] Creating event network-vif-plugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:15:51.799777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b69ece66-825b-44e0-a86a-4eba2d1d136e req-5380305c-02fc-4377-a92f-59a8e10ce76c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142231 Sep 16 14:15:51.801632 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1940/3874] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:51.823391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:51.825460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:51.849400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:51.885372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:51.892491 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2b1f4a8-4b69-4343-bf2c-5040ca71bc11 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.093808 Sep 16 14:15:51.899584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:51.900227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:51.901363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:51.902137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:51.912403 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1935/3875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:50 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:51.913804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:52.520752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:52.521455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:52.550538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:52.553992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:52.557967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:52.562627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:52.569199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:52.573350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:52.702267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:15:53.231217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:53.285548 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-761a9281-b501-4f2a-8ee9-235f3d6d263e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.480735 Sep 16 14:15:53.310975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1941/3876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:51 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:53.724929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Calling method '.version_select at 0x7f724c23f550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:53.745980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:53.746911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:53.748264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:53.830915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:53.831509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:53.832091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:53.871749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:53.875099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:53.875947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:53.897390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8964d01d-9ae7-43f3-a820-374fb735f06e tempest-PortsAdminExtendedAttrsTestJSON-340976210 tempest-PortsAdminExtendedAttrsTestJSON-340976210-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.577441 Sep 16 14:15:53.898539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1942/3877] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:15:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:54.263532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:54.327439 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-961354e1-ebf3-4000-b320-5a953ee7998a tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1479 microversion: 2.1 time: 1.810081 Sep 16 14:15:54.364379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1936/3878] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:52 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1479 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:54.400581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:54.402153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:54.442556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:54.448484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:54.452165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:54.459509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:54.461530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:54.464242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:54.469893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:54.470771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:54.512890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:54.519924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:54.530382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:54.547823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:54.554055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:54.561739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:55.918112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:55.964896 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-491a841f-db35-406f-add4-798ded518d01 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 2.064894 Sep 16 14:15:55.982561 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1943/3879] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:53 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:55.995029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:56.004381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:56.037718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:56.038512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:56.039155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:56.042377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:56.045505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:56.047595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:57.184197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:57.231146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5e085f9c0f498c93a22c1e7417fdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1579fb25c9f4456b1b9fec1b34fb96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:57.244406 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-457dd0e1-1d57-42a1-9b1c-28d2da39a93f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 2.875191 Sep 16 14:15:57.245418 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1937/3880] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:54 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 2880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:57.247248 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e917717-ed2b-4a3d-8efc-e4c7bad900d6 tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 200 len: 1437 microversion: 2.1 time: 1.280359 Sep 16 14:15:57.248842 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1944/3881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:55 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 1437 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:57.254866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:57.255877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:57.287372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e51f6480-5342-4d03-b31a-f65a25033ef7 req-5e8a0f32-3df2-45c6-87f4-61973f14a7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac01276-8448-4514-8a4b-70183e0e2879", "name": "network-vif-deleted", "tag": "5ddebda4-bb49-4f29-9476-24179bb35be9"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:57.291563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:57.298053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:57.299004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:57.302944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:57.304103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:57.304800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:57.332213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e51f6480-5342-4d03-b31a-f65a25033ef7 req-5e8a0f32-3df2-45c6-87f4-61973f14a7d4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:57.333082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e51f6480-5342-4d03-b31a-f65a25033ef7 req-5e8a0f32-3df2-45c6-87f4-61973f14a7d4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:57.333833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e51f6480-5342-4d03-b31a-f65a25033ef7 req-5e8a0f32-3df2-45c6-87f4-61973f14a7d4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:57.384023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e51f6480-5342-4d03-b31a-f65a25033ef7 req-5e8a0f32-3df2-45c6-87f4-61973f14a7d4 service nova] Creating event network-vif-deleted:5ddebda4-bb49-4f29-9476-24179bb35be9 for instance aac01276-8448-4514-8a4b-70183e0e2879 on n-h2-858129-2 Sep 16 14:15:57.410236 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e51f6480-5342-4d03-b31a-f65a25033ef7 req-5e8a0f32-3df2-45c6-87f4-61973f14a7d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163101 Sep 16 14:15:57.411147 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1938/3882] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:15:57.438214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-439756497", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "941f1dd8-b04a-486d-bbeb-3b2d2413b0c1"}], "block_device_mapping_v2": [{"uuid": "48c8cbbd-fef3-4e6b-9fbf-447627b9730f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:15:57.711866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] validate_networks() for [('941f1dd8-b04a-486d-bbeb-3b2d2413b0c1', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:15:58.238460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:58.291970 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f7452c1-2e9f-44de-8a57-080f3c55c174 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.038650 Sep 16 14:15:58.296744 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1945/3883] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:57 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:58.327516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:58.336055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] [instance: aac01276-8448-4514-8a4b-70183e0e2879] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:58.359911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:58.373649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:58.394699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:58.396177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:58.396956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:58.397731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:58.456451 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] HTTP exception thrown: Instance aac01276-8448-4514-8a4b-70183e0e2879 could not be found. Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Request method failure captured: Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 HTTP/1.1 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPZ2RpP4CooHTbcI0uvXa4E3CRe-DnyBax5IPO0J8epBAZ09XeVwQbwxJKc5uUaQWdO3POQF6aBocx9lZtPWgumjrdzICSZgz2ILeFh8Y-VwX5zPsSAC5-W4I18ZcjgSfCij0K-aI3fAMDVTN3NxWWzqWrATc0yCMh3Wcz6QwukWug Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e1579fb25c9f4456b1b9fec1b34fb96e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e1579fb25c9f4456b1b9fec1b34fb96e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e1579fb25c9f4456b1b9fec1b34fb96e"}]}] Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersTestJSON-640657825 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e1579fb25c9f4456b1b9fec1b34fb96e Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersTestJSON-640657825 Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersTestJSON-640657825-project Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1d5e085f9c0f498c93a22c1e7417fdef Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersTestJSON-640657825-project Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance aac01276-8448-4514-8a4b-70183e0e2879 could not be found. Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'aac01276-8448-4514-8a4b-70183e0e2879'} Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac01276-8448-4514-8a4b-70183e0e2879 could not be found. Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac01276-8448-4514-8a4b-70183e0e2879 could not be found. Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:58.468156 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac01276-8448-4514-8a4b-70183e0e2879 could not be found. Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] Returning 404 to user: Instance aac01276-8448-4514-8a4b-70183e0e2879 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02394229-618c-42cc-a1e2-764add586c4c tempest-ServersTestJSON-640657825 tempest-ServersTestJSON-640657825-project] 10.222.0.60 "GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879" status: 404 len: 111 microversion: 2.1 time: 0.166788 Sep 16 14:15:58.476474 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1946/3884] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:58 2022] GET /compute/v2.1/servers/aac01276-8448-4514-8a4b-70183e0e2879 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:15:58.489522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:58.491375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:58.535664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:58.542658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:58.543962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:58.552138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:58.553402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:58.554497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:59.524261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:15:59.544080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b68f2ac-e49e-4305-abb5-0d463a12a1c0 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.070053 Sep 16 14:15:59.545630 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1947/3885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:58 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:15:59.555413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:15:59.555413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:15:59.568484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:59.569156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:59.570508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:15:59.571409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:15:59.575324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:15:59.575970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:00.119284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:00.193130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d25619e3-ef6f-40dd-93dd-053395a580c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.646229 Sep 16 14:16:00.223555 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1948/3886] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:15:59 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:00.581843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:00.583271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:00.616732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:00.628094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:00.629526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:00.631490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:00.632330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:00.633116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:00.686814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:00.697254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:16:00.698324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:16:00.700291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:16:00.701129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:16:00.720570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:16:00.782909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:00.787628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:00.788707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:00.799842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:00.804282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:00.805359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:00.960803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:16:00.994597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Getting quotas for user 35e0a11712764fa5b78e9ac4d1859f3a and project 0880eeb6de8348f4a18288e1a1247eb6. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:16:01.227286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:16:01.237482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48c8cbbd-fef3-4e6b-9fbf-447627b9730f',volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:16:01.802138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b95e3910-b6f6-4684-a1d7-698c58881510 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.388990 Sep 16 14:16:01.806175 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1939/3887] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:16:01.840123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:01.844921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:01.910899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:01.911760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:01.912540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:01.924209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:01.925171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:01.925862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:02.472358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:02.516217 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-799aae9c-fd61-4a96-a879-156ac1b4222e tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.932596 Sep 16 14:16:02.524240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1949/3888] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:00 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:02.580266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14d238f6-b518-4e84-8535-a0f11508d14b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:02.584261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14d238f6-b518-4e84-8535-a0f11508d14b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:02.949599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:02.987695 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8fe0657a-5447-42e8-ab83-a7ffd039fa16 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 1.174923 Sep 16 14:16:03.019531 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1940/3889] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:01 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:03.188205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-14d238f6-b518-4e84-8535-a0f11508d14b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:03.241690 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14d238f6-b518-4e84-8535-a0f11508d14b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1052 microversion: 2.1 time: 0.704743 Sep 16 14:16:03.246243 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1950/3890] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:02 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1052 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:03.577716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:03.580411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:03.626537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:03.628127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:03.636127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:03.639407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:03.643676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:03.644832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:03.923950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:03.928250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:03.956782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:03.966184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:03.967337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:03.968834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:03.969765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:03.970647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:04.996797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:05.011843 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d22e8be-00c3-4097-b67d-b6d6572914ff tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.442508 Sep 16 14:16:05.012768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1941/3891] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:03 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:05.030381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:05.031408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:05.050956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:05.051567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:05.052091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:05.052941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:05.053523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:05.054993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:05.114926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:05.130245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:05.146933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:05.151902 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9fb0a94e-ffa3-4cb2-abeb-68dbff6d1348 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2958 microversion: 2.42 time: 1.232370 Sep 16 14:16:05.152590 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1951/3892] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:03 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2958 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:05.169345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:05.172756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:05.196685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:05.197179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:05.197620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:05.198331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:05.198894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:05.199253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:05.544725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:05.575523 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-701c2082-364a-4a45-a7ba-6f817797cf9e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1150 microversion: 2.1 time: 0.412268 Sep 16 14:16:05.580202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1952/3893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:05 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1150 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:05.614896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:05.624054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:05.665109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:05.665993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:05.672005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:05.674211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:05.677964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:05.683522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:05.848241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:05.888274 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01a9d39e-61ec-4bf3-baa1-8040c6ffa030 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 0.871446 Sep 16 14:16:05.895171 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1942/3894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:05 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:06.057914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:06.061280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:06.077853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:06.085657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:06.089249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:06.102124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:06.105600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:06.107044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:06.352658 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56e9790c-24d7-4816-b58c-b5e4a1de1f10 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.768008 Sep 16 14:16:06.354096 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1953/3895] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 14:16:05 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38/os-interface => generated 1832 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:06.651320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:06.652957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:06.688504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:06.691189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:06.694480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:06.699304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:06.706335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:06.709439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:07.113864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:07.182617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f2ff5bd4-4057-44dd-a36a-fb49b5331942 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1168 microversion: 2.1 time: 0.578056 Sep 16 14:16:07.191376 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1954/3896] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:06 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1168 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:07.214217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-215543f8-f0ee-4da2-999d-2b63bd76f300 req-e20aaec9-a3fc-465c-9ad8-a4407ef67a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b557d2b-a03d-4ae9-9ac0-e7622662ea70", "name": "network-vif-plugged", "status": "completed", "tag": "47224649-fdcf-4799-972f-47b3715870d1"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:07.260294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-215543f8-f0ee-4da2-999d-2b63bd76f300 req-e20aaec9-a3fc-465c-9ad8-a4407ef67a5d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:07.263066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-215543f8-f0ee-4da2-999d-2b63bd76f300 req-e20aaec9-a3fc-465c-9ad8-a4407ef67a5d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:07.265402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-215543f8-f0ee-4da2-999d-2b63bd76f300 req-e20aaec9-a3fc-465c-9ad8-a4407ef67a5d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:07.309776 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-215543f8-f0ee-4da2-999d-2b63bd76f300 req-e20aaec9-a3fc-465c-9ad8-a4407ef67a5d service nova] Creating event network-vif-plugged:47224649-fdcf-4799-972f-47b3715870d1 for instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 on n-h2-858129-2 Sep 16 14:16:07.321008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-215543f8-f0ee-4da2-999d-2b63bd76f300 req-e20aaec9-a3fc-465c-9ad8-a4407ef67a5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127080 Sep 16 14:16:07.328366 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1955/3897] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:07.335135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:07.336095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:07.344347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:07.345425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:07.346121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:07.347181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:07.352914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:07.354315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:09.574742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:09.591287 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7cb38007-0b79-4555-9fe0-3fabaa1b273f tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 3.548748 Sep 16 14:16:09.623569 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1943/3898] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:06 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 3581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:09.645787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:09.647509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:09.678011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:09.678583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:09.679046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:09.679824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:09.680298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:09.680738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:09.942348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:09.953569 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fcfbecac-0d11-4fbb-9dd1-e4cf7673fc09 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1524 microversion: 2.1 time: 2.623208 Sep 16 14:16:09.974288 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1956/3899] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:07 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1524 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:10.060702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:10.112004 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a5ca0fe-3b5e-4a0b-8627-6cf64f9279af tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1168 microversion: 2.1 time: 0.484248 Sep 16 14:16:10.114776 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1944/3900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:09 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1168 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:10.624639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:10.625538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:10.651500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:10.652274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:10.652996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:10.655361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:10.658568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:10.661126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:10.996835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:11.002815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:11.052766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:11.054622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:11.066710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:11.074089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:11.075659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:11.078520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:11.080035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:11.081191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:11.760525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:11.790845 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82db3188-8bc4-4227-be06-9abc9fc83745 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1506 microversion: 2.1 time: 0.802139 Sep 16 14:16:11.796477 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1945/3901] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:10 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1506 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:11.815574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:11.817277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:11.840463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:11.842700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:11.843815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:11.848831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:11.850143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:11.852131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:11.949961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:11.967887 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a4a5f876-f5e0-472d-be50-e29680b20279 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1324 microversion: 2.1 time: 1.346155 Sep 16 14:16:11.983734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1957/3902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:10 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1324 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:12.106985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-71dcb625-d05e-4ac0-af4a-b8e517451ea5 req-a638c5e7-395d-4258-9da2-4898e11d3129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9", "name": "network-vif-unplugged", "status": "completed", "tag": "280e464f-8eb1-4a08-81ff-d6817bececa2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:12.137025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-71dcb625-d05e-4ac0-af4a-b8e517451ea5 req-a638c5e7-395d-4258-9da2-4898e11d3129 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:12.137930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-71dcb625-d05e-4ac0-af4a-b8e517451ea5 req-a638c5e7-395d-4258-9da2-4898e11d3129 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:12.141697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-71dcb625-d05e-4ac0-af4a-b8e517451ea5 req-a638c5e7-395d-4258-9da2-4898e11d3129 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:12.191218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-71dcb625-d05e-4ac0-af4a-b8e517451ea5 req-a638c5e7-395d-4258-9da2-4898e11d3129 service nova] Creating event network-vif-unplugged:280e464f-8eb1-4a08-81ff-d6817bececa2 for instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 on n-h2-858129-2 Sep 16 14:16:12.208958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-71dcb625-d05e-4ac0-af4a-b8e517451ea5 req-a638c5e7-395d-4258-9da2-4898e11d3129 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106434 Sep 16 14:16:12.210217 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1958/3903] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:16:12.608376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:12.625263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-65094337-e2b2-4358-bb7e-d457ef244af0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1168 microversion: 2.1 time: 0.824425 Sep 16 14:16:12.625263 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1946/3904] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:11 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1168 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:12.829078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:12.830424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:12.884515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:12.887771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:12.889198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:12.897693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:12.903164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:12.905987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:12.910060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:13.001692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:13.002335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:13.019532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:13.025164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:13.030634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:13.038194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:13.038985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:13.039598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:13.232659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:15.233930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:15.252049 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc755023-f107-42b7-bd3e-6cc432822e62 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1520 microversion: 2.1 time: 2.254397 Sep 16 14:16:15.260722 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1947/3905] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:12 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1520 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:15.287947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:15.294043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:15.337610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:15.338396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:15.346123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:15.353277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:15.354182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:15.356226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:15.708045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:15.723881 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-092b2905-7d77-4a11-b4c2-31a22ddbd10d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 200 len: 1509 microversion: 2.1 time: 2.904737 Sep 16 14:16:15.749813 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1959/3906] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:12 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 1509 bytes in 2932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:15.776933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:15.777552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:15.802810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:15.803316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:15.803768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:15.804539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:15.805004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:15.805436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:15.960757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] HTTP exception thrown: Action 999 not found Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Request method failure captured: Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70/os-instance-actions/999 HTTP/1.1 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIUEqinKEd9plpoh6P0a3saklfJCe9iFwFrG3KW0G4Gaqw-RA4EJ7D-G6GCY3AfHq3z3nayQ7CHbHNmAY-An2CdpCH1rsax6kE_C_V45k2aDZwc37AbR-WZkmuHpjEMfv-057FSx-YdrjbzLbcbtKFaTH3vUieyjocPOJnqf3NIgxvk Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 88869642aeff4b1a991a8975dddecbaf Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88869642aeff4b1a991a8975dddecbaf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88869642aeff4b1a991a8975dddecbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88869642aeff4b1a991a8975dddecbaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88869642aeff4b1a991a8975dddecbaf"}]}] Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 88869642aeff4b1a991a8975dddecbaf Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-InstanceActionsNegativeTestJSON-1650423221-project Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 69468bb491204f15b5afaa71b5c66837 Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1650423221-project Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: exception: Action 999 not found Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '2b557d2b-a03d-4ae9-9ac0-e7622662ea70', 'id': '999'} Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 16 14:16:15.972648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:15.981235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Returning 404 to user: Action 999 not found {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:16:15.983748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-823a66a9-2967-4468-9e0c-c1e52ff28a96 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.232358 Sep 16 14:16:15.985210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1960/3907] 10.222.0.60 () {58 vars in 1308 bytes} [Fri Sep 16 14:16:15 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70/os-instance-actions/999 => generated 66 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:16:15.996866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:15.998592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:16.015113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:16.016497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:16.017603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:16.021446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:16.023523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:16.027360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:16.136183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:16:16.155309 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Working on deleting snapshot 0a8d8d70-bf64-4297-ae7e-d504fc44e65d from shelved instance... Sep 16 14:16:16.452666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:16.507765 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0ebd358-6ec9-4292-b2f3-f4d407ac6706 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1210 microversion: 2.1 time: 1.229621 Sep 16 14:16:16.520747 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1948/3908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:15 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1210 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:16.538939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc17b50f-3015-4cca-8ba8-a59913caa421 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '.version_select at 0x7f724d308ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:16.541159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc17b50f-3015-4cca-8ba8-a59913caa421 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: eb932140-5c19-4ec2-95b4-9a79fb621370] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:16.587093 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bc17b50f-3015-4cca-8ba8-a59913caa421 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] HTTP exception thrown: Instance eb932140-5c19-4ec2-95b4-9a79fb621370 could not be found. Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc17b50f-3015-4cca-8ba8-a59913caa421 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Request method failure captured: Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/eb932140-5c19-4ec2-95b4-9a79fb621370/os-instance-actions HTTP/1.1 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIUEqinKEd9plpoh6P0a3saklfJCe9iFwFrG3KW0G4Gaqw-RA4EJ7D-G6GCY3AfHq3z3nayQ7CHbHNmAY-An2CdpCH1rsax6kE_C_V45k2aDZwc37AbR-WZkmuHpjEMfv-057FSx-YdrjbzLbcbtKFaTH3vUieyjocPOJnqf3NIgxvk Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 88869642aeff4b1a991a8975dddecbaf Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88869642aeff4b1a991a8975dddecbaf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88869642aeff4b1a991a8975dddecbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88869642aeff4b1a991a8975dddecbaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88869642aeff4b1a991a8975dddecbaf"}]}] Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 88869642aeff4b1a991a8975dddecbaf Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceActionsNegativeTestJSON-1650423221-project Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 69468bb491204f15b5afaa71b5c66837 Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1650423221-project Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance eb932140-5c19-4ec2-95b4-9a79fb621370 could not be found. Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': 'eb932140-5c19-4ec2-95b4-9a79fb621370'} Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb932140-5c19-4ec2-95b4-9a79fb621370 could not be found. Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:16:16.619457 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb932140-5c19-4ec2-95b4-9a79fb621370 could not be found. Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb932140-5c19-4ec2-95b4-9a79fb621370 could not be found. Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc17b50f-3015-4cca-8ba8-a59913caa421 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Returning 404 to user: Instance eb932140-5c19-4ec2-95b4-9a79fb621370 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:16:16.623115 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc17b50f-3015-4cca-8ba8-a59913caa421 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/eb932140-5c19-4ec2-95b4-9a79fb621370/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.099245 Sep 16 14:16:16.633682 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1949/3909] 10.222.0.60 () {58 vars in 1296 bytes} [Fri Sep 16 14:16:16 2022] GET /compute/v2.1/servers/eb932140-5c19-4ec2-95b4-9a79fb621370/os-instance-actions => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:16:16.671460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:16.672658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:16.721970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:16.731184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:16.732269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:16.733628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:16.742155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:16.743301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:16.914698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:16:17.361154 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5241bfa4-0d3d-440b-8e11-32982ad7af73 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 204 len: 0 microversion: 2.1 time: 0.725667 Sep 16 14:16:17.361778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1950/3910] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:16:16 2022] DELETE /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:16:17.377207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:17.378006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:17.409297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:17.409832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:17.418908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:17.433624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:17.434128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:17.434615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:18.176650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:18.189220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2f9d93e7-7853-41ba-b58c-96aa1ccb4080 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1526 microversion: 2.1 time: 0.816838 Sep 16 14:16:18.194245 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1951/3911] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:17 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1526 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:18.199936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:18.200587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:18.223865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:18.224369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:18.224809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:18.225542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:18.226191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:18.226804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:18.240722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Doing local delete in cell 08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=128642) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 16 14:16:18.242309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:18.243426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:18.250750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:18.251601 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 16 14:16:18.263021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] deallocate_for_instance() {{(pid=128642) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 16 14:16:18.919041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:18.930370 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ff298ab6-a8eb-4a60-8244-d6580af617be tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1210 microversion: 2.1 time: 0.734538 Sep 16 14:16:18.931024 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1952/3912] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:18 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1210 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:19.241715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:19.242307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:19.249787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:19.259538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:19.260332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:19.260946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:19.261861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:19.262970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:19.265786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:20.781360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69468bb491204f15b5afaa71b5c66837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88869642aeff4b1a991a8975dddecbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:20.870811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:20.891115 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-48079278-3252-4619-8541-1675181b02f6 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 200 len: 1526 microversion: 2.1 time: 1.649661 Sep 16 14:16:20.895828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1953/3913] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:19 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 1526 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:20.913920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:20.916008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:20.937002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:20.939599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:20.940794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:20.945620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:20.947066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:20.948134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:21.859023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:21.917656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Updating instance_info_cache with network_info: [] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:16:21.922178 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7ae039f-b284-4e74-bf40-5ba9c9f2dee3 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 1.015363 Sep 16 14:16:21.946988 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1954/3914] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:20 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:21.957730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3ae7a717-0935-4175-a78e-1e57d6ea2844 req-7ab3b007-7017-4c25-9314-8cb349405db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6caea4-8af7-4ada-b46d-436dfb7b58c6", "tag": "ac3825f1-8762-45aa-8080-f2246831d82a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:21.975288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3ae7a717-0935-4175-a78e-1e57d6ea2844 req-7ab3b007-7017-4c25-9314-8cb349405db4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:21.976136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3ae7a717-0935-4175-a78e-1e57d6ea2844 req-7ab3b007-7017-4c25-9314-8cb349405db4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:21.976804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3ae7a717-0935-4175-a78e-1e57d6ea2844 req-7ab3b007-7017-4c25-9314-8cb349405db4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:21.993374 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3ae7a717-0935-4175-a78e-1e57d6ea2844 req-7ab3b007-7017-4c25-9314-8cb349405db4 service nova] Creating event network-changed:ac3825f1-8762-45aa-8080-f2246831d82a for instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 on n-h1-858129-2 Sep 16 14:16:22.004333 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3ae7a717-0935-4175-a78e-1e57d6ea2844 req-7ab3b007-7017-4c25-9314-8cb349405db4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053317 Sep 16 14:16:22.009011 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1955/3915] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:22.017455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-80f5ca96-a0df-49b0-aae7-a03d1f742620 req-ba55d8ce-f6a4-4d23-9b37-75c1023ac13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b557d2b-a03d-4ae9-9ac0-e7622662ea70", "name": "network-vif-deleted", "tag": "47224649-fdcf-4799-972f-47b3715870d1"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:22.034716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80f5ca96-a0df-49b0-aae7-a03d1f742620 req-ba55d8ce-f6a4-4d23-9b37-75c1023ac13b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:22.035888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80f5ca96-a0df-49b0-aae7-a03d1f742620 req-ba55d8ce-f6a4-4d23-9b37-75c1023ac13b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:22.036543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80f5ca96-a0df-49b0-aae7-a03d1f742620 req-ba55d8ce-f6a4-4d23-9b37-75c1023ac13b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:22.070177 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-80f5ca96-a0df-49b0-aae7-a03d1f742620 req-ba55d8ce-f6a4-4d23-9b37-75c1023ac13b service nova] Creating event network-vif-deleted:47224649-fdcf-4799-972f-47b3715870d1 for instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 on n-h2-858129-2 Sep 16 14:16:22.087244 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-80f5ca96-a0df-49b0-aae7-a03d1f742620 req-ba55d8ce-f6a4-4d23-9b37-75c1023ac13b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074530 Sep 16 14:16:22.090874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1956/3916] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:22.110034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:22.112328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] [instance: 2b557d2b-a03d-4ae9-9ac0-e7622662ea70] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:22.130438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:22.131631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:22.134196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:22.139889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:22.141542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:22.144443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:22.188125 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] HTTP exception thrown: Instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 could not be found. Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Request method failure captured: Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 HTTP/1.1 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIUEqinKEd9plpoh6P0a3saklfJCe9iFwFrG3KW0G4Gaqw-RA4EJ7D-G6GCY3AfHq3z3nayQ7CHbHNmAY-An2CdpCH1rsax6kE_C_V45k2aDZwc37AbR-WZkmuHpjEMfv-057FSx-YdrjbzLbcbtKFaTH3vUieyjocPOJnqf3NIgxvk Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 88869642aeff4b1a991a8975dddecbaf Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_88869642aeff4b1a991a8975dddecbaf", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88869642aeff4b1a991a8975dddecbaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/88869642aeff4b1a991a8975dddecbaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/88869642aeff4b1a991a8975dddecbaf"}]}] Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 88869642aeff4b1a991a8975dddecbaf Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1650423221 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceActionsNegativeTestJSON-1650423221-project Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 69468bb491204f15b5afaa71b5c66837 Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1650423221-project Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 could not be found. Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2b557d2b-a03d-4ae9-9ac0-e7622662ea70'} Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 could not be found. Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 could not be found. Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:22.193959 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 could not be found. Sep 16 14:16:22.199306 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:16:22.207006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] Returning 404 to user: Instance 2b557d2b-a03d-4ae9-9ac0-e7622662ea70 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:16:22.208243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a9b0306-0af1-4380-9975-3308e1a8c323 tempest-InstanceActionsNegativeTestJSON-1650423221 tempest-InstanceActionsNegativeTestJSON-1650423221-project] 10.222.0.60 "GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70" status: 404 len: 111 microversion: 2.1 time: 0.115639 Sep 16 14:16:22.213675 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1957/3917] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:22 2022] GET /compute/v2.1/servers/2b557d2b-a03d-4ae9-9ac0-e7622662ea70 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:16:22.974695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:22.975722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:23.000915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:23.007649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:23.010757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:23.014190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:23.017247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:23.021217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:23.171738 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-626a40d1-271a-40e7-8b1a-6956e695ba14 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 204 len: 0 microversion: 2.1 time: 7.184511 Sep 16 14:16:23.173779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1961/3918] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:16:15 2022] DELETE /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 0 bytes in 7186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:16:23.182144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:23.183151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:23.195422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:23.196296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:23.197043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:23.198496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:23.199220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:23.199916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:23.207254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:23.223301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 HTTP/1.1 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9'} Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:16:23.225225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:16:23.229700 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:16:23.234193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:16:23.235757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e1da9c9-d08c-4524-9ad9-30f9588abec2 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 404 len: 111 microversion: 2.1 time: 0.058875 Sep 16 14:16:23.239780 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1962/3919] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:23 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:16:23.342079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:23.369380 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6457dc7f-e154-438e-84b2-fbee7795af38 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.410606 Sep 16 14:16:23.379383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1958/3920] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:22 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:23.438038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:23.439923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:23.460290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:23.463130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:23.464656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:23.465461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:23.465939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:23.467145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:23.592019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-501145220", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:23.718091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:23.727119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-910d50e9-1828-4f19-9241-813f43e98fbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.297345 Sep 16 14:16:23.739253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:16:23.743531 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1963/3921] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:23 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:24.046279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8d668770-ddd3-4d8c-81df-8cbc5a2e44b1 req-ed3e7941-5c08-4c45-b88d-0c7478a50abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9", "name": "network-vif-deleted", "tag": "280e464f-8eb1-4a08-81ff-d6817bececa2"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:24.073249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d668770-ddd3-4d8c-81df-8cbc5a2e44b1 req-ed3e7941-5c08-4c45-b88d-0c7478a50abb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:24.074084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d668770-ddd3-4d8c-81df-8cbc5a2e44b1 req-ed3e7941-5c08-4c45-b88d-0c7478a50abb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:24.074728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d668770-ddd3-4d8c-81df-8cbc5a2e44b1 req-ed3e7941-5c08-4c45-b88d-0c7478a50abb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:24.101544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.compute.server_external_events [req-8d668770-ddd3-4d8c-81df-8cbc5a2e44b1 req-ed3e7941-5c08-4c45-b88d-0c7478a50abb service nova] Unable to find a host for instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9. Dropping event network-vif-deleted {{(pid=128642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 14:16:24.104053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8d668770-ddd3-4d8c-81df-8cbc5a2e44b1 req-ed3e7941-5c08-4c45-b88d-0c7478a50abb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.063543 Sep 16 14:16:24.105871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1964/3922] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 14:16:24.902133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:16:24.902976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:16:24.905253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:16:24.905998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:16:24.906784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:16:24.948620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:24.949580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:24.953085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:24.956044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:24.958261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:24.959128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:25.035024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:16:25.047580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:16:25.081208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:16:25.086886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:16:25.104698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1387295133", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:25.244638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:16:25.245405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:16:25.246319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:16:25.250222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:16:25.251018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:16:25.257384 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b6b1fad-883f-4126-9851-c01af34b9cdf tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673608 Sep 16 14:16:25.259250 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1959/3923] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:16:25.270465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:25.272459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:25.304130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:25.306679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:25.306955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:25.309127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:25.311080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:25.312673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:25.313257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:25.316604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:25.317773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:25.318520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:25.318919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:25.321263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:25.355266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Getting quotas for project aa65f55ea17e450994040e617ba95348. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:16:25.363384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Getting quotas for user 95989fda13dd41ecb28f1770c6c6930c and project aa65f55ea17e450994040e617ba95348. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:16:25.382888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:16:25.385773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:16:25.478210 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ff7a91f-b696-44c8-942c-579a49d55205 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.239446 Sep 16 14:16:25.486855 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1965/3924] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 16 14:16:25.493319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:25.494396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:25.503915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:25.516562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:25.517738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:25.520956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:25.521756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:25.527662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:26.001668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:26.011757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ace14896-9151-407f-93d4-f4a08e2dd29e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.523321 Sep 16 14:16:26.035956 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1966/3925] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:25 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:26.042921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-70b3fa37-2ce0-4249-9d03-4b7ce58c30b5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:26.043761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-70b3fa37-2ce0-4249-9d03-4b7ce58c30b5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:26.287469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70b3fa37-2ce0-4249-9d03-4b7ce58c30b5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:26.306086 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-70b3fa37-2ce0-4249-9d03-4b7ce58c30b5 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1214 microversion: 2.1 time: 0.264240 Sep 16 14:16:26.307489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1967/3926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:26 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:26.341730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8f3e152-3f90-4f7b-ba6b-0a10814c6eff tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:26.343441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8f3e152-3f90-4f7b-ba6b-0a10814c6eff tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:26.357912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:26.391003 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f6c36c0-11b4-4bc4-bfa2-d92f5060095d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 1.126489 Sep 16 14:16:26.397715 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1960/3927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:25 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:26.415179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-553085060"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:26.430557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:26.466855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:26.471416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:26.474963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:26.479926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:26.486786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:26.488848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:26.592983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8f3e152-3f90-4f7b-ba6b-0a10814c6eff tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:26.634052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8f3e152-3f90-4f7b-ba6b-0a10814c6eff tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:26.647182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8f3e152-3f90-4f7b-ba6b-0a10814c6eff tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:26.656041 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8f3e152-3f90-4f7b-ba6b-0a10814c6eff tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1278 microversion: 2.57 time: 0.341376 Sep 16 14:16:26.661058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1968/3928] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:26 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1278 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:27.361299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:27.362431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:27.380524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.384928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.385987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:27.388634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.389537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.390187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:27.418098 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1bb717d-9429-4fd7-81d0-03f0af110474 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 1.016214 Sep 16 14:16:27.419721 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1961/3929] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:16:26 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 16 14:16:27.433578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5fff7d9a-4600-488f-9d25-b27425e2409f req-aa805450-c896-4362-b180-00cabebaf804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-unplugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:27.489355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5fff7d9a-4600-488f-9d25-b27425e2409f req-aa805450-c896-4362-b180-00cabebaf804 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.494921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5fff7d9a-4600-488f-9d25-b27425e2409f req-aa805450-c896-4362-b180-00cabebaf804 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.500871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5fff7d9a-4600-488f-9d25-b27425e2409f req-aa805450-c896-4362-b180-00cabebaf804 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:27.537581 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5fff7d9a-4600-488f-9d25-b27425e2409f req-aa805450-c896-4362-b180-00cabebaf804 service nova] Creating event network-vif-unplugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:16:27.551680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5fff7d9a-4600-488f-9d25-b27425e2409f req-aa805450-c896-4362-b180-00cabebaf804 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129436 Sep 16 14:16:27.554324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:27.555038 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1962/3930] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:27.565795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:27.566971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:27.568534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a0b6179-532e-42ae-9102-8684d2f325e7 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1210 microversion: 2.1 time: 0.211559 Sep 16 14:16:27.569145 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1969/3931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:27 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1210 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:27.575518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.576635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.577362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:27.578297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.579066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.579781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:27.585696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:27.586331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:27.599375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.602165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.603675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:27.605248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:27.607227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:27.607893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:28.088031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:28.119423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68a44787-1244-49d4-b5f4-2fa1ccff35fd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.544423 Sep 16 14:16:28.121581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1970/3932] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:27 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:28.136666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:28.157896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:28.162763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:28.168920 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-adb503ce-4634-479a-bb7e-26fa4058afbd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.612226 Sep 16 14:16:28.174330 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1963/3933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:27 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:28.184035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:28.186188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:28.187410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:28.188917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:28.190611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:28.191857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:28.371356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:28.393333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:28.397491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:28.400462 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fccd7eb8-7608-4105-b184-e9727686e40b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1338 microversion: 2.57 time: 0.276039 Sep 16 14:16:28.401517 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1971/3934] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:28 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1338 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:28.618017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:28.618911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:28.630010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:28.631854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:28.635133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:28.636473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:28.637150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:28.639055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:28.745255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:28.755774 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc0497a0-8517-4bea-b56f-a4552e05c89c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1266 microversion: 2.1 time: 0.141768 Sep 16 14:16:28.756814 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1964/3935] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:28 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:29.167266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:29.167885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:29.175662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.176414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.177006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.178132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.178879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.179464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.202739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:29.203407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:29.211743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.212363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.212918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.213665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.214127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.214597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.438803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:29.453252 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6bc97790-3be1-4920-91bc-9efd9ca46666 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.289953 Sep 16 14:16:29.468031 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1972/3936] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:29 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:29.479997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:29.480855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:29.488828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.489607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.490258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.491756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.492452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.493219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.512941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:29.537383 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a59da5fa-9073-490a-83b3-95140a2f6c42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.340945 Sep 16 14:16:29.541777 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1965/3937] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:29 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:29.681113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:29.692122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:29.710391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:29.715576 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d8c1e2c-fb69-44b1-b4be-dcb94a5576b3 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1336 microversion: 2.57 time: 0.246398 Sep 16 14:16:29.716422 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1973/3938] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:29 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1336 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:29.792373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:29.793366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:29.803447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.804996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.805608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.806641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:29.807321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:29.807904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:29.956104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:29.973912 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d2d8d56-24ed-4724-aaef-7b5e54eb5b6b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1284 microversion: 2.1 time: 0.187787 Sep 16 14:16:29.975728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1966/3939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:29 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:30.483913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:30.484349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:30.493264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:30.493784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:30.494237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:30.495029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:30.495503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:30.499673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:30.565105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:30.565730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:30.584484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:30.585089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:30.585544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:30.586304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:30.590343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:30.590746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:30.947463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:30.958568 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a720e951-1776-425c-919a-a85fdbf8a671 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.479666 Sep 16 14:16:30.959191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1974/3940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:30 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:30.978962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:30.979907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:30.988059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:30.997292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:30.997802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:30.998577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:30.999221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:30.999829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:31.345412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:31.370282 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4a122b4e-7b25-4f39-abe9-c93c75a4c256 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.808712 Sep 16 14:16:31.376282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1967/3941] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:30 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:31.386532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:31.390832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:31.406518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:31.407830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:31.408921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:31.410681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:31.411906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:31.413028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:31.586878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:31.611206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:31.615556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:31.622914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02437bfd-c837-4c2d-8b80-8148af5f4eb1 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1336 microversion: 2.57 time: 0.656894 Sep 16 14:16:31.622914 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1975/3942] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:30 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1336 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:31.644924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:31.697361 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb3ee84c-82cc-4c6b-b6bd-e48b265779a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1272 microversion: 2.1 time: 0.317835 Sep 16 14:16:31.699374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1968/3943] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:31 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:32.005557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:32.006579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:32.015585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:32.016528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:32.017061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:32.018121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:32.018832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:32.019425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:32.250561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:32.281567 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9e4ab0f-e51b-4429-8326-adcd057bc2f0 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.268494 Sep 16 14:16:32.282625 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1976/3944] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:31 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:32.420264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:32.420943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:32.432072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:32.432903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:32.433529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:32.434692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:32.435891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:32.437240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:32.665116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:32.666629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:32.675279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:32.676154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:32.676842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:32.678777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:32.679848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:32.680550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:32.985217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:33.007206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:33.008639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:33.009866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d16e870e-68ab-4d24-9275-ee08d57c5b5c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1336 microversion: 2.57 time: 0.348871 Sep 16 14:16:33.010833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1977/3945] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:32 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1336 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:33.042263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:33.046694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:33.062463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:33.062463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:33.062463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:33.062463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:33.062463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:33.062463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:33.211816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:33.227232 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45617fd5-44a5-4510-b182-c0ae4a9020a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1686 microversion: 2.1 time: 0.811826 Sep 16 14:16:33.228392 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1969/3946] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:32 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1686 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:33.331356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:33.333233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:33.344057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:33.345340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:33.346087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:33.349018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:33.349979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:33.350822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:33.430076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:33.477179 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0ccb399-d4dc-444a-bf6c-eba85bcda102 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.445700 Sep 16 14:16:33.479287 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1978/3947] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:33 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:33.864927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:33.883399 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5eefb39-23bf-4813-bcca-9896330bea3d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.566237 Sep 16 14:16:33.884936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1970/3948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:33 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:34.040230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:34.041072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:34.063188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.063587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.064038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.064784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.065255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.074082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.257281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:34.257442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:34.274218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.275193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.276228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.283218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.286183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.287567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.370017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:34.387876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:34.394888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:34.396587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce45d7ea-bdd7-482a-a2f2-3acf7e3a92df tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1357 microversion: 2.57 time: 0.360656 Sep 16 14:16:34.399849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1979/3949] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:34 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:34.415072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cc814eb6-05bc-4c1c-9bae-196392ac871b req-d19bf828-83b3-4d67-b25e-201f0a973bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4511d8-8000-40f8-a77f-d77025c7eab0", "tag": "b6ab45d2-85d5-4244-8cdd-0e5de9b9625e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:34.436732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cc814eb6-05bc-4c1c-9bae-196392ac871b req-d19bf828-83b3-4d67-b25e-201f0a973bb6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.437716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cc814eb6-05bc-4c1c-9bae-196392ac871b req-d19bf828-83b3-4d67-b25e-201f0a973bb6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.443393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cc814eb6-05bc-4c1c-9bae-196392ac871b req-d19bf828-83b3-4d67-b25e-201f0a973bb6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.464978 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cc814eb6-05bc-4c1c-9bae-196392ac871b req-d19bf828-83b3-4d67-b25e-201f0a973bb6 service nova] Creating event network-changed:b6ab45d2-85d5-4244-8cdd-0e5de9b9625e for instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 on n-h2-858129-2 Sep 16 14:16:34.482852 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cc814eb6-05bc-4c1c-9bae-196392ac871b req-d19bf828-83b3-4d67-b25e-201f0a973bb6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080845 Sep 16 14:16:34.484857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1980/3950] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:34.491060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:34.506804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:34.516226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.531480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.532287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.534546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.535961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.539502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.728189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:16:34.728753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:16:34.729269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:16:34.729858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:16:34.734881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:16:34.760045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:34.782565 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e59dbc29-82c6-4686-927b-36f812921748 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1686 microversion: 2.1 time: 0.530629 Sep 16 14:16:34.789705 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1971/3951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:34 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1686 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:34.802961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:34.805508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:34.824370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.827074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.828456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.829822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.830952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.831663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.862760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:34.970055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:34.989217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.991203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.992526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.995092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:34.997130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:34.999126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:34.999462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:35.054978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:35.062005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:35.072389 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f8ae71cd-b60b-43a6-ae6c-75819a70ad57 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "POST /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c/action" status: 202 len: 1138 microversion: 2.57 time: 0.586031 Sep 16 14:16:35.073431 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1981/3952] 10.222.0.60 () {62 vars in 1320 bytes} [Fri Sep 16 14:16:34 2022] POST /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c/action => generated 1138 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 14:16:35.080718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:35.082434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:35.093184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.094155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.094926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.095896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.096573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.097223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.342921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:35.676370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:35.710844 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ecc9d4c-898a-40fb-bb93-a7b25f337c45 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.636035 Sep 16 14:16:35.736801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1982/3953] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:35 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:35.748383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:35.752390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:35.760036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.761786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.763301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.764497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.765311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.766868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.779725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:35.789178 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fcc293c9-1465-4be8-93b5-711d06a5be99 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.997913 Sep 16 14:16:35.792869 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1972/3954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:34 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:35.813368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9360cdcd-494f-4dde-95da-e824150277ca req-4df6d002-30fb-48c1-97ac-eb189c70cb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6caea4-8af7-4ada-b46d-436dfb7b58c6", "name": "network-vif-plugged", "status": "completed", "tag": "ac3825f1-8762-45aa-8080-f2246831d82a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:35.831496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9360cdcd-494f-4dde-95da-e824150277ca req-4df6d002-30fb-48c1-97ac-eb189c70cb6f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.833509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9360cdcd-494f-4dde-95da-e824150277ca req-4df6d002-30fb-48c1-97ac-eb189c70cb6f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.834957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9360cdcd-494f-4dde-95da-e824150277ca req-4df6d002-30fb-48c1-97ac-eb189c70cb6f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.867411 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9360cdcd-494f-4dde-95da-e824150277ca req-4df6d002-30fb-48c1-97ac-eb189c70cb6f service nova] Creating event network-vif-plugged:ac3825f1-8762-45aa-8080-f2246831d82a for instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 on n-h1-858129-2 Sep 16 14:16:35.880405 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9360cdcd-494f-4dde-95da-e824150277ca req-4df6d002-30fb-48c1-97ac-eb189c70cb6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083204 Sep 16 14:16:35.883222 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1973/3955] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:35.897275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:35.898435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:35.918213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.920699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.923730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.925056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:35.925801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:35.926866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:35.979788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:36.003003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:36.004936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:36.007813 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-875ba7d8-9a22-4dec-909c-59e0d227c98c tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.269079 Sep 16 14:16:36.008743 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1983/3956] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:35 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:36.483146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:36.492529 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cdca0ef5-6e5c-4061-987e-f899bbd1850e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1686 microversion: 2.1 time: 0.607314 Sep 16 14:16:36.518105 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1974/3957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:35 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1686 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:36.745869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:36.746690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:36.755022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:36.765833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:36.766504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:36.767047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:36.767912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:36.768497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:36.769035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:36.825075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:36.826266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:36.834036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:36.834573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:36.835017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:36.835746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:36.836200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:36.836633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:37.139328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:37.153152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-690c04b8-f6fb-45e0-9812-3f6622bcc6ad tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1198 microversion: 2.1 time: 0.412154 Sep 16 14:16:37.154301 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1984/3958] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:36 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1198 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:37.195940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:37.198813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:37.211466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:37.215041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:37.216914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:37.219250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:37.222845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:37.225188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:37.226290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:37.233912 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71779805-4ead-4614-adde-06c2eb542b8d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.411233 Sep 16 14:16:37.235808 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1975/3959] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:36 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:37.477967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:37.491024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:37.495851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:37.498649 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e980d1e6-39cc-4990-bd87-0dcbc6981063 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.341972 Sep 16 14:16:37.499742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1985/3960] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:37 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:37.529467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:37.530731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:37.544369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:37.546023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:37.546023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:37.548223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:37.548936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:37.550044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:38.206836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:38.214691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:38.259980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:38.267037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:38.270922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:38.275703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:38.280456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:38.284534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:38.330724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:38.358673 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab9d9ef7-ef59-4754-9db2-bdac23ed1831 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.837360 Sep 16 14:16:38.359811 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1976/3961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:37 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:38.382981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:38.386327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:38.410889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:38.413625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:38.416663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:38.422815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:38.427183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:38.428501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.268220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:39.309473 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56565e82-3049-4dbb-8227-17158dbff8a1 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1380 microversion: 2.1 time: 1.113755 Sep 16 14:16:39.317594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1986/3962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:38 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1380 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:39.341791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:39.352995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:39.389135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.396898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.400922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.407445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.417135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.419041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.509327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:39.546344 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ea4ec12b-b9dc-4d7f-9163-fe97de988e05 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 1.184163 Sep 16 14:16:39.558946 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1977/3963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:38 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:39.593034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-610bc37b-86ec-498d-8ecc-72330cfedbae req-1c0842df-61b8-4975-8ded-b87174694768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-plugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:39.645858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-610bc37b-86ec-498d-8ecc-72330cfedbae req-1c0842df-61b8-4975-8ded-b87174694768 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.668170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-610bc37b-86ec-498d-8ecc-72330cfedbae req-1c0842df-61b8-4975-8ded-b87174694768 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.673050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-610bc37b-86ec-498d-8ecc-72330cfedbae req-1c0842df-61b8-4975-8ded-b87174694768 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.715498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:39.736734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:39.738719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:39.752520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea3cee5f-ceeb-4094-982c-51d1719b4568 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.423783 Sep 16 14:16:39.764926 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-610bc37b-86ec-498d-8ecc-72330cfedbae req-1c0842df-61b8-4975-8ded-b87174694768 service nova] Creating event network-vif-plugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:16:39.779558 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1987/3964] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:39 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:39.805153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:39.818731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-610bc37b-86ec-498d-8ecc-72330cfedbae req-1c0842df-61b8-4975-8ded-b87174694768 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256440 Sep 16 14:16:39.819494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:39.822723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1978/3965] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:39.846221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.846869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.854136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.858724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:39.860746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:39.864251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.865061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.882253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.895288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.896336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.897254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:39.899638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:39.906887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:39.910086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:40.457598 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-871bd635-420b-4a13-aca8-5dbeb693aded tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1531 microversion: 2.1 time: 0.670678 Sep 16 14:16:40.479449 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1988/3966] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:39 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1531 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:40.503231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:40.503843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:40.528017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:40.529103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:40.529603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:40.530362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:40.530905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:40.531545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:40.693000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:40.782908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a9697680-e594-43e9-9365-a70299f12375 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.955783 Sep 16 14:16:40.791806 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1979/3967] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:39 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:40.829833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:40.838225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:40.902452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:40.904532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:40.915171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:40.919229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:40.924633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:40.929940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:41.767268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:41.787918 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d0552b8-ced5-4a83-9ea1-ca2e2a8e8d9d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.988420 Sep 16 14:16:41.798459 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1980/3968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:40 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:41.810043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:41.810043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:41.813223 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-066e6e84-b980-4a73-b8cb-a73d78a88abd tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1531 microversion: 2.1 time: 1.321581 Sep 16 14:16:41.814550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1989/3969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:40 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1531 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:41.837658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:41.837658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:41.837658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:41.837658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:41.837658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:41.837658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:41.862448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:41.877532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:41.929787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:41.930698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:41.944488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:41.950133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:41.958671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:41.962178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:42.173256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:42.201782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:42.208686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:42.210010 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd81fad7-cc4e-4f83-af39-9428b5307b97 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.419456 Sep 16 14:16:42.215317 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1981/3970] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:41 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:42.227325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:42.251374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:42.252062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:42.257119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:42.258062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:42.258591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:42.259033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:42.388601 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32fc0a4f-e172-4c50-a830-a93c8fbb5cc6 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.167809 Sep 16 14:16:42.389271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1982/3971] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 14:16:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:42.403251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858129-2", "block_migration": false, "disk_over_commit": false}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:42.413506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:42.432765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:42.433540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:42.434149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:42.438231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:42.442221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:42.443130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:42.508976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lazy-loading 'flavor' on Instance uuid 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:16:42.552477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Going to try to live migrate instance to n-h2-858129-2 {{(pid=128643) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:16:43.305857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:43.357479 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da593328-132a-4452-b7f0-31b7082ad2d8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.531977 Sep 16 14:16:43.359071 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1990/3972] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:41 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:43.396215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:43.404457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:43.414851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:43.427989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:43.434464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:43.436172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:43.440041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:43.444551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:43.445676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:43.804003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:43.848444 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7954d526-0182-43f2-9a2f-0bc5d385fc98 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.465969 Sep 16 14:16:43.852308 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1991/3973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:43 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:43.901147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:43.904744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:43.930895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:43.933651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:43.934947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:43.943287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:43.947202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:43.948604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:44.771837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:44.824203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:44.834190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:44.847527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7986e50e-5ce0-47ed-916d-5fd080ae63b6 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.981450 Sep 16 14:16:44.864548 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1992/3974] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:43 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:44.913415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:44.916008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:44.963304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:44.966905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:44.974147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:44.976132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:44.985850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:44.988883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:45.517664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:45.536686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf6e7d65-98a7-4345-964c-452eee5ab1c3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.669918 Sep 16 14:16:45.537332 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1993/3975] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:44 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:45.567363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e1e63f33-e08c-44cd-8836-591b8b71d6af req-0cf3a6a0-5829-41c1-90e2-ca4ccd6875ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4511d8-8000-40f8-a77f-d77025c7eab0", "name": "network-vif-plugged", "status": "completed", "tag": "b6ab45d2-85d5-4244-8cdd-0e5de9b9625e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:45.588923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e1e63f33-e08c-44cd-8836-591b8b71d6af req-0cf3a6a0-5829-41c1-90e2-ca4ccd6875ea service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:45.589424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e1e63f33-e08c-44cd-8836-591b8b71d6af req-0cf3a6a0-5829-41c1-90e2-ca4ccd6875ea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:45.589866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e1e63f33-e08c-44cd-8836-591b8b71d6af req-0cf3a6a0-5829-41c1-90e2-ca4ccd6875ea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:45.619537 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e1e63f33-e08c-44cd-8836-591b8b71d6af req-0cf3a6a0-5829-41c1-90e2-ca4ccd6875ea service nova] Creating event network-vif-plugged:b6ab45d2-85d5-4244-8cdd-0e5de9b9625e for instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 on n-h2-858129-2 Sep 16 14:16:45.632113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e1e63f33-e08c-44cd-8836-591b8b71d6af req-0cf3a6a0-5829-41c1-90e2-ca4ccd6875ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078573 Sep 16 14:16:45.634584 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1994/3976] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:16:45.645900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:45.647271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:45.659265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:45.660185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:45.661078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:45.662438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:45.663246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:45.664412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:46.509639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:46.546019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0cd2bce-2ac5-4d3d-96b4-f52d09cb34aa tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.909543 Sep 16 14:16:46.547048 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1995/3977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:45 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:46.565097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:46.566118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:46.583067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:46.584047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:46.584740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:46.590902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:46.591950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:46.592659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:46.921877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:47.003825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:47.012062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:47.026047 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-492932e8-0bca-4a27-8ecb-979d482e4a51 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.475744 Sep 16 14:16:47.042456 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1996/3978] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:46 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:47.060981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:47.062122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:47.107766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:47.115978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:47.117977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:47.126221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:47.129067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:47.133021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:47.814952 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b129025-6c4c-484b-98f4-135f53d2420f tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6/action" status: 202 len: 0 microversion: 2.1 time: 5.416795 Sep 16 14:16:47.816736 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1983/3979] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:16:42 2022] POST /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6/action => generated 0 bytes in 5419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:16:47.822690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:47.827735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:47.849925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:47.862205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:47.862957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:47.863907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:47.864646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:47.865287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:48.078387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:48.114211 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc535428-d5f1-4ac3-8571-c504b904aa24 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.085146 Sep 16 14:16:48.121944 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1997/3980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:47 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:48.148691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:48.151967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:48.238854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:48.242722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:48.252209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:48.264467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:48.266808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:48.273652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:48.785034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:48.801821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a0841dc-da7d-4293-b413-d17fad3946c9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1314 microversion: 2.1 time: 0.983112 Sep 16 14:16:48.820896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1984/3981] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:47 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:48.838060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:48.847988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:48.902164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:48.904635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:48.906495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:48.909371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:48.915125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:48.918167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:49.498355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:49.521501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:49.542040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:49.545962 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-840bbcc7-c687-4262-85c7-ef1c4abeffad tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.734175 Sep 16 14:16:49.547836 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1985/3982] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:48 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:49.564798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:49.565856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:49.581837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:49.589846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:49.591523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:49.591523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:49.593512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:49.594037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:49.594522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:49.610345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:49.614897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:49.635249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c446ce4-f09d-4c7c-bc43-783f76dcef69 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.510704 Sep 16 14:16:49.643246 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1998/3983] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:48 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:49.856114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:49.856865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:49.880476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:49.885642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:49.889455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:49.892131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:49.895836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:49.896595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:50.172122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:50.199523 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bb25065-f732-4fdf-bfaa-12f760770bf7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.647752 Sep 16 14:16:50.258354 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1986/3984] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:49 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:50.547140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:50.585576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:50.587865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:50.592584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f64c42e3-8996-4237-ae91-1a13e7a93386 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1502 microversion: 2.1 time: 0.741748 Sep 16 14:16:50.598125 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 1999/3985] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:49 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1502 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:50.642627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:50.644110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:50.645023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:50.647168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:50.648195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:50.649214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:50.655433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c154ad63-9b00-4675-8a2b-ebd82de02bfc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:50.685427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c154ad63-9b00-4675-8a2b-ebd82de02bfc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:50.688771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c154ad63-9b00-4675-8a2b-ebd82de02bfc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:50.689875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c154ad63-9b00-4675-8a2b-ebd82de02bfc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:50.870752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:50.876808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c154ad63-9b00-4675-8a2b-ebd82de02bfc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Going to try to stop instance {{(pid=128642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:16:50.882593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:50.884434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:50.885917 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-499718cf-a534-4bfa-abe3-2992968e4e25 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.308738 Sep 16 14:16:50.886739 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1987/3986] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:50 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:50.912059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:50.913596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:50.920943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:50.921810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:50.922522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:50.923523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:50.924229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:50.924871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:51.069880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c154ad63-9b00-4675-8a2b-ebd82de02bfc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0/action" status: 202 len: 0 microversion: 2.1 time: 0.416473 Sep 16 14:16:51.076337 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2000/3987] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:16:50 2022] POST /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:16:51.100096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:51.101652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:51.131698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:51.132700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:51.133503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:51.141434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:51.144512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:51.145511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:51.271618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:51.281011 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0cd37f2-877d-44ad-8e1a-64b8b13f8367 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.381075 Sep 16 14:16:51.281619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1988/3988] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:50 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:51.308760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:51.309440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:51.322674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:51.323273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:51.323720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:51.324654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:51.325207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:51.328131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:51.363393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:51.722797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:51.742054 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68145da9-dcde-412e-9233-524966e72a5d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.662379 Sep 16 14:16:51.742720 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2001/3989] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:51 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:51.876925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:51.906052 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb1df5fb-3bfc-46b9-8450-ca7b9df17aae tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.592454 Sep 16 14:16:51.906773 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1989/3990] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:51 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:51.937494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:51.942077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:51.989083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:51.990295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:51.996837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:52.000487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:52.002251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:52.003985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:52.322716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:52.331237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:52.363115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:16:52.374718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:52.376364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:52.382022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:52.384152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:52.386085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:52.391439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:52.808151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:52.829051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:52.832625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:52.848363 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52e7f189-1d69-4416-930d-168534312dac tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.932478 Sep 16 14:16:52.853303 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2002/3991] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:51 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:52.884166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:52.887032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:52.917148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:52.918432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:52.920738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:52.922577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:52.924451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:52.925700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:53.058925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:53.072335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a9d8edbd-bb7e-4547-82ac-64ffc34f2a58 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.766217 Sep 16 14:16:53.079304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1990/3992] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:52 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:53.084898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:53.086376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:53.115044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:53.117906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:53.119161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:53.120967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:53.122603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:53.126005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:53.432111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:53.473299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f48bcdf-cf6d-4a98-b307-a50bd3176e6d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.617465 Sep 16 14:16:53.484408 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2003/3993] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:52 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:53.512193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:53.545529 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c47ca538-719e-4956-9319-fe32e5c80074 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.462802 Sep 16 14:16:53.556156 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1991/3994] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:53 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:53.885154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:53.886724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:53.905334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:53.910495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:53.914652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:53.917323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:53.919738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:53.920738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:54.098220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:54.098874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:54.125652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:54.128114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:54.128706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:54.131222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:54.131812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:54.135855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:54.205803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:54.219510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:54.237207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:54.240560 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b66ec056-f317-4dca-b9bf-ce0c27239c82 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.359686 Sep 16 14:16:54.267825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2004/3995] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:53 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:54.504200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:54.504835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:54.517729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:54.523269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:54.523726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:54.524536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:54.525011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:54.531007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:54.672415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:54.692403 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8fc28a2e-2fab-40c3-b935-f85a0cdc5c8c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.596026 Sep 16 14:16:54.708845 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1992/3996] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:54 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:16:54.718396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:54.719666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:54.726827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:54.727605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:54.728499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:54.729466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:54.730091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:54.730902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:55.319822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:55.339489 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e61c1a0-c19f-428a-9e98-13f514d5a677 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.840799 Sep 16 14:16:55.343861 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2005/3997] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:54 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:55.362257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:55.363313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:55.386554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:55.389750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:55.396628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:55.405468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:55.408591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-800a26ba-be4d-4c1c-a0ad-cc9094cce19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.694450 Sep 16 14:16:55.409931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:55.419579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:55.420724 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1993/3998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:54 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:55.421556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:55.591802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:55.602859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:55.620030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:55.630207 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24cf819c-3dca-4c5d-8ed8-237c4070b46e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.277333 Sep 16 14:16:55.631271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2006/3999] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:55 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:55.723251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:55.724726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:55.744012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:55.745803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:55.752930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:55.754114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:55.755072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:55.756446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:56.247531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:56.256147 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fab9b9c-53f1-4308-bd6d-fddb2d8a27bd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.538106 Sep 16 14:16:56.266330 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1994/4000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:55 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:56.394209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:56.395345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:56.406835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:56.411215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:56.414163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:56.415270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:56.416212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:56.420218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:56.478014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:56.478685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:56.511447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:56.511940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:56.512382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:56.513680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:56.514153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:56.514615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:57.404627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:57.446317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:57.451698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e106318-3d36-4d49-8923-6b1feceef154 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 1.050677 Sep 16 14:16:57.468014 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2007/4001] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:56 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:57.486571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:57.493409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:57.507485 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30c9c1a6-b8a7-40ac-aabd-1ccc65cb5411 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.034896 Sep 16 14:16:57.510662 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1995/4002] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:56 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:57.524077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:57.533054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:57.546051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:57.547111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:57.548972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:57.552356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:57.555180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:57.558863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:57.562935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:57.568738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:57.576106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:57.578890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:57.579407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:57.579862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:57.859596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:57.893120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:57.909549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:57.925204 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-80be3e8b-0d40-48e5-bcb6-dee108606b28 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.444095 Sep 16 14:16:57.945158 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2008/4003] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:57 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:16:58.290853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:58.313937 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-daced58f-8ee2-44b2-b224-b1e85bb3f591 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.793523 Sep 16 14:16:58.328287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1996/4004] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:57 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:58.517775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:58.525899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:58.564992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:58.565915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:58.566979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:58.568391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:58.569242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:58.570048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:58.799927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-285315907", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0e5f33b8-78c0-421f-9857-3fe7ad4fdada"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:16:59.137449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] validate_networks() for [('0e5f33b8-78c0-421f-9857-3fe7ad4fdada', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:16:59.249073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:59.263642 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e49ba829-2590-4d95-bb0c-d58d8a41e91f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.755485 Sep 16 14:16:59.266098 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1997/4005] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:58 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:59.280490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:59.296373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:59.332633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:59.334571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:59.335879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:59.340431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:59.343769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:59.344638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:59.821778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:16:59.864210 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-275d7c75-8b0c-46b2-9cf8-e8221b9804ec tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.596638 Sep 16 14:16:59.876138 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1998/4006] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:16:59 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:16:59.896060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:16:59.900332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:16:59.938810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:59.939511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:59.943613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:16:59.950944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:16:59.951239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:16:59.952183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:00.368109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:17:00.368863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:17:00.369742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:17:00.370552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:17:00.374097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:17:00.448423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:00.461115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:00.462206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:00.471447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:00.472342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:00.473153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:00.541414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:00.602055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:00.619455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:00.628805 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd4d46d1-96d2-4b36-b7cf-53aa9125d66e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.748134 Sep 16 14:17:00.632828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 1999/4007] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:16:59 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:00.645740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:00.646373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Getting quotas for project b5080789f45a4646960949cbc7726000. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:17:00.658234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:00.691820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:00.694540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Getting quotas for user 24a7dff26b0d4a8b8020366af8aa007a and project b5080789f45a4646960949cbc7726000. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:17:00.695942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:00.699021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:00.703249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:00.708828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:00.711016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:00.766600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Going to run 3 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:17:00.781951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:17:01.345370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:01.367025 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f400abe1-c756-41fd-92ed-bc4eaf86900d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.731726 Sep 16 14:17:01.376221 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2000/4008] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:00 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:01.399038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:01.407301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:01.457342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:01.459315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:01.459895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:01.461311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:01.461725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:01.464051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:01.794447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:17:01.899949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:01.905679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=064dc6dc-ccea-4b4f-9d7e-eb150183f4e4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:17:01.923772 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bfc4371d-42d6-4466-a7bb-5b74b819fc43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.544825 Sep 16 14:17:01.929750 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2001/4009] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:01 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:01.949845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:01.954895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:01.982185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:01.982937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:01.987043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:01.990631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:01.994737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:01.996269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:02.073596 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28d0f410-c38e-4b4a-b108-7015905ba009 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.114211 Sep 16 14:17:02.079127 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2009/4010] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:16:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:17:02.089152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:02.090084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:02.115166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:02.124132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:02.126127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:02.128290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:02.133285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:02.134133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:02.593739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:02.618356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:02.623353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:02.628997 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7da5dc77-3db5-437e-a92a-180fe84c889b tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.547606 Sep 16 14:17:02.630460 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2010/4011] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:02 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:02.645385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:02.698295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:02.705112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:02.845291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:02.846296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:02.869438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:02.873703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:02.882472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:02.884188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:02.942772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:02.987839 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0928b3e9-e6e2-4a05-b5cb-e1f7946e74dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.053847 Sep 16 14:17:02.993518 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2002/4012] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:01 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:03.031438 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4017e68-b921-4e52-836a-9bc8999c0099 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.398956 Sep 16 14:17:03.036570 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2011/4013] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:17:02 2022] GET /compute/v2.1/servers => generated 1015 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:03.057140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:03.059005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:03.060472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:03.062330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:03.078943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:03.080912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:03.082768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:03.084380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:03.085637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:03.087099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:03.087627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:03.092438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:03.094699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:03.095768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:03.099272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:03.100289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:04.091579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:04.103675 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53cba7d0-701e-49ac-871c-da4ca3a6d735 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.100862 Sep 16 14:17:04.106052 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2003/4014] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:02 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:04.118932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-202853b1-0e07-4839-bca5-3a7c19107a39 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:04.119544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-202853b1-0e07-4839-bca5-3a7c19107a39 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:04.257117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:04.306741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5fd2360-6c0f-4e2e-8c26-aa70b3b0997d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 1.233355 Sep 16 14:17:04.324106 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2012/4015] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:03 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:04.353451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:04.357490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:04.386004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:04.398679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:04.407574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:04.409455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:04.414512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:04.418632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:04.505818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-202853b1-0e07-4839-bca5-3a7c19107a39 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:04.547220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-202853b1-0e07-4839-bca5-3a7c19107a39 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1222 microversion: 2.1 time: 0.434902 Sep 16 14:17:04.551211 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2004/4016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:04 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1222 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:04.579514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:04.581018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:04.617745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:04.625038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:04.626172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:04.636100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:04.639311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:04.644954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:04.781044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:04.799280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:04.801429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:04.803032 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff04570b-6dd1-45cf-a51b-9386f895900a tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1366 microversion: 2.57 time: 0.467846 Sep 16 14:17:04.814921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2013/4017] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:04 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:05.155805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:05.157946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:05.183506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:05.196764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:05.199305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:05.207476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:05.208734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:05.209788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:05.563941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:05.622888 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c69c8c42-e27e-4681-9491-0d0c7ab8cf61 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.059674 Sep 16 14:17:05.623995 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2005/4018] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:04 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:05.654760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:05.671666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:05.706759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:05.710804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:05.716904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:05.720041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:05.728052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:05.729089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:06.140765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:06.180877 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe7906e5-368c-482c-b517-fb55f5283972 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.032314 Sep 16 14:17:06.185202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2014/4019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:05 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:06.217919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:06.235940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:06.257925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:06.263784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:06.268201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:06.270893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:06.273322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:06.276410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:06.801612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:06.806292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:06.825702 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b54816d-0642-44f7-9d37-2d9ebff91fcc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1218 microversion: 2.1 time: 0.631177 Sep 16 14:17:06.826956 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2015/4020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:06 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1218 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:06.831217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:06.833885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:06.835779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:06.836589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:06.846481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:06.847928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:06.848618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:06.849536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:06.850172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:06.850527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee9bd195-8f9d-4c1e-8915-a1cf947c5749 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 1.218931 Sep 16 14:17:06.851000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:06.852106 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2006/4021] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:05 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:06.858836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:06.859841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:06.868894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:06.869828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:06.870550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:06.872348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:06.873239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:06.873939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:07.240674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:07.287779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:07.297401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:07.305749 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69c647b2-0ac1-45a5-9af4-077a654b2c58 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1372 microversion: 2.57 time: 0.476852 Sep 16 14:17:07.333111 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2016/4022] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:06 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1372 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:07.354891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:07.356931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:07.409865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:07.416200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:07.417798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:07.422510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:07.430052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:07.437270 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7c3a2d1-711f-4831-b8f1-ecdc1aef0f93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.583482 Sep 16 14:17:07.438857 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2007/4023] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:06 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:07.439425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:07.440252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:07.874065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:07.875763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:07.904490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:07.907252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:07.909735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:07.910562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:07.915032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:07.920881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:07.922715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:07.941000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3fd9b3fe-a05a-4506-8c7f-df953fdf0ee7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.611306 Sep 16 14:17:07.951938 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2017/4024] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:07 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:07.995882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:07.997623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:08.018781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:08.023557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:08.025116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:08.029915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:08.031468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:08.032553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:08.220210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:08.243755 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae8d5956-ab08-4a53-aa42-05aae87a4272 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1218 microversion: 2.1 time: 0.374826 Sep 16 14:17:08.249617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2008/4025] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:07 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1218 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:08.381012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:08.386468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:08.453376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:08.458287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:08.461598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:08.472375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:08.474973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:08.477887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:08.692475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:08.722879 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6527b5b7-d9b6-4d7a-b6c2-3986a998d73f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.768089 Sep 16 14:17:08.724497 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2018/4026] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:07 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:08.740145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:08.742362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:08.755075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:08.756084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:08.757215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:08.758479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:08.759411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:08.760536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:08.839083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:08.895903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:08.900478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:08.911084 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79c4a68d-3ae2-45ee-8586-42dd4dd8f6bd tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1372 microversion: 2.57 time: 0.551685 Sep 16 14:17:08.930438 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2009/4027] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:08 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1372 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:08.993616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:08.994487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:09.014175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:09.015159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:09.015606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:09.021142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:09.021662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:09.022118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:09.999937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:10.035052 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1fb5363a-20e4-4944-bec0-64e126d824cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.306609 Sep 16 14:17:10.036147 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2019/4028] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:08 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:10.052377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:10.053283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:10.081189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:10.082018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:10.082873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:10.083883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:10.085266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:10.085898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:10.223703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:10.248723 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25e4f7d5-896a-4abc-baa3-cf8679510ac1 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1218 microversion: 2.1 time: 0.208453 Sep 16 14:17:10.249616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2020/4029] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:10 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:10.271246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:10.283037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:10.308610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:10.310624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:10.312012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:10.313810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:10.317867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:10.318728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:10.529400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:10.553255 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b200571-6562-483d-9a46-aa2a9cf17f9b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.565527 Sep 16 14:17:10.553863 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2010/4030] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:08 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:10.575823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:10.576723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:10.588453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:10.588946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:10.589465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:10.590350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:10.600065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:10.607253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:10.738215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:11.915622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:11.947963 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5a902e0-6c10-49a9-9374-a5da032f17a0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 1.683888 Sep 16 14:17:11.967468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2021/4031] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:10 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:11.996439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:11.998142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:12.011750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:12.014929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:12.016240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:12.017861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:12.019064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:12.020149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:12.308130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:12.358157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:12.367679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:12.372891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-732688e6-f8a9-4eec-8cf1-e23699980f10 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1372 microversion: 2.57 time: 1.817241 Sep 16 14:17:12.378269 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2011/4032] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:10 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1372 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:12.441038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:12.444217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:12.519562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:12.521433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:12.524924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:12.539586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:12.544294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:12.550965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:12.766606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:12.776453 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6701089b-7cb5-4f0a-ae2c-6a2811b56df5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.806970 Sep 16 14:17:12.777290 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2022/4033] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:11 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:12.783807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:12.784673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:12.820538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:12.823800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:12.824651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:12.826034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:12.835242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:12.838126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:12.919225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:13.249620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:13.266302 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b3acfe22-e81d-4458-863c-f0eae91c13db tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1274 microversion: 2.1 time: 0.883030 Sep 16 14:17:13.272006 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2012/4034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:12 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1274 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:13.285847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:13.308601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:13.344668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:13.345677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:13.346300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:13.349490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:13.350221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:13.350849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:13.800314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:13.811427 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37d56869-4af4-4d7d-aa1c-08eed18b4176 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.032164 Sep 16 14:17:13.819376 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2023/4035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:12 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:13.832221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:13.833124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:13.835652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:13.843391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:13.849971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:13.850473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:13.851243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:13.851715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:13.852157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:13.918190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:13.940646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3769fa13-d45f-4cca-9f0a-bf48aec68d07 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.667215 Sep 16 14:17:13.941490 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2013/4036] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:13 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:13.957140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:13.958044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:13.978612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:13.979154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:13.979635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:13.991087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:13.991604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:13.992323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:14.123351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:14.138453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:14.147225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:14.148916 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d30f960f-4eab-4321-928a-c78309f5b784 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1357 microversion: 2.57 time: 0.328218 Sep 16 14:17:14.168237 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2024/4037] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:13 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1357 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:14.203215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:14.211497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:14.244597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:14.247971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:14.253124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:14.257313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:14.261363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:14.263065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:14.406171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:17:14.518351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:14.722778 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-731fd568-e013-4cdd-a753-ce31e48cdeae tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 204 len: 0 microversion: 2.57 time: 0.524896 Sep 16 14:17:14.732204 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2025/4038] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:17:14 2022] DELETE /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 14:17:14.756389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:14.757179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:14.783882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:14.785364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:14.790165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:14.791681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:14.795810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:14.796897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.116530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:15.148076 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3455fb3e-25ee-4a7c-b40c-2f95d099b6c8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1280 microversion: 2.1 time: 0.409920 Sep 16 14:17:15.169307 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2026/4039] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:14 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1280 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:15.176104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:15.177956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:15.208841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:15.214913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:15.216299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.218817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:15.224931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:15.226918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.341358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:15.359911 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-644b835a-952d-4b12-ae8d-d6fb062b3a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 1.417210 Sep 16 14:17:15.361837 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2014/4040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:13 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:15.371948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:15.380034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:15.399803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:15.400681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:15.404558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.408930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:15.409819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:15.413576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.506841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:15.536374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:15.549396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:15.570947 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a1c6e774-f716-483c-aea0-1945c22a6bc8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1363 microversion: 2.57 time: 0.391877 Sep 16 14:17:15.574825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2027/4041] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:15 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:15.627621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:15.629197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:15.684916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:15.696312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:15.705127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.714562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:15.715587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:15.717752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:15.895956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:15.908632 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b07b2d1-4f23-4237-a054-4a7c43a04a36 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.545589 Sep 16 14:17:15.927796 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2015/4042] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:15 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:16.191513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:16.192346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:16.214068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:16.214605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:16.215049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:16.227224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:16.231784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:16.236173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:16.305339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:16.317624 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0629772-f00c-458f-8420-97efc4129ee3 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1512 microversion: 2.1 time: 0.740339 Sep 16 14:17:16.326029 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2028/4043] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:15 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:16.406655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:16.407573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:16.420986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:16.426882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:16.427617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:16.429422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:16.436440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:16.439043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:16.610768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:16.658115 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93f4f62d-e9b3-47f5-a285-b4381f4d96d4 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1280 microversion: 2.1 time: 0.471663 Sep 16 14:17:16.713065 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2016/4044] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:16 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1280 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:16.741401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:16.743477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:16.773822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:16.776169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:16.777402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:16.780430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:16.781590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:16.782673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.039514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:17.100244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:17.109537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:17.113170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67074741-46b7-4573-b2ea-ca9266f8b3ea tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1363 microversion: 2.57 time: 0.398113 Sep 16 14:17:17.113433 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2017/4045] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:16 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:17.140746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:17.141256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:17.149757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:17.150284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:17.150784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.151758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:17.152464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:17.153102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.164758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:17.189310 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41949bc9-5f94-4c85-88aa-554ffd604fb0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1681 microversion: 2.1 time: 0.786945 Sep 16 14:17:17.205487 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2029/4046] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:16 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1681 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:17.378206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:17.380230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:17.403625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:17.404419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:17.405096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.407352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:17.409213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:17.410645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.619983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:17.632377 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4a66259-f978-40d5-ac13-05050bfd45b6 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.504207 Sep 16 14:17:17.633677 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2018/4047] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:17 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:17.716982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:17.718224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:17.728305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:17.729184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:17.730066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.731642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:17.732396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:17.733045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:17.893868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:17.908596 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d89181d-bc69-4359-8c05-6b66cd3ccd76 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1280 microversion: 2.1 time: 0.196714 Sep 16 14:17:17.933732 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2019/4048] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:17 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:18.066218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:18.073003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:18.104922 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8326ffee-d4fe-484b-84c3-c4e37e7e742f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1489 microversion: 2.1 time: 0.731745 Sep 16 14:17:18.121235 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2030/4049] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:17 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1489 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:18.159402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:18.163270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:18.181025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:18.187330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:18.225016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.228134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.230446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.237076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.238046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.238825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.239954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.240906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.241681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.248640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.249401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.262438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.406297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:17:18.569288 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05987c44-e8dd-48bd-81ea-086460ad4919 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 204 len: 0 microversion: 2.1 time: 0.413959 Sep 16 14:17:18.571051 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2031/4050] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:17:18 2022] DELETE /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:17:18.580434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:18.581641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:18.591981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.592874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.593560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.594669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.595389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.596982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.809819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:18.858393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:18.869402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95989fda13dd41ecb28f1770c6c6930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa65f55ea17e450994040e617ba95348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:18.879400 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b636d338-5389-43b8-b586-0cc84afe1fe8 tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 200 len: 1363 microversion: 2.57 time: 0.731070 Sep 16 14:17:18.884881 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2020/4051] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:18 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 1363 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:17:18.920365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:18.921154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:18.957552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.958546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.959406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:18.960772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:18.961619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:18.970879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:19.895501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:19.905734 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93468907-be96-4ced-a299-ad563a86e085 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.332644 Sep 16 14:17:19.906730 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2032/4052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:18 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:19.914842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:19.915547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:19.923393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:19.923923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:19.924390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:19.925242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:19.925721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:19.926162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:20.492871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:20.505993 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54ad9455-232d-4d80-9a00-da806291a881 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.597638 Sep 16 14:17:20.512823 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2033/4053] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:19 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:20.518443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:20.519423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:20.540575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:20.541104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:20.541561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:20.542338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:20.542870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:20.543316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.034581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:21.051916 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-25a0e29b-4522-448c-b10f-728fdf79199d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1495 microversion: 2.1 time: 2.163654 Sep 16 14:17:21.054970 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2021/4054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:18 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1495 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:21.062615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-06e6ecf5-e04d-4499-ac74-e34f065a34d8 req-c002ed3e-1da1-42d9-8d16-c0c5eae85c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11", "tag": "c4fb7fd6-b3ef-44e3-9237-b9e8ad5fc492"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:21.072465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=74 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:21.074875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-06e6ecf5-e04d-4499-ac74-e34f065a34d8 req-c002ed3e-1da1-42d9-8d16-c0c5eae85c71 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.075588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-06e6ecf5-e04d-4499-ac74-e34f065a34d8 req-c002ed3e-1da1-42d9-8d16-c0c5eae85c71 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.076171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-06e6ecf5-e04d-4499-ac74-e34f065a34d8 req-c002ed3e-1da1-42d9-8d16-c0c5eae85c71 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.104836 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-06e6ecf5-e04d-4499-ac74-e34f065a34d8 req-c002ed3e-1da1-42d9-8d16-c0c5eae85c71 service nova] Creating event network-changed:c4fb7fd6-b3ef-44e3-9237-b9e8ad5fc492 for instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 on n-h1-858129-2 Sep 16 14:17:21.113092 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-06e6ecf5-e04d-4499-ac74-e34f065a34d8 req-c002ed3e-1da1-42d9-8d16-c0c5eae85c71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056525 Sep 16 14:17:21.117875 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2022/4055] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:21.146598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:21.147391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] [instance: 15e287c1-bffe-4e80-8570-538d9ec8b30c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:21.214832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.215836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.224316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.227763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.232725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.235335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.260649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:21.272107 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-886f9445-0f82-4081-9e83-6ae43c68dccb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 0.757992 Sep 16 14:17:21.288514 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2034/4056] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:20 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:21.310256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:21.311390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:21.324300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.325171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.326148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.327298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.328008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.328606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.332608 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] HTTP exception thrown: Instance 15e287c1-bffe-4e80-8570-538d9ec8b30c could not be found. Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Request method failure captured: Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c HTTP/1.1 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIU3-Ho4NoEsqOiCbAK1a296TNnvmbfh4MR6tnJnGPRMBj5O0d8ruvq6wiBIF_hzFzDt82AErj9elxZzXC8qqTqRK_KZyIRYVSmMoDeRopUJ3g2CbDGNRfVAaI-YEUD7izHyC_rCElMbCelY4ZxdvZN909vN5w0jExeA_CSooJzH9VU Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.57 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: aa65f55ea17e450994040e617ba95348 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerShowV257Test-1027723655 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aa65f55ea17e450994040e617ba95348", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aa65f55ea17e450994040e617ba95348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aa65f55ea17e450994040e617ba95348"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aa65f55ea17e450994040e617ba95348"}]}] Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerShowV257Test-1027723655 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: aa65f55ea17e450994040e617ba95348 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerShowV257Test-1027723655 Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerShowV257Test-1027723655-project Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 95989fda13dd41ecb28f1770c6c6930c Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerShowV257Test-1027723655-project Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 15e287c1-bffe-4e80-8570-538d9ec8b30c could not be found. Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '15e287c1-bffe-4e80-8570-538d9ec8b30c'} Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e287c1-bffe-4e80-8570-538d9ec8b30c could not be found. Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e287c1-bffe-4e80-8570-538d9ec8b30c could not be found. Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:21.335756 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e287c1-bffe-4e80-8570-538d9ec8b30c could not be found. Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:21.340078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] Returning 404 to user: Instance 15e287c1-bffe-4e80-8570-538d9ec8b30c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:17:21.340698 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c15e250-24d9-4c25-97a5-3358c63e189e tempest-ServerShowV257Test-1027723655 tempest-ServerShowV257Test-1027723655-project] 10.222.0.60 "GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c" status: 404 len: 111 microversion: 2.57 time: 0.218359 Sep 16 14:17:21.361462 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2023/4057] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:17:21 2022] GET /compute/v2.1/servers/15e287c1-bffe-4e80-8570-538d9ec8b30c => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:17:21.566592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:21.567658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:21.580152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.581517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.582772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:21.584562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:21.585935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:21.586989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:23.104816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:23.127880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4aaeb44-2c9b-4242-8894-2600227c367c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.822768 Sep 16 14:17:23.138575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2035/4058] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:21 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:23.152197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d3e9ed81-1fdd-4308-a7bf-a5c5f63258e5 req-cf8c4f72-b0ed-4709-8669-3fc5cfff8427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6caea4-8af7-4ada-b46d-436dfb7b58c6", "name": "network-vif-unplugged", "status": "completed", "tag": "ac3825f1-8762-45aa-8080-f2246831d82a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:23.223479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d3e9ed81-1fdd-4308-a7bf-a5c5f63258e5 req-cf8c4f72-b0ed-4709-8669-3fc5cfff8427 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:23.224523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d3e9ed81-1fdd-4308-a7bf-a5c5f63258e5 req-cf8c4f72-b0ed-4709-8669-3fc5cfff8427 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:23.231262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d3e9ed81-1fdd-4308-a7bf-a5c5f63258e5 req-cf8c4f72-b0ed-4709-8669-3fc5cfff8427 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:23.273988 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d3e9ed81-1fdd-4308-a7bf-a5c5f63258e5 req-cf8c4f72-b0ed-4709-8669-3fc5cfff8427 service nova] Creating event network-vif-unplugged:ac3825f1-8762-45aa-8080-f2246831d82a for instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 on n-h1-858129-2 Sep 16 14:17:23.296043 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d3e9ed81-1fdd-4308-a7bf-a5c5f63258e5 req-cf8c4f72-b0ed-4709-8669-3fc5cfff8427 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155207 Sep 16 14:17:23.298316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2036/4059] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:23.328921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:23.334201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:23.351851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:23.357218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:23.361408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:23.364607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:23.366729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:23.371776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:23.514648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:23.523447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:23.527538 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f883eb7-b604-465e-be6e-bb66eb693a0f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.970650 Sep 16 14:17:23.529362 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2024/4060] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:21 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:23.543987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:23.545901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:23.562595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:23.566194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:23.567115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:23.570275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:23.571051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:23.572242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:24.339440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:24.357270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cdff74a-7acd-4d9d-ae83-eebe51fa88a4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1495 microversion: 2.1 time: 1.056375 Sep 16 14:17:24.360761 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2037/4061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:23 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1495 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:24.372843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fc2e3523-66a9-4cd6-bedc-4c489b5188fc req-63778436-d2d3-4261-9f0a-28730e2243f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-unplugged", "status": "completed", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:24.393769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fc2e3523-66a9-4cd6-bedc-4c489b5188fc req-63778436-d2d3-4261-9f0a-28730e2243f3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:24.395141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fc2e3523-66a9-4cd6-bedc-4c489b5188fc req-63778436-d2d3-4261-9f0a-28730e2243f3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:24.396684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fc2e3523-66a9-4cd6-bedc-4c489b5188fc req-63778436-d2d3-4261-9f0a-28730e2243f3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:24.423811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fc2e3523-66a9-4cd6-bedc-4c489b5188fc req-63778436-d2d3-4261-9f0a-28730e2243f3 service nova] Creating event network-vif-unplugged:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:17:24.436203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fc2e3523-66a9-4cd6-bedc-4c489b5188fc req-63778436-d2d3-4261-9f0a-28730e2243f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071878 Sep 16 14:17:24.438685 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2038/4062] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:24.587575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:24.588826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:24.672454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:24.688756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:24.690043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:24.696913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:24.701242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:24.703461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:25.929125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:25.952022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7bcc8ff1-da96-43a0-840b-edc7b6fea2bb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 2.419961 Sep 16 14:17:25.972075 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2025/4063] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:23 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:26.001727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064dc6dc-ccea-4b4f-9d7e-eb150183f4e4", "tag": "34f1ba54-b34f-488d-8af8-3a483a1e36c8"}, {"server_uuid": "8f4511d8-8000-40f8-a77f-d77025c7eab0", "name": "network-vif-deleted", "tag": "b6ab45d2-85d5-4244-8cdd-0e5de9b9625e"}, {"name": "network-changed", "server_uuid": "6b6caea4-8af7-4ada-b46d-436dfb7b58c6", "tag": "ac3825f1-8762-45aa-8080-f2246831d82a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:26.037567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:26.038377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:26.039031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:26.081940 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Creating event network-changed:34f1ba54-b34f-488d-8af8-3a483a1e36c8 for instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 on n-h2-858129-2 Sep 16 14:17:26.082887 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Creating event network-vif-deleted:b6ab45d2-85d5-4244-8cdd-0e5de9b9625e for instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 on n-h2-858129-2 Sep 16 14:17:26.083787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] Creating event network-changed:ac3825f1-8762-45aa-8080-f2246831d82a for instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 on n-h1-858129-2 Sep 16 14:17:26.132254 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b2d3de3c-4ec8-4726-9835-39e04d74f3fd req-393471c4-fd17-4948-8dcd-5ea457ae6358 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.149782 Sep 16 14:17:26.133627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2026/4064] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:26.134260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:26.155895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6b94d6f-0ec4-4710-8314-d7c8c2afcc79 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 1.580168 Sep 16 14:17:26.157421 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2039/4065] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:24 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:26.161088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:26.166125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:26.186275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:26.189131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:26.197654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:26.198575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:26.199689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:26.202173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:26.205885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:26.207066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:26.219903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:26.220717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:26.221381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:26.222705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:26.223656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:26.224309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:26.378829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:26.382022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:26.386165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:26.388786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'fault' on Instance uuid 8f4511d8-8000-40f8-a77f-d77025c7eab0 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:17:26.721453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:26.753514 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d9874c0-a9a0-42d6-aa9e-491661d0dc73 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 200 len: 1304 microversion: 2.1 time: 0.612281 Sep 16 14:17:26.755809 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2027/4066] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:26 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 1304 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:27.005503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:27.010453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:27.053708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:27.063733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:27.064787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:27.066184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:27.091087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:27.093660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:27.662383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:27.714777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8ebf800f-c905-40cb-8eb8-f8808d6fc5ab tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.554132 Sep 16 14:17:27.717842 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2040/4067] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:26 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:27.760566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:27.762229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:27.800791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:27.806805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:27.810079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:27.813459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:27.814889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f5b1a8b-695e-44c5-8ddb-5a2d9f204314 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 0.817676 Sep 16 14:17:27.819255 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2028/4068] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:26 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:27.820152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:27.823662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:27.828778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:27.831796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e5a88d0d-9266-43bb-9ea9-f71a30ef7e25 req-b66788bd-9f2d-44cb-86d9-cd87feca1940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe403bd-c4ad-441e-9368-177dba7dddc0", "tag": "a671dd2b-2b3a-4f6b-95b5-29212aa13c6d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:27.861394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e5a88d0d-9266-43bb-9ea9-f71a30ef7e25 req-b66788bd-9f2d-44cb-86d9-cd87feca1940 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:27.862790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e5a88d0d-9266-43bb-9ea9-f71a30ef7e25 req-b66788bd-9f2d-44cb-86d9-cd87feca1940 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:27.869486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e5a88d0d-9266-43bb-9ea9-f71a30ef7e25 req-b66788bd-9f2d-44cb-86d9-cd87feca1940 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:27.947270 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e5a88d0d-9266-43bb-9ea9-f71a30ef7e25 req-b66788bd-9f2d-44cb-86d9-cd87feca1940 service nova] Creating event network-changed:a671dd2b-2b3a-4f6b-95b5-29212aa13c6d for instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 on n-h2-858129-2 Sep 16 14:17:27.983841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e5a88d0d-9266-43bb-9ea9-f71a30ef7e25 req-b66788bd-9f2d-44cb-86d9-cd87feca1940 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161806 Sep 16 14:17:27.992001 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2029/4069] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:28.017084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:28.024326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:28.054390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:28.057378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:28.062684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:28.064536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:28.065780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:28.071936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:28.851550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:28.865388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1cb10169-7666-4a66-88f0-e69b52ae337e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.870698 Sep 16 14:17:28.866012 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2030/4070] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:27 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:28.874302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:28.880840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:28.898703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:28.900071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:28.900708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:28.901656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:28.902327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:28.903603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:28.930876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 HTTP/1.1 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8f4511d8-8000-40f8-a77f-d77025c7eab0'} Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:28.936217 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:17:28.940185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:28.943391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:17:28.946964 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-863dd43f-310c-450d-889c-b66e7500e646 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 404 len: 111 microversion: 2.1 time: 0.079499 Sep 16 14:17:28.948368 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2031/4071] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:28 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:17:28.967544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:28.979729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:29.020139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:29.022330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:29.039813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:29.062871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:29.064584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:29.066150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:29.955394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:29.995484 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e97ab38-f5e1-4d9c-9fb5-4c6123f2465c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 2.267737 Sep 16 14:17:30.010547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2041/4072] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:27 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:30.018347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:30.019699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:30.035424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:30.041581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:30.042444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:30.044320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:30.045128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:30.045836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:30.214485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:30.236458 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e789bca-dd61-4b4c-bc27-1a75ae2ccb70 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 1.275094 Sep 16 14:17:30.238538 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2032/4073] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:28 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:30.251487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-460145897", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1a0e2e99-2d5c-4e8f-a386-9161feb1d11b"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:30.389607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] validate_networks() for [('1a0e2e99-2d5c-4e8f-a386-9161feb1d11b', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:17:31.014789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:31.031424 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.016793 Sep 16 14:17:31.032655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2042/4074] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:30 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:31.035151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:31.036717 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5e92022-b586-47b0-b6e8-df983361a2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002096 Sep 16 14:17:31.038760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2043/4075] 10.222.0.60 () {56 vars in 886 bytes} [Fri Sep 16 14:17:31 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 14:17:31.046266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-682f3a6e-37bd-4f6f-9b70-5d6ba43ee2d9 req-8ce92517-6e2f-446a-9cb0-2085e3788ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11", "name": "network-vif-plugged", "status": "completed", "tag": "c4fb7fd6-b3ef-44e3-9237-b9e8ad5fc492"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:31.073460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-682f3a6e-37bd-4f6f-9b70-5d6ba43ee2d9 req-8ce92517-6e2f-446a-9cb0-2085e3788ef2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.076271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-682f3a6e-37bd-4f6f-9b70-5d6ba43ee2d9 req-8ce92517-6e2f-446a-9cb0-2085e3788ef2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.077209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-682f3a6e-37bd-4f6f-9b70-5d6ba43ee2d9 req-8ce92517-6e2f-446a-9cb0-2085e3788ef2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:31.095822 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-682f3a6e-37bd-4f6f-9b70-5d6ba43ee2d9 req-8ce92517-6e2f-446a-9cb0-2085e3788ef2 service nova] Creating event network-vif-plugged:c4fb7fd6-b3ef-44e3-9237-b9e8ad5fc492 for instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 on n-h1-858129-2 Sep 16 14:17:31.105368 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-682f3a6e-37bd-4f6f-9b70-5d6ba43ee2d9 req-8ce92517-6e2f-446a-9cb0-2085e3788ef2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064003 Sep 16 14:17:31.107240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2044/4076] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:31.116508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:31.117795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:31.129717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.130755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.131419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:31.132391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.133208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.133872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:31.758664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:31.777301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d025dab-6b21-4463-8122-9f16e5e77c56 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.667921 Sep 16 14:17:31.778315 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2045/4077] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:31 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:31.783417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:31.785867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:31.799907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.800420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.800865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:31.801615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.802081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.802556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:31.927698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3780e9cf-59e7-4ba6-be38-b6e3c8569e15 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.147846 Sep 16 14:17:31.934495 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2046/4078] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:17:31 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:17:31.951510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:31.953153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:31.963821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.964635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.965990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:31.967144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:31.967830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:31.968328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:32.576401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:17:32.578486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:17:32.579180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:17:32.580662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:17:32.581274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:17:32.608421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:32.614748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:32.615258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:32.615703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:32.616489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:32.621784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:32.622221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:32.624829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:32.640817 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-411bf326-0bb9-45e8-84c8-dc816e86f4e0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 0.702272 Sep 16 14:17:32.662650 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2047/4079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:31 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:32.689102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:32.690838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:32.701910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:17:32.707752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:32.712954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:32.712954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:32.712954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:32.713652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:32.714077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:32.725839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Getting quotas for user 34b5828a1ccf48cd866f88400ac00649 and project 149cfd30d6054320a0b3bbde7a2e70ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:17:32.767395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:17:32.775757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:17:32.913140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4fcd986-0a17-4c91-a63b-8ab8cb2a7698 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.672012 Sep 16 14:17:32.921003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2033/4080] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:17:32.935163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:32.936804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:32.950722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:32.953859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:32.957719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:32.959632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:32.960658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:32.966511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:33.713962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:33.741866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-787ad397-52d8-4c98-85f7-57cf69a57bf8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1670 microversion: 2.1 time: 1.077058 Sep 16 14:17:33.748595 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2048/4081] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:32 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1670 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:33.762157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-50e1a55b-32bd-4b99-bb0f-7e453041cfcc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:33.767228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-50e1a55b-32bd-4b99-bb0f-7e453041cfcc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:34.464624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-50e1a55b-32bd-4b99-bb0f-7e453041cfcc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:34.511667 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-50e1a55b-32bd-4b99-bb0f-7e453041cfcc tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1214 microversion: 2.1 time: 0.760723 Sep 16 14:17:34.513462 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2049/4082] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:33 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1214 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:34.555755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f66ce9f8-5dde-41c0-8531-c93111a0abc9 req-5ebb3e72-e4c7-4553-8230-049391fe8fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064dc6dc-ccea-4b4f-9d7e-eb150183f4e4", "name": "network-vif-plugged", "status": "completed", "tag": "34f1ba54-b34f-488d-8af8-3a483a1e36c8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:34.654067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f66ce9f8-5dde-41c0-8531-c93111a0abc9 req-5ebb3e72-e4c7-4553-8230-049391fe8fc2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:34.654999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f66ce9f8-5dde-41c0-8531-c93111a0abc9 req-5ebb3e72-e4c7-4553-8230-049391fe8fc2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:34.655821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f66ce9f8-5dde-41c0-8531-c93111a0abc9 req-5ebb3e72-e4c7-4553-8230-049391fe8fc2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:34.699996 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f66ce9f8-5dde-41c0-8531-c93111a0abc9 req-5ebb3e72-e4c7-4553-8230-049391fe8fc2 service nova] Creating event network-vif-plugged:34f1ba54-b34f-488d-8af8-3a483a1e36c8 for instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 on n-h2-858129-2 Sep 16 14:17:34.719889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f66ce9f8-5dde-41c0-8531-c93111a0abc9 req-5ebb3e72-e4c7-4553-8230-049391fe8fc2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198575 Sep 16 14:17:34.735530 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2050/4083] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:34.748477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:34.749801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:34.802908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:34.808055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:34.819286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:34.825507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:34.828536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:34.832137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:34.963635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:35.019990 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19a91cfe-7c19-4a37-975f-9df7ef125410 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 2.097227 Sep 16 14:17:35.027163 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2034/4084] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:32 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:35.062356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:35.064153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:35.095436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:35.098636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:35.102845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:35.106996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:35.108648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:35.111682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:37.032228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:37.062479 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-795c5f1c-f7fa-437a-8e92-f8e283937848 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 2.323557 Sep 16 14:17:37.069358 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2051/4085] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:34 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 2333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:37.085740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:37.087261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:37.103817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:37.105220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:37.106935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:37.108967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:37.110898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:37.112376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:37.217926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:37.246982 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a06d7f2a-3faa-4ce3-bb91-65327d163538 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1670 microversion: 2.1 time: 2.209685 Sep 16 14:17:37.258441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2035/4086] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:35 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1670 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:37.279677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:37.281139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:37.322186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:37.324064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:37.325999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:37.327869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:37.329282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:37.330431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:37.530968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:37.547321 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1272 microversion: 2.1 time: 0.474869 Sep 16 14:17:37.549081 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2052/4087] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:37 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:37.551030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:37.552712 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002230 Sep 16 14:17:37.563508 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2053/4088] 10.222.0.60 () {56 vars in 886 bytes} [Fri Sep 16 14:17:37 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 14:17:37.570368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:37.572637 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003045 Sep 16 14:17:37.579569 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2054/4089] 10.222.0.60 () {54 vars in 1035 bytes} [Fri Sep 16 14:17:37 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 16 14:17:37.593305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:37.595344 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003558 Sep 16 14:17:37.596859 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2055/4090] 10.222.0.60 () {54 vars in 1041 bytes} [Fri Sep 16 14:17:37 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:37.612471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:37.614296 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-543bf8bb-f694-4f93-a772-0f938845fd08 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002905 Sep 16 14:17:37.619025 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2056/4091] 10.222.0.60 () {56 vars in 886 bytes} [Fri Sep 16 14:17:37 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 14:17:37.898946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:37.957911 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae922a9a-61ad-4370-bce7-3662c415699f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.696483 Sep 16 14:17:37.971227 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2036/4092] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:37 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:38.126610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:38.128995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:38.171044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.172267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.173215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:38.174783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.175997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.177069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:38.239657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-500ce7c0-6018-4e6d-99d3-81e311417b46 req-53818515-5a87-46bd-b60e-06ed25faf275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe403bd-c4ad-441e-9368-177dba7dddc0", "name": "network-vif-plugged", "status": "completed", "tag": "a671dd2b-2b3a-4f6b-95b5-29212aa13c6d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:38.284233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-500ce7c0-6018-4e6d-99d3-81e311417b46 req-53818515-5a87-46bd-b60e-06ed25faf275 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.285071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-500ce7c0-6018-4e6d-99d3-81e311417b46 req-53818515-5a87-46bd-b60e-06ed25faf275 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.285866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-500ce7c0-6018-4e6d-99d3-81e311417b46 req-53818515-5a87-46bd-b60e-06ed25faf275 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:38.355205 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-500ce7c0-6018-4e6d-99d3-81e311417b46 req-53818515-5a87-46bd-b60e-06ed25faf275 service nova] Creating event network-vif-plugged:a671dd2b-2b3a-4f6b-95b5-29212aa13c6d for instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 on n-h2-858129-2 Sep 16 14:17:38.376525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-500ce7c0-6018-4e6d-99d3-81e311417b46 req-53818515-5a87-46bd-b60e-06ed25faf275 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145132 Sep 16 14:17:38.379874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2037/4093] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:38.399526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:38.404312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:38.419073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.421436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.423166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:38.425699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.427950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.429142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:38.729464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:38.753093 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca23656d-4214-42ca-bec9-b7f26642c6c0 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 0.639329 Sep 16 14:17:38.780277 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2057/4094] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:38 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:38.785860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:38.787013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:38.795209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.795726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.796322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:38.807236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:38.811209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:38.811888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:39.129127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:39.145495 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aed50174-927a-4e3d-8cbd-553f54a35670 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1272 microversion: 2.1 time: 0.363005 Sep 16 14:17:39.146363 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2058/4095] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:38 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:39.156427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:39.158290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:39.177677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:39.179462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:39.187087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:39.189716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:39.193838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:39.197916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:39.321024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:39.337897 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-646c63af-2f3a-4c4b-8a71-5ac79df896d0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1675 microversion: 2.1 time: 0.951783 Sep 16 14:17:39.339831 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2038/4096] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:38 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1675 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:39.648923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:39.676522 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f359ec90-0d17-49b4-9437-1f3474bf59f8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.527757 Sep 16 14:17:39.678640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2059/4097] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:39 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:39.801205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:39.802274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:39.833698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:39.835093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:39.836226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:39.837865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:39.838718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:39.839694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:40.194114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:40.197011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:40.211013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:40.212208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:40.213359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:40.215911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:40.218465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:40.219656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:40.456220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:40.504310 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd97ef13-ad6c-48e8-af76-f2fd47c16c33 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1322 microversion: 2.1 time: 0.713036 Sep 16 14:17:40.517012 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2039/4098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:39 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:40.931034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:40.945099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-130e2535-1d96-4cfc-be86-de409eedc050 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 0.759627 Sep 16 14:17:40.964402 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2060/4099] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:40 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:40.983738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:40.987333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:41.003783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.005416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.007121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.007907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.008395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.008840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.206215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:41.206883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:41.222321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.225479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.227220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.231567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.232319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.232930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.341376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:41.355784 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7715ec5a-40fd-470d-b3da-083cd8ee3a33 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1390 microversion: 2.1 time: 0.389320 Sep 16 14:17:41.359846 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2061/4100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:40 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:41.564367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:41.565288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:41.577031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.577552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.578007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.582582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.583249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.583712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.596702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:41.606294 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90cedf57-72b3-44e6-ab36-8bb777b572d6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.086920 Sep 16 14:17:41.613532 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2040/4101] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:40 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:41.642586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:41.645091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:41.661151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.662629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.664116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.665270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.667932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.669963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.826609 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b760d1ab-62ec-48f1-89a4-15d807cbe681 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 200 len: 323 microversion: 2.1 time: 0.188165 Sep 16 14:17:41.829453 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2041/4102] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:17:41 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:17:41.856517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:41.857978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:41.884684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.886720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.895866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.898655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:41.900705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:41.902130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:41.952869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:41.968248 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b35cb23c-3cf1-43a4-8393-43589140d5e9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1513 microversion: 2.1 time: 0.408125 Sep 16 14:17:41.989813 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2062/4103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:41 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1513 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:42.011565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:42.012277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:42.048774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.049385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.049955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.050775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.059848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.060367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.357782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:42.369274 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-57e7b593-485e-4eb9-8a38-0ad560a7ff0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.530710 Sep 16 14:17:42.369930 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2042/4104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:41 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:42.393594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:42.394580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:42.401741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.402184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.403357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.404328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.404837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.405422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.483182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:42.507791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65d617c1-33f1-424f-a8fa-f63b4488bdff tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 0.500490 Sep 16 14:17:42.508766 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2063/4105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:41 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:42.527351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:42.528567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:42.569681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.571090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.574993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.580814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.581971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.585054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.662723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:42.751547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:42.864978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:42.889360 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ff189173-42a3-4115-8649-164df66c8637 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4" status: 200 len: 1513 microversion: 2.1 time: 0.517063 Sep 16 14:17:42.891405 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2043/4106] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:42 2022] GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:42.900524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:42.902353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:42.918569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.919943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.921016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:42.923018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:42.924135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:42.925129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.123950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:43.148294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5219334a-c9bf-471c-bb78-c3e8d0fb45e9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.633023 Sep 16 14:17:43.154256 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2064/4107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:42 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:43.184589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:43.186350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:43.223616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.227615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.231187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.233433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.236510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.237474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.313911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:43.317954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:43.335716 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ff97fef-aaa4-4cd2-bd14-90aac6b50ebd tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1380 microversion: 2.1 time: 0.442398 Sep 16 14:17:43.344419 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2044/4108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:42 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1380 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:43.350233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:43.351166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:43.366791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.367791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.370041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.371976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.373222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.374325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.650811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:43.661025 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-658570a9-1f04-45aa-82dc-0ccb8606bf58 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 200 len: 1514 microversion: 2.1 time: 0.504441 Sep 16 14:17:43.675005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2065/4109] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:43 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 1514 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:43.685611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-238a663f-05cb-4297-899a-1c971af48025 req-991eefd4-de13-4496-87ef-1478fe6d1da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8df4d0a-666b-4a3a-b143-7a3974d99cf3", "tag": "abf6325c-4ec4-4751-b345-6a4fbf60f6df"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:43.698177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-238a663f-05cb-4297-899a-1c971af48025 req-991eefd4-de13-4496-87ef-1478fe6d1da0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.699498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-238a663f-05cb-4297-899a-1c971af48025 req-991eefd4-de13-4496-87ef-1478fe6d1da0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.700026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-238a663f-05cb-4297-899a-1c971af48025 req-991eefd4-de13-4496-87ef-1478fe6d1da0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.714322 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-238a663f-05cb-4297-899a-1c971af48025 req-991eefd4-de13-4496-87ef-1478fe6d1da0 service nova] Creating event network-changed:abf6325c-4ec4-4751-b345-6a4fbf60f6df for instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 on n-h1-858129-2 Sep 16 14:17:43.722316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-238a663f-05cb-4297-899a-1c971af48025 req-991eefd4-de13-4496-87ef-1478fe6d1da0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045771 Sep 16 14:17:43.723702 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2066/4110] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:43.728162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:43.729903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-238e8028-f01b-47e7-b415-ac76b48a9373 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '.version_select at 0x7f724c197ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:43.734369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-238e8028-f01b-47e7-b415-ac76b48a9373 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.734990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-238e8028-f01b-47e7-b415-ac76b48a9373 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.735613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-238e8028-f01b-47e7-b415-ac76b48a9373 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.740817 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28a3bca6-db06-43e2-baba-9bde5d5356d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.394656 Sep 16 14:17:43.747354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-238e8028-f01b-47e7-b415-ac76b48a9373 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.021619 Sep 16 14:17:43.747984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2067/4112] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 14:17:43 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:43.748155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2045/4112] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:43 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:43.753584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:43.756266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:43.762174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:43.762880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:43.764920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.765449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.765902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.766698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.767182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.767917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.770010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.770545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.771188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.771954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.772795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.772916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.806114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:17:43.920274 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e0a78d4-25b5-496b-a4c5-6084096f1163 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 204 len: 0 microversion: 2.1 time: 0.163615 Sep 16 14:17:43.925210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2068/4113] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:17:43 2022] DELETE /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:17:43.932050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:43.933035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:43.941621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:43.943887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.944924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.945602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.946983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:43.947490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:43.948097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:43.952798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:44.013928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d194d813-fccd-4c69-981e-07951c27f86f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 0.263797 Sep 16 14:17:44.027204 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2046/4114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:43 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:44.042355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:44.046967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:44.062435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.063631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.064600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.067613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.070177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.072147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.193813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:44.204995 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3cfb8ea-0350-4bff-80e5-98f94ca10103 tempest-LiveMigrationTest-820472839 tempest-LiveMigrationTest-820472839-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1531 microversion: 2.1 time: 0.277578 Sep 16 14:17:44.206119 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2069/4115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:43 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1531 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:44.228227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:44.231591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:44.247506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.248814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.249884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.251671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.252780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.253977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.403484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:44.431669 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16b390af-040d-474f-b215-9b63e4c49ad4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.401975 Sep 16 14:17:44.442096 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2047/4116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:44 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:44.451999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:44.459650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:44.474464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.475002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.475429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.475856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:44.476172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.477362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.477362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.529066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:17:44.704111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e44d9543-366f-4a0b-aa0e-ec6d608842bf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 204 len: 0 microversion: 2.1 time: 0.258398 Sep 16 14:17:44.709708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2048/4117] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:17:44 2022] DELETE /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:17:44.727130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:44.729762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:44.749782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.752850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.754248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.756321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:44.758897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:44.760380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:44.776176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:44.801294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0754da67-ffbe-4b78-8e8c-3970259d96cb tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 200 len: 1520 microversion: 2.1 time: 0.592979 Sep 16 14:17:44.813204 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2070/4118] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:44 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 1520 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:44.827959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-531302471", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f64a9d39-280d-4bfc-99d8-7531ba64697a"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:44.958158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] validate_networks() for [('f64a9d39-280d-4bfc-99d8-7531ba64697a', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:17:45.174224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:45.202499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-999c3558-4d61-4196-a308-5030d62ecc13 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1386 microversion: 2.1 time: 0.489551 Sep 16 14:17:45.207716 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2049/4119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:44 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1386 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:45.226981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-291086940", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "66675b13-e03c-4e68-a9bb-f34532d06d31"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:45.347947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] validate_networks() for [('66675b13-e03c-4e68-a9bb-f34532d06d31', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:17:47.178079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:17:47.179874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:17:47.181559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:17:47.183157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:17:47.186019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:17:47.208257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:47.209385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:47.210308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:47.211935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:47.213131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:47.214010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:47.251932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:17:47.268515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for user 7b08b72cf46345f2a3c88a6251b1c996 and project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:17:47.314367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:17:47.318068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:17:47.379471 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40263657-7298-461b-a692-5fd1bd7f816d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.563910 Sep 16 14:17:47.380704 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2071/4120] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:17:47.388773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:47.389750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:47.399759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:47.400812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:47.401462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:47.402640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:47.404024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:47.404875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:47.982630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:17:47.983420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:17:47.983619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:17:47.984927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:17:47.985702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:17:48.017310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.017310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.021543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.023808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.024325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.024785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.100501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Getting quotas for project ea65bd193ded42158601fbf77be2aa4e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:17:48.131842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Getting quotas for user ab7393592e664b03a71bedda2f26b24f and project ea65bd193ded42158601fbf77be2aa4e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:17:48.182301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:17:48.188209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:17:48.334812 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7991bbb1-1954-4caf-913b-e674dbe51c3d tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.125030 Sep 16 14:17:48.336509 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2050/4121] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:17:48.343489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:48.344512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:48.353036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.353946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.354664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.356627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.357402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.358249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.440811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:48.473811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66525770-c2c2-4940-b4c2-4c4eef31be86 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 1.091408 Sep 16 14:17:48.475811 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2072/4122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:47 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:48.488082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:48.502206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:48.533647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.534922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.535995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.537524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.538645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.539681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.939836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:48.958395 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e154af80-e0a9-478e-99ca-c9f76b4acf7e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 200 len: 1478 microversion: 2.1 time: 0.619604 Sep 16 14:17:48.959155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2051/4123] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:48 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 1478 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:48.966787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:48.967753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:48.975091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.975874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.977559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:48.980044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:48.981054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:48.982289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:49.435301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:49.450922 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5ba2f75-84a4-44e0-9d91-2a27cc90e1a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1210 microversion: 2.1 time: 0.488789 Sep 16 14:17:49.452557 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2052/4124] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:48 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1210 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:49.468838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1780569c-8d8c-458c-85ca-92d30b21b2c9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:49.468838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1780569c-8d8c-458c-85ca-92d30b21b2c9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:49.503967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:49.551150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:49.567550 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-246cf96b-72f0-4fe4-a3ad-2ed8fda0bc1a tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1386 microversion: 2.1 time: 1.089865 Sep 16 14:17:49.568616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2073/4125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:48 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1386 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:49.579842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6b325c81-94e9-49b0-9c60-f9f916efff3f req-301d760d-9f17-4ec2-82db-d980be665b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11", "name": "network-vif-deleted", "tag": "c4fb7fd6-b3ef-44e3-9237-b9e8ad5fc492"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:49.604928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6b325c81-94e9-49b0-9c60-f9f916efff3f req-301d760d-9f17-4ec2-82db-d980be665b83 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:49.605502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6b325c81-94e9-49b0-9c60-f9f916efff3f req-301d760d-9f17-4ec2-82db-d980be665b83 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:49.605951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6b325c81-94e9-49b0-9c60-f9f916efff3f req-301d760d-9f17-4ec2-82db-d980be665b83 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:49.638621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6b325c81-94e9-49b0-9c60-f9f916efff3f req-301d760d-9f17-4ec2-82db-d980be665b83 service nova] Creating event network-vif-deleted:c4fb7fd6-b3ef-44e3-9237-b9e8ad5fc492 for instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 on n-h1-858129-2 Sep 16 14:17:49.650081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6b325c81-94e9-49b0-9c60-f9f916efff3f req-301d760d-9f17-4ec2-82db-d980be665b83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079986 Sep 16 14:17:49.650753 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2074/4126] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:49.662750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:49.663716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1780569c-8d8c-458c-85ca-92d30b21b2c9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:49.670881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:49.679189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1780569c-8d8c-458c-85ca-92d30b21b2c9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1213 microversion: 2.1 time: 0.220617 Sep 16 14:17:49.683647 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2053/4127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:49 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:49.685587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:49.686292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:49.686906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:49.688013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:49.688636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:49.690955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.006814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:50.007585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:50.023137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.025187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.025712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.028411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.028902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.030239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.099612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.109890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.112343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.112855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lazy-loading 'fault' on Instance uuid 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:17:50.298885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:50.314832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:50.327890 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2835905-d4d4-4e85-b6dd-6b4996f5990d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 0.675664 Sep 16 14:17:50.329197 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39d749c9-e589-4b68-9b67-4ef2e8110b79 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 200 len: 1312 microversion: 2.1 time: 0.319568 Sep 16 14:17:50.338512 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2054/4128] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:50 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:50.339043 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2075/4129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:49 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:50.483862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:50.487128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:50.497802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.498693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.499330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.500275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.500905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.503110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.611514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:50.613105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:50.621705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.622903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.623838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:50.642270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:50.645812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:50.648467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.098188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:51.115780 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d408f8f3-9b63-40e1-9e9b-92ad4b537299 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1266 microversion: 2.1 time: 0.640673 Sep 16 14:17:51.131305 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2055/4130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:50 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1266 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:51.147795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:51.148638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:51.171049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.172367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.173023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.173969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.174677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.175168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:51.175314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.186451 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa9bc4d6-c5d5-4974-817d-2c448c5fa4d8 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1183 microversion: 2.1 time: 0.579118 Sep 16 14:17:51.220014 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2076/4131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:50 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1183 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:51.352040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:51.354151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:51.354945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:51.371702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1678a32a-625d-459f-bc16-ff33cf0012da tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1209 microversion: 2.1 time: 0.237254 Sep 16 14:17:51.373721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.374364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.374949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.376719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2056/4132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:51 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:51.377723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.378450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.382317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.388814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:51.392631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:51.414746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.423724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.426777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.428811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.429917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.431321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.576872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:51.579243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:51.580467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:51.581989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lazy-loading 'fault' on Instance uuid 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:17:52.332143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:52.341043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a12df980-9a87-4efe-90e1-b79b42221ce3 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 200 len: 1312 microversion: 2.1 time: 0.958487 Sep 16 14:17:52.347293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2057/4133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:51 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 1312 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:52.352713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2b49c4d8-da0c-4064-88ea-c2fd053d6baf req-06474ad2-f659-403a-ab4d-38ea26a7645b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6caea4-8af7-4ada-b46d-436dfb7b58c6", "name": "network-vif-deleted", "tag": "ac3825f1-8762-45aa-8080-f2246831d82a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:52.381659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2b49c4d8-da0c-4064-88ea-c2fd053d6baf req-06474ad2-f659-403a-ab4d-38ea26a7645b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:52.385818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2b49c4d8-da0c-4064-88ea-c2fd053d6baf req-06474ad2-f659-403a-ab4d-38ea26a7645b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:52.386729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2b49c4d8-da0c-4064-88ea-c2fd053d6baf req-06474ad2-f659-403a-ab4d-38ea26a7645b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:52.400814 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2b49c4d8-da0c-4064-88ea-c2fd053d6baf req-06474ad2-f659-403a-ab4d-38ea26a7645b service nova] Creating event network-vif-deleted:ac3825f1-8762-45aa-8080-f2246831d82a for instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 on n-h2-858129-2 Sep 16 14:17:52.408269 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2b49c4d8-da0c-4064-88ea-c2fd053d6baf req-06474ad2-f659-403a-ab4d-38ea26a7645b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059261 Sep 16 14:17:52.409853 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2058/4134] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:52.416574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:52.417645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:52.438173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:52.439279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:52.439990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:52.441067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:52.441799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:52.443156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:52.663907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:52.691769 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4a0e13b-545b-4306-bc5b-829f4835491b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1272 microversion: 2.1 time: 0.279786 Sep 16 14:17:52.693936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2059/4135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:52 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:52.705591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:52.708347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:52.724685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:52.726309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:52.728347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:52.732475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:52.733893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:52.745629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.132150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:53.145552 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-12cec21e-c683-4f35-954e-9df68dc91246 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1183 microversion: 2.1 time: 0.449140 Sep 16 14:17:53.162298 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2060/4136] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:52 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1183 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:53.162606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:53.165519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:53.182088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.183181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.185064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.188321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.188889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.189686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.214396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:53.242777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-416067d0-dbff-4dbe-81aa-1bfaad9719cb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 1.893618 Sep 16 14:17:53.255725 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2077/4137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:51 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:17:53.255831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:53.365115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:53.372442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:53.373179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:53.382169 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec1d65e8-42dc-4ee4-8026-13651d183c38 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1271 microversion: 2.1 time: 0.230961 Sep 16 14:17:53.392779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.393458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.393993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.398626 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2061/4138] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:53 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:53.398865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.399427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.399953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.433072 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] HTTP exception thrown: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 HTTP/1.1 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11'} Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.438626 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:17:53.444257 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.445415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 404 to user: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:17:53.453481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e534c35f-9eb1-46f0-a653-727e2a6bb7ad req-d053d7bf-babd-422a-9f76-75dc2c36c036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8df4d0a-666b-4a3a-b143-7a3974d99cf3", "name": "network-vif-plugged", "status": "completed", "tag": "abf6325c-4ec4-4751-b345-6a4fbf60f6df"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:53.455454 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88a1511a-9819-4f3d-8a58-48c6e9168b9a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 404 len: 111 microversion: 2.1 time: 0.080855 Sep 16 14:17:53.456498 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2078/4139] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:53 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:17:53.475002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e534c35f-9eb1-46f0-a653-727e2a6bb7ad req-d053d7bf-babd-422a-9f76-75dc2c36c036 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.476000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e534c35f-9eb1-46f0-a653-727e2a6bb7ad req-d053d7bf-babd-422a-9f76-75dc2c36c036 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.476501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:53.477874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e534c35f-9eb1-46f0-a653-727e2a6bb7ad req-d053d7bf-babd-422a-9f76-75dc2c36c036 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.494459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:53.496081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:53.501798 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e534c35f-9eb1-46f0-a653-727e2a6bb7ad req-d053d7bf-babd-422a-9f76-75dc2c36c036 service nova] Creating event network-vif-plugged:abf6325c-4ec4-4751-b345-6a4fbf60f6df for instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 on n-h1-858129-2 Sep 16 14:17:53.519384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.526033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.526484 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e534c35f-9eb1-46f0-a653-727e2a6bb7ad req-d053d7bf-babd-422a-9f76-75dc2c36c036 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076763 Sep 16 14:17:53.526656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.528403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.528918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.530720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.532235 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2062/4140] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:17:53.726096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:53.731443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:53.761181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.761181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.761839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.763196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.764029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.764782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.795375 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-33c3c26f-7c97-4749-b0b7-8859d7a8364c tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.326444 Sep 16 14:17:53.796885 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2079/4141] 10.222.0.60 () {58 vars in 1230 bytes} [Fri Sep 16 14:17:53 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:17:53.813835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc7335b6-5043-4ace-93a5-c45151d1a6c5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc7335b6-5043-4ace-93a5-c45151d1a6c5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: action_args: {} Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 16 14:17:53.830439 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 16 14:17:53.838770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:53.843664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc7335b6-5043-4ace-93a5-c45151d1a6c5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:17:53.843664 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc7335b6-5043-4ace-93a5-c45151d1a6c5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.037583 Sep 16 14:17:53.844837 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2080/4142] 10.222.0.60 () {58 vars in 1182 bytes} [Fri Sep 16 14:17:53 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:17:53.856057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:53.862720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:53.863676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:53.874492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.875189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.875663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.876614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:53.877326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:53.877963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:53.924114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:17:53.992971 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-141e640c-ec57-4a9a-a56c-7fb424d25007 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.141491 Sep 16 14:17:54.001040 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2081/4143] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:17:53 2022] GET /compute/v2.1/servers => generated 681 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:54.011358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:54.022507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:54.025587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.compute.servers [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Removing options 'limit' from query {{(pid=128642) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 16 14:17:54.028110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:54.039349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:54.040565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:54.041666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:54.044106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:54.045530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:54.046582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:54.129089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:17:54.222721 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21c0badd-2e96-435d-9f8a-78287785d94d tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.218847 Sep 16 14:17:54.229782 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2082/4144] 10.222.0.60 () {58 vars in 1144 bytes} [Fri Sep 16 14:17:54 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:54.250239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:54.251189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:54.274853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:54.275306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:54.276766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:54.278730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:54.279530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:54.280291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:54.374153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:54.392171 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-17b469de-40de-496a-9bd6-b1b70a5acde9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.674208 Sep 16 14:17:54.393425 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2063/4145] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:53 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:54.400814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5caa0c6-c0a4-4c3a-b83c-9edf0868ae11 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5caa0c6-c0a4-4c3a-b83c-9edf0868ae11 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: action_args: {} Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi '-1' Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 16 14:17:54.411172 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5caa0c6-c0a4-4c3a-b83c-9edf0868ae11 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5caa0c6-c0a4-4c3a-b83c-9edf0868ae11 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.018249 Sep 16 14:17:54.419582 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2064/4146] 10.222.0.60 () {58 vars in 1142 bytes} [Fri Sep 16 14:17:54 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:17:54.436245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:54.437130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:54.459413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:54.460272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:54.461085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:54.462449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:54.463303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:54.463941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:55.116208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:55.156152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f8c2b841-f45c-49bb-aeec-300613569873 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1183 microversion: 2.1 time: 0.913291 Sep 16 14:17:55.224305 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2083/4147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:54 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1183 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:55.266897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:55.270041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:55.299771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:55.301134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:55.302258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:55.303973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:55.306221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:55.307683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:55.650013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:55.699574 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34c901b1-4682-420d-8bfb-67d551e1f358 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1271 microversion: 2.1 time: 0.469013 Sep 16 14:17:55.704470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2084/4148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:55 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1271 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:55.723628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58a00bb9-0565-4ca4-a60b-d86ba0fd0655 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58a00bb9-0565-4ca4-a60b-d86ba0fd0655 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: action_args: {} Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'testing' Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 16 14:17:55.745675 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:17:55.755650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58a00bb9-0565-4ca4-a60b-d86ba0fd0655 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:17:55.757965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58a00bb9-0565-4ca4-a60b-d86ba0fd0655 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.049042 Sep 16 14:17:55.763969 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2085/4149] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:17:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:17:55.775104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:55.776821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:55.793670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:55.795003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:55.796157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:55.797808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:55.798928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:55.800092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.397769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:56.414321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d4e00e81-774b-481c-8e5b-de45932bf52d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1314 microversion: 2.1 time: 1.979033 Sep 16 14:17:56.427414 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2065/4150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:54 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1314 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:56.438393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-849fc2df-3db9-426d-b291-cd0c46200389 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:56.444449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-849fc2df-3db9-426d-b291-cd0c46200389 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:56.445613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-849fc2df-3db9-426d-b291-cd0c46200389 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:56.456038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.servers [None req-849fc2df-3db9-426d-b291-cd0c46200389 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Flavor 'non_existing_flavor' could not be found {{(pid=128643) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 16 14:17:56.458142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-849fc2df-3db9-426d-b291-cd0c46200389 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.029515 Sep 16 14:17:56.459110 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2066/4151] 10.222.0.60 () {58 vars in 1178 bytes} [Fri Sep 16 14:17:56 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:17:56.489041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:56.490205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:56.510193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.511271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.512928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.514096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.514871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.518920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.571973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:56.585463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92b6e790-0809-4627-8f66-353d8712f962 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.819439 Sep 16 14:17:56.592219 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2086/4152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:55 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:56.614001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:56.624451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:56.625458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:56.646768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.647282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.647798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.648595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.649221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.649659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.755887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:56.794188 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73a60e65-4060-4764-b969-3c7a66525b7c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1183 microversion: 2.1 time: 0.321473 Sep 16 14:17:56.795206 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2067/4153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:56 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:56.817045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:56.818099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:56.829521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.830478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.831190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.832463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.833152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.833792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.879336 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-78d7f583-fd88-4ea2-8341-df9038b44ee5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.283609 Sep 16 14:17:56.888020 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2087/4154] 10.222.0.60 () {58 vars in 1174 bytes} [Fri Sep 16 14:17:56 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:17:56.900856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:56.909240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:56.910191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:56.919723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.920446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.920899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:56.922423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:56.922912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:56.923991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:57.181300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2c1f0f0-6f5e-47b0-a07f-6e55f685d9a8 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.287827 Sep 16 14:17:57.198077 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2088/4155] 10.222.0.60 () {58 vars in 1184 bytes} [Fri Sep 16 14:17:56 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:17:57.209536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:57.231451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:57.233055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:57.254918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:57.255792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:57.256622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:57.258054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:57.259029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:57.259823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:57.284758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:57.339240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:17:57.401560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:57.412609 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15c268c8-6c50-4b4e-bbc8-f121bd1fd5e3 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 0.600304 Sep 16 14:17:57.419014 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2068/4156] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:56 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:57.422635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:57.431527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:57.432386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:57.433062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:57.446553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:57.447701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:57.459003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:57.465851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:57.467777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:57.471221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:57.474757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:57.477066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:58.081409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:58.249197 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2ce6e60-116a-4537-9270-c3fa6c6ea2cc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 3019 microversion: 2.1 time: 1.049048 Sep 16 14:17:58.250236 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2089/4157] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:17:57 2022] GET /compute/v2.1/servers/detail => generated 3019 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:58.259350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:58.272455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:58.302977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:58.316352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:58.317429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:58.318739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:58.320327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:58.322677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:58.323760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:58.355906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d38a49ef-b6f4-4afb-b3d0-c8002cb93183 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1501 microversion: 2.1 time: 0.911431 Sep 16 14:17:58.358858 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2069/4158] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:57 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1501 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:58.373830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:58.383863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:58.417373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:58.420209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:58.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:58.434595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:58.435729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:58.437232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:58.852900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:58.893835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6400a6d6-49af-4124-854f-169de1052425 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 200 len: 1183 microversion: 2.1 time: 0.532571 Sep 16 14:17:58.897577 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2070/4159] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:58 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 1183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:58.925924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9974d8d6-aa73-4faa-935d-fd1fd440db8e req-b57f18d1-99f8-49aa-833f-83171fb63a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d22e05-0bc2-44cd-ac80-2b99545d1671", "tag": "eaf13879-6963-4fcb-969d-02e71813433c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:58.980543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9974d8d6-aa73-4faa-935d-fd1fd440db8e req-b57f18d1-99f8-49aa-833f-83171fb63a0d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:58.983038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9974d8d6-aa73-4faa-935d-fd1fd440db8e req-b57f18d1-99f8-49aa-833f-83171fb63a0d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:58.984000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9974d8d6-aa73-4faa-935d-fd1fd440db8e req-b57f18d1-99f8-49aa-833f-83171fb63a0d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.037016 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9974d8d6-aa73-4faa-935d-fd1fd440db8e req-b57f18d1-99f8-49aa-833f-83171fb63a0d service nova] Creating event network-changed:eaf13879-6963-4fcb-969d-02e71813433c for instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 on n-h1-858129-2 Sep 16 14:17:59.074851 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9974d8d6-aa73-4faa-935d-fd1fd440db8e req-b57f18d1-99f8-49aa-833f-83171fb63a0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174127 Sep 16 14:17:59.081751 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2071/4160] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:59.106687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94ff133d-cac0-4c7a-8b94-b50a69792ebc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:59.129839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-94ff133d-cac0-4c7a-8b94-b50a69792ebc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:59.145299 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-94ff133d-cac0-4c7a-8b94-b50a69792ebc tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.061055 Sep 16 14:17:59.151702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2072/4161] 10.222.0.60 () {58 vars in 1178 bytes} [Fri Sep 16 14:17:59 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:17:59.164872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:17:59.170763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:59.198955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.205400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.207784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.217081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.218650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.219955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.307685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'flavor' on Instance uuid f8df4d0a-666b-4a3a-b143-7a3974d99cf3 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:17:59.491277 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-918517e8-d790-4bbc-9bcb-e55699ad0309 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "POST /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3/action" status: 202 len: 0 microversion: 2.1 time: 0.337309 Sep 16 14:17:59.498461 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2073/4162] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:17:59 2022] POST /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:17:59.505425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:59.506504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:59.525246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.526478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.529589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.531178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.534562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.535548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.670101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:59.673343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:59.684671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5ca8d2d-75f9-4d51-a175-bf1d153e8196 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 1.432554 Sep 16 14:17:59.685989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2090/4163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:58 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:59.694290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:59.700786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:59.701922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Searching by: {'deleted': False, 'project_id': 'b5080789f45a4646960949cbc7726000'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:17:59.711556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.713525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.714455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.717610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.718434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.719043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.750048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:17:59.770472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:17:59.834705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-caf03fe5-3e0b-4fa2-bd8b-0758bcce96f9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.146970 Sep 16 14:17:59.837913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2091/4164] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 14:17:59 2022] GET /compute/v2.1/servers => generated 681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:17:59.847808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:59.848975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:59.889332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.890319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.892545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.893998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.906945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.908283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.923337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:17:59.932594 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd1086b6-c800-449a-8b2a-fe1f6a5bd9f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 0.431935 Sep 16 14:17:59.938973 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2074/4165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:59 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:17:59.944440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:17:59.944939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:17:59.965715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.966237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.966694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:17:59.967422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:17:59.973378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:17:59.974102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.010150 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] HTTP exception thrown: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 HTTP/1.1 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11'} Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:00.012361 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 404 to user: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-47b5dbb7-df6f-4425-92c5-3824dabf1bf9 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 404 len: 111 microversion: 2.1 time: 0.075373 Sep 16 14:18:00.019645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2075/4166] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:17:59 2022] DELETE /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:00.030791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:00.031444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 6b6caea4-8af7-4ada-b46d-436dfb7b58c6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:00.047415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.053713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.054396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.055200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.055691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.056113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.089079 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] HTTP exception thrown: Instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 could not be found. Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Request method failure captured: Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 HTTP/1.1 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINCdgmIV5nXQnepbzBDhpkMVAEqP8wWOFP5mjHmmbcHXoOdTJ49QyH_ezQ7zc8ZybreHMnnry06puFe6Nw_zkXmwxmXv_Mov7eJoxxVDsqgH7RrbJoPSHp16266CC9v9W3vQmpK9aeEZt6eyzrRaG1OK_oVFWfHVDFkE6THiOH9AFE Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0880eeb6de8348f4a18288e1a1247eb6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}] Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 35e0a11712764fa5b78e9ac4d1859f3a Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 could not be found. Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '6b6caea4-8af7-4ada-b46d-436dfb7b58c6'} Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 could not be found. Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 could not be found. Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:00.099496 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 could not be found. Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Returning 404 to user: Instance 6b6caea4-8af7-4ada-b46d-436dfb7b58c6 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02dade5e-ef2a-4190-9585-c6982a8f1c20 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6" status: 404 len: 111 microversion: 2.1 time: 0.080881 Sep 16 14:18:00.104030 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2076/4167] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:00 2022] GET /compute/v2.1/servers/6b6caea4-8af7-4ada-b46d-436dfb7b58c6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:00.118705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9736e1a0-ccfd-4926-baaa-4bb512a68f5d req-7cc58778-0080-4081-97f6-92c774597088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d9e745-24af-4330-8609-eae8639f2901", "tag": "6660a025-663e-4689-8952-3a3bad68b711"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:00.146752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9736e1a0-ccfd-4926-baaa-4bb512a68f5d req-7cc58778-0080-4081-97f6-92c774597088 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.147405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9736e1a0-ccfd-4926-baaa-4bb512a68f5d req-7cc58778-0080-4081-97f6-92c774597088 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.147860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9736e1a0-ccfd-4926-baaa-4bb512a68f5d req-7cc58778-0080-4081-97f6-92c774597088 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.179543 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9736e1a0-ccfd-4926-baaa-4bb512a68f5d req-7cc58778-0080-4081-97f6-92c774597088 service nova] Creating event network-changed:6660a025-663e-4689-8952-3a3bad68b711 for instance d8d9e745-24af-4330-8609-eae8639f2901 on n-h1-858129-2 Sep 16 14:18:00.197807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9736e1a0-ccfd-4926-baaa-4bb512a68f5d req-7cc58778-0080-4081-97f6-92c774597088 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090045 Sep 16 14:18:00.201639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2077/4168] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:00.219545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:00.222841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:00.241164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.241960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.245192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.254532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.255959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.258357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.319946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:00.514367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b672476-37c7-461d-9559-dd0094d0fd0e tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "DELETE /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4" status: 204 len: 0 microversion: 2.1 time: 0.309250 Sep 16 14:18:00.520287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2078/4169] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:00 2022] DELETE /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:18:00.531303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:00.532841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:00.546054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.546872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.547418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.548595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.549305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.551479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.587606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:00.659938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:00.708391 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7841066f-a25c-4330-876d-e232e3fd1d67 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 204 len: 0 microversion: 2.1 time: 0.185121 Sep 16 14:18:00.709770 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2079/4170] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:00 2022] DELETE /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:18:00.716813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:00.718784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:00.730545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.731212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.731884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:00.733273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:00.733953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:00.734576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:01.389612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:01.428102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:01.437326 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19338a2c-0bc8-4ba6-ba7f-15673ff0626d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1509 microversion: 2.1 time: 1.596861 Sep 16 14:18:01.441580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4a9df18a-9693-43cc-9678-8c0aa9a59232 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.729348 Sep 16 14:18:01.443077 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2092/4171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:17:59 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1509 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:01.459406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:01.462755 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2080/4172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:00 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:01.475146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:01.487663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:01.490904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:01.514426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:01.515827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:01.519494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:01.523044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:01.525881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:01.530323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:01.531210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:01.532299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:01.535115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:01.536022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:01.541333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:01.541993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:01.611502 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] HTTP exception thrown: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 HTTP/1.1 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11'} Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:01.619217 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 404 to user: Instance 0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8903e2a-ca97-43b6-8c59-77ad3e8862e5 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11" status: 404 len: 111 microversion: 2.1 time: 0.172063 Sep 16 14:18:01.646607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2093/4173] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:01 2022] GET /compute/v2.1/servers/0ff347d3-ff5f-4ac5-bbdb-919eea8ccb11 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:01.653170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:01.654831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:01.667284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:01.669501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:01.670827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:01.672646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:01.673877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:01.675052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:02.087344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:02.120633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a54a7626-43af-4080-84ce-2da5a23dcbae tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 0.655808 Sep 16 14:18:02.135834 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2081/4174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:01 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:02.200404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:02.218934 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47adabb9-e150-441f-b6cb-64d31a547bcd tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4" status: 200 len: 1519 microversion: 2.1 time: 0.575751 Sep 16 14:18:02.220007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2094/4175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:01 2022] GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 => generated 1519 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:02.468516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:02.469456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:02.486877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:02.488142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:02.502383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:02.504167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:02.505005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:02.505730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:02.506369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:02.507517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:02.508452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:02.509443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:02.510159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:02.512278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:02.513159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:02.513825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:03.051165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:03.068323 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-646bef8a-a318-4205-a986-5517379e9dba tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.604676 Sep 16 14:18:03.078818 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2082/4176] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:02 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:03.338863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:03.354991 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2bff237-57b1-41cc-921f-5a0d536cd3af tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1492 microversion: 2.1 time: 0.868972 Sep 16 14:18:03.377550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2095/4177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:02 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1492 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:03.405507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:03.406162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:03.422855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05252e30-6fa6-4a39-8b28-340afee9b74f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'create', calling method: .version_select at 0x7f724d394040>, body: {"keypair": {"name": "tempest-keypair-1632741643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3doBekJZIt9KuLBFJJBn2j3NLfJzBy9ALK71v3OaAyd0BwySYbHUTLlfjnY8Uj/ctK/s8qb4J1XgqCt5hYAbVabn4wVkKmp3OgYVqVEbrFij8GJKq4gy2qbysmhLd0Mg=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:03.428328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:03.428842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:03.429292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:03.439611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:03.440367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:03.441655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:03.446244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-05252e30-6fa6-4a39-8b28-340afee9b74f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for project d8057a5157844b15bb19ece760a72ce5. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:18:03.454536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-05252e30-6fa6-4a39-8b28-340afee9b74f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for user 6830539834e941eaa36dcb955b57194d and project d8057a5157844b15bb19ece760a72ce5. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:18:03.507237 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05252e30-6fa6-4a39-8b28-340afee9b74f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.406879 Sep 16 14:18:03.508781 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2083/4178] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 14:18:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 411 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 16 14:18:03.533687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:03.535577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:03.549840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:03.552995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:03.554121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:03.556619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:03.559615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:03.560304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:04.507697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:04.521936 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-412a9443-2a03-4778-8a60-51fa6f3853e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 1.141876 Sep 16 14:18:04.525868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2096/4179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:03 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:04.538195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:04.541515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:04.564471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:04.566566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:04.567658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:04.569509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:04.574099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:04.576250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:04.662492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:04.954210 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f5950dae-b5ab-4d6b-8002-44b98546dc20 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 204 len: 0 microversion: 2.1 time: 0.423594 Sep 16 14:18:04.962202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2097/4180] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:04 2022] DELETE /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:18:05.010115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:05.012286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:05.061681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:05.062203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:05.062747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:05.063504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:05.065095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:05.065095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:05.096238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:05.112681 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2048b6c5-1083-4bb2-b4ad-fdbcf6177968 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4" status: 200 len: 1519 microversion: 2.1 time: 1.602517 Sep 16 14:18:05.118502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2084/4181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:03 2022] GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 => generated 1519 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:05.124525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:05.135219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:05.162701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:05.163506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:05.165469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:05.172896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:05.173659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:05.175057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.335255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:06.356297 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a19ee57b-8fe7-406a-9870-d64a8db175e9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1498 microversion: 2.1 time: 1.235590 Sep 16 14:18:06.356593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:06.357843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2085/4182] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:05 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1498 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:06.382143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c9bf6814-b23a-4c0a-94fe-4c900c241d7b req-58ff1f70-64d9-4306-bb78-ed15408b5f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064dc6dc-ccea-4b4f-9d7e-eb150183f4e4", "name": "network-vif-deleted", "tag": "34f1ba54-b34f-488d-8af8-3a483a1e36c8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:06.393920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ad04d5d-daf7-45ec-93ba-b5913e1fbc79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 1.418492 Sep 16 14:18:06.401416 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2098/4183] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:04 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:06.421849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:06.422848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:06.429007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c9bf6814-b23a-4c0a-94fe-4c900c241d7b req-58ff1f70-64d9-4306-bb78-ed15408b5f8b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.438234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c9bf6814-b23a-4c0a-94fe-4c900c241d7b req-58ff1f70-64d9-4306-bb78-ed15408b5f8b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.442254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c9bf6814-b23a-4c0a-94fe-4c900c241d7b req-58ff1f70-64d9-4306-bb78-ed15408b5f8b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.447552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.448086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.448549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.449859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.450337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.450820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.497999 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c9bf6814-b23a-4c0a-94fe-4c900c241d7b req-58ff1f70-64d9-4306-bb78-ed15408b5f8b service nova] Creating event network-vif-deleted:34f1ba54-b34f-488d-8af8-3a483a1e36c8 for instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 on n-h2-858129-2 Sep 16 14:18:06.555278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c9bf6814-b23a-4c0a-94fe-4c900c241d7b req-58ff1f70-64d9-4306-bb78-ed15408b5f8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167266 Sep 16 14:18:06.556419 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2086/4184] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:06.591011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:06.593614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:06.623034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.625133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.626006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.627426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.628468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.629682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.666278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] HTTP exception thrown: Instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 could not be found. Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 HTTP/1.1 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 could not be found. Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '064dc6dc-ccea-4b4f-9d7e-eb150183f4e4'} Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 could not be found. Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 could not be found. Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:06.671147 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 could not be found. Sep 16 14:18:06.680934 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:06.684261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 404 to user: Instance 064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:06.687675 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1031e3a8-4055-4a63-b338-1f08d22b304b tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4" status: 404 len: 111 microversion: 2.1 time: 0.122515 Sep 16 14:18:06.694505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2087/4185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:06 2022] GET /compute/v2.1/servers/064dc6dc-ccea-4b4f-9d7e-eb150183f4e4 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:06.709201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:06.711111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:06.736802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.738127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.739311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:06.741426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:06.742983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:06.744013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.105400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24a7dff26b0d4a8b8020366af8aa007a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5080789f45a4646960949cbc7726000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:07.125228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59ac64cb-90d7-4da3-ace3-43d603b46745 tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 200 len: 1477 microversion: 2.1 time: 0.428498 Sep 16 14:18:07.154175 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2088/4186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:06 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:07.159467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-52ac338d-aa85-4184-9ef6-321492126a2a req-029e1760-c886-46a7-b4a5-f7729a1db05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe403bd-c4ad-441e-9368-177dba7dddc0", "name": "network-vif-deleted", "tag": "a671dd2b-2b3a-4f6b-95b5-29212aa13c6d"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:07.182145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-52ac338d-aa85-4184-9ef6-321492126a2a req-029e1760-c886-46a7-b4a5-f7729a1db05b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.182966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-52ac338d-aa85-4184-9ef6-321492126a2a req-029e1760-c886-46a7-b4a5-f7729a1db05b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.184415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-52ac338d-aa85-4184-9ef6-321492126a2a req-029e1760-c886-46a7-b4a5-f7729a1db05b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.233557 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-52ac338d-aa85-4184-9ef6-321492126a2a req-029e1760-c886-46a7-b4a5-f7729a1db05b service nova] Creating event network-vif-deleted:a671dd2b-2b3a-4f6b-95b5-29212aa13c6d for instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 on n-h2-858129-2 Sep 16 14:18:07.255668 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-52ac338d-aa85-4184-9ef6-321492126a2a req-029e1760-c886-46a7-b4a5-f7729a1db05b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096020 Sep 16 14:18:07.258686 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2089/4187] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:07.346052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:07.348718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:07.350225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:07.365148 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eee510ed-6d58-4183-9e84-b83153565306 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 0.959730 Sep 16 14:18:07.366202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2099/4188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:06 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:07.371090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.371604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.372046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.372774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.373224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.373641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.389252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:07.390795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:07.414737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.421298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.428562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.429659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.430390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.431249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.432215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:07.470046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:07.843634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:07.858638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9c99df20-6337-4809-81d9-1625de62ac96 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 204 len: 0 microversion: 2.1 time: 0.511273 Sep 16 14:18:07.867946 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2090/4189] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:07 2022] DELETE /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:18:07.901220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:07.907347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:07.936273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.939649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.942850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:07.946888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:07.950285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:07.951193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.034704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:08.047210 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3bed7d9-84ba-44ae-966d-d1f73d38941e tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1498 microversion: 2.1 time: 0.662576 Sep 16 14:18:08.050741 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2100/4190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:07 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1498 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:08.064182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:08.066443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:08.098123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:08.101567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:08.104773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.109140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:08.115121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:08.124846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.669583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:08.695147 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5982622-4333-48c0-ba97-147b454eda71 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.816635 Sep 16 14:18:08.721794 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2091/4191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:07 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:08.755132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:08.756545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] [instance: 0fe403bd-c4ad-441e-9368-177dba7dddc0] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:08.781870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:08.782932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:08.796116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.797493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:08.798609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:08.799363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.821321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] HTTP exception thrown: Instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 could not be found. Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Request method failure captured: Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 HTTP/1.1 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIVZObuJrvhus4plak5Tsz_aTrX9Ge8pGkU4Z9ZaDhb7_kQa_prm_4wJa3kBx5tR244X78WUcoloRXyYa4TklOcADwhq91HogK5-vG3Pjhqn_ZfUv-c9vKOcL5v3vXWR3exSs1vjY400bely7hSjhWornexeCfiZUC7Ey_M-CrIlrE4 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b5080789f45a4646960949cbc7726000", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b5080789f45a4646960949cbc7726000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b5080789f45a4646960949cbc7726000"}]}] Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: b5080789f45a4646960949cbc7726000 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-208921448 Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 24a7dff26b0d4a8b8020366af8aa007a Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ListServersNegativeTestJSON-208921448-project Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 could not be found. Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0fe403bd-c4ad-441e-9368-177dba7dddc0'} Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 could not be found. Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 could not be found. Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:08.823509 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 could not be found. Sep 16 14:18:08.827886 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:08.832141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] Returning 404 to user: Instance 0fe403bd-c4ad-441e-9368-177dba7dddc0 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:08.833515 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5fa9326-5ce2-48fd-8860-cbc9bc51bb1a tempest-ListServersNegativeTestJSON-208921448 tempest-ListServersNegativeTestJSON-208921448-project] 10.222.0.60 "GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0" status: 404 len: 111 microversion: 2.1 time: 0.105753 Sep 16 14:18:08.834507 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2092/4192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:08 2022] GET /compute/v2.1/servers/0fe403bd-c4ad-441e-9368-177dba7dddc0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:08.844674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:08.845394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:08.856932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:08.857605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:08.858155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.859335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:08.859927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:08.860476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:08.948293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:08.963971 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0136c0cd-83f8-46c2-8fe9-58295423af00 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1667 microversion: 2.1 time: 0.905463 Sep 16 14:18:08.965930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2101/4193] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:08 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1667 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:09.092066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:09.092836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:09.107903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:09.108980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:09.110328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:09.111957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:09.114882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:09.116158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:09.590611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:09.619762 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-549986e8-9aff-4533-be8d-836ea222360f tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 0.780005 Sep 16 14:18:09.635416 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2093/4194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:08 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:09.676199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1e87572b-f981-448b-b891-b1875d91c9e9 req-acfde2db-6b56-4052-9e81-a56eeaedd469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d22e05-0bc2-44cd-ac80-2b99545d1671", "name": "network-vif-plugged", "status": "completed", "tag": "eaf13879-6963-4fcb-969d-02e71813433c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:09.731169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1e87572b-f981-448b-b891-b1875d91c9e9 req-acfde2db-6b56-4052-9e81-a56eeaedd469 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:09.732249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1e87572b-f981-448b-b891-b1875d91c9e9 req-acfde2db-6b56-4052-9e81-a56eeaedd469 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:09.733238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1e87572b-f981-448b-b891-b1875d91c9e9 req-acfde2db-6b56-4052-9e81-a56eeaedd469 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:09.738464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:09.771965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1e87572b-f981-448b-b891-b1875d91c9e9 req-acfde2db-6b56-4052-9e81-a56eeaedd469 service nova] Creating event network-vif-plugged:eaf13879-6963-4fcb-969d-02e71813433c for instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 on n-h1-858129-2 Sep 16 14:18:09.783305 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1e87572b-f981-448b-b891-b1875d91c9e9 req-acfde2db-6b56-4052-9e81-a56eeaedd469 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145047 Sep 16 14:18:09.784891 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2094/4195] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:09.796709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:09.798022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:09.810632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:09.811878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:09.813251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:09.814859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:09.816014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:09.817074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:10.583478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:10.601520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb80eece-a589-4216-a255-60b9e2349bcb tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1498 microversion: 2.1 time: 1.514888 Sep 16 14:18:10.623975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2102/4196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:09 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1498 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:10.645388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:10.647625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:10.675976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:10.677535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:10.678537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:10.679960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:10.681415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:10.682644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:10.839329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:10.857166 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53d98b10-255d-4aed-ab07-231c064d0ada tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 1.069607 Sep 16 14:18:10.860847 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2095/4197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:09 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:10.873038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:10.873989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:10.883143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:10.884062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:10.884752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:10.885762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:10.887082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:10.888771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:11.369769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:11.383537 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-192e3c7e-1452-46aa-b71f-63de3bd22d72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1667 microversion: 2.1 time: 0.757917 Sep 16 14:18:11.384868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2103/4198] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:10 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1667 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:11.391322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-984d8528-225d-489a-a32c-8d05c0a5ec0d req-9a48b6be-5676-4628-a50d-64cfb808c00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8df4d0a-666b-4a3a-b143-7a3974d99cf3", "name": "network-vif-deleted", "tag": "abf6325c-4ec4-4751-b345-6a4fbf60f6df"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:11.406919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-984d8528-225d-489a-a32c-8d05c0a5ec0d req-9a48b6be-5676-4628-a50d-64cfb808c00f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:11.407740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-984d8528-225d-489a-a32c-8d05c0a5ec0d req-9a48b6be-5676-4628-a50d-64cfb808c00f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:11.408362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-984d8528-225d-489a-a32c-8d05c0a5ec0d req-9a48b6be-5676-4628-a50d-64cfb808c00f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:11.423793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-984d8528-225d-489a-a32c-8d05c0a5ec0d req-9a48b6be-5676-4628-a50d-64cfb808c00f service nova] Creating event network-vif-deleted:abf6325c-4ec4-4751-b345-6a4fbf60f6df for instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 on n-h1-858129-2 Sep 16 14:18:11.432745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-984d8528-225d-489a-a32c-8d05c0a5ec0d req-9a48b6be-5676-4628-a50d-64cfb808c00f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044842 Sep 16 14:18:11.435469 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2104/4199] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:11.594652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:11.631836 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c0b3bd6-069c-4d60-a035-5e63d6ae32e2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1313 microversion: 2.1 time: 0.767885 Sep 16 14:18:11.633658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2096/4200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:10 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:11.694713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:11.697779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:11.729236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:11.732611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:11.734982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:11.784330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:11.787015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:11.791718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:12.016376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:12.018726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:12.060556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:12.062143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:12.064050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:12.066031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:12.067239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:12.068152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:12.070674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:12.082782 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3be3cfa8-84c7-4fbe-9e8d-52e2bbda1b0c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1290 microversion: 2.1 time: 0.431714 Sep 16 14:18:12.087680 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2097/4201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:11 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1290 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:12.126624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:12.132246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:12.159619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:12.161080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:12.162288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:12.164215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:12.165500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:12.168082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:12.172071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:12.243366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:12.356420 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f8be924-29ff-4c99-bba7-a6b87d697e25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 204 len: 0 microversion: 2.42 time: 0.775798 Sep 16 14:18:12.365122 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2105/4202] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:18:11 2022] DELETE /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:18:12.401455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-655320387", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5285c9a9-50e4-40cd-8364-0a426267378e"}], "security_groups": [{"name": "tempest-securitygroup--1052659668"}], "key_name": "tempest-keypair-1632741643", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:12.858539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] validate_networks() for [('5285c9a9-50e4-40cd-8364-0a426267378e', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:18:12.880992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:12.884769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:12.896020 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f36e3b65-3f71-4795-98e1-5692fbac4154 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.802267 Sep 16 14:18:12.897137 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2098/4203] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:12 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:12.908069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:12.909179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:12.924238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:12.925622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:12.926734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:12.928754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:12.931339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:12.933815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:13.473769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:13.792016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:13.921941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:13.947423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:13.953657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:13.957231 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb46ee9b-e3b9-4f6c-a6ca-9fc0de9d21be tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2964 microversion: 2.42 time: 1.057613 Sep 16 14:18:13.959300 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2099/4204] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:12 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2964 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:13.973678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:13.975309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:14.002380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:14.003558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:14.004343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:14.006927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:14.007880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:14.008847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:14.635189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:14.682815 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c87150df-d132-4ba2-99e6-810646257503 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1599 microversion: 2.1 time: 0.719454 Sep 16 14:18:14.696337 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2100/4205] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:13 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1599 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:14.707587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:14.713143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:14.735746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:14.736300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:14.736763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:14.737513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:14.737986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:14.738433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.460671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:15.470663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:18:15.473887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:18:15.475390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:18:15.477440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:18:15.482987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:18:15.510899 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b2954ac-0255-4167-aded-2f72a353bc39 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1497 microversion: 2.1 time: 0.807557 Sep 16 14:18:15.522729 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2101/4206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:14 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1497 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:15.528631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.534909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.535436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.537179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.537750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.538204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.556264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:15.563308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:15.578928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for project d8057a5157844b15bb19ece760a72ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:18:15.586092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for user 6830539834e941eaa36dcb955b57194d and project d8057a5157844b15bb19ece760a72ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:18:15.606601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:18:15.610687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:18:15.631776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.634225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.635111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.636144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.639695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.641422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.738844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.739757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.742165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.743112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lazy-loading 'fault' on Instance uuid f8df4d0a-666b-4a3a-b143-7a3974d99cf3 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:18:15.782385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-444766b7-7b5e-4bfe-99f9-5827e4d0d1fa tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.408563 Sep 16 14:18:15.794757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2106/4207] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:18:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:18:15.803667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:15.804884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:15.829219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.830259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.831116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:15.832621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:15.833351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:15.834154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:16.214558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b5828a1ccf48cd866f88400ac00649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149cfd30d6054320a0b3bbde7a2e70ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:16.245005 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad009128-c869-4078-bee0-c285a593d6a9 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 200 len: 1304 microversion: 2.1 time: 0.715922 Sep 16 14:18:16.248758 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2102/4208] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:15 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 1304 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:16.265281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c471e21b-b545-49d0-94f4-719a7a1fe6b8 req-58068ba0-cd41-43b6-8651-e72eb2d31ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d9e745-24af-4330-8609-eae8639f2901", "name": "network-vif-plugged", "status": "completed", "tag": "6660a025-663e-4689-8952-3a3bad68b711"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:16.301209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c471e21b-b545-49d0-94f4-719a7a1fe6b8 req-58068ba0-cd41-43b6-8651-e72eb2d31ce8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:16.302089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c471e21b-b545-49d0-94f4-719a7a1fe6b8 req-58068ba0-cd41-43b6-8651-e72eb2d31ce8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:16.302793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c471e21b-b545-49d0-94f4-719a7a1fe6b8 req-58068ba0-cd41-43b6-8651-e72eb2d31ce8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:16.321292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c471e21b-b545-49d0-94f4-719a7a1fe6b8 req-58068ba0-cd41-43b6-8651-e72eb2d31ce8 service nova] Creating event network-vif-plugged:6660a025-663e-4689-8952-3a3bad68b711 for instance d8d9e745-24af-4330-8609-eae8639f2901 on n-h1-858129-2 Sep 16 14:18:16.333180 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c471e21b-b545-49d0-94f4-719a7a1fe6b8 req-58068ba0-cd41-43b6-8651-e72eb2d31ce8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081057 Sep 16 14:18:16.334602 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2103/4209] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:16.346936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:16.348146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:16.357398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:16.358627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:16.359595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:16.360980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:16.362134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:16.362891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:17.136302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:17.157175 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b50461c5-0386-401f-8c97-6165a1aeca9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 1.366156 Sep 16 14:18:17.175399 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2107/4210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:15 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:17.182599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3f4dfd5e-05c5-46c1-8bde-68ba9aa787e8 req-ea75480e-4b94-4c8a-9567-5aac781a370c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d141f3-2891-487a-861e-ccaf4b2d5cbe", "name": "network-vif-deleted", "tag": "20061ac3-c0ee-4011-9ba3-ecd56514297d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:17.219455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3f4dfd5e-05c5-46c1-8bde-68ba9aa787e8 req-ea75480e-4b94-4c8a-9567-5aac781a370c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:17.220767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3f4dfd5e-05c5-46c1-8bde-68ba9aa787e8 req-ea75480e-4b94-4c8a-9567-5aac781a370c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:17.221799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3f4dfd5e-05c5-46c1-8bde-68ba9aa787e8 req-ea75480e-4b94-4c8a-9567-5aac781a370c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:17.250321 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3f4dfd5e-05c5-46c1-8bde-68ba9aa787e8 req-ea75480e-4b94-4c8a-9567-5aac781a370c service nova] Creating event network-vif-deleted:20061ac3-c0ee-4011-9ba3-ecd56514297d for instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe on n-h1-858129-2 Sep 16 14:18:17.284275 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3f4dfd5e-05c5-46c1-8bde-68ba9aa787e8 req-ea75480e-4b94-4c8a-9567-5aac781a370c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115366 Sep 16 14:18:17.288513 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2108/4211] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:17.306648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:17.322863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:17.344341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:17.345670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:17.347822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:17.350155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:17.352207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:17.353477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:17.452567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:17.453403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:17.454851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:17.455693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lazy-loading 'fault' on Instance uuid e8d141f3-2891-487a-861e-ccaf4b2d5cbe {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:18:17.616935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:17.636670 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e32089c9-d4ba-41e1-b2b2-f8b21a73c663 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 200 len: 1325 microversion: 2.1 time: 0.345446 Sep 16 14:18:17.640913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2109/4212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:17 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:17.654357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:17.656004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:17.671051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:17.672235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:17.673317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:17.675308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:17.676317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:17.677484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.003300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:18.020512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:18.021183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:18.023303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:18.031733 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ba4865a-c35d-41ca-9581-3d2673daaee6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2964 microversion: 2.42 time: 1.695602 Sep 16 14:18:18.032995 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2104/4213] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:16 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2964 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:18.038277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:18.045013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:18.070368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.071366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.072208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.073201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.079408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.081135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.087029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:18.098606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:18.104228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89a5fd27-3d45-414c-a954-09f592941260 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1285 microversion: 2.20 time: 0.460256 Sep 16 14:18:18.107090 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2110/4214] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:17 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1285 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:18.142131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:18.164351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:18.165577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:18.211546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.212290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.212706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.216487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.217095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.218325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.309897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 HTTP/1.1 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f8df4d0a-666b-4a3a-b143-7a3974d99cf3'} Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:18.313223 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.321171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.338005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:18.340560 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-380be0a9-9595-4b90-9641-eb300ace3a43 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 404 len: 111 microversion: 2.1 time: 0.228032 Sep 16 14:18:18.350648 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2111/4215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:18 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 111 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:18.363633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:18.364779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:18.384320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.385158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.385559 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b130253c-e727-432e-80ff-40fa26e0789e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 204 len: 0 microversion: 2.1 time: 0.349310 Sep 16 14:18:18.386081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.389769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.391214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.391643 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2105/4216] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:18 2022] DELETE /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:18:18.394455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.409445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:18.410861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:18.428378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.429664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.430774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.432643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.436946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.438199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.476027 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 HTTP/1.1 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f8df4d0a-666b-4a3a-b143-7a3974d99cf3'} Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:18.481448 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52547cdd-8091-4380-9cb0-2467570eab5f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 404 len: 111 microversion: 2.1 time: 0.090676 Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2106/4217] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:18 2022] DELETE /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:18.500749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:18.505162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:18.525343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.529601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.532093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.536776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:18.538574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:18.539986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:18.996776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:19.020863 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e8492ae-611b-4c19-9cbf-015d705483e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 0.668487 Sep 16 14:18:19.023007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2112/4218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:18 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:19.054262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.066349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: f8df4d0a-666b-4a3a-b143-7a3974d99cf3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.069207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:19.087153 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc0476e4-d13d-488f-8d28-1705af6f5905 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1503 microversion: 2.1 time: 0.599801 Sep 16 14:18:19.087766 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2107/4219] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:18 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1503 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:19.102897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.102897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.104215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.108563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.109192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: e8d141f3-2891-487a-861e-ccaf4b2d5cbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.111662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.112963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.114061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.116687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.117446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.118346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.119302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.119934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.121052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.141774 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] HTTP exception thrown: Instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe could not be found. Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Request method failure captured: Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe HTTP/1.1 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJINCdgmIV5nXQnepbzBDhpkMVAEqP8wWOFP5mjHmmbcHXoOdTJ49QyH_ezQ7zc8ZybreHMnnry06puFe6Nw_zkXmwxmXv_Mov7eJoxxVDsqgH7RrbJoPSHp16266CC9v9W3vQmpK9aeEZt6eyzrRaG1OK_oVFWfHVDFkE6THiOH9AFE Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0880eeb6de8348f4a18288e1a1247eb6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}] Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 35e0a11712764fa5b78e9ac4d1859f3a Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe could not be found. Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e8d141f3-2891-487a-861e-ccaf4b2d5cbe'} Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe could not be found. Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe could not be found. Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.145688 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe could not be found. Sep 16 14:18:19.153844 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.156354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Returning 404 to user: Instance e8d141f3-2891-487a-861e-ccaf4b2d5cbe could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:19.158041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e2eba6a1-dc0e-49c1-bbb3-1ef4b72c1b8e tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe" status: 404 len: 111 microversion: 2.1 time: 0.053313 Sep 16 14:18:19.159838 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2108/4220] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:19 2022] GET /compute/v2.1/servers/e8d141f3-2891-487a-861e-ccaf4b2d5cbe => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:19.169322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-74b39d69-ebcc-45e4-8241-92377b5edae2 req-3e2e76c9-8700-4fc8-8f47-03596001b3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-unplugged", "status": "completed", "tag": "0974b5ba-47a8-4c90-9f21-37e8ba95c23e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:19.189675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-74b39d69-ebcc-45e4-8241-92377b5edae2 req-3e2e76c9-8700-4fc8-8f47-03596001b3f7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.191242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-74b39d69-ebcc-45e4-8241-92377b5edae2 req-3e2e76c9-8700-4fc8-8f47-03596001b3f7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.192331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-74b39d69-ebcc-45e4-8241-92377b5edae2 req-3e2e76c9-8700-4fc8-8f47-03596001b3f7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.195654 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 HTTP/1.1 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f8df4d0a-666b-4a3a-b143-7a3974d99cf3'} Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.210801 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. Sep 16 14:18:19.222008 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.225388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-74b39d69-ebcc-45e4-8241-92377b5edae2 req-3e2e76c9-8700-4fc8-8f47-03596001b3f7 service nova] Creating event network-vif-unplugged:0974b5ba-47a8-4c90-9f21-37e8ba95c23e for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:19.227459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance f8df4d0a-666b-4a3a-b143-7a3974d99cf3 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:19.229562 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0577386f-aa5d-4aef-a499-3f2c4dabc5e0 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3" status: 404 len: 111 microversion: 2.1 time: 0.200539 Sep 16 14:18:19.234032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-74b39d69-ebcc-45e4-8241-92377b5edae2 req-3e2e76c9-8700-4fc8-8f47-03596001b3f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071736 Sep 16 14:18:19.235952 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2109/4221] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:19.237184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2113/4222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:19 2022] GET /compute/v2.1/servers/f8df4d0a-666b-4a3a-b143-7a3974d99cf3 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:19.248902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.250833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.262571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.264011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.266594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.267808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.269236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.270970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.272091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.273087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.293252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.298459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.299948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.304732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.306110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.311419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.750253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:19.765529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:19.769530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:19.771104 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0a235e0-6032-4b58-81c3-2ebb03e3d1d7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1351 microversion: 2.20 time: 0.532372 Sep 16 14:18:19.771957 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2114/4223] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:19 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1351 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:19.778975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a49ff53-f029-4a2b-ae64-61748526fb7f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '.version_select at 0x7f724d8188b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.812180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a49ff53-f029-4a2b-ae64-61748526fb7f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977272102" status: 202 len: 0 microversion: 2.1 time: 0.038788 Sep 16 14:18:19.815305 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2115/4224] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977272102 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:18:19.823075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.824502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.843421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.843938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.844382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.845115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.845581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.846020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.863561 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 HTTP/1.1 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '8f4511d8-8000-40f8-a77f-d77025c7eab0'} Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:19.864838 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44925f10-1c49-4363-8131-348fa10e93c4 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 404 len: 111 microversion: 2.1 time: 0.049950 Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2116/4225] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:19 2022] DELETE /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.884487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 8f4511d8-8000-40f8-a77f-d77025c7eab0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.888101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.888615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.889060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.889790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.890450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.891188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.913430 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 HTTP/1.1 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '8f4511d8-8000-40f8-a77f-d77025c7eab0'} Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.916949 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. Sep 16 14:18:19.925799 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.930852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 8f4511d8-8000-40f8-a77f-d77025c7eab0 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:19.931509 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3882f237-2a30-459d-a724-905ca78b233b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0" status: 404 len: 111 microversion: 2.1 time: 0.057274 Sep 16 14:18:19.933419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2117/4226] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:19 2022] GET /compute/v2.1/servers/8f4511d8-8000-40f8-a77f-d77025c7eab0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:18:19.944533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:19.945233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:19.953359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.954148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.954968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.956092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:19.956830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:19.958052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:19.980904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 HTTP/1.1 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9'} Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:19.982835 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e41b0884-41b0-48ae-aad2-7909d173178a tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 404 len: 111 microversion: 2.1 time: 0.046424 Sep 16 14:18:19.997600 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2118/4227] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:19 2022] DELETE /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:20.002771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:20.002771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:20.014311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.015004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.015798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.017048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.018130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.019270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.059930 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 HTTP/1.1 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9'} Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:20.063496 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:20.068168 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55a35d9e-3a39-4f00-9418-6cc72cadd6f6 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9" status: 404 len: 111 microversion: 2.1 time: 0.072793 Sep 16 14:18:20.069971 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2119/4228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:19 2022] GET /compute/v2.1/servers/204cc7b8-91a8-4fb3-ad0c-6bcda4a94da9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:20.077428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:20.079856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:20.087897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.088711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.089169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.091521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.092647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.093395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.188023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:20.207790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:20.209530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:20.210914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a15d571-b3a8-4702-93b9-c08ec3d74fec tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2964 microversion: 2.42 time: 0.972183 Sep 16 14:18:20.215590 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2110/4229] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:19 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2964 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:20.224624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:20.225128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:20.241811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.242322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.243104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.243995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.244510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.244983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.284388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e HTTP/1.1 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '30c68eb4-4905-44be-8e97-db747fa50b6e'} Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:20.301607 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:20.316488 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:20.322638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:20.325273 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31cbba61-ffae-4d45-a195-d81b1d9bd877 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 404 len: 111 microversion: 2.1 time: 0.106077 Sep 16 14:18:20.332737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2111/4230] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:20 2022] DELETE /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:20.350329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:20.351332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:20.375902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.376770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.377559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:20.378902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:20.379739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:20.380493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.210362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:21.233530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bca473e7-6994-4d45-abd4-f59b12209509 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1314 microversion: 2.1 time: 1.161148 Sep 16 14:18:21.234453 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2120/4231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:20 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:21.239634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:21.240546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 30c68eb4-4905-44be-8e97-db747fa50b6e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:21.254589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.255542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.256172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.257096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.257747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.258360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.275355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e HTTP/1.1 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '30c68eb4-4905-44be-8e97-db747fa50b6e'} Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:21.277363 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. Sep 16 14:18:21.281757 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:21.283181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 30c68eb4-4905-44be-8e97-db747fa50b6e could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:21.284305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c69faa5-b531-4b4a-9f23-f684861d5d2c tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e" status: 404 len: 111 microversion: 2.1 time: 0.048730 Sep 16 14:18:21.285464 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2121/4232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:21 2022] GET /compute/v2.1/servers/30c68eb4-4905-44be-8e97-db747fa50b6e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:21.310752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:21.311642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:21.318966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.319740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.320373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.321279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.321929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.322566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.493520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:21.525207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:21.531803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:21.535647 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7a62b62-2be2-4950-9238-66652e60b4ec tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1339 microversion: 2.20 time: 0.247887 Sep 16 14:18:21.538358 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2122/4233] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:21 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:21.550885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:21.552700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:21.569035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.570578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.572184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.575548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.577111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.578800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.826053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:21.844332 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8fb3711-d5e6-4851-9890-c938b28df88e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1503 microversion: 2.1 time: 1.511321 Sep 16 14:18:21.858454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2112/4234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:20 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1503 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:21.858454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-unplugged", "status": "completed", "tag": "a16fb69b-f2c7-4b30-905c-5df0a528462b"}, {"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-unplugged", "status": "completed", "tag": "b78ea35a-15e5-4d5c-87e9-1d548568d455"}, {"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-unplugged", "status": "completed", "tag": "d8a97c77-7fda-479d-aba9-21750aa99c16"}, {"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-unplugged", "status": "completed", "tag": "6b9c8884-6bcf-4183-b37c-a27f8e5836cc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:21.880424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.881797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.883614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.916722 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Creating event network-vif-unplugged:a16fb69b-f2c7-4b30-905c-5df0a528462b for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:21.917700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Creating event network-vif-unplugged:b78ea35a-15e5-4d5c-87e9-1d548568d455 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:21.918598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Creating event network-vif-unplugged:d8a97c77-7fda-479d-aba9-21750aa99c16 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:21.920007 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] Creating event network-vif-unplugged:6b9c8884-6bcf-4183-b37c-a27f8e5836cc for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:21.934727 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-45114c3d-9a43-4e85-8d9c-7d99854df9a5 req-702b1ee8-44fc-4419-b824-928e0431468e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.085704 Sep 16 14:18:21.936700 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2113/4235] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:21.952819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:21.954063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:21.975750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.976666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.977476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:21.980999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:21.982132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:21.983724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:22.016015 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b HTTP/1.1 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b'} Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:22.018737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.022273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.024703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:22.026356 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3958c462-98ec-45e0-8197-b7c4dc40fa95 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 404 len: 111 microversion: 2.1 time: 0.085787 Sep 16 14:18:22.028150 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2114/4236] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:21 2022] DELETE /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:22.051448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:22.052979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:22.070845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:22.072545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:22.074879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:22.078379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:22.081698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:22.083120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:22.146664 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b HTTP/1.1 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b'} Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:22.150692 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:22.158386 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e9111cf-0f0a-4d60-b577-b0e5d9ef657f tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b" status: 404 len: 111 microversion: 2.1 time: 0.122790 Sep 16 14:18:22.168566 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2115/4237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:22 2022] GET /compute/v2.1/servers/2cf4aac0-b4d3-404d-9188-c85dbd0f5c7b => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:22.259638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:22.260270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:22.307234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:22.308883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:22.309990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:22.311485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:22.312069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:22.322933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:22.323173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:22.324587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:22.332350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:22.336637 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c31dcf89-16a6-46cb-9b25-abc44ec66c53 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2943 microversion: 2.42 time: 0.794108 Sep 16 14:18:22.338958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2123/4238] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:21 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2943 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:22.595808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:22.596938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:22.607261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:22.608068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:22.608889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:22.609819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:22.610486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:22.611081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:23.172473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:23.194805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:23.196458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:23.198176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b594bcf-19fb-4cd7-bc8e-32efc87c11f7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 0.608638 Sep 16 14:18:23.208323 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2124/4239] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:22 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:18:23.221166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:23.230970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:23.247186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:23.249765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:23.250396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:23.253324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:23.253852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:23.254373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:23.292360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:23.371537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5108285d-f7de-4e99-b8ce-2c60c0f7feca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1500 microversion: 2.1 time: 1.112110 Sep 16 14:18:23.378203 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2116/4240] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:22 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1500 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:23.421686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:23.427503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:23.442526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:23.443764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:23.444742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:23.446350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:23.447923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:23.450044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.138251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:24.149426 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-313070c9-b89e-480d-8556-8ffcc6af6eac tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1503 microversion: 2.1 time: 0.938407 Sep 16 14:18:24.163991 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2125/4241] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:23 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1503 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:24.173331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e87c001-914e-43ac-bdb4-33568e6edac0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:24.189993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e87c001-914e-43ac-bdb4-33568e6edac0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.190763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e87c001-914e-43ac-bdb4-33568e6edac0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.191217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e87c001-914e-43ac-bdb4-33568e6edac0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.252956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e87c001-914e-43ac-bdb4-33568e6edac0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Going to try to stop instance {{(pid=128642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:18:24.332835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:24.342112 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e87c001-914e-43ac-bdb4-33568e6edac0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901/action" status: 202 len: 0 microversion: 2.1 time: 0.172852 Sep 16 14:18:24.344214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2126/4242] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:18:24 2022] POST /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:18:24.354214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:24.355962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:24.361287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:24.368446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.369434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.370324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.372536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.373498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.374482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.376461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:24.378829 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8f56cef-8c30-4536-ad02-f81ffcd6a745 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2922 microversion: 2.42 time: 0.977089 Sep 16 14:18:24.391780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2117/4243] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:23 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2922 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:24.409524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-cf2b9d83-19ff-424c-aca2-e35e4c8ddf54 req-34534a5f-9bef-431d-95a4-6fb85e0daf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-unplugged", "status": "completed", "tag": "a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:24.445383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cf2b9d83-19ff-424c-aca2-e35e4c8ddf54 req-34534a5f-9bef-431d-95a4-6fb85e0daf59 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.446770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cf2b9d83-19ff-424c-aca2-e35e4c8ddf54 req-34534a5f-9bef-431d-95a4-6fb85e0daf59 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.450176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cf2b9d83-19ff-424c-aca2-e35e4c8ddf54 req-34534a5f-9bef-431d-95a4-6fb85e0daf59 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.468311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:24.469246 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-cf2b9d83-19ff-424c-aca2-e35e4c8ddf54 req-34534a5f-9bef-431d-95a4-6fb85e0daf59 service nova] Creating event network-vif-unplugged:a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:24.477059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-cf2b9d83-19ff-424c-aca2-e35e4c8ddf54 req-34534a5f-9bef-431d-95a4-6fb85e0daf59 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080799 Sep 16 14:18:24.482831 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2118/4244] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:24.491719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:24.493468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:24.504813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:24.505131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.506713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.507606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.508969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.509760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.512164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.615656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:24.762706 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7bfcc7e1-8a73-4478-ab0e-174f6ec75542 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 204 len: 0 microversion: 2.1 time: 0.414976 Sep 16 14:18:24.764458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2127/4245] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:24 2022] DELETE /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:18:24.783978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1f133f52-483a-44c4-8ee9-60f2917b5994 req-9e89d61b-1a8d-42e8-b424-e3c5890a86b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d22e05-0bc2-44cd-ac80-2b99545d1671", "name": "network-vif-deleted", "tag": "eaf13879-6963-4fcb-969d-02e71813433c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:24.848980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1f133f52-483a-44c4-8ee9-60f2917b5994 req-9e89d61b-1a8d-42e8-b424-e3c5890a86b8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.850305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1f133f52-483a-44c4-8ee9-60f2917b5994 req-9e89d61b-1a8d-42e8-b424-e3c5890a86b8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.851619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1f133f52-483a-44c4-8ee9-60f2917b5994 req-9e89d61b-1a8d-42e8-b424-e3c5890a86b8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.875160 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1f133f52-483a-44c4-8ee9-60f2917b5994 req-9e89d61b-1a8d-42e8-b424-e3c5890a86b8 service nova] Creating event network-vif-deleted:eaf13879-6963-4fcb-969d-02e71813433c for instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 on n-h1-858129-2 Sep 16 14:18:24.893448 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1f133f52-483a-44c4-8ee9-60f2917b5994 req-9e89d61b-1a8d-42e8-b424-e3c5890a86b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124757 Sep 16 14:18:24.896716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2128/4246] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:24.908878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:24.910837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:24.924295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.925066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.925806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:24.926908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:24.927762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:24.928552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:25.558449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:25.598155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:25.666781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:25.678211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:25.679644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:25.680852 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-126e18a9-1ad3-4f94-b0a4-6a5e496807a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 1.196411 Sep 16 14:18:25.693442 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2119/4247] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:24 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:25.699433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:25.700321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:25.715403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:25.719216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:25.719992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:25.720941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:25.721586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:25.724116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:26.022161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:26.062130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37de5868-294b-490b-9790-3eafda6c62ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 1.162769 Sep 16 14:18:26.077884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2129/4248] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:24 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:26.089820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:26.089980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:26.119872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:26.140831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:26.141744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:26.142993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:26.143766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:26.144508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:26.387993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:26.389511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:26.390659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:26.391904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lazy-loading 'fault' on Instance uuid 02d22e05-0bc2-44cd-ac80-2b99545d1671 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:18:26.613850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:26.630758 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-415f03be-4ba4-469d-9d79-52f4dac56711 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 200 len: 1303 microversion: 2.1 time: 0.559363 Sep 16 14:18:26.631361 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2130/4249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:26 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 1303 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:26.637132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:26.638037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:26.659933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:26.660428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:26.660867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:26.661674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:26.662035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:26.662666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:27.269710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:27.300785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53311f5c-f853-4fa5-b837-7cf5349c3f87 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1485 microversion: 2.1 time: 1.605433 Sep 16 14:18:27.319091 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2120/4250] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:25 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1485 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:27.362932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:27.364591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:27.388207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:27.389620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:27.390842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:27.392530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:27.403655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:27.404892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.155964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:28.190983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:28.195864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:28.200360 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7da3b6cd-b057-4d16-916d-3a40f0a003ed tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2875 microversion: 2.42 time: 1.566164 Sep 16 14:18:28.201836 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2131/4251] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:26 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2875 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:28.246698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:28.252669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:28.284064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.290033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.291279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.296763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.298024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.300693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.565075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:28.597384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:28.606891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:28.612519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb117494-8c5e-412e-ae3b-6c11ad36894a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 1.288860 Sep 16 14:18:28.615911 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2121/4252] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:27 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:28.669167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d9c1950a-a858-4339-a66e-5ee1c70dd776 req-744d145b-b908-4333-93a0-37e7eedb68ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-deleted", "tag": "d8a97c77-7fda-479d-aba9-21750aa99c16"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:28.710338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d9c1950a-a858-4339-a66e-5ee1c70dd776 req-744d145b-b908-4333-93a0-37e7eedb68ff service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.711778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d9c1950a-a858-4339-a66e-5ee1c70dd776 req-744d145b-b908-4333-93a0-37e7eedb68ff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.712861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d9c1950a-a858-4339-a66e-5ee1c70dd776 req-744d145b-b908-4333-93a0-37e7eedb68ff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.739816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d9c1950a-a858-4339-a66e-5ee1c70dd776 req-744d145b-b908-4333-93a0-37e7eedb68ff service nova] Creating event network-vif-deleted:d8a97c77-7fda-479d-aba9-21750aa99c16 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:28.751753 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d9c1950a-a858-4339-a66e-5ee1c70dd776 req-744d145b-b908-4333-93a0-37e7eedb68ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133002 Sep 16 14:18:28.754227 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2122/4253] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:28.766437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:28.768467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: 02d22e05-0bc2-44cd-ac80-2b99545d1671] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:28.798292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.803817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.805421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.807108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.812507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.813929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.879751 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] HTTP exception thrown: Instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 could not be found. Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Request method failure captured: Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 HTTP/1.1 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIWEBctjOvPDaznIM5G8Ts5glB5rVHCcepKp0sqfMY35sB8RXhXcKtj_LY-hUmkPCOzZGluD8Px1OxTOJJ2yTnudU-Owm24B_u1jnbvyRcV3aqfs46mG7U0hsR2mOE7iDxHACMhxGMVabgHqAzzWuZtxkk5vVitIXJLQIJC3ktYU9IU Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ea65bd193ded42158601fbf77be2aa4e Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesActionsTest-1287765906 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ea65bd193ded42158601fbf77be2aa4e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ea65bd193ded42158601fbf77be2aa4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ea65bd193ded42158601fbf77be2aa4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ea65bd193ded42158601fbf77be2aa4e"}]}] Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesActionsTest-1287765906 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ea65bd193ded42158601fbf77be2aa4e Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesActionsTest-1287765906 Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesActionsTest-1287765906-project Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ab7393592e664b03a71bedda2f26b24f Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesActionsTest-1287765906-project Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 could not be found. Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '02d22e05-0bc2-44cd-ac80-2b99545d1671'} Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 could not be found. Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 could not be found. Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:28.883574 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 could not be found. Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Returning 404 to user: Instance 02d22e05-0bc2-44cd-ac80-2b99545d1671 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:28.888104 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5bb9b6f2-56f2-4177-8547-5d2c4f3ff31e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671" status: 404 len: 111 microversion: 2.1 time: 0.129712 Sep 16 14:18:28.896292 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2123/4254] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:28 2022] GET /compute/v2.1/servers/02d22e05-0bc2-44cd-ac80-2b99545d1671 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:28.920537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:28.922734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:28.944182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.945268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.946073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:28.952987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:28.958740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:28.961587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.019185 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb HTTP/1.1 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '883be0de-5cc5-4181-84c2-a466f4758beb'} Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:29.025346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.029530 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.035262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:29.037766 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1dd774d0-05d5-48d7-80c2-e0dd437ff39d tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 404 len: 111 microversion: 2.1 time: 0.140043 Sep 16 14:18:29.046607 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2124/4255] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:28 2022] DELETE /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:29.250628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f43660c5-b4f3-485e-aa24-14e89416d7ec req-612e8099-37e6-4cfc-be79-f45a22750fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:29.256945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:29.276477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f43660c5-b4f3-485e-aa24-14e89416d7ec req-612e8099-37e6-4cfc-be79-f45a22750fd8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:29.281222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f43660c5-b4f3-485e-aa24-14e89416d7ec req-612e8099-37e6-4cfc-be79-f45a22750fd8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:29.281688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f43660c5-b4f3-485e-aa24-14e89416d7ec req-612e8099-37e6-4cfc-be79-f45a22750fd8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.315750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-903d26bb-2f71-4b0f-9a75-e3afd5b0c4a2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 1.102001 Sep 16 14:18:29.317316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2132/4256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:28 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:29.329692 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f43660c5-b4f3-485e-aa24-14e89416d7ec req-612e8099-37e6-4cfc-be79-f45a22750fd8 service nova] Creating event network-changed:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:18:29.342985 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f43660c5-b4f3-485e-aa24-14e89416d7ec req-612e8099-37e6-4cfc-be79-f45a22750fd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294379 Sep 16 14:18:29.345775 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2125/4257] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:29.368961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:29.369681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 883be0de-5cc5-4181-84c2-a466f4758beb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:29.381001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:29.381506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:29.381954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.382705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:29.386883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:29.387556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.430979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb HTTP/1.1 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '883be0de-5cc5-4181-84c2-a466f4758beb'} Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:29.432690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 883be0de-5cc5-4181-84c2-a466f4758beb could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:29.436788 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11506728-8a3b-4191-ae02-82465e6e8620 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb" status: 404 len: 111 microversion: 2.1 time: 0.087100 Sep 16 14:18:29.439990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2126/4258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:29 2022] GET /compute/v2.1/servers/883be0de-5cc5-4181-84c2-a466f4758beb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:29.451163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-639737084", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "66675b13-e03c-4e68-a9bb-f34532d06d31"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:29.600357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] validate_networks() for [('66675b13-e03c-4e68-a9bb-f34532d06d31', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:18:29.749874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:29.751088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:29.774037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:29.774904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:29.775625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.776807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:29.777641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:29.778429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.939916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:29.941376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:29.943196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:29.946721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lazy-loading 'fault' on Instance uuid 4c236989-5cd0-4119-9e6d-f747cf03e7c7 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:18:30.145107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:30.173240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0692623-2ddb-428f-80ab-e53b20be1dbf tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 200 len: 1301 microversion: 2.1 time: 0.848854 Sep 16 14:18:30.185861 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2133/4259] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:29 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 1301 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:30.210489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:30.211967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:30.238021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:30.243779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:30.246491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:30.248273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:30.252541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:30.256276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.055069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.069486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.072214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.075988 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59de8d06-151a-47da-a0f8-dd4eb6eb7143 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2714 microversion: 2.42 time: 0.885868 Sep 16 14:18:31.077833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2134/4260] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:30 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2714 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:31.083722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:31.084603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:31.093779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.094618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.095201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.096182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.097167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.098069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.115731 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 HTTP/1.1 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7c53f4ae-a78c-492f-adb3-1b08edc22196'} Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:31.118836 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.123417 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.127447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:31.128749 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45826e10-6a61-46aa-9866-68ace8400752 tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 404 len: 111 microversion: 2.1 time: 0.049639 Sep 16 14:18:31.129302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2135/4261] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:31 2022] DELETE /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:31.139558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:31.141708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:31.158208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.160797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.161312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.162072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.162595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.171685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.192808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:18:31.193754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:18:31.194307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:18:31.195315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:18:31.195967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:18:31.246628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.249260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.250042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.253447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.254828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.255516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.302246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Getting quotas for project ea65bd193ded42158601fbf77be2aa4e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:18:31.318693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Getting quotas for user ab7393592e664b03a71bedda2f26b24f and project ea65bd193ded42158601fbf77be2aa4e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:18:31.361931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:18:31.365499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:18:31.425285 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40e1c90e-d6e2-4221-b182-83189c77c526 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983579 Sep 16 14:18:31.426718 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2127/4262] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:18:31.434305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:31.435443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:31.439747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:31.446833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.448137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.449373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.450383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.456403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.456403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.629796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.644428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.647210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.654670 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-043e8e47-5906-4ef4-adb5-cc7071345800 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 0.519849 Sep 16 14:18:31.673518 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2136/4263] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:31 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:31.685591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c236989-5cd0-4119-9e6d-f747cf03e7c7", "name": "network-vif-deleted", "tag": "cf840358-f1c1-437b-89e1-58d21beeea72"}, {"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-deleted", "tag": "0974b5ba-47a8-4c90-9f21-37e8ba95c23e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:31.717743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.718683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.719551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.785587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] Creating event network-vif-deleted:cf840358-f1c1-437b-89e1-58d21beeea72 for instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 on n-h1-858129-2 Sep 16 14:18:31.792431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] Creating event network-vif-deleted:0974b5ba-47a8-4c90-9f21-37e8ba95c23e for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:31.816578 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2902f8cb-9c87-411b-b707-a03e5fd4d856 req-a50b00c6-282f-48ef-b1a6-b816120c32aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138726 Sep 16 14:18:31.818971 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2137/4264] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:31.830348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:31.831837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] [instance: 7c53f4ae-a78c-492f-adb3-1b08edc22196] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:31.844790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.845982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.847069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.848510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.849494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.850434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.880928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] HTTP exception thrown: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Request method failure captured: Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 HTTP/1.1 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPrxZ22zg3dAsE4K62f6OkXT0RHiAQR8LyQsFoLVZNhGQ_fLJpCcyoLz6Ct7IqlTj1zBLHWJOWg0Sv5UKsgvuHjNd-RQLl0Y28OV01Bi9aef370zXqy_vLodIkYIgl8jsxRR3o9mP4aavmXnGl3pUABndnTzCcblh5grONSvonVNhs Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_149cfd30d6054320a0b3bbde7a2e70ae", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/149cfd30d6054320a0b3bbde7a2e70ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/149cfd30d6054320a0b3bbde7a2e70ae"}]}] Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 149cfd30d6054320a0b3bbde7a2e70ae Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-294591285 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 34b5828a1ccf48cd866f88400ac00649 Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-294591285-project Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7c53f4ae-a78c-492f-adb3-1b08edc22196'} Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:31.886537 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:31.896740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] Returning 404 to user: Instance 7c53f4ae-a78c-492f-adb3-1b08edc22196 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:31.899172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd8fdca3-4732-451e-bbe2-5c792638149b tempest-DeleteServersTestJSON-294591285 tempest-DeleteServersTestJSON-294591285-project] 10.222.0.60 "GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196" status: 404 len: 111 microversion: 2.1 time: 0.077350 Sep 16 14:18:31.911774 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2138/4265] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:31 2022] GET /compute/v2.1/servers/7c53f4ae-a78c-492f-adb3-1b08edc22196 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:31.915917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:31.923299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:31.924357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 4c236989-5cd0-4119-9e6d-f747cf03e7c7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:31.928881 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e817aa00-22ad-4bd3-8e53-b40b7562bb0e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.498949 Sep 16 14:18:31.942155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2128/4266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:31 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:31.947772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.950591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.953011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.954505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:31.955397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:31.956398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:31.959319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-461a310c-050e-4800-a80f-e636fa323339 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:31.960493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-461a310c-050e-4800-a80f-e636fa323339 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:31.997030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] HTTP exception thrown: Instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 could not be found. Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Request method failure captured: Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 HTTP/1.1 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJINCdgmIV5nXQnepbzBDhpkMVAEqP8wWOFP5mjHmmbcHXoOdTJ49QyH_ezQ7zc8ZybreHMnnry06puFe6Nw_zkXmwxmXv_Mov7eJoxxVDsqgH7RrbJoPSHp16266CC9v9W3vQmpK9aeEZt6eyzrRaG1OK_oVFWfHVDFkE6THiOH9AFE Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0880eeb6de8348f4a18288e1a1247eb6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}] Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 35e0a11712764fa5b78e9ac4d1859f3a Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 could not be found. Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4c236989-5cd0-4119-9e6d-f747cf03e7c7'} Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 could not be found. Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 could not be found. Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:32.000130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 could not be found. Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Returning 404 to user: Instance 4c236989-5cd0-4119-9e6d-f747cf03e7c7 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a477b800-881a-4ffa-93b0-b7aad46eeb0c tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7" status: 404 len: 111 microversion: 2.1 time: 0.089226 Sep 16 14:18:32.009058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2139/4267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:31 2022] GET /compute/v2.1/servers/4c236989-5cd0-4119-9e6d-f747cf03e7c7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:32.031764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:32.032317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:32.048017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:32.050911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:32.051535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:32.054563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:32.055173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:32.056101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:32.112705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:18:32.171436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-461a310c-050e-4800-a80f-e636fa323339 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:32.214386 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-461a310c-050e-4800-a80f-e636fa323339 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1213 microversion: 2.1 time: 0.279798 Sep 16 14:18:32.234449 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2129/4268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:31 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:32.248690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:32.255007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:32.304501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:32.306941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:32.307792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:32.309015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:32.316753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:32.319054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:32.329122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:32.365526 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9265453c-92df-4e03-b9e9-0628bfa89ac7 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 204 len: 0 microversion: 2.1 time: 0.346482 Sep 16 14:18:32.374541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2140/4269] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:18:32 2022] DELETE /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:18:32.384400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:32.387567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:32.415175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:32.416052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:32.416670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:32.417628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:32.418267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:32.418894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:33.331698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:33.333815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:33.355586 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7d6c170-11dd-4263-8b7d-4e8de785010d tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1499 microversion: 2.1 time: 0.975801 Sep 16 14:18:33.359810 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2141/4270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:32 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1499 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:33.365123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:33.370835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:33.373478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:33.374348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:33.376825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8d847a2-010f-44fd-b0a6-1ae26f9a0948 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2509 microversion: 2.42 time: 1.154342 Sep 16 14:18:33.391490 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2130/4271] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:32 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2509 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:33.393305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:33.395453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:33.396153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:33.403797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:33.404393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:33.404806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:33.405198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:33.405636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:33.415168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:33.416471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:33.417078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:33.417939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:33.418509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:33.419041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.235778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:34.264082 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2089b4a-8f22-41ce-8a77-6a9f6fcc58a6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.870939 Sep 16 14:18:34.265256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2131/4272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:33 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:34.286578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:34.303152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:34.325539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:34.352560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.353395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.355770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.356660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.357140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.359170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.363742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:34.377923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:34.381549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb0a05a6-4e8a-4869-8eb4-b2a120ad07b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 1.019388 Sep 16 14:18:34.414392 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2142/4273] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:33 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:34.441827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4abd739e-69ac-4b43-bdd3-255e7d85adb6 req-e4527556-c090-4398-bb03-6a11002328fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-deleted", "tag": "6b9c8884-6bcf-4183-b37c-a27f8e5836cc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:34.495977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4abd739e-69ac-4b43-bdd3-255e7d85adb6 req-e4527556-c090-4398-bb03-6a11002328fd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.496868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4abd739e-69ac-4b43-bdd3-255e7d85adb6 req-e4527556-c090-4398-bb03-6a11002328fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.497659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4abd739e-69ac-4b43-bdd3-255e7d85adb6 req-e4527556-c090-4398-bb03-6a11002328fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.560716 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4abd739e-69ac-4b43-bdd3-255e7d85adb6 req-e4527556-c090-4398-bb03-6a11002328fd service nova] Creating event network-vif-deleted:6b9c8884-6bcf-4183-b37c-a27f8e5836cc for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:34.574773 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4abd739e-69ac-4b43-bdd3-255e7d85adb6 req-e4527556-c090-4398-bb03-6a11002328fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156533 Sep 16 14:18:34.580197 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2143/4274] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:34.607914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:34.609732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:34.625012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.627315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.629737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.632382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.636733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.639747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.658891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:34.695004 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3c73c5c7-b1bf-4b98-802b-391ba7f22088 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1265 microversion: 2.1 time: 0.416739 Sep 16 14:18:34.718923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2132/4275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:34 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:34.741155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:34.743476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:34.754170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:34.756593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.758220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.759306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:34.762391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:34.766388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:34.767565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:35.338200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:35.361160 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-60208af4-d4f8-450d-85b1-d3a6783eb20b tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1499 microversion: 2.1 time: 0.778359 Sep 16 14:18:35.361791 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2144/4276] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:34 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1499 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:35.382051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:35.382728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:35.398235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:35.398809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:35.400367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:35.401412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:35.402180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:35.406889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:35.574237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:35.635400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:35.644393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:35.650109 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32f0ab0c-d1b5-4bfe-93e1-0cc6d99443c3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2216 microversion: 2.42 time: 0.928555 Sep 16 14:18:35.662880 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2133/4277] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:34 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2216 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:35.675506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:35.676571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:35.690055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:35.699786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:35.700612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:35.701855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:35.703061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:35.703731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:36.521306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:36.540885 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77144aba-57f9-44f5-884c-6449e1b2fb4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 1.177806 Sep 16 14:18:36.542387 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2145/4278] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:35 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:36.549417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:36.550525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:36.572115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:36.572818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:36.573064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:36.574483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:36.588635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:36.590857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:36.616347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:36.669881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:36.688882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:36.701200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b93500b-35fa-4956-845e-314aed5619d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 1.026301 Sep 16 14:18:36.702120 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2134/4279] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:35 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:36.762427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:36.774263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:36.816937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:36.818462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:36.819542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:36.821073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:36.822206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:36.823328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:36.923406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:36.945329 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44a04174-a8d5-47dc-8797-b93d5fdb1478 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1271 microversion: 2.1 time: 0.399085 Sep 16 14:18:36.949411 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2146/4280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:36 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1271 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:36.960121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:36.961706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:36.989334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:36.991666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:36.999582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.001851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.002767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.004377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.029407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.035913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.036634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.037351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lazy-loading 'fault' on Instance uuid 7f688628-999c-4cb5-a109-dbcef0dd7b53 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:18:37.181742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0a11712764fa5b78e9ac4d1859f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0880eeb6de8348f4a18288e1a1247eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:37.197873 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8e40ca7b-9874-45d4-841b-7a2825880f72 tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 200 len: 1301 microversion: 2.1 time: 0.468780 Sep 16 14:18:37.199841 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2135/4281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:36 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 1301 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:37.211226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-deleted", "tag": "a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2"}, {"server_uuid": "7f688628-999c-4cb5-a109-dbcef0dd7b53", "name": "network-vif-deleted", "tag": "2501a8f9-83ad-477f-9fc2-b55d2c748974"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:37.244752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.247522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.247989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.292168 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] Creating event network-vif-deleted:a2bd6d0f-9ffd-4d20-9b0b-9d4709f05fd2 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:37.292842 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] Creating event network-vif-deleted:2501a8f9-83ad-477f-9fc2-b55d2c748974 for instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 on n-h1-858129-2 Sep 16 14:18:37.309551 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-31154604-03c4-40ec-ad45-8d3a34ee974c req-98fcb5e5-21a1-471a-a5b8-202675accb82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107465 Sep 16 14:18:37.319199 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2136/4282] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:37.589247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:37.590212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:37.598248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.599097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.599694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.600726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.601357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.601939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.790821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:37.818586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:37.822152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:37.824650 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6e10646-cd45-44f5-94e3-e52b375f5bc3 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 2169 microversion: 2.42 time: 0.873252 Sep 16 14:18:37.830626 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2147/4283] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:36 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 2169 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:37.855575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:37.856683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:37.869894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.871616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.872610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:37.874151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:37.875333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:37.876411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.047153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:38.091123 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7ce0596-252b-4232-b56a-ca567e13ed8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.503874 Sep 16 14:18:38.095014 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2137/4284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:37 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:38.116571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:38.117643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:38.126577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.127389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.127994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.128949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.129580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.130713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.229234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:38.259197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:38.270687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:38.287625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4ade9b3-ac07-459a-bb48-3a5d16580eb2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 0.452868 Sep 16 14:18:38.303719 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2148/4285] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:37 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:38.353630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:38.355520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] [instance: 7f688628-999c-4cb5-a109-dbcef0dd7b53] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:38.367877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.369664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.370816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.372380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.373428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.374719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.461222 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] HTTP exception thrown: Instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 could not be found. Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Request method failure captured: Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 HTTP/1.1 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJINCdgmIV5nXQnepbzBDhpkMVAEqP8wWOFP5mjHmmbcHXoOdTJ49QyH_ezQ7zc8ZybreHMnnry06puFe6Nw_zkXmwxmXv_Mov7eJoxxVDsqgH7RrbJoPSHp16266CC9v9W3vQmpK9aeEZt6eyzrRaG1OK_oVFWfHVDFkE6THiOH9AFE Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0880eeb6de8348f4a18288e1a1247eb6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0880eeb6de8348f4a18288e1a1247eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0880eeb6de8348f4a18288e1a1247eb6"}]}] Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0880eeb6de8348f4a18288e1a1247eb6 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-LiveMigrationTest-1528155925 Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 35e0a11712764fa5b78e9ac4d1859f3a Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-LiveMigrationTest-1528155925-project Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 could not be found. Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7f688628-999c-4cb5-a109-dbcef0dd7b53'} Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 could not be found. Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 could not be found. Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:18:38.464640 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 could not be found. Sep 16 14:18:38.473608 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:18:38.475602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] Returning 404 to user: Instance 7f688628-999c-4cb5-a109-dbcef0dd7b53 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:18:38.477121 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-216e00ba-355a-43c8-9b64-8b0e6059045f tempest-LiveMigrationTest-1528155925 tempest-LiveMigrationTest-1528155925-project] 10.222.0.60 "GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53" status: 404 len: 111 microversion: 2.1 time: 0.137640 Sep 16 14:18:38.478377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2149/4286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:38 2022] GET /compute/v2.1/servers/7f688628-999c-4cb5-a109-dbcef0dd7b53 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:18:38.563604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:38.578680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-42112f7c-16ec-44fd-88f6-3bdaed1fcb6c tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.481282 Sep 16 14:18:38.582969 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2138/4287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:38 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:38.617126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5602e018-8ca3-4feb-94d3-6840e12c55b1 req-27efd622-648e-43f7-b266-e93f3deb6e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "name": "network-vif-plugged", "status": "completed", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:38.649318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5602e018-8ca3-4feb-94d3-6840e12c55b1 req-27efd622-648e-43f7-b266-e93f3deb6e27 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.652557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5602e018-8ca3-4feb-94d3-6840e12c55b1 req-27efd622-648e-43f7-b266-e93f3deb6e27 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.653937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5602e018-8ca3-4feb-94d3-6840e12c55b1 req-27efd622-648e-43f7-b266-e93f3deb6e27 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.681603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5602e018-8ca3-4feb-94d3-6840e12c55b1 req-27efd622-648e-43f7-b266-e93f3deb6e27 service nova] Creating event network-vif-plugged:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:18:38.692493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5602e018-8ca3-4feb-94d3-6840e12c55b1 req-27efd622-648e-43f7-b266-e93f3deb6e27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113585 Sep 16 14:18:38.694454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2150/4288] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:18:38.860036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:38.860833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:38.872071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.872573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.875322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:38.876349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:38.877195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:38.877822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.022218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.055668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.060565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.066003 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aabd36f5-034f-4eed-81f6-4f0800742c67 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.211440 Sep 16 14:18:39.093272 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2139/4289] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:38 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:39.139795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:39.143013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:39.172387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.174156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.176069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.183772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.186832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.191548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.342193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:39.343097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:39.356380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.357795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.361206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.365166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.367430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.371720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.674030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.684758 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76314b38-5e81-46d7-8839-136e8b31915c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.564838 Sep 16 14:18:39.699243 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2151/4290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:39 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:39.707670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7160a3bf-2fcc-47f8-98e3-cb3030962bc8 req-4b181065-cfaa-4571-be53-aebc8f12f0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3388427a-be99-45c8-90c1-bc6076e82e38", "name": "network-vif-deleted", "tag": "b78ea35a-15e5-4d5c-87e9-1d548568d455"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:39.728117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7160a3bf-2fcc-47f8-98e3-cb3030962bc8 req-4b181065-cfaa-4571-be53-aebc8f12f0b3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.730965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7160a3bf-2fcc-47f8-98e3-cb3030962bc8 req-4b181065-cfaa-4571-be53-aebc8f12f0b3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.736011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7160a3bf-2fcc-47f8-98e3-cb3030962bc8 req-4b181065-cfaa-4571-be53-aebc8f12f0b3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.756118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7160a3bf-2fcc-47f8-98e3-cb3030962bc8 req-4b181065-cfaa-4571-be53-aebc8f12f0b3 service nova] Creating event network-vif-deleted:b78ea35a-15e5-4d5c-87e9-1d548568d455 for instance 3388427a-be99-45c8-90c1-bc6076e82e38 on n-h1-858129-2 Sep 16 14:18:39.773068 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7160a3bf-2fcc-47f8-98e3-cb3030962bc8 req-4b181065-cfaa-4571-be53-aebc8f12f0b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071749 Sep 16 14:18:39.774266 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2152/4291] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:39.780352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:39.781560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:39.787748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.789797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.790514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.791308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.792768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:39.793405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:39.794296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:39.828588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.837092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:39.849980 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00d9df22-006e-447a-a154-e0bf8d372219 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1407 microversion: 2.20 time: 0.503271 Sep 16 14:18:39.860046 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2140/4292] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:39 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:40.107031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:40.107809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:40.124080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:40.124721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:40.125276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:40.126139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:40.127199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:40.130627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:40.201841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:40.356793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:40.375990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:40.377493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:40.378864 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-640e8b35-6ccb-43b2-b709-093552e6e81d tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.277207 Sep 16 14:18:40.401343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2141/4293] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:40 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:40.522335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:40.530963 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8089239f-6972-47c8-92b8-7d57e309578e tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.755122 Sep 16 14:18:40.531575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2153/4294] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:39 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:40.713381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:40.714783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:40.727207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:40.729753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:40.732864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:40.737167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:40.738519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:40.741671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:40.906815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:40.907827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:40.924319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:40.926278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:40.928525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:40.929544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:40.932074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:40.932882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:41.277819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:41.976412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:41.999690 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2ee174f-b6ec-44d6-8928-7bf3afb75d7a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 1.290290 Sep 16 14:18:42.017464 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2142/4295] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:40 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:42.024424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:42.033022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:42.042201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.044727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.048115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.054509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.071493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.071782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.072739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.074713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.076700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c763d02-44cc-486a-b940-5e343905f66a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1599 microversion: 2.20 time: 1.174033 Sep 16 14:18:42.077871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2154/4296] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:40 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1599 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:18:42.088353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.100883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:42.102014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:42.134671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.138038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.139173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.139987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.141432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.143861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.279209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:42.554957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.569148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.572043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.589687 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0bc0a846-988b-44d8-a6b0-aca7e9e9075c tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.569388 Sep 16 14:18:42.591301 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2143/4297] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:42 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:42.597321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-45ad08c6-2696-4d66-ba74-bbcb231ab410 req-2dc6822d-a057-431d-9b22-ccba76367e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c141711d-6e89-424f-8643-6028e1563ca9", "tag": "7767b449-3a03-4edf-9889-31ed72fe9eb8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:42.625694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45ad08c6-2696-4d66-ba74-bbcb231ab410 req-2dc6822d-a057-431d-9b22-ccba76367e5e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.627495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45ad08c6-2696-4d66-ba74-bbcb231ab410 req-2dc6822d-a057-431d-9b22-ccba76367e5e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.628315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45ad08c6-2696-4d66-ba74-bbcb231ab410 req-2dc6822d-a057-431d-9b22-ccba76367e5e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.662738 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45ad08c6-2696-4d66-ba74-bbcb231ab410 req-2dc6822d-a057-431d-9b22-ccba76367e5e service nova] Creating event network-changed:7767b449-3a03-4edf-9889-31ed72fe9eb8 for instance c141711d-6e89-424f-8643-6028e1563ca9 on n-h1-858129-2 Sep 16 14:18:42.669962 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-45ad08c6-2696-4d66-ba74-bbcb231ab410 req-2dc6822d-a057-431d-9b22-ccba76367e5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076912 Sep 16 14:18:42.671389 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2144/4298] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:42.680348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:42.682785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:42.694074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.695194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.696116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.697287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:42.698090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:42.699378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:42.874773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:42.913526 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8638698a-4880-4653-a64a-c4d8e97831ff tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.831276 Sep 16 14:18:42.921181 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2155/4299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:42 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:42.929974 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-588aefde-93c1-4493-afa1-f381569abb54 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.256525 Sep 16 14:18:42.932177 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2145/4300] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 14:18:42 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:18:43.028921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:43.030026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:43.037612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:43.038561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:43.039254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:43.040263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:43.041021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:43.041701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:43.620875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:43.622340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:43.631455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:43.632259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:43.632864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:43.633840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:43.634526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:43.635200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:43.768369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:43.782307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:43.786447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:43.788264 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56230303-24ce-41dc-bcd7-453bd251ccab tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.172373 Sep 16 14:18:43.804409 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2146/4301] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:43 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:43.859531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:43.875496 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8db493c5-2a94-417a-86f4-c5de9e68744f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.854167 Sep 16 14:18:43.896163 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2156/4302] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:43 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:43.959249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:43.960130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:43.977259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:43.978222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:43.978935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:43.982113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:43.983252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:43.984173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:44.724989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:44.734387 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e93ab50a-0143-4dd1-b210-a242100d8f63 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.785851 Sep 16 14:18:44.743560 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2147/4303] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:43 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:44.819480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:44.820307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:44.835324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:44.851667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:44.852876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:44.854821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:44.855942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:44.856946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:44.905904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:44.906752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:44.921945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:44.927311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:44.927972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:44.928885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:44.929474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:44.930011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:45.249486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:45.300486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:45.302910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:45.305408 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bca897f0-23a2-4d51-815f-2f70b7b70164 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.491142 Sep 16 14:18:45.310888 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2157/4304] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:44 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:18:45.648925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:45.660533 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-491d0200-a699-425d-940a-7aa688510ccb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.758528 Sep 16 14:18:45.674439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2148/4305] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:44 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:45.795817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:45.803178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:45.834971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:45.837879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:45.838974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:45.840763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:45.850866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:45.853038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:46.340870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:46.341720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:46.353046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:46.353843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:46.355284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:46.359596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:46.360456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:46.361122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:46.649462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:46.668651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:46.670315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:46.671804 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8fbedcc-651a-448e-bfe0-24db586fc0bb tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.335330 Sep 16 14:18:46.672950 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2149/4306] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:46 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:46.691337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:46.692369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:46.696217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:46.704310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:46.704979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:46.708029 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a838196f-4fd0-4043-8cee-314282be2e83 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.920762 Sep 16 14:18:46.708827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:46.709582 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2158/4307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:45 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:46.709847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:46.710583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:46.711335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:47.308379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:47.357921 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-797a0491-f903-490e-b70e-e8700fa50feb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.669921 Sep 16 14:18:47.363465 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2150/4308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:46 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:47.717832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:47.720591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:47.755242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:47.755906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:47.756608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:47.757886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:47.758993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:47.760657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:47.763125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:47.774646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:47.785597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:47.786872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:47.787590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:47.788896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:47.789726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:47.790549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:48.139158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:48.156665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:48.158194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:48.159533 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31a44bb9-7019-42a9-af75-14bf066f3a49 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.461139 Sep 16 14:18:48.160129 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2159/4309] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:47 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:48.388386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:48.390531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:48.403443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:48.405131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:48.408521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:48.410308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:48.411012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:48.413329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:48.727663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:48.776971 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05bb609c-602b-4f2e-b2cd-fb3a3048d1f8 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 1.028365 Sep 16 14:18:48.778089 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2151/4310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:47 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:48.903299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:48.928911 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05421d7f-9992-4061-81aa-444301a1c4f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.545611 Sep 16 14:18:48.949185 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2160/4311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:48 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:49.221604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:49.222843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:49.268198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:49.268710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:49.282771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:49.284321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:49.285579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:49.286249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:49.563574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:49.580440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:49.585162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:49.590896 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a5c20c2-bf8d-4266-b3cf-d7d5e457e834 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.384644 Sep 16 14:18:49.591947 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2152/4312] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:49 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:49.811664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:49.812547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:49.829708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:49.830539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:49.831163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:49.832066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:49.837200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:49.838476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:49.958092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:49.959614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:49.972619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:49.977243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:49.979547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:49.982125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:49.986205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:49.987051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:50.575210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:50.602467 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3301db3e-fed1-447a-b4d5-561bef952529 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.797502 Sep 16 14:18:50.637615 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2161/4313] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:49 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:50.653884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-64685f7d-81b9-4993-9df3-bb4b6e3c4ac9 req-1a821e37-8703-4ab8-b781-4af0e511cb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:50.703884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-64685f7d-81b9-4993-9df3-bb4b6e3c4ac9 req-1a821e37-8703-4ab8-b781-4af0e511cb40 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:50.714125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-64685f7d-81b9-4993-9df3-bb4b6e3c4ac9 req-1a821e37-8703-4ab8-b781-4af0e511cb40 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:50.715029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-64685f7d-81b9-4993-9df3-bb4b6e3c4ac9 req-1a821e37-8703-4ab8-b781-4af0e511cb40 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:50.758204 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-64685f7d-81b9-4993-9df3-bb4b6e3c4ac9 req-1a821e37-8703-4ab8-b781-4af0e511cb40 service nova] Creating event network-changed:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:18:50.781501 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-64685f7d-81b9-4993-9df3-bb4b6e3c4ac9 req-1a821e37-8703-4ab8-b781-4af0e511cb40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141784 Sep 16 14:18:50.788207 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2162/4314] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:50.805516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:50.815381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:50.849827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:50.856143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:50.857113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:50.859204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:50.865377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:50.867277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:50.883298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:50.927600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0b37713-6101-4b7a-afed-8a085cd317e2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1510 microversion: 2.1 time: 0.969811 Sep 16 14:18:50.931396 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2153/4315] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:49 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1510 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:51.229448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:51.254627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:18:51.291211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:51.303843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:51.316286 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52181c61-9f27-41b3-b180-c57de7aee6c7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.525252 Sep 16 14:18:51.321718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2163/4316] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:50 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:51.661972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:51.667028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:51.704670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:51.706764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:51.709196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:51.712870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:51.717411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:51.724514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:51.956045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:51.957092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:51.967381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:51.972745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:51.973656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:51.977479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:51.982562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:51.983366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.294557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:53.304365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:53.308235 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3955d16c-59e9-49b5-9bf9-68e7b3c494c6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1487 microversion: 2.1 time: 1.355652 Sep 16 14:18:53.310998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2164/4317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:51 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1487 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:53.335322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:53.336370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:53.337832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d8b9277f-9d1d-4dc2-b3be-e3326a4daffc tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 1.684761 Sep 16 14:18:53.339323 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2154/4318] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:51 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:53.344549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.345485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.346195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.347220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.347941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.348606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.369896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c1b9fbee-0e59-4b7d-b09f-fdbc9ab10d3e req-28d67805-80e3-424c-9abf-b3a77829d3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c141711d-6e89-424f-8643-6028e1563ca9", "name": "network-vif-plugged", "status": "completed", "tag": "7767b449-3a03-4edf-9889-31ed72fe9eb8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:53.395785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1b9fbee-0e59-4b7d-b09f-fdbc9ab10d3e req-28d67805-80e3-424c-9abf-b3a77829d3ba service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.397029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1b9fbee-0e59-4b7d-b09f-fdbc9ab10d3e req-28d67805-80e3-424c-9abf-b3a77829d3ba service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.399164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1b9fbee-0e59-4b7d-b09f-fdbc9ab10d3e req-28d67805-80e3-424c-9abf-b3a77829d3ba service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.435903 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c1b9fbee-0e59-4b7d-b09f-fdbc9ab10d3e req-28d67805-80e3-424c-9abf-b3a77829d3ba service nova] Creating event network-vif-plugged:7767b449-3a03-4edf-9889-31ed72fe9eb8 for instance c141711d-6e89-424f-8643-6028e1563ca9 on n-h1-858129-2 Sep 16 14:18:53.453562 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c1b9fbee-0e59-4b7d-b09f-fdbc9ab10d3e req-28d67805-80e3-424c-9abf-b3a77829d3ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111107 Sep 16 14:18:53.456021 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2155/4319] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:53.469440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:53.474746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:53.488099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.489538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.503232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.505964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.509684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.511130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.569974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:53.600848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:53.604141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:53.608016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67f54ba9-a2f9-4dfe-91aa-ac33059235e6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.276795 Sep 16 14:18:53.633157 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2165/4320] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:53 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:53.644084 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82acdb49-1574-4980-b31d-2b0745de19dc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 200 len: 168 microversion: 2.1 time: 0.185132 Sep 16 14:18:53.651069 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2156/4321] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:18:53 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 168 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:18:53.660845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:53.661965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:53.673184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.674394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.675784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:53.677379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:53.678612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:53.679908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:54.347228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:54.375006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3d8fb61-59e0-4947-b53e-13fe02cd508a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.721065 Sep 16 14:18:54.376750 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2166/4322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:53 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:54.415756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:54.416833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:54.435275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:54.435951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:54.436512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:54.437551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:54.440212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:54.440817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:54.447496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:54.449792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:54.463338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:54.465068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:54.466543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:54.468522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:54.469885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:54.471132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:55.034948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:55.043966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77001e92-53b4-40bd-8d84-b3a224db0cea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.605040 Sep 16 14:18:55.051613 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2167/4323] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:54 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:55.057075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:55.058164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:55.074969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:55.075470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:55.075921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:55.076654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:55.077122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:55.077562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:55.100602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:55.125312 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5689b267-7512-4199-8bd5-f2db7d4a5a03 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1313 microversion: 2.1 time: 0.752732 Sep 16 14:18:55.144176 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2157/4324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:54 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1313 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:55.156211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:55.157875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:55.171856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:55.173103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:55.174117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:55.175837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:55.177015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:55.179088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:55.284331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:55.301392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:55.308992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:55.310949 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3025c3c3-4915-460a-8b8a-c855b9a21fb6 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.258059 Sep 16 14:18:55.312787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2168/4325] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:55 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:55.758845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:55.774782 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d2d74873-3ef4-4336-ade6-ad6f40299f84 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.623906 Sep 16 14:18:55.791236 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2158/4326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:55 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:55.806658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:55.808268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:55.830477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:55.831396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:55.832207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:55.833578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:55.845865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:55.847054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:56.173232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:56.175576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:56.192259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:56.193330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:56.195519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:56.200426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:56.201245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:56.204825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:56.657079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:56.679587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d5d388d-ef4f-4070-afc8-62d8d88c4e42 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.873224 Sep 16 14:18:56.680871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2169/4327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:55 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:18:56.693823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:18:56.703807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:18:56.708699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:56.722090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:56.724497 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-390de7e7-780f-4ff1-9f86-e26db01625ef tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1497 microversion: 2.1 time: 0.564186 Sep 16 14:18:56.725319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:56.727247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:56.728224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:18:56.735203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:18:56.738308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:18:56.763235 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2159/4328] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:18:56 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1497 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:18:57.150090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:57.168313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:57.171893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:18:57.176361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac08f90a-06f6-4359-aaf4-bd6f8bb683dc tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.493940 Sep 16 14:18:57.178675 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2170/4329] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:18:56 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:18:57.185822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1001369030", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f64a9d39-280d-4bfc-99d8-7531ba64697a"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:57.358692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] validate_networks() for [('f64a9d39-280d-4bfc-99d8-7531ba64697a', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:18:57.476093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1778053008", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:18:57.643668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] validate_networks() for [('ac5da4a3-1bcd-41b9-ba8e-1490ef09e6a5', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:19:00.170623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:19:00.171521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:19:00.172420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:19:00.173319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:19:00.174241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:19:00.229685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:00.230518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:00.233306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:00.241816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:00.242671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:00.243691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:00.298288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:19:00.309788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for user 7b08b72cf46345f2a3c88a6251b1c996 and project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:19:00.330897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:19:00.334805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:19:00.434662 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25314088-d992-4335-9e68-c548c0bb7b9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.252587 Sep 16 14:19:00.438755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2171/4330] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:19:00.450876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:00.455470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:00.467533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:00.468325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:00.468944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:00.470588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:00.471462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:00.472215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:00.564538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:19:00.954494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d4a9c14-2aaa-4218-95fa-de5c97931d71 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 204 len: 0 microversion: 2.1 time: 0.505109 Sep 16 14:19:00.962797 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2172/4331] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:19:00 2022] DELETE /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:19:00.978098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:00.980118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:00.995758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:00.997084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:00.999292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:01.001747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:01.003831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:01.007860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:01.115794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:19:01.116544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:19:01.116544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:19:01.116904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:19:01.117455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:19:01.146027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:01.150759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:01.156279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:01.159381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:01.160504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:01.161453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:01.162868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:01.194774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:01.200932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:01.215334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:01.236645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47b468b8-c638-4396-b1a8-3effd57448d7 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.255079 Sep 16 14:19:01.240504 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2173/4332] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:00 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:19:01.263679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Getting quotas for project b63cdaceb99945cb9c685b43e06845b2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:19:01.282495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Getting quotas for user 32f90da4c8d440fea434af70421f0cbe and project b63cdaceb99945cb9c685b43e06845b2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:19:01.377036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17ea80e2-7c96-4a31-9c47-69df1e5a7580 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:01.378104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17ea80e2-7c96-4a31-9c47-69df1e5a7580 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:01.407960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:19:01.413006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:19:01.521455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:01.574717 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9dc384f3-c8e3-4fba-92a1-483fd5c9a210 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.810356 Sep 16 14:19:01.588654 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2160/4333] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:18:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:19:01.601257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:01.603613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:01.621385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:01.622640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:01.623545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:01.625068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:01.626044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:01.626971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:02.152888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17ea80e2-7c96-4a31-9c47-69df1e5a7580 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:02.197642 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17ea80e2-7c96-4a31-9c47-69df1e5a7580 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1215 microversion: 2.1 time: 0.921545 Sep 16 14:19:02.209686 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2174/4334] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:01 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1215 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:02.267563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa584333-07a3-43f9-b9d1-8bd94998ea4a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:02.268255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa584333-07a3-43f9-b9d1-8bd94998ea4a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:02.975978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa584333-07a3-43f9-b9d1-8bd94998ea4a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:03.008924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa584333-07a3-43f9-b9d1-8bd94998ea4a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1223 microversion: 2.1 time: 0.796781 Sep 16 14:19:03.060599 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2175/4335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:02 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1223 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:03.072154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:03.074154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:03.078256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:03.103843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:03.105025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:03.106238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:03.107779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:03.109061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:03.110068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:03.584842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:03.644057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:03.655277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:03.665514 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-70a455bb-0618-45f7-bd13-890c7daa74d5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.602254 Sep 16 14:19:03.674008 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2176/4336] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:03 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:19:03.707409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:03.709179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:03.746687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:03.754899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:03.756738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:03.757906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:03.761864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:03.784635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:03.787438 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d8b125bf-c182-4159-82b7-b3984c0258f9 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1503 microversion: 2.1 time: 2.184072 Sep 16 14:19:03.788508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:03.789798 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2161/4337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:01 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1503 bytes in 2200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:04.065597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:04.069383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:04.107296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:04.111826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:04.118200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:04.121089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:04.122314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:04.126442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:04.508476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:04.566591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97537811-d1f3-4eb3-820f-b794a7e362f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1275 microversion: 2.1 time: 0.885661 Sep 16 14:19:04.569302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2177/4338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:03 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1275 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:04.606714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:04.667656 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3914b1e-fad7-4ac0-9908-d2e65e097aaf tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1219 microversion: 2.1 time: 0.612241 Sep 16 14:19:04.669952 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2162/4339] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:04 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1219 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:04.741962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:04.744561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:04.773077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:04.776649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:04.778974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:04.783195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:04.788041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:04.792706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:04.845362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:04.855198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:04.884862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:04.906613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:04.910454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:04.923495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:04.927765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:04.934987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:05.095229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:05.112407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:05.114511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:05.116190 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99b84d30-171d-418c-816f-504a27df3d9b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.382686 Sep 16 14:19:05.117456 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2178/4340] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:04 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:19:05.333017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:05.349659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa746100-59f9-4b24-ab40-1c21fa57aa46 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1503 microversion: 2.1 time: 0.513129 Sep 16 14:19:05.355209 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2163/4341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:04 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1503 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:05.597950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:05.599049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:05.625007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:05.627314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:05.630679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:05.632252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:05.638102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:05.639814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:05.691908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:05.692887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:05.704161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:05.707216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:05.707974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:05.711696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:05.716825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:05.717517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:05.913285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:05.943883 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ceac8054-f6a3-4570-9c56-2235e809bcca tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1283 microversion: 2.1 time: 0.255623 Sep 16 14:19:05.979078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2164/4342] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:05 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1283 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:06.173378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:06.174471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:06.186866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:06.191052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:06.191946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:06.192952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:06.196010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:06.196701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:06.611599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:06.649194 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f8ced81-edc5-4e8c-a12d-8509476a4de7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1273 microversion: 2.1 time: 1.054209 Sep 16 14:19:06.654939 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2179/4343] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:05 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1273 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:06.683355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:06.686933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:06.708574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:06.709651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:06.714196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:06.717987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:06.721063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:06.722003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:06.783235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:06.829523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:06.837415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:06.845573 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-da114f8a-fad3-4788-8512-1c090164973b tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.675009 Sep 16 14:19:06.851771 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2165/4344] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:06 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:19:07.003002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:07.006833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:07.036756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:07.038743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:07.039959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:07.051361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:07.055881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:07.058818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:07.378575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:07.412674 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90f03ed8-5a8d-4d8c-a8e2-e8de76198f78 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1281 microversion: 2.1 time: 0.420857 Sep 16 14:19:07.419327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2166/4345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:06 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:07.686116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:07.691200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:07.731216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:07.732456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:07.734813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:07.739376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:07.740962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:07.743209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:08.239814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:08.265119 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af3ffe6e-404a-445a-ba05-68fddba76d1d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1273 microversion: 2.1 time: 0.586434 Sep 16 14:19:08.266454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2167/4346] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:07 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1273 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:08.279783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:08.283749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:08.321301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:08.324260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:08.325023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:08.332130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:08.333403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:08.334496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:08.692308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7393592e664b03a71bedda2f26b24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea65bd193ded42158601fbf77be2aa4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:08.718811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bbcbd8b7-adb1-4f2a-9b27-cd9cc2ec8b57 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 200 len: 1503 microversion: 2.1 time: 2.056862 Sep 16 14:19:08.728349 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2180/4347] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:06 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 1503 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:08.731877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:08.747029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2d416665-bfe3-4b46-85a1-9848120301a3 req-1d6786c1-591c-4d3a-9d14-f5dc97819544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c141711d-6e89-424f-8643-6028e1563ca9", "name": "network-vif-deleted", "tag": "7767b449-3a03-4edf-9889-31ed72fe9eb8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:08.751746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:08.753475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a248191406934e0f8e6137af391df828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a728706eb44e0bb214733383cb9959', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:08.754977 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ce58b3e-0736-42f0-b879-3aa5e50beb41 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 200 len: 1605 microversion: 2.42 time: 0.486049 Sep 16 14:19:08.756045 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2168/4348] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:08 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 1605 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:19:08.777509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:08.777966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2d416665-bfe3-4b46-85a1-9848120301a3 req-1d6786c1-591c-4d3a-9d14-f5dc97819544 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:08.778179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:08.790590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2d416665-bfe3-4b46-85a1-9848120301a3 req-1d6786c1-591c-4d3a-9d14-f5dc97819544 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:08.795566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2d416665-bfe3-4b46-85a1-9848120301a3 req-1d6786c1-591c-4d3a-9d14-f5dc97819544 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:08.799778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:08.801424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:08.802248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:08.803227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:08.803873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:08.804461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:08.849139 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2d416665-bfe3-4b46-85a1-9848120301a3 req-1d6786c1-591c-4d3a-9d14-f5dc97819544 service nova] Creating event network-vif-deleted:7767b449-3a03-4edf-9889-31ed72fe9eb8 for instance c141711d-6e89-424f-8643-6028e1563ca9 on n-h1-858129-2 Sep 16 14:19:08.863729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2d416665-bfe3-4b46-85a1-9848120301a3 req-1d6786c1-591c-4d3a-9d14-f5dc97819544 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132998 Sep 16 14:19:08.872228 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2181/4349] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:09.309369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:09.327601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:09.350038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:09.350695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:09.353197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:09.353998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:09.357172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:09.357921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:09.411488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:09.628016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:09.654928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56851a22-69bd-46e4-9646-2c4cfe3ac63a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 0.897535 Sep 16 14:19:09.666290 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2169/4350] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:08 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:09.782358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:09.783106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] [instance: c141711d-6e89-424f-8643-6028e1563ca9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:09.798428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:09.798938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:09.799607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:09.800568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:09.801039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:09.801475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:09.862156 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] HTTP exception thrown: Instance c141711d-6e89-424f-8643-6028e1563ca9 could not be found. Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Request method failure captured: Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 HTTP/1.1 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIWEBctjOvPDaznIM5G8Ts5glB5rVHCcepKp0sqfMY35sB8RXhXcKtj_LY-hUmkPCOzZGluD8Px1OxTOJJ2yTnudU-Owm24B_u1jnbvyRcV3aqfs46mG7U0hsR2mOE7iDxHACMhxGMVabgHqAzzWuZtxkk5vVitIXJLQIJC3ktYU9IU Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ea65bd193ded42158601fbf77be2aa4e Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesActionsTest-1287765906 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ea65bd193ded42158601fbf77be2aa4e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ea65bd193ded42158601fbf77be2aa4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ea65bd193ded42158601fbf77be2aa4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ea65bd193ded42158601fbf77be2aa4e"}]}] Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesActionsTest-1287765906 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ea65bd193ded42158601fbf77be2aa4e Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesActionsTest-1287765906 Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesActionsTest-1287765906-project Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ab7393592e664b03a71bedda2f26b24f Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesActionsTest-1287765906-project Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance c141711d-6e89-424f-8643-6028e1563ca9 could not be found. Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'c141711d-6e89-424f-8643-6028e1563ca9'} Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c141711d-6e89-424f-8643-6028e1563ca9 could not be found. Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c141711d-6e89-424f-8643-6028e1563ca9 could not be found. Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:09.870023 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c141711d-6e89-424f-8643-6028e1563ca9 could not be found. Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] Returning 404 to user: Instance c141711d-6e89-424f-8643-6028e1563ca9 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1edb7cd-c304-4310-ab59-2dc8c9246bc2 tempest-VolumesActionsTest-1287765906 tempest-VolumesActionsTest-1287765906-project] 10.222.0.60 "GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9" status: 404 len: 111 microversion: 2.1 time: 0.100405 Sep 16 14:19:09.879928 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2170/4351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:09 2022] GET /compute/v2.1/servers/c141711d-6e89-424f-8643-6028e1563ca9 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:19:09.901887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:09.903063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:09.914731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:09.915542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:09.916846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:09.918321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:09.919560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:09.920620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:09.960028 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] HTTP exception thrown: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Request method failure captured: Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 HTTP/1.1 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIPz-YcRbPGt17VoOXibXxvdTV_OjawnPs65coaS9E_XZ1YhCAAKE_m27DJkgGgPGkayrHQns1l60OiG_f7o7Evog3Ad94xHsdrCC2hmNwrzOq4TSeT_r8Jm3idSixHUxPnOCPBUY6KUPEjhkdEL0RpdbeDoDeJcNi9JVRwGS9LyqtY Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.42 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 89a728706eb44e0bb214733383cb9959 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89a728706eb44e0bb214733383cb9959", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89a728706eb44e0bb214733383cb9959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89a728706eb44e0bb214733383cb9959"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89a728706eb44e0bb214733383cb9959"}]}] Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 89a728706eb44e0bb214733383cb9959 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TaggedBootDevicesTest_v242-179425168-project Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: a248191406934e0f8e6137af391df828 Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TaggedBootDevicesTest_v242-179425168-project Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '3388427a-be99-45c8-90c1-bc6076e82e38'} Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.964227 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:09.972988 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:09.975195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Returning 404 to user: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:19:09.977140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a75f6dde-2889-4e9e-b838-414c60f26fcf tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 404 len: 111 microversion: 2.42 time: 0.097509 Sep 16 14:19:09.994259 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2171/4352] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:09 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:19:10.003964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0be06680-1ae0-4a0f-9cd1-aec25080bbfd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '.version_select at 0x7f724c5fbf70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:10.055163 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0be06680-1ae0-4a0f-9cd1-aec25080bbfd tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777213397" status: 204 len: 0 microversion: 2.42 time: 0.058497 Sep 16 14:19:10.055781 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2172/4353] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 14:19:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777213397 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:19:10.283968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:10.525870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:10.541177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-666df29d-8064-4068-86e1-cf5bbd8b60cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 1.241437 Sep 16 14:19:10.548104 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2182/4354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:09 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:10.707087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:10.715952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:10.730820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:10.731960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:10.732815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:10.733751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:10.734387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:10.735002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:11.194828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:11.366799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:11.575648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:11.576533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:11.589928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:11.590463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:11.590920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:11.591687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:11.592157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:11.592591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:12.460743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:12.497706 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-08ec4259-9ec7-4dcf-967b-a3eaef46cb6a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 1.806063 Sep 16 14:19:12.504170 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2173/4355] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:10 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:12.933431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:13.014770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:13.021102 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d173da8-a06c-4569-aa7b-150e3b8141ed tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 1.449830 Sep 16 14:19:13.040584 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2183/4356] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:11 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:13.100520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8d58cf5c-ed32-4dda-b4f5-ba1edda74ee9 req-c1e62b0a-c970-485f-b8e3-a2fb37aa0375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5d4b40-951e-495f-8553-d5daeb0f8226", "tag": "4dee8eb3-2471-4adb-9f15-ef6e2436605c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:13.144260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d58cf5c-ed32-4dda-b4f5-ba1edda74ee9 req-c1e62b0a-c970-485f-b8e3-a2fb37aa0375 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:13.149111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d58cf5c-ed32-4dda-b4f5-ba1edda74ee9 req-c1e62b0a-c970-485f-b8e3-a2fb37aa0375 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:13.149111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8d58cf5c-ed32-4dda-b4f5-ba1edda74ee9 req-c1e62b0a-c970-485f-b8e3-a2fb37aa0375 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:13.207522 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8d58cf5c-ed32-4dda-b4f5-ba1edda74ee9 req-c1e62b0a-c970-485f-b8e3-a2fb37aa0375 service nova] Creating event network-changed:4dee8eb3-2471-4adb-9f15-ef6e2436605c for instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 on n-h2-858129-2 Sep 16 14:19:13.258727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8d58cf5c-ed32-4dda-b4f5-ba1edda74ee9 req-c1e62b0a-c970-485f-b8e3-a2fb37aa0375 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170812 Sep 16 14:19:13.263614 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2184/4357] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:13.395391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-732089585", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "99da2191-612a-4bb1-89db-a4f2b83a6988"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:13.563191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] validate_networks() for [('99da2191-612a-4bb1-89db-a4f2b83a6988', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:19:13.580367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:13.584688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:13.618437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:13.619600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:13.620921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:13.629507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:13.631447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:13.635069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:14.879907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:14.913661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac82ace9-ff14-4874-94f4-29bf2ad0aa96 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 1.358005 Sep 16 14:19:14.930765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2185/4358] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:13 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:14.946784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:14.947009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:15.001048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:15.004420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:15.004420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:15.008626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:15.012361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:15.016020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:16.750829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:16.789593 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54b2aac6-98b6-4cda-9904-a98079e26fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 1.867561 Sep 16 14:19:16.797532 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2186/4359] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:14 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:16.811927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:16.816008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:16.833797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:16.837432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:16.839955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:16.843765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:16.852399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:16.853592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:17.602197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:19:17.603077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:19:17.603909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:19:17.607465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:19:17.608097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:19:17.683406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:17.689626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:17.693475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:17.708705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:17.714788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:17.716173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:17.896120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Getting quotas for project 674e7e806e7c488188c319d86f8f9d84. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:19:17.925957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Getting quotas for user 85c0174589024f7bac7ad4cf7bdbebaa and project 674e7e806e7c488188c319d86f8f9d84. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:19:18.015995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:19:18.029485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:19:18.046460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:18.093411 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41863c06-670d-4a1a-a677-98475b9b6fa6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 1.293899 Sep 16 14:19:18.101826 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2187/4360] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:16 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:18.265993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.379949 Sep 16 14:19:18.268219 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2174/4361] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:19:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 5384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:19:18.297091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:18.298995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:18.321994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:18.328131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:18.334153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:18.341496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:18.344667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:18.346514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:19.288268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-48508fa4-afdc-4111-8712-2cec32fd72f4 req-e9156430-8fde-47e7-94db-d9af25c90c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:19.327239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48508fa4-afdc-4111-8712-2cec32fd72f4 req-e9156430-8fde-47e7-94db-d9af25c90c0a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:19.331961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48508fa4-afdc-4111-8712-2cec32fd72f4 req-e9156430-8fde-47e7-94db-d9af25c90c0a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:19.332743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-48508fa4-afdc-4111-8712-2cec32fd72f4 req-e9156430-8fde-47e7-94db-d9af25c90c0a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:19.362742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-48508fa4-afdc-4111-8712-2cec32fd72f4 req-e9156430-8fde-47e7-94db-d9af25c90c0a service nova] Creating event network-changed:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:19:19.372456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-48508fa4-afdc-4111-8712-2cec32fd72f4 req-e9156430-8fde-47e7-94db-d9af25c90c0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.268608 Sep 16 14:19:19.373126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2188/4362] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:19.386696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53bf9c72-2edf-46e7-8393-d38cb1d73a16 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:19.393493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53bf9c72-2edf-46e7-8393-d38cb1d73a16 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:19.456659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:19.469119 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-903940c9-99e4-4a84-8df9-51bfce148b65 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 1.194418 Sep 16 14:19:19.486978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2175/4363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:18 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:19.502451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:19.504275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:19.528552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:19.530110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:19.533660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:19.536932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:19.543131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:19.548714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:20.032682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-53bf9c72-2edf-46e7-8393-d38cb1d73a16 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:20.042573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53bf9c72-2edf-46e7-8393-d38cb1d73a16 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1216 microversion: 2.1 time: 0.663457 Sep 16 14:19:20.050845 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2189/4364] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:19 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1216 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:20.509843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:20.511003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:20.531670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:20.538048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:20.538722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:20.539622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:20.545806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:20.546471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:20.755048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:20.811449 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2337c50-a6b8-4714-b422-433f1853cd34 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 1.322637 Sep 16 14:19:20.824687 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2176/4365] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:19 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:21.084350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:21.084971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:21.108935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:21.110117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:21.112973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:21.114133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:21.120534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:21.121542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:21.505165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:21.512672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:21.525729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-547ea40b-87cd-459f-a3ad-0686da8c241e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 1.020241 Sep 16 14:19:21.541359 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2190/4366] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:20 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:21.556083 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8984b48a-779a-4eb7-b8fe-f6bc45dabda1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1212 microversion: 2.1 time: 0.473480 Sep 16 14:19:21.572658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2177/4367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:21 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1212 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:21.855945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:21.857388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:21.874792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:21.875344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:21.875813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:21.876571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:21.877047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:21.877480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:22.177869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1590025690", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:22.287205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:19:22.515811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:22.531235 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4bfaf857-a2a1-49b2-aa86-355ef6b2afae tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 0.679624 Sep 16 14:19:22.535864 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2178/4368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:21 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:22.559360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:22.562383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:22.576315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:22.582069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:22.585699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:22.588180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:22.589733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:22.590963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.161294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:19:23.162007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:19:23.162629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:19:23.163412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:19:23.164268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:19:23.187710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.188766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.193025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.194368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.195243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.198385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.263648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Getting quotas for project 330f65aebd344c99b97cdcddb5ca9637. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:19:23.278893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Getting quotas for user 2d4685e0517e49a5a9bed15b266aa244 and project 330f65aebd344c99b97cdcddb5ca9637. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:19:23.311784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:19:23.321290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:19:23.421148 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0bad9b40-3292-4907-9f25-bfc563b941c9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720615 Sep 16 14:19:23.428880 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2191/4369] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:19:23.435350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:23.436460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:23.444528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.445288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.445972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.447099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.448463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.449169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.460287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:23.472457 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82f5156f-8aa5-45ea-b694-d2c06035be8b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 0.915998 Sep 16 14:19:23.476882 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2179/4370] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:22 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:23.485922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4c4611bd-ba52-43c1-8ea6-a77b61152576 req-f906f94e-1bd1-4aa5-9fec-c814975bc19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5d4b40-951e-495f-8553-d5daeb0f8226", "name": "network-vif-plugged", "status": "completed", "tag": "4dee8eb3-2471-4adb-9f15-ef6e2436605c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:23.516126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4c4611bd-ba52-43c1-8ea6-a77b61152576 req-f906f94e-1bd1-4aa5-9fec-c814975bc19a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.522462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4c4611bd-ba52-43c1-8ea6-a77b61152576 req-f906f94e-1bd1-4aa5-9fec-c814975bc19a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.523321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4c4611bd-ba52-43c1-8ea6-a77b61152576 req-f906f94e-1bd1-4aa5-9fec-c814975bc19a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.545914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4c4611bd-ba52-43c1-8ea6-a77b61152576 req-f906f94e-1bd1-4aa5-9fec-c814975bc19a service nova] Creating event network-vif-plugged:4dee8eb3-2471-4adb-9f15-ef6e2436605c for instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 on n-h2-858129-2 Sep 16 14:19:23.552253 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4c4611bd-ba52-43c1-8ea6-a77b61152576 req-f906f94e-1bd1-4aa5-9fec-c814975bc19a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073733 Sep 16 14:19:23.553271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2180/4371] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:23.560587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59be0382-06f8-4ba3-ac72-6ffe4c970516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:23.561784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59be0382-06f8-4ba3-ac72-6ffe4c970516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:23.682656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:23.699629 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f1efcff1-6937-4b1e-95d6-ff81443b47ca tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1274 microversion: 2.1 time: 0.263777 Sep 16 14:19:23.700841 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2192/4372] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:23 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:23.712981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:23.714060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:23.724575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.725523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.733289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.737136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:23.738197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:23.738856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:23.974052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-59be0382-06f8-4ba3-ac72-6ffe4c970516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:23.996152 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59be0382-06f8-4ba3-ac72-6ffe4c970516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1219 microversion: 2.1 time: 0.439826 Sep 16 14:19:23.998910 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2181/4373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:23 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1219 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:24.264121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:24.276346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa9d0608-8d21-4675-a475-6c3c7f131176 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 0.573659 Sep 16 14:19:24.285386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2193/4374] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:23 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:24.519233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:24.531999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:24.563948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:24.569050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:24.573700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:24.578915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:24.582087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:24.583419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:24.656502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:24.751158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:24.753630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:24.787259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:24.791879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:24.793980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:24.795493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:24.801614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:24.818303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:25.128686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:25.194455 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b2f3ae6-fc18-4d14-b23b-d8e827b3114d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1315 microversion: 2.1 time: 0.694090 Sep 16 14:19:25.215997 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2182/4375] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:24 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:25.218871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:25.224164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:25.224907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:25.228448 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-51108a04-0260-430a-9067-47d8db0e3f05 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1274 microversion: 2.1 time: 0.486244 Sep 16 14:19:25.230215 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2194/4376] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:24 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1274 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:25.239993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:25.240821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:25.243184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:25.244367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:25.247591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:25.249198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:25.326756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:25.327405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:25.335608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:25.336232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:25.336687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:25.337432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:25.337916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:25.345810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:25.449311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:25.477858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a9e7969a-0b94-4845-b9a9-2fda61e0b629 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1215 microversion: 2.1 time: 0.274252 Sep 16 14:19:25.479508 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2183/4377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:25 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1215 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:25.809296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:25.867433 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4ab8586-2254-4a77-a394-e8dea6526fb6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 0.545291 Sep 16 14:19:25.870662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2195/4378] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:25 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:26.227936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:26.230631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:26.273326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:26.274533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:26.283760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:26.284693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:26.286444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:26.309820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:26.310483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:26.311081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:26.315833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:26.316784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:26.332311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:26.342774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:26.345374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:26.360006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:27.789348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:28.455102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:28.489074 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70eaaee8-b7a8-44f6-b853-47a5c15fc818 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1501 microversion: 2.1 time: 2.268538 Sep 16 14:19:28.491751 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2184/4379] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:26 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1501 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:28.518015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:28.519842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:28.542644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.543575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.544201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.545255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.546180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.546824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.642038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:28.662335 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ad90831-979d-46f0-99b1-55d927a12998 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 2.394817 Sep 16 14:19:28.664851 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2196/4380] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:26 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:28.679891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:28.684771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:28.705444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.707156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.719025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.720335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.721151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.722381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.752921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:28.770212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed93377e-4248-4c60-84fd-a54368b17385 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1277 microversion: 2.1 time: 0.274794 Sep 16 14:19:28.772332 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2185/4381] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:28 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:28.785532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bd89c663-c8de-4191-a9dd-8963ae041889 req-e53d69eb-6df4-4587-a967-9ba68a706808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "name": "network-vif-plugged", "status": "completed", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:28.806150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bd89c663-c8de-4191-a9dd-8963ae041889 req-e53d69eb-6df4-4587-a967-9ba68a706808 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.809093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bd89c663-c8de-4191-a9dd-8963ae041889 req-e53d69eb-6df4-4587-a967-9ba68a706808 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.809822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bd89c663-c8de-4191-a9dd-8963ae041889 req-e53d69eb-6df4-4587-a967-9ba68a706808 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.827571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bd89c663-c8de-4191-a9dd-8963ae041889 req-e53d69eb-6df4-4587-a967-9ba68a706808 service nova] Creating event network-vif-plugged:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:19:28.834507 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bd89c663-c8de-4191-a9dd-8963ae041889 req-e53d69eb-6df4-4587-a967-9ba68a706808 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059809 Sep 16 14:19:28.836020 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2186/4382] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:28.844330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:28.847513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:28.856695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.857752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.858572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.860235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:28.860998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:28.861679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:28.934504 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9777f208-c423-41df-af8c-5a7ed5b50aaa tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.095957 Sep 16 14:19:28.935926 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2187/4383] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:28 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:19:29.704200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:29.705590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:29.717886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:29.723563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:29.724558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:29.725564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:29.733447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:29.734273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:29.777382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:29.795716 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04a0ebd7-205c-475c-9c69-e82caf5c48b6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 1.128765 Sep 16 14:19:29.818149 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2197/4384] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:28 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:29.827012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:29.827859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:29.847095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:29.847819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:29.848413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:29.849290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:29.853926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:29.854608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:30.127382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:30.138501 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2104379-b87f-44a2-896f-b9abe0bb01f9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1277 microversion: 2.1 time: 0.318894 Sep 16 14:19:30.139843 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2198/4385] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:29 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1277 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:30.145550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:30.148369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:30.157132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:30.158010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:30.158742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:30.159712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:30.160397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:30.161014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:30.491231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:30.508785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-311f0b16-1b25-4095-ac4e-8e1cf165eeb3 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.808960 Sep 16 14:19:30.510788 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2188/4386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:29 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:30.531212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63f91a2c-eaa2-469b-8fbb-8533c3bb3a41 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.389688 Sep 16 14:19:30.531887 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2199/4387] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:30 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:19:30.823586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:30.823586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:30.858969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:30.862467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:30.875631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:30.878272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:30.890362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:30.895870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.194312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:31.199429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:31.262126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.265890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.266425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.271487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.272121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.276285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.542636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:31.560895 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91211232-b6e4-4981-b485-2d573519ff5e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1323 microversion: 2.1 time: 0.743722 Sep 16 14:19:31.562091 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2189/4388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:30 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1323 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:31.578624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1b43d7d6-4aa2-45e4-84cd-28f50597fd5f req-0dc30e7c-197b-4fbb-825a-f60a9e049e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598a047d-d289-4110-a5a9-27b9eb0b7995", "tag": "29e700c1-c003-4c5a-9489-c75d72323b6b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:31.628018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1b43d7d6-4aa2-45e4-84cd-28f50597fd5f req-0dc30e7c-197b-4fbb-825a-f60a9e049e3a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.629354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1b43d7d6-4aa2-45e4-84cd-28f50597fd5f req-0dc30e7c-197b-4fbb-825a-f60a9e049e3a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.641106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1b43d7d6-4aa2-45e4-84cd-28f50597fd5f req-0dc30e7c-197b-4fbb-825a-f60a9e049e3a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.683353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1b43d7d6-4aa2-45e4-84cd-28f50597fd5f req-0dc30e7c-197b-4fbb-825a-f60a9e049e3a service nova] Creating event network-changed:29e700c1-c003-4c5a-9489-c75d72323b6b for instance 598a047d-d289-4110-a5a9-27b9eb0b7995 on n-h1-858129-2 Sep 16 14:19:31.708292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1b43d7d6-4aa2-45e4-84cd-28f50597fd5f req-0dc30e7c-197b-4fbb-825a-f60a9e049e3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144186 Sep 16 14:19:31.709710 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2190/4389] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:31.715942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:31.716929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:31.744933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:31.748327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.749046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.749701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.750768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.752561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.757160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.888024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:31.897732 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ec72357-a2d8-4bee-a7de-94d49bc6cfea tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.718092 Sep 16 14:19:31.898468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2200/4390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:31 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:31.904043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:31.910631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:31.936652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.937018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.937474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:31.938433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:31.938907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:31.939352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:32.149811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7eb52cd-b0b4-4a1f-b109-dcded6c35fa1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.248759 Sep 16 14:19:32.153028 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2201/4391] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:31 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:19:32.262394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:32.278381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54ebad83-4d50-4afe-bbed-2f617dc66dc1 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.567127 Sep 16 14:19:32.279627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2191/4392] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:31 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:32.593272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:32.598120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:32.618074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:32.621979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:32.626100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:32.629866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:32.631443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:32.634733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:32.768333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:32.927508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:32.928372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:32.945523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:32.946028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:32.946550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:32.948288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:32.948288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:32.948699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.099070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:33.113861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8471b70-19e1-4308-a78a-b7c73a687b2d tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1518 microversion: 2.1 time: 0.525471 Sep 16 14:19:33.126544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2202/4393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:32 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1518 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:33.150144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:33.153263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:33.168873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.169383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.169835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.170619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.176829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.177495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.216740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lazy-loading 'flavor' on Instance uuid 4586981e-4f62-4dfe-875e-4e968deaff31 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:19:33.249379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:33.300058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:33.452547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-83f3ff16-4b82-41cc-b498-ce426879d76e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action" status: 200 len: 32 microversion: 2.1 time: 0.306127 Sep 16 14:19:33.471190 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2203/4394] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:33 2022] POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:19:33.547314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:33.555929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:33.563567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:33.579249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.584628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.585250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.586038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.586559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.587389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.677379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d06417b8-3aba-402a-adec-7ab9e7bd703e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.192234 Sep 16 14:19:33.679802 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2204/4395] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:33 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:19:33.681776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:33.700323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:33.701058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:33.725946 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40aa6af4-9642-48aa-bf89-149ae9e3fd60 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.802565 Sep 16 14:19:33.730770 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2192/4396] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:32 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:33.740227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.741265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.742175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.743648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:33.748138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:33.750068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.754317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.755499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.764969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.769626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.775022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.778543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:33.779601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:33.780292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:33.992141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:34.237945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:34.252566 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2d86a60-206d-43b0-a6f3-368c5f92a278 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.570975 Sep 16 14:19:34.257884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2205/4397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:33 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:34.264510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:34.268748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:34.286638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.295791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.307384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.308188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.314727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.315651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.367766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] HTTP exception thrown: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Request method failure captured: Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 HTTP/1.1 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPz-YcRbPGt17VoOXibXxvdTV_OjawnPs65coaS9E_XZ1YhCAAKE_m27DJkgGgPGkayrHQns1l60OiG_f7o7Evog3Ad94xHsdrCC2hmNwrzOq4TSeT_r8Jm3idSixHUxPnOCPBUY6KUPEjhkdEL0RpdbeDoDeJcNi9JVRwGS9LyqtY Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.42 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 89a728706eb44e0bb214733383cb9959 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89a728706eb44e0bb214733383cb9959", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89a728706eb44e0bb214733383cb9959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89a728706eb44e0bb214733383cb9959"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89a728706eb44e0bb214733383cb9959"}]}] Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 89a728706eb44e0bb214733383cb9959 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TaggedBootDevicesTest_v242-179425168-project Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: a248191406934e0f8e6137af391df828 Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TaggedBootDevicesTest_v242-179425168-project Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3388427a-be99-45c8-90c1-bc6076e82e38'} Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:19:34.372486 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Returning 404 to user: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:19:34.378806 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce352cb3-5487-47c5-a735-3987284307b5 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 404 len: 111 microversion: 2.42 time: 0.113910 Sep 16 14:19:34.387750 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2206/4398] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:19:34 2022] DELETE /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:19:34.392905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:34.393540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] [instance: 3388427a-be99-45c8-90c1-bc6076e82e38] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:34.415996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.415996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.415996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.415996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.415996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.415996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.461080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] HTTP exception thrown: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Request method failure captured: Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 HTTP/1.1 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIPz-YcRbPGt17VoOXibXxvdTV_OjawnPs65coaS9E_XZ1YhCAAKE_m27DJkgGgPGkayrHQns1l60OiG_f7o7Evog3Ad94xHsdrCC2hmNwrzOq4TSeT_r8Jm3idSixHUxPnOCPBUY6KUPEjhkdEL0RpdbeDoDeJcNi9JVRwGS9LyqtY Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.42 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 89a728706eb44e0bb214733383cb9959 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89a728706eb44e0bb214733383cb9959", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89a728706eb44e0bb214733383cb9959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89a728706eb44e0bb214733383cb9959"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89a728706eb44e0bb214733383cb9959"}]}] Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 89a728706eb44e0bb214733383cb9959 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-179425168 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TaggedBootDevicesTest_v242-179425168-project Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: a248191406934e0f8e6137af391df828 Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TaggedBootDevicesTest_v242-179425168-project Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3388427a-be99-45c8-90c1-bc6076e82e38'} Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.463244 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. Sep 16 14:19:34.468458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:34.470664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] Returning 404 to user: Instance 3388427a-be99-45c8-90c1-bc6076e82e38 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:19:34.478282 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d28ff4e-342a-471c-a382-def553a71d25 tempest-TaggedBootDevicesTest_v242-179425168 tempest-TaggedBootDevicesTest_v242-179425168-project] 10.222.0.60 "GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38" status: 404 len: 111 microversion: 2.42 time: 0.089288 Sep 16 14:19:34.479296 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2207/4399] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:19:34 2022] GET /compute/v2.1/servers/3388427a-be99-45c8-90c1-bc6076e82e38 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:19:34.527745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:34.537411 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1de14549-d8d6-4b71-accb-182ba207e9db tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.805120 Sep 16 14:19:34.559072 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2193/4400] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:33 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:34.649528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b1c7d1ee-1e64-4bb9-8485-052a94e662d6 req-9bc3ea84-e7f9-4df5-9905-0b7b392c7fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca04c82-192b-4332-a1fa-403ea76d08b8", "tag": "134616fd-43b1-4efe-9344-360d15ee384f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:34.678154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b1c7d1ee-1e64-4bb9-8485-052a94e662d6 req-9bc3ea84-e7f9-4df5-9905-0b7b392c7fb1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.679483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b1c7d1ee-1e64-4bb9-8485-052a94e662d6 req-9bc3ea84-e7f9-4df5-9905-0b7b392c7fb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.684543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b1c7d1ee-1e64-4bb9-8485-052a94e662d6 req-9bc3ea84-e7f9-4df5-9905-0b7b392c7fb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.691811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:34.694568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:34.713763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.714351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.723240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.723965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.724454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.728381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.756628 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b1c7d1ee-1e64-4bb9-8485-052a94e662d6 req-9bc3ea84-e7f9-4df5-9905-0b7b392c7fb1 service nova] Creating event network-changed:134616fd-43b1-4efe-9344-360d15ee384f for instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 on n-h1-858129-2 Sep 16 14:19:34.772989 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b1c7d1ee-1e64-4bb9-8485-052a94e662d6 req-9bc3ea84-e7f9-4df5-9905-0b7b392c7fb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127526 Sep 16 14:19:34.774353 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2208/4401] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:19:34.782821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:34.798476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:34.805991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.809988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.810843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.811838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:34.815182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:34.815991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:34.875176 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b29c01b-096d-4d1e-854c-d6cebd963810 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.184498 Sep 16 14:19:34.877817 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2194/4402] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:34 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:19:35.215434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:35.225066 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a300c407-db10-4cc3-80e5-4522392a7d80 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.449051 Sep 16 14:19:35.232036 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2209/4403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:34 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:35.295688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:35.297429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:35.315490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:35.316733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:35.317587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:35.318827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:35.320796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:35.321493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:35.572620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:35.573921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:35.590248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:35.594106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:35.594746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:35.599505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:35.600389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:35.601390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:35.712297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:35.726374 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0ad0b0ff-45c5-444e-a81a-8cec5e7a9f0f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.444178 Sep 16 14:19:35.732048 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2195/4404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:35 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:35.880763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:35.894728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:35.898703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:35.907686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cae54eb5-f4ef-4c07-973b-2d8a85e1a40f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.335693 Sep 16 14:19:35.918757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2210/4405] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:35 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:35.921841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:35.923038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:35.924343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:35.925633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:35.926511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:35.927471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:36.020196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11c85cdd-ff54-4d23-94da-fe7e0db822ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.135776 Sep 16 14:19:36.024900 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2196/4406] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:35 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:19:36.260666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:36.262351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:36.274456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:36.275900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:36.277034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:36.278820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:36.281118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:36.282380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:36.626955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:36.640396 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e935bbe-ded9-4e9f-882f-c5065498d4bd tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.386683 Sep 16 14:19:36.641643 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2211/4407] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:36 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:36.800594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:36.803109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:36.832404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:36.833649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:36.837667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:36.840326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:36.841555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:36.842849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:36.933485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:36.934223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:36.948550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:36.949071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:36.954812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:36.958159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:36.962140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:36.963835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:37.459848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:37.475942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c935902d-8565-442c-8b6f-bd3d5aabf500 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.699531 Sep 16 14:19:37.479353 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2197/4408] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:36 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:37.497009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:37.499444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:37.517876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:37.520214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:37.522798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:37.523618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:37.526237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:37.529629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:37.582287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:37.612349 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af950529-666e-4912-9985-e8642ee54493 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.678122 Sep 16 14:19:37.626960 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2212/4409] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:36 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:37.661804 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-96b19a16-e56b-43b9-a1bc-f5907101ab88 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 14 microversion: 2.1 time: 0.180552 Sep 16 14:19:37.665822 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2198/4410] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:37 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:19:37.673706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:37.675013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:37.696314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:37.697178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:37.697955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:37.699271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:37.704762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:37.716643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:38.018919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:38.031874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54835807-cb78-486a-9d8f-74b34a2319a2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.366138 Sep 16 14:19:38.053429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2213/4411] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:37 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:38.539652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:38.542021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:38.565204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:38.566368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:38.567414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:38.569048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:38.574210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:38.575677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:38.663552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:38.664665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:38.679996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:38.683785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:38.686721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:38.687998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:38.690963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:38.692169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:39.087231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:39.096168 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3cdd402-ade7-49c0-a78a-9fac59789eb0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.575410 Sep 16 14:19:39.110446 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2199/4412] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:38 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:39.110446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:39.110446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:39.122024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:39.122024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:39.136237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:39.136237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:39.136237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:39.136237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:39.178238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:39.199355 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2fcd148e-8793-4ce5-b354-6d411d0fb9a4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.541598 Sep 16 14:19:39.206784 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2214/4413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:38 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:39.232789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:39.233951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:39.265858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:39.269785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:39.271025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:39.275241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:39.279976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:39.284304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:39.346691 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c4db0c2-2301-4cec-bb13-5663214d1a83 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action" status: 200 len: 8206 microversion: 2.1 time: 0.246442 Sep 16 14:19:39.362580 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2200/4414] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:39 2022] POST /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226/action => generated 8206 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:39.384261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:39.390655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:39.416940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:39.451102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:39.452461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:39.455034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:39.456213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:39.457245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:40.304375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:40.317332 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a06e339-6287-4814-a832-614f8e6143dc tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 1.108936 Sep 16 14:19:40.319912 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2215/4415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:39 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:40.331038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:40.335613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:40.355516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:40.356327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:40.356956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:40.357962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:40.358651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:40.359277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:40.366224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:40.375087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:40.411813 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75326a4f-b7b4-49dd-9ca6-51ac0aaffa4b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.040935 Sep 16 14:19:40.416937 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2201/4416] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:39 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:40.427100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:40.435752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:40.458722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:40.462468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:40.479951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:40.481579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:40.482630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:40.486907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:41.471304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:41.500334 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63f67522-e586-4950-8c3c-233f04ab9b3f tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 1.177752 Sep 16 14:19:41.511888 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2216/4417] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:40 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:41.523189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:41.535971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:41.573472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:41.580057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:41.603124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:41.604770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:41.609965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:41.614337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:41.663152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:41.675292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-baa24767-1b71-41d4-bd99-6091f117c388 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 1.256728 Sep 16 14:19:41.695791 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2202/4418] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:40 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:41.708391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:41.709037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:41.723372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:41.725438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:41.728212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:41.729451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:41.731699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:41.732354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:43.936547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:43.966993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91f56c2b-39b1-401c-910c-94dd9c9ce5ca tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 2.269865 Sep 16 14:19:43.967975 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2203/4419] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:41 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:44.005624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:44.025559 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9b0fff90-c451-4b2b-975f-b55bb4fac005 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 2.511171 Sep 16 14:19:44.026973 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2217/4420] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:41 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:44.086602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:44.089259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:44.108072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:44.110768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:44.112329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:44.114668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:44.116309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:44.117503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:44.251037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4fb3261a-9c28-4c2c-ab11-881ff6fc064d req-339967ee-75aa-4fcf-aa24-413ad777c19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598a047d-d289-4110-a5a9-27b9eb0b7995", "name": "network-vif-plugged", "status": "completed", "tag": "29e700c1-c003-4c5a-9489-c75d72323b6b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:44.286388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4fb3261a-9c28-4c2c-ab11-881ff6fc064d req-339967ee-75aa-4fcf-aa24-413ad777c19c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:44.289925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4fb3261a-9c28-4c2c-ab11-881ff6fc064d req-339967ee-75aa-4fcf-aa24-413ad777c19c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:44.292327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4fb3261a-9c28-4c2c-ab11-881ff6fc064d req-339967ee-75aa-4fcf-aa24-413ad777c19c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:44.363263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4fb3261a-9c28-4c2c-ab11-881ff6fc064d req-339967ee-75aa-4fcf-aa24-413ad777c19c service nova] Creating event network-vif-plugged:29e700c1-c003-4c5a-9489-c75d72323b6b for instance 598a047d-d289-4110-a5a9-27b9eb0b7995 on n-h1-858129-2 Sep 16 14:19:44.370604 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4fb3261a-9c28-4c2c-ab11-881ff6fc064d req-339967ee-75aa-4fcf-aa24-413ad777c19c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401025 Sep 16 14:19:44.371676 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2204/4421] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:44.379334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:44.380082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:44.390327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:44.390957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:44.391910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:44.393134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:44.393817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:44.394813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.012475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:45.027899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-756df0bd-9b16-4767-ba0d-efb96a458a0c tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.951433 Sep 16 14:19:45.030627 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2218/4422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:44 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:45.044801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:45.045843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:45.068374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:45.069813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:45.073336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.075876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:45.076701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:45.078055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.136131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:45.150581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:45.167835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c3362f22-4dac-42ed-933a-602e27ff94d0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.787537 Sep 16 14:19:45.169269 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2205/4423] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:44 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:45.175880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:45.176512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:45.208094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:45.209421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:45.214439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.215856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:45.216361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:45.223065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.559294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:45.582160 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99f39188-efa5-4ca3-b484-6a4b5d5f7d43 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.546322 Sep 16 14:19:45.584047 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2219/4424] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:45 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:45.638835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:45.640413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:45.653783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:45.654994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:45.655895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.657235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:45.658209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:45.659247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:45.703670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:45.713894 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5228cc55-d6c1-46eb-aed2-e0a9c18244d1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.541797 Sep 16 14:19:45.719737 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2206/4425] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:45 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:46.020651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:46.046823 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d59dc7a9-6573-46df-8717-bd4139282f23 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.416145 Sep 16 14:19:46.048142 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2220/4426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:45 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:46.073296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:46.073924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:46.095761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:46.095761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:46.124178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.124689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.125140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.127188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.127637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.129142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.130564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.130690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.131540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.131771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.132356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.132552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.290572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Locking {{(pid=128642) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 16 14:19:46.535957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86500a99-188b-475a-9ddc-7e59e2bd8eb5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.454154 Sep 16 14:19:46.537871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2221/4427] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:46 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:19:46.553190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:46.555368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:46.570987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.572366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.573723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.577217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.578352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.579609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.629239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:46.644177 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97fe37df-2bbf-4bc8-b517-4495108df627 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1316 microversion: 2.1 time: 0.573242 Sep 16 14:19:46.659271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2207/4428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:46 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:46.674959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4015124b-fd2e-49b5-bb3f-c96166295350 req-3569d52f-6aed-4ac5-a243-6abca87a90dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca04c82-192b-4332-a1fa-403ea76d08b8", "name": "network-vif-plugged", "status": "completed", "tag": "134616fd-43b1-4efe-9344-360d15ee384f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:46.704398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4015124b-fd2e-49b5-bb3f-c96166295350 req-3569d52f-6aed-4ac5-a243-6abca87a90dd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.704872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4015124b-fd2e-49b5-bb3f-c96166295350 req-3569d52f-6aed-4ac5-a243-6abca87a90dd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.708069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4015124b-fd2e-49b5-bb3f-c96166295350 req-3569d52f-6aed-4ac5-a243-6abca87a90dd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.738749 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4015124b-fd2e-49b5-bb3f-c96166295350 req-3569d52f-6aed-4ac5-a243-6abca87a90dd service nova] Creating event network-vif-plugged:134616fd-43b1-4efe-9344-360d15ee384f for instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 on n-h1-858129-2 Sep 16 14:19:46.746446 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4015124b-fd2e-49b5-bb3f-c96166295350 req-3569d52f-6aed-4ac5-a243-6abca87a90dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084967 Sep 16 14:19:46.747871 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2208/4429] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:46.755000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:46.756635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:46.764454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.765174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.765838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:46.766944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:46.767563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:46.768279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.464986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:47.476556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7dbfa638-19db-45da-9d83-b96caac39127 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.936369 Sep 16 14:19:47.477176 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2222/4430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:46 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:47.489913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:47.502811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:47.506979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:47.509537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9c247d69-1c06-4a0f-92f2-b088757950ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.759891 Sep 16 14:19:47.522485 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2209/4431] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:46 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:47.531221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.532646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.533415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.534454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.535439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.536245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.567341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:47.584483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.592697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.593336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.802849 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] HTTP exception thrown: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb is locked Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Request method failure captured: Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action HTTP/1.1 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 15 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIRXx5WnZlChrhhpAc9BCgpT5hSLUirttqocULdnP1XI5qL8AqYTPlgehGobW3mIyXaGYjuEWmY8n7oL5TYpIVyDuVZ_4vj4MtPGWdGSrY3rzSEaadoSEv4eDD3TdCJB9cKtU60yOuE2cNWiSGUKWx7-tWLOf6LbHQvB56Ry6CQCEg0 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c22dd0c01bde40a0a0f194f91e180d03", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}] Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerActionsTestJSON-688292966 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7b08b72cf46345f2a3c88a6251b1c996 Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: {"os-stop": {}} Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb is locked Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '138dc7b6-7648-46cc-9712-c32e2ab8fcdb', 'body': {'os-stop': {}}} Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb is locked Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb is locked Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb is locked Sep 16 14:19:47.806103 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:19:47.811471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Returning 409 to user: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb is locked {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:19:47.811471 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e689019-e3fa-44c4-830a-d7e4a7b38cdc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 409 len: 107 microversion: 2.1 time: 0.246661 Sep 16 14:19:47.824552 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2210/4432] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:47 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 107 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:19:47.851152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:47.852658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:47.880286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.883508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.884617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.887999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.891229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:47.891894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.892936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.915165 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6009cedd-c43d-4a80-97b9-4100aa24f166 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1319 microversion: 2.1 time: 0.428513 Sep 16 14:19:47.918984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2223/4433] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:47 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:47.932252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:47.935737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:47.957483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.963704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.967184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:47.972060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:47.973098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:47.973834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.117094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Unlocking {{(pid=128642) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 16 14:19:48.289786 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9a79a08-929f-4b28-95cc-9de3a498bed5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.369086 Sep 16 14:19:48.293426 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2224/4434] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:47 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:19:48.303622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83eaa498-fbcb-4107-8cf5-b978959bb341 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:48.321812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83eaa498-fbcb-4107-8cf5-b978959bb341 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.322348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83eaa498-fbcb-4107-8cf5-b978959bb341 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.329030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83eaa498-fbcb-4107-8cf5-b978959bb341 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.351089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:48.393270 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3a290c7-e7aa-4f9a-8457-4a4352844bda tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1505 microversion: 2.1 time: 0.552079 Sep 16 14:19:48.396630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-83eaa498-fbcb-4107-8cf5-b978959bb341 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Going to try to stop instance {{(pid=128642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:19:48.398239 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2211/4435] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:47 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:48.427270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:48.439479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:48.467849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.469183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.470294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.473657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.477312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.479662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.544654 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-83eaa498-fbcb-4107-8cf5-b978959bb341 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.247944 Sep 16 14:19:48.546755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2225/4436] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:48 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:19:48.562979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:48.566227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:48.581046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.581580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.582014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.582771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.587145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.587646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.601839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:48.608828 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59bed818-32f5-4745-9668-1e0921404b89 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995/os-instance-actions/req-20c6852d-74c0-4fd0-9a08-36ea21e57e02" status: 200 len: 313 microversion: 2.1 time: 0.189346 Sep 16 14:19:48.610005 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2212/4437] 10.222.0.60 () {58 vars in 1419 bytes} [Fri Sep 16 14:19:48 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995/os-instance-actions/req-20c6852d-74c0-4fd0-9a08-36ea21e57e02 => generated 313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:48.624467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:48.625272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:48.643129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.644678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.645651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:48.647357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:48.651546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:48.655040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:49.212819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:49.235227 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-743553fc-4030-46f7-9bf2-ac06a2adc919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.622982 Sep 16 14:19:49.236114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2213/4438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:48 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:49.249105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:49.258187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:49.269794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:49.271978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:49.273320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:49.274074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:49.276709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:49.277472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:49.279054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:49.289802 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d58bbcb6-68f1-40e5-b7dc-288add80b835 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.740254 Sep 16 14:19:49.297752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2226/4439] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:48 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:49.331848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:49.339928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:49.367895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:49.369160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:49.371213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:49.379477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:49.382703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:49.383759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:49.450670 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3034d143-c812-4a02-9a26-1d897c5c194a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "POST /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995/action" status: 202 len: 0 microversion: 2.1 time: 0.212370 Sep 16 14:19:49.452586 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2214/4440] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:19:49 2022] POST /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:19:49.472111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:49.473021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:49.486439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:49.491122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:49.494597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:49.498009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:49.500805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:49.503861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:50.079581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:50.093747 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9eb7925-19c1-489b-bd57-7bf387261244 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1507 microversion: 2.1 time: 0.625161 Sep 16 14:19:50.102645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2215/4441] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:49 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:50.189745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:50.203049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c9c6f4d-2def-4467-8741-fd3ef5da840c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1469 microversion: 2.1 time: 0.895601 Sep 16 14:19:50.205350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2227/4442] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:49 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1469 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:50.278170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:50.280883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:50.310874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:50.311990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:50.314566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:50.318800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:50.318800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:50.321084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:50.624847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2093515830", "block_migration": true, "disk_over_commit": false}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:50.652451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:50.708684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:50.709579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:50.715887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:50.717417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:50.718159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:50.718856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:50.902665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:50.931365 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bcacad10-7778-4a2e-930d-372361cf6777 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.671964 Sep 16 14:19:50.936472 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2216/4443] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:50 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:50.968033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:50.969253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:50.978941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:50.979522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:50.979866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:50.980594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:50.981046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:50.981468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:51.226778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lazy-loading 'flavor' on Instance uuid 0ca04c82-192b-4332-a1fa-403ea76d08b8 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:19:51.263385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Going to try to live migrate instance to tempest-host-2093515830 {{(pid=128642) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:19:51.288046 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] HTTP exception thrown: Compute host tempest-host-2093515830 could not be found. Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Request method failure captured: Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8/action HTTP/1.1 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 107 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIXptAgAnfiWbtZT307UQgKJCNTcsNoV_8hOoSnHhTMkJuMuS7T3pDqW18QUJRP_T5tcKAnvHcpC8vvQAJ8A-DGscMWde8h5T1VWlG0HYjB-ta4XtgHG2Yf4K3CcruQautLMXYoti6LRfDpRqjsW1eWA4BzP_mH20z2wqO6DbdgQ--g Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 23f590ac12564e6e81fd27cff23d06b9 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-LiveMigrationNegativeTest-495095453 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23f590ac12564e6e81fd27cff23d06b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23f590ac12564e6e81fd27cff23d06b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23f590ac12564e6e81fd27cff23d06b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23f590ac12564e6e81fd27cff23d06b9"}]}] Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-LiveMigrationNegativeTest-495095453 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 23f590ac12564e6e81fd27cff23d06b9 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-495095453 Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-LiveMigrationNegativeTest-495095453-project-admin Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 78b814751c6c4465a58523ff5f6d745f Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-LiveMigrationNegativeTest-495095453-project-admin Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: {"os-migrateLive": {"host": "tempest-host-2093515830", "block_migration": true, "disk_over_commit": false}} Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: exception: Compute host tempest-host-2093515830 could not be found. Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0ca04c82-192b-4332-a1fa-403ea76d08b8', 'body': {'os-migrateLive': {'host': 'tempest-host-2093515830', 'block_migration': True, 'disk_over_commit': False}}} Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 16 14:19:51.318478 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2093515830 could not be found. Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2093515830 could not be found. Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2093515830 could not be found. Sep 16 14:19:51.324604 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:19:51.331440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Returning 400 to user: Compute host tempest-host-2093515830 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:19:51.332584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-099c9d96-dc96-454a-b80b-4fde8fe2073b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8/action" status: 400 len: 100 microversion: 2.1 time: 1.074489 Sep 16 14:19:51.333868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2228/4444] 10.222.0.60 () {60 vars in 1279 bytes} [Fri Sep 16 14:19:50 2022] POST /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8/action => generated 100 bytes in 1076 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:19:51.342457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:51.344212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:51.361903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:51.364281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:51.366740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:51.369650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:51.372366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:51.374390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:51.583752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:51.608033 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3bc14d86-2392-4895-b656-ed0387bffc53 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.670324 Sep 16 14:19:51.614326 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2217/4445] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:50 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:51.642103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:51.654302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:51.671227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:51.672813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:51.673604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:51.676488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:51.677181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:51.677792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:51.852046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:51.856848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:51.875154 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-855896ba-63db-4e75-9fa1-f61bbb1cae17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1507 microversion: 2.1 time: 0.537489 Sep 16 14:19:51.876821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2229/4446] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:51 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:51.982342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:51.983009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:51.983665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:51.996430 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e678b8c-3564-4ab7-87f0-ebd98e25d63b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1469 microversion: 2.1 time: 0.377450 Sep 16 14:19:51.997419 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2218/4447] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:51 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:52.009636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:52.010538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:52.011167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:52.012749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:52.013805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:52.017342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:52.397647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1218549361", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:19:52.641392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:19:52.702913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:52.739403 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-845616c5-6421-4730-8462-4f36967805c0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.761429 Sep 16 14:19:52.762600 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2230/4448] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:51 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:52.774423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:52.788510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:52.822263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:52.827269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:52.827734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:52.831077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:52.839652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:52.841568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:53.659831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:19:53.660672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:19:53.663534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:19:53.664885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:19:53.665635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:19:53.771889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:53.778811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:53.788506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:53.790009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:53.799262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:53.800167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:53.856636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:19:53.881501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Getting quotas for project 330f65aebd344c99b97cdcddb5ca9637. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:19:53.895269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Getting quotas for user 2d4685e0517e49a5a9bed15b266aa244 and project 330f65aebd344c99b97cdcddb5ca9637. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:19:53.897515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:53.930099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe4b4b55-386a-4f95-8552-9b321fde282e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 1.166709 Sep 16 14:19:53.931436 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2231/4449] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:52 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:53.953290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:53.953864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:19:53.965289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:53.965699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:19:53.985954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:53.990385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:53.995970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:53.997309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.000210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.000901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.090963 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-deee1409-ed16-458a-849b-b47eec1cbf28 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697198 Sep 16 14:19:54.097718 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2219/4450] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:19:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:19:54.106208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:54.107851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:54.117528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.118752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.119526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.120447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.120951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.121373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.607886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:54.616899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2030594-d01f-4c7d-b4ad-9efd74476164 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1505 microversion: 2.1 time: 0.683542 Sep 16 14:19:54.652154 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2232/4451] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:53 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:54.657567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-400ee13b-d5c8-49aa-a36a-26a840545b3f tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:54.667318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-400ee13b-d5c8-49aa-a36a-26a840545b3f tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:54.807076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:54.819206 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-675b685f-a198-466b-a8f5-e4ddbbfe9b8c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.725805 Sep 16 14:19:54.823988 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2220/4452] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:54 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:54.845194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-400ee13b-d5c8-49aa-a36a-26a840545b3f tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:54.847271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '.version_select at 0x7f724c45e9d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:54.847965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:54.853468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-400ee13b-d5c8-49aa-a36a-26a840545b3f tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1219 microversion: 2.1 time: 0.199681 Sep 16 14:19:54.868043 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2233/4453] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:54 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:54.871237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.871725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.872184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.872919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.873384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.873816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.958926 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3abdd6c3-968e-4ebc-9c38-82a9a545be3e tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.137862 Sep 16 14:19:54.959923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2221/4454] 10.222.0.60 () {58 vars in 1296 bytes} [Fri Sep 16 14:19:54 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995/os-instance-actions => generated 611 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:19:54.970999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:54.972537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:54.982826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:54.983326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:54.985126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.985960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.986707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.988931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.996260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:54.996651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:54.996821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:54.997323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.001087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.009708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.011828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.019483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.085643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:19:55.273945 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e5dc248-7626-4a29-98f9-84e3e4f67cbd tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "DELETE /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 204 len: 0 microversion: 2.1 time: 0.295328 Sep 16 14:19:55.274973 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2222/4455] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:19:54 2022] DELETE /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:19:55.309505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:55.311099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:55.321976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.323588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.324300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.325388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.326132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.326841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.608064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:55.649038 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7fcb5980-b020-413b-9031-57491410a08a tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.681935 Sep 16 14:19:55.650087 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2234/4456] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:54 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:55.866327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:55.872395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:55.876429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:55.886343 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-623b96eb-c67f-47d7-8f91-2130d1116e40 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1511 microversion: 2.1 time: 0.599992 Sep 16 14:19:55.890308 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2223/4457] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:55 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:55.897691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:55.904864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:55.905803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.907332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.911110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.915294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.921493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.923035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.940731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.943808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.944278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:55.954446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:55.954446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:55.954446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:56.113604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:56.123379 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8399fc66-4d4a-4bd9-95a5-bfc2ddb1a715 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1271 microversion: 2.1 time: 0.231774 Sep 16 14:19:56.134028 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2224/4458] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:55 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:56.272193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:56.315083 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-113d13a0-84a6-419e-8fee-e4eb4fc20db8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.450884 Sep 16 14:19:56.316405 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2235/4459] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:55 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:19:56.688831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:56.689892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:56.704543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:56.712186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:56.716087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:56.717066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:56.720927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:56.724644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:56.935537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:56.943562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:57.017166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:57.018105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:57.036662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:57.038247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:57.039122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:57.063074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:57.380762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:57.391779 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1d8ab2b-88c8-4ea2-b422-3df41a53d85f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.708544 Sep 16 14:19:57.406439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2225/4460] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:56 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:57.408006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:57.408766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:57.424108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:57.424665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:57.425113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:57.425870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:57.426360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:57.426832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:57.664623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:57.679294 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb0547f3-f143-4baa-9bc7-3c3f422a09bf tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1277 microversion: 2.1 time: 0.281707 Sep 16 14:19:57.680267 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2226/4461] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:57 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:57.700746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:57.701083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:57.715330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:57.715827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:57.719187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:57.720151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:57.720661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:57.721115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:57.850755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:57.859261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d438b610-a196-429f-9353-f79de1ac14b0 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1511 microversion: 2.1 time: 0.932894 Sep 16 14:19:57.859874 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2236/4462] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:56 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1511 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:58.426585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:58.430847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:58.475568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:58.476457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:58.481741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:58.483259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:58.484183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:58.485850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:58.942725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:19:58.993447 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b8f429c-41a0-41d0-9c22-70c09c653d79 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 1.311893 Sep 16 14:19:59.010439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2227/4463] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:57 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:19:59.051411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:19:59.053306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:19:59.097376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:59.105033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:59.110948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:19:59.114316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:19:59.126026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:19:59.127215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:00.147084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:00.173785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d30f7328-4390-4b47-addd-ca27509265da tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1277 microversion: 2.1 time: 1.148949 Sep 16 14:20:00.174922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2228/4464] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:59 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1277 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:00.199346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:00.207471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:00.246324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:00.247161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:00.248638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:00.250290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:00.251387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:00.252404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:00.407596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:00.408055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:00.408836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:00.409738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lazy-loading 'fault' on Instance uuid 598a047d-d289-4110-a5a9-27b9eb0b7995 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:20:00.752342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:00.765386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4543eb6-cf19-437c-a0f2-c21636214f60 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 2.347644 Sep 16 14:20:00.787807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2237/4465] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:19:58 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:20:00.792693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:00.793873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:00.804995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:00.807485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:00.808264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:00.809255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:00.811176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:00.812120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:01.708308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85c0174589024f7bac7ad4cf7bdbebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674e7e806e7c488188c319d86f8f9d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:01.741308 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b0809af-505b-4518-9d7a-c966af50d88a tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 200 len: 1306 microversion: 2.1 time: 1.557966 Sep 16 14:20:01.742553 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2229/4466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:00 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 1306 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:01.749448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a1d354fb-e882-4e83-891e-3958bd88bde1 req-ea51894f-858d-432a-97dd-f0679646e0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598a047d-d289-4110-a5a9-27b9eb0b7995", "name": "network-vif-deleted", "tag": "29e700c1-c003-4c5a-9489-c75d72323b6b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:01.760924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:01.764564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a1d354fb-e882-4e83-891e-3958bd88bde1 req-ea51894f-858d-432a-97dd-f0679646e0a1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:01.765693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a1d354fb-e882-4e83-891e-3958bd88bde1 req-ea51894f-858d-432a-97dd-f0679646e0a1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:01.768638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a1d354fb-e882-4e83-891e-3958bd88bde1 req-ea51894f-858d-432a-97dd-f0679646e0a1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:01.791610 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a1d354fb-e882-4e83-891e-3958bd88bde1 req-ea51894f-858d-432a-97dd-f0679646e0a1 service nova] Creating event network-vif-deleted:29e700c1-c003-4c5a-9489-c75d72323b6b for instance 598a047d-d289-4110-a5a9-27b9eb0b7995 on n-h1-858129-2 Sep 16 14:20:01.799639 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a1d354fb-e882-4e83-891e-3958bd88bde1 req-ea51894f-858d-432a-97dd-f0679646e0a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055001 Sep 16 14:20:01.801067 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2230/4467] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:01.811538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:01.812551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:01.826028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:01.828448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:01.829501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:01.831319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:01.832115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:01.832797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.139824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:02.159086 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-743810a5-5899-41e8-9200-cc33e1cf9808 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1655 microversion: 2.1 time: 1.387221 Sep 16 14:20:02.178438 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2238/4468] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:00 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1655 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:02.188359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:02.189479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:02.212377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.218445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.222024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.229944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.231050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.231829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.310779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:02.324378 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-58b4a150-0e2a-4c68-b11b-98ad64184082 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.520756 Sep 16 14:20:02.325758 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2231/4469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:01 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:02.331542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:02.332448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:02.340701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.341498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.342178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.343121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.343889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.344576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.403088 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86376e2b-35d0-4d0c-b94e-17d2e9bbb2b4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/ips" status: 200 len: 152 microversion: 2.20 time: 0.075253 Sep 16 14:20:02.417836 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2232/4470] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Sep 16 14:20:02 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/ips => generated 152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:20:02.428776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-980e96d4-00ea-48cf-8d40-3f0d4f2d6e04 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:02.442962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e96d4-00ea-48cf-8d40-3f0d4f2d6e04 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.443901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e96d4-00ea-48cf-8d40-3f0d4f2d6e04 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.444744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e96d4-00ea-48cf-8d40-3f0d4f2d6e04 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.519331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-980e96d4-00ea-48cf-8d40-3f0d4f2d6e04 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Going to try to start instance {{(pid=128643) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 14:20:02.646595 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-980e96d4-00ea-48cf-8d40-3f0d4f2d6e04 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.224845 Sep 16 14:20:02.648513 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2233/4471] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:02 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:02.660901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:02.661680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:02.694666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.699320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.702686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.703776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.712833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.714382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.750253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:02.818694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:02.833493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee6a391e-db68-4a74-b58a-034f31eae167 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.664875 Sep 16 14:20:02.862440 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2239/4472] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:02 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:02.889356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:02.890858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] [instance: 598a047d-d289-4110-a5a9-27b9eb0b7995] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:02.906629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.907972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.909592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.910693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:02.911846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:02.912978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:02.932452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] HTTP exception thrown: Instance 598a047d-d289-4110-a5a9-27b9eb0b7995 could not be found. Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Request method failure captured: Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 HTTP/1.1 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIXgJwTpi0zS-4pUWkZvsGeiKwPuf-3LgHwrKvczrvtSAm2UiUprmRTzD2vzuBT1lG4Ogu5vahSOFP3d33QlFKaTiKB0CLHyxrPCHj5KiABpxlDeNVmoYkGfUFD-_JdgnDtLKBuYrv6SPCTXdCkrcyKCPF0Ru0T6NSfs9CrqwQ1_a2A Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 674e7e806e7c488188c319d86f8f9d84 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-InstanceActionsTestJSON-460446418 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_674e7e806e7c488188c319d86f8f9d84", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/674e7e806e7c488188c319d86f8f9d84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/674e7e806e7c488188c319d86f8f9d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/674e7e806e7c488188c319d86f8f9d84"}]}] Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-InstanceActionsTestJSON-460446418 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 674e7e806e7c488188c319d86f8f9d84 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-InstanceActionsTestJSON-460446418 Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-InstanceActionsTestJSON-460446418-project Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 85c0174589024f7bac7ad4cf7bdbebaa Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-InstanceActionsTestJSON-460446418-project Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 598a047d-d289-4110-a5a9-27b9eb0b7995 could not be found. Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '598a047d-d289-4110-a5a9-27b9eb0b7995'} Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598a047d-d289-4110-a5a9-27b9eb0b7995 could not be found. Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598a047d-d289-4110-a5a9-27b9eb0b7995 could not be found. Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:02.935646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598a047d-d289-4110-a5a9-27b9eb0b7995 could not be found. Sep 16 14:20:02.942551 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:02.951343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] Returning 404 to user: Instance 598a047d-d289-4110-a5a9-27b9eb0b7995 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:20:02.957527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02fc84ba-db0d-4bde-9479-6d67e5530f17 tempest-InstanceActionsTestJSON-460446418 tempest-InstanceActionsTestJSON-460446418-project] 10.222.0.60 "GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995" status: 404 len: 111 microversion: 2.1 time: 0.096159 Sep 16 14:20:02.968141 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2240/4473] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:02 2022] GET /compute/v2.1/servers/598a047d-d289-4110-a5a9-27b9eb0b7995 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:20:03.388152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:03.389806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:03.428257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:03.436538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:03.439325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:03.448041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:03.448956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:03.450029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:03.501904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:03.534519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae46857f-90bf-42a0-aed4-4c5de1d374d9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1664 microversion: 2.1 time: 0.877766 Sep 16 14:20:03.585862 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2234/4474] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:02 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1664 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:20:03.881404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:03.883237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:03.920672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:03.923628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:03.924170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:03.931749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:03.944193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:03.947673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:03.955694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:03.956027 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-050f7ca2-2819-4caf-acc0-dcb3b0ff8f76 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.587004 Sep 16 14:20:03.957090 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2241/4475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:03 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:03.967971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:03.967971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:04.491588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:04.503795 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a3aae550-e276-49cc-a956-48c7381d984f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.630431 Sep 16 14:20:04.514451 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2235/4476] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:03 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:04.590256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:04.593859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:04.616206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=78 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:04.628129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:04.629602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:04.630740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:04.632393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:04.633543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:04.635211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:04.853825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:05.004302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:05.005339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:05.036342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:05.040687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:05.041740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:05.042970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:05.047516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:05.048434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:05.171597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:05.193207 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-105da3da-d9d0-40e7-9ffa-5d8a504a5a8d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1664 microversion: 2.1 time: 0.610355 Sep 16 14:20:05.236061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2242/4477] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:04 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1664 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:05.555349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:05.561386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:05.599629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:05.601734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:05.602918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:05.610986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:05.612509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:05.617103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:05.715724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:05.760491 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe11b194-4430-46f3-84ba-58feb63de59e tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.747004 Sep 16 14:20:05.762253 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2236/4478] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:04 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:20:06.023560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:06.038531 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d8d31da-33ea-4846-bafb-0b9ee61c88e0 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.496870 Sep 16 14:20:06.055161 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2243/4479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:05 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:06.247894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:06.251683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:06.270253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:06.271434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:06.272052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:06.273170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:06.273875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:06.274441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:06.546334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:06.601404 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8db7a837-1277-4762-a589-b51b16be8f5c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.363286 Sep 16 14:20:06.612172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2237/4480] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:06 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:06.652911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:06.654738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:06.663604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:06.664519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:06.666521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:06.668294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:06.668901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:06.669445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:06.814560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:06.816060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:06.830666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:06.832443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:06.833921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:06.836330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:06.838257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:06.839354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.078955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:07.095595 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69aa20ac-bf61-4e09-890b-255fd48ad0ce tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.451587 Sep 16 14:20:07.096481 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2244/4481] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:06 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:07.101670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:07.103812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:07.121649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.127342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.128115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.129052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.129728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.131104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.237592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:07.254628 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dda9a467-e65e-41ae-82f4-9aef04bf9e78 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.454817 Sep 16 14:20:07.258709 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2238/4482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:06 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:07.276740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:07.278057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:07.287528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.288970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.289906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.291729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.293323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.294913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.370610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Unlocking {{(pid=128643) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 16 14:20:07.466869 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3a8c0a6-c250-4331-8f8a-0d4815599dbe tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.206742 Sep 16 14:20:07.467866 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2239/4483] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:07 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:07.477879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:07.482237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:07.498799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.500509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.501403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.502664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.503895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.505250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.548249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:07.561216 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef25816d-1629-4393-ac39-a2cc4ed1e6a9 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.463420 Sep 16 14:20:07.563202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2245/4484] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:07 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:07.573272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e3c20f45-b01a-4373-a2f7-3283f41f99ce req-12a2f9af-39a2-44ff-85b9-a35a69771d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef04c10e-16a9-4508-b71c-bbab6320d996", "tag": "c00b799c-3038-4487-9407-741fe77db3a0"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:07.577342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lazy-loading 'flavor' on Instance uuid 71ac39ea-a915-4f5b-991a-f086e509d8ba {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:20:07.632671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e3c20f45-b01a-4373-a2f7-3283f41f99ce req-12a2f9af-39a2-44ff-85b9-a35a69771d56 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.634861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e3c20f45-b01a-4373-a2f7-3283f41f99ce req-12a2f9af-39a2-44ff-85b9-a35a69771d56 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.637159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e3c20f45-b01a-4373-a2f7-3283f41f99ce req-12a2f9af-39a2-44ff-85b9-a35a69771d56 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.695839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e3c20f45-b01a-4373-a2f7-3283f41f99ce req-12a2f9af-39a2-44ff-85b9-a35a69771d56 service nova] Creating event network-changed:c00b799c-3038-4487-9407-741fe77db3a0 for instance ef04c10e-16a9-4508-b71c-bbab6320d996 on n-h2-858129-2 Sep 16 14:20:07.750657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e3c20f45-b01a-4373-a2f7-3283f41f99ce req-12a2f9af-39a2-44ff-85b9-a35a69771d56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184159 Sep 16 14:20:07.751897 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2246/4485] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:07.784213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:07.785607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:07.805657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.807571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.809084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.811321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.814421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.815911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.950519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee286454-ec27-4082-aa03-96063d38f641 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/action" status: 202 len: 0 microversion: 2.20 time: 0.478687 Sep 16 14:20:07.957601 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2240/4486] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:20:07 2022] POST /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:20:07.974009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:07.974009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:07.990108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.990762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.991344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:07.992213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:07.992804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:07.993408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:08.397240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:08.415405 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c983e60-fd46-488a-aa01-006557aa74e3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.654035 Sep 16 14:20:08.416118 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2247/4487] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:07 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:08.421182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:08.430029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:08.439081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:08.450981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:08.451525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:08.452308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:08.452799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:08.453242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:08.496691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:08.530037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:08.548162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:08.550239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8e10b28c-4f0f-4684-8e2f-9e01f5679008 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 0.591439 Sep 16 14:20:08.556895 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2241/4488] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:07 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:08.570682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:08.574379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:08.588001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:08.588660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:08.589364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:08.590725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:08.600436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:08.601070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:09.146995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:09.163248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:09.168756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f75de67c-1a78-4b7b-a9d5-b57cfd07f5a8 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.750910 Sep 16 14:20:09.171194 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2248/4489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:08 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:09.182940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:09.184441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:09.213719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:09.215203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:09.216422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:09.218070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:09.219543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:09.220719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:09.313507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:09.355272 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c330c06-c8e5-4793-853e-3f842b640ddd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.791543 Sep 16 14:20:09.358842 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2242/4490] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:08 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:09.411574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:09.413295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:09.426159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:09.427592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:09.428752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:09.430668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:09.432513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:09.433655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:09.784240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:09.801036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aba4ad91-9394-438b-b176-57a53d26c650 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1524 microversion: 2.1 time: 0.626748 Sep 16 14:20:09.803534 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2249/4491] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:09 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1524 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:09.830548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:09.834131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:09.877185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:09.878157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:09.881404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:09.883369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:09.888820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:09.892806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.005451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:10.036655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a733f9c-f49e-4c90-8979-626f07b69e58 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.630071 Sep 16 14:20:10.038065 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2243/4492] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:09 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:20:10.100733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:10.104812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:10.116519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:10.117904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:10.120157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.123514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:10.125005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:10.126074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.351592 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e35a0d5-906c-4dd3-a1d8-bd60c197ffee tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.265152 Sep 16 14:20:10.352671 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2244/4493] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:10 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:10.363421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:10.365033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:10.377935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:10.379266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:10.380506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.383265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:10.384693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:10.385741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.455811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:10.718360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:10.749978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:10.765801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:10.772502 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65226126-5a78-46bb-bd61-e35f3af88ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 0.966132 Sep 16 14:20:10.780986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2250/4494] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:09 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:10.799671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:10.801620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:10.823240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:10.824280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:10.830118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.832259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:10.833373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:10.838666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:10.938604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:10.959717 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca23936d-0180-4116-82c7-6b60979937c6 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.603907 Sep 16 14:20:10.961144 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2245/4495] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:10 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:11.004457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:11.005295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:11.020704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:11.022170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:11.024054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:11.027150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:11.028207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:11.029158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:11.780265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:11.816609 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-065e8130-7b61-44f6-b39c-057bcb3be2da tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1653 microversion: 2.1 time: 1.033588 Sep 16 14:20:11.820870 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2251/4496] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:10 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1653 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:11.829772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:11.835332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:11.848165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:11.855663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:11.856621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:11.857994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:11.858786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:11.859853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:11.929895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:11.950882 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1cbdbb68-e708-4e88-bcff-7c684893ea97 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1504 microversion: 2.1 time: 0.982679 Sep 16 14:20:11.955385 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2246/4497] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:10 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1504 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:11.972159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:11.974264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:11.988395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:11.992395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:11.993277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:11.996735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:11.998754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:12.001216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:12.167549 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7b76b1a-fe73-4f29-9bf5-8c64a71fa017 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.209080 Sep 16 14:20:12.175148 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2247/4498] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:11 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:12.194582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:12.196713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:12.219808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:12.220576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:12.221508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:12.223135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:12.225266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:12.226516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:12.767905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:12.777224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:12.783013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:12.784374 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a5daecb5-7e04-4006-b281-094c7f930d13 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 0.961849 Sep 16 14:20:12.784996 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2252/4499] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:11 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:12.843711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa81d5ac-a02c-4ee4-8cee-1685a5c5898b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'create', calling method: .version_select at 0x7f724c4ac280>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-454533123", "description": "tempest-description-639163174"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:13.062271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:13.094189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb8c6a0c-b973-4f1d-988e-6c9244a18c68 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.915736 Sep 16 14:20:13.113683 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2248/4500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:12 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:13.126187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:13.127511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:13.147744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:13.148995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:13.151571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:13.155343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:13.157636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:13.157958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:14.861880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa81d5ac-a02c-4ee4-8cee-1685a5c5898b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 2.048668 Sep 16 14:20:14.862541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2253/4501] 10.222.0.60 () {60 vars in 1180 bytes} [Fri Sep 16 14:20:12 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:14.874165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:14.876362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:14.902252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:14.908899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:14.909929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:14.912315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:14.912718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:14.915354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:15.028042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:15.047259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79f54f71-e7af-4ffb-8797-7df2d0346b93 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.931154 Sep 16 14:20:15.066438 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2249/4502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:13 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:15.066438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:15.068395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:15.080172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:15.080172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:15.080172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:15.080172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:15.080172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:15.080172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:15.639847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:15.658354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d3e06d9b-1d7d-4aac-bb32-c5b2f1e16e72 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.601806 Sep 16 14:20:15.659413 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2250/4503] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:15 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:15.670173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-454533123"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:15.670757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:15.682344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:15.701278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:15.702808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:15.704064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a37da3c-edb5-4a1c-b10b-70ff69bcfc2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 0.840060 Sep 16 14:20:15.706500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:15.707052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:15.707492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:15.708242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:15.708684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:15.709123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:15.716040 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2254/4504] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:14 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:15.735371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:15.739081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:15.755806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:15.757872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:15.758706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:15.760543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:15.761280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:15.761892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:16.359932 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.network.security_group_api [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Adding security group a46e9d6c-ead1-4079-bfc0-55acf2e6dccb to port 5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 Sep 16 14:20:16.448874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:16.474010 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44b6e3be-b058-48c7-b80b-a430790137ca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.754806 Sep 16 14:20:16.478166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2255/4505] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:15 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:16.518241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:16.519468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:16.532054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:16.533578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:16.534782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:16.535911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:16.537142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:16.538784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:17.447661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:17.470215 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec97fb58-708b-4b3b-a9ba-375297ae40c8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.968541 Sep 16 14:20:17.473567 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2256/4506] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:16 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:17.495588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:17.497174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:17.522709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:17.523606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:17.524546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:17.543742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:17.553318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:17.554224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:18.397278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59175fc2-c7f5-4a6d-b369-42e36a7c963b tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action" status: 202 len: 0 microversion: 2.1 time: 2.735454 Sep 16 14:20:18.405269 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2251/4507] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:15 2022] POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action => generated 0 bytes in 2744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:18.409041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:18.426674 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-740538a7-b588-4337-b74c-e1271cb59f1c tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1319 microversion: 2.1 time: 0.937918 Sep 16 14:20:18.428290 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2257/4508] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:17 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1319 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:18.438592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d5aa8e68-8285-4e2a-a8dc-4b6a6cb56d8b req-369d5b94-34d6-41e0-9d7b-5a284af6667e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef04c10e-16a9-4508-b71c-bbab6320d996", "name": "network-vif-plugged", "status": "completed", "tag": "c00b799c-3038-4487-9407-741fe77db3a0"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:18.441857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:18.443305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:18.457967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d5aa8e68-8285-4e2a-a8dc-4b6a6cb56d8b req-369d5b94-34d6-41e0-9d7b-5a284af6667e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:18.458719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d5aa8e68-8285-4e2a-a8dc-4b6a6cb56d8b req-369d5b94-34d6-41e0-9d7b-5a284af6667e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:18.459408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d5aa8e68-8285-4e2a-a8dc-4b6a6cb56d8b req-369d5b94-34d6-41e0-9d7b-5a284af6667e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:18.468982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:18.469857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:18.472888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:18.480227 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d5aa8e68-8285-4e2a-a8dc-4b6a6cb56d8b req-369d5b94-34d6-41e0-9d7b-5a284af6667e service nova] Creating event network-vif-plugged:c00b799c-3038-4487-9407-741fe77db3a0 for instance ef04c10e-16a9-4508-b71c-bbab6320d996 on n-h2-858129-2 Sep 16 14:20:18.486629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:18.487393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:18.488110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:18.489519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d5aa8e68-8285-4e2a-a8dc-4b6a6cb56d8b req-369d5b94-34d6-41e0-9d7b-5a284af6667e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059141 Sep 16 14:20:18.490792 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2258/4509] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:18.501165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:18.503043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:18.513875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:18.514798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:18.515462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:18.518357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:18.519363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:18.520034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.108631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:19.110298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:19.125794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:19.129480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:19.132053 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9690f8dd-f5bc-49c8-bdfe-0804ed43dece tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 0.724807 Sep 16 14:20:19.147048 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ece12e4-da29-4f8d-9602-d24d3da89f36 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.648135 Sep 16 14:20:19.147048 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2259/4510] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:18 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:19.147948 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2252/4511] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:18 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:19.186770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-83b65e91-d866-41dd-8e10-84e9a1412961 req-f15a51e7-f8ec-471e-8e24-75369b34d6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:19.218307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-83b65e91-d866-41dd-8e10-84e9a1412961 req-f15a51e7-f8ec-471e-8e24-75369b34d6d0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.219495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-83b65e91-d866-41dd-8e10-84e9a1412961 req-f15a51e7-f8ec-471e-8e24-75369b34d6d0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.220240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-83b65e91-d866-41dd-8e10-84e9a1412961 req-f15a51e7-f8ec-471e-8e24-75369b34d6d0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.241586 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-83b65e91-d866-41dd-8e10-84e9a1412961 req-f15a51e7-f8ec-471e-8e24-75369b34d6d0 service nova] Creating event network-changed:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:20:19.252203 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-83b65e91-d866-41dd-8e10-84e9a1412961 req-f15a51e7-f8ec-471e-8e24-75369b34d6d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101598 Sep 16 14:20:19.253874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2253/4512] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:19.265296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-454533123"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:19.266714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:19.279096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.280366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.282509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.284308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.285502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.286546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.598031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1798966736", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:19.686357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:20:19.687232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:20:19.687921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:20:19.688500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:20:19.689079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:20:19.701227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.702076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.702941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.704011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.704518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.705150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.716913 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.network.security_group_api [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Removing security group a46e9d6c-ead1-4079-bfc0-55acf2e6dccb from port 5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 Sep 16 14:20:19.731314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Getting quotas for project c3a92f54ff5e40f584f47f990e2ce82c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:20:19.740195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Getting quotas for user d27093df5e3843a6824cdea9b3d2d188 and project c3a92f54ff5e40f584f47f990e2ce82c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:20:19.757549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:20:19.767496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:20:19.847603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd2c5310-c820-477e-82f9-8592b6e7c45e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.697793 Sep 16 14:20:19.849395 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2260/4513] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:20:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:20:19.868323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:19.870178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:19.898125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.898668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.899134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:19.899970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:19.901008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:19.901450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:21.113239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:21.124021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ecacdb7-2e6c-4e39-aab8-80df93a8e9af tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.266695 Sep 16 14:20:21.125290 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2261/4514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:19 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:21.151748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:21.154003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:21.162004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:21.163009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:21.163744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:21.164783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:21.165485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:21.166840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:21.824323 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-437ed7ff-1275-44bc-9f93-8bc616d2f0ff tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action" status: 202 len: 0 microversion: 2.1 time: 2.568433 Sep 16 14:20:21.825209 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2254/4515] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:19 2022] POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action => generated 0 bytes in 2571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:21.832010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:21.833608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:21.877869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:21.883634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:21.885619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:21.886831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:21.890678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:21.892660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:22.140881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.170875 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2fc4761e-f8d5-49ff-8769-b8ff23c34cc2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1469 microversion: 2.1 time: 1.019667 Sep 16 14:20:22.172066 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2262/4516] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:21 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1469 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:22.201358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:22.202971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:22.230574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:22.233371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:22.235201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:22.238553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:22.239878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:22.240952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:22.264905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.279855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.282209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.283858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b570a70-5163-4139-a49b-21e18bf8b48e tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 200 len: 1333 microversion: 2.47 time: 0.456580 Sep 16 14:20:22.284689 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2255/4517] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:21 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 1333 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:22.294191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:22.295254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:22.305742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:22.307419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:22.309051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:22.310196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:22.310939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:22.311595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:22.779543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.792972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.799213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.800920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-38ad8679-20d8-430f-b1ae-9c06d4fa93a2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1745 microversion: 2.20 time: 0.619111 Sep 16 14:20:22.808489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2263/4518] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:22 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1745 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:22.819648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d24504b4-d772-4f2c-a7fa-c0cfa65ab80e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'create', calling method: .version_select at 0x7f724c43eaf0>, body: {"pool": null} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:22.856678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:22.867705 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e1751925-7b5a-4f14-b5b1-4c785b6a98c1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.578115 Sep 16 14:20:22.878439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2256/4519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:22 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:22.878439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1419760440", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:23.020711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] validate_networks() for None {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:20:24.037978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:20:24.040327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:20:24.041925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:20:24.043247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:20:24.044330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:20:24.062497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.063893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.064994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:24.066717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.067733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.070572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:24.116659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Getting quotas for project 669931d2145e4d49adc4ac9cd4fbd0b5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:20:24.130712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Getting quotas for user b65213802525402ab4bead244eec6601 and project 669931d2145e4d49adc4ac9cd4fbd0b5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:20:24.162792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:20:24.170928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:20:24.316835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-049650de-e451-4c64-aaed-026dde21d390 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444049 Sep 16 14:20:24.320427 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2257/4520] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:20:24.331432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f2adb950-d59e-4b10-937d-61f32b1ed959 req-46a68aad-b7fe-448b-a09a-4397782e5b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:24.375430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f2adb950-d59e-4b10-937d-61f32b1ed959 req-46a68aad-b7fe-448b-a09a-4397782e5b7e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.376361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f2adb950-d59e-4b10-937d-61f32b1ed959 req-46a68aad-b7fe-448b-a09a-4397782e5b7e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.379311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f2adb950-d59e-4b10-937d-61f32b1ed959 req-46a68aad-b7fe-448b-a09a-4397782e5b7e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:24.411763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f2adb950-d59e-4b10-937d-61f32b1ed959 req-46a68aad-b7fe-448b-a09a-4397782e5b7e service nova] Creating event network-changed:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:20:24.424060 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f2adb950-d59e-4b10-937d-61f32b1ed959 req-46a68aad-b7fe-448b-a09a-4397782e5b7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099980 Sep 16 14:20:24.427283 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2258/4521] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:24.437916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:24.440519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:24.453349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.454751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.456818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:24.458774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.459903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.461180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:24.540771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lazy-loading 'flavor' on Instance uuid ef04c10e-16a9-4508-b71c-bbab6320d996 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:20:24.735167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-33ce86b5-2c5a-4b1c-8ce9-d19ff36b7b1c tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996/action" status: 202 len: 0 microversion: 2.1 time: 0.303627 Sep 16 14:20:24.736191 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2259/4522] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:24 2022] POST /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:24.766623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:24.770285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:24.789147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.790572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.792683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:24.795008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:24.798027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:24.800250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:25.033104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:25.086804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:25.095658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:25.100086 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06164617-26c6-4b45-afa1-53c4a8a2384d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 200 len: 1339 microversion: 2.47 time: 0.361794 Sep 16 14:20:25.101368 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2260/4523] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:24 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 1339 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:25.131532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:25.132995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:25.152126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:25.153128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:25.154012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:25.157257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:25.158195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:25.159024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:26.166435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:26.192966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:26.195461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:26.198045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a6441b00-4ab1-435e-adc7-7b904294237e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1745 microversion: 2.20 time: 1.085378 Sep 16 14:20:26.199079 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2261/4524] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:25 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1745 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:26.205449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1d882de2-7fe8-4f4f-afb1-6c62520d0902 req-48bb4056-3aed-4353-8155-2e9cfc53b853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "name": "network-vif-plugged", "status": "completed", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:26.239248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1d882de2-7fe8-4f4f-afb1-6c62520d0902 req-48bb4056-3aed-4353-8155-2e9cfc53b853 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:26.241547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1d882de2-7fe8-4f4f-afb1-6c62520d0902 req-48bb4056-3aed-4353-8155-2e9cfc53b853 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:26.245059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1d882de2-7fe8-4f4f-afb1-6c62520d0902 req-48bb4056-3aed-4353-8155-2e9cfc53b853 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:26.259983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:26.279487 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1d882de2-7fe8-4f4f-afb1-6c62520d0902 req-48bb4056-3aed-4353-8155-2e9cfc53b853 service nova] Creating event network-vif-plugged:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:20:26.309928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1d882de2-7fe8-4f4f-afb1-6c62520d0902 req-48bb4056-3aed-4353-8155-2e9cfc53b853 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095634 Sep 16 14:20:26.317363 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2262/4525] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:26.330715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:26.338843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:26.356027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:26.357027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:26.357787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:26.360337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:26.362161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:26.363465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:26.823151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:26.833927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4314d043-c87e-4eca-b157-f60434d80975 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1211 microversion: 2.1 time: 0.514458 Sep 16 14:20:26.833927 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2263/4526] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:26 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1211 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:26.839856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:26.840486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:26.851127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:26.851964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:26.856851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:26.858212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:26.859093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:26.862302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:27.391270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d24504b4-d772-4f2c-a7fa-c0cfa65ab80e tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.580392 Sep 16 14:20:27.392481 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2264/4527] 10.222.0.60 () {60 vars in 1170 bytes} [Fri Sep 16 14:20:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:27.410734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:27.412562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:27.414279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:27.424236 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8235bb3-de73-4fa8-ad50-6fc246333516 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1460 microversion: 2.1 time: 0.589079 Sep 16 14:20:27.424854 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2264/4528] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:26 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1460 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:27.444392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:27.445314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:27.446490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:27.448222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:27.449383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:27.450993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:27.451834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:27.455334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:27.475558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:27.476391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:27.477019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:27.478500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:27.479187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:27.479812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:27.922453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:27.982356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:27.989909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:27.998288 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7b3bb516-5d82-4b39-9b07-7607d4b44656 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 200 len: 1339 microversion: 2.47 time: 0.603576 Sep 16 14:20:28.006915 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2265/4529] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:27 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 1339 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:28.023375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.191"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:28.039001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:28.071622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:28.072807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:28.073735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:28.075573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:28.078068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:28.083701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:28.177377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "refresh_cache-4586981e-4f62-4dfe-875e-4e968deaff31" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:20:28.187509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquired lock "refresh_cache-4586981e-4f62-4dfe-875e-4e968deaff31" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:20:28.207604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:28.232471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:28.234299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:28.244605 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-99984207-617c-431e-801a-1a3f8e0cc7a7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1745 microversion: 2.20 time: 0.814519 Sep 16 14:20:28.252116 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2265/4530] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:27 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1745 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:28.263239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:28.264195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:28.285506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:28.286468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:28.306774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:28.307981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:28.308871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:28.309562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:29.634727 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4af66103-56cb-4012-8ab9-00170faf5ca4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1611 microversion: 2.1 time: 1.379843 Sep 16 14:20:29.636425 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2266/4531] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:28 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1611 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:29.646460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:29.661075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:29.687560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:29.688763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:29.692566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:29.695000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:29.696811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:29.698952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:29.717780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:29.751765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:29.944664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:29.963534 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54ddef67-fb7b-48d0-afcb-918be58f51b2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1273 microversion: 2.1 time: 0.320469 Sep 16 14:20:29.964978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2267/4532] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:29 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:29.971633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:29.972617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:29.981063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:29.983095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:29.983851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:29.985074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:29.985802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:29.987174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:30.192976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:30.220017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:30.231569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:30.240965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-adcd16a4-4290-4c44-b149-19da1a6f1edc tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 200 len: 1360 microversion: 2.47 time: 0.274476 Sep 16 14:20:30.246338 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2268/4533] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:29 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 1360 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:30.258118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:30.259107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:30.269586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:30.270767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:30.271471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:30.272432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:30.273168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:30.274199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:31.511414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:31.546044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:31.549785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:31.552557 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-848d428b-b741-47cc-ab24-6f2b2316cbd4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 1.304480 Sep 16 14:20:31.554508 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2269/4534] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:30 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:31.563881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:31.577225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:31.578818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:31.579931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:31.581642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:31.583055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:31.584506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:31.654120 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a529bac-2f3b-4257-9df5-454afad0e2f4 tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097318 Sep 16 14:20:31.670972 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2270/4535] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 14:20:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:31.680524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1084118861"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:31.685050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:31.697829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:31.698651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:31.699700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:31.701564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:31.702887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:31.704004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.204532 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-caa4db02-452c-419d-a20b-3ad212d1c574 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "POST /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141/action" status: 202 len: 52 microversion: 2.47 time: 0.531808 Sep 16 14:20:32.206091 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2271/4536] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:20:31 2022] POST /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141/action => generated 52 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 16 14:20:32.226708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:32.228276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:32.240305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:32.242893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:32.244376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:32.245641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.247353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:32.248146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:32.249010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.434910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:32.453557 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d08851d1-8df6-484c-846e-c3c566e18e18 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1273 microversion: 2.1 time: 0.245287 Sep 16 14:20:32.456091 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2272/4537] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:32 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:32.470974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858129-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:32.477252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:32.492381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:32.494529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:32.496401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.498394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:32.499887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:32.501236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.638693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Lazy-loading 'flavor' on Instance uuid ef04c10e-16a9-4508-b71c-bbab6320d996 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:20:32.689044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance ef04c10e-16a9-4508-b71c-bbab6320d996 while it is in vm_state suspended Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Request method failure captured: Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996/action HTTP/1.1 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 97 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIXptAgAnfiWbtZT307UQgKJCNTcsNoV_8hOoSnHhTMkJuMuS7T3pDqW18QUJRP_T5tcKAnvHcpC8vvQAJ8A-DGscMWde8h5T1VWlG0HYjB-ta4XtgHG2Yf4K3CcruQautLMXYoti6LRfDpRqjsW1eWA4BzP_mH20z2wqO6DbdgQ--g Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 23f590ac12564e6e81fd27cff23d06b9 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-LiveMigrationNegativeTest-495095453 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Role: admin,reader,member Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: admin,reader,member Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23f590ac12564e6e81fd27cff23d06b9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23f590ac12564e6e81fd27cff23d06b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23f590ac12564e6e81fd27cff23d06b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23f590ac12564e6e81fd27cff23d06b9"}]}] Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-LiveMigrationNegativeTest-495095453 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 23f590ac12564e6e81fd27cff23d06b9 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-495095453 Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-LiveMigrationNegativeTest-495095453-project-admin Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 78b814751c6c4465a58523ff5f6d745f Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-LiveMigrationNegativeTest-495095453-project-admin Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: {"os-migrateLive": {"host": "n-h1-858129-2", "block_migration": true, "disk_over_commit": false}} Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot 'os-migrateLive' instance ef04c10e-16a9-4508-b71c-bbab6320d996 while it is in vm_state suspended Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'ef04c10e-16a9-4508-b71c-bbab6320d996', 'body': {'os-migrateLive': {'host': 'n-h1-858129-2', 'block_migration': True, 'disk_over_commit': False}}} Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:32.710335 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance ef04c10e-16a9-4508-b71c-bbab6320d996 while it is in vm_state suspended Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance ef04c10e-16a9-4508-b71c-bbab6320d996 while it is in vm_state suspended Sep 16 14:20:32.715352 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:32.724578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance ef04c10e-16a9-4508-b71c-bbab6320d996 while it is in vm_state suspended {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:20:32.743034 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d7845a7-0808-43a7-ab7d-6995786e8a8b tempest-LiveMigrationNegativeTest-495095453 tempest-LiveMigrationNegativeTest-495095453-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996/action" status: 409 len: 155 microversion: 2.1 time: 0.284311 Sep 16 14:20:32.750666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2273/4538] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:32 2022] POST /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996/action => generated 155 bytes in 288 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:20:32.765503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:32.766971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:32.800176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:32.801545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:32.803757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.805761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:32.807766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:32.809162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:32.899399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:20:33.155462 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-465701eb-1c1e-47c4-9162-1f8fe74dbd83 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 204 len: 0 microversion: 2.47 time: 0.407941 Sep 16 14:20:33.160661 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2274/4539] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:20:32 2022] DELETE /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:20:33.170012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:33.174111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:33.195013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:33.200200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:33.200693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:33.208854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:33.209462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:33.209917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:33.444603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:20:33.628182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:33.646449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:33.653068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:33.655056 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0088662-74c7-48c7-8c5c-05764bf46dbd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.495636 Sep 16 14:20:33.655266 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2275/4540] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:33 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:33.668368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:33.668603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:33.690929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:33.692341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:33.694048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:33.694396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:33.698731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:33.699193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:33.774706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:20:33.848881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:33.999346 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bf59196-e8b4-492f-97bb-246828b01c9b tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 204 len: 0 microversion: 2.1 time: 0.336324 Sep 16 14:20:34.001026 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2276/4541] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:20:33 2022] DELETE /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:20:34.028364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:34.030167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:34.059400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:34.060753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:34.061934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:34.063510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:34.066332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:34.072190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:34.158920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:34.355844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:34.422917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:34.426610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:34.428766 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4e42828-b4b6-498f-bab0-34b628a676e5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 200 len: 1366 microversion: 2.47 time: 0.423379 Sep 16 14:20:34.429833 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2277/4542] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:34 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:34.469419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8abc4cfe-79f6-4442-bd21-780635883ede req-c3a577b6-cac9-4a62-8603-22adcd8a5940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:34.516860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8abc4cfe-79f6-4442-bd21-780635883ede req-c3a577b6-cac9-4a62-8603-22adcd8a5940 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:34.522913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8abc4cfe-79f6-4442-bd21-780635883ede req-c3a577b6-cac9-4a62-8603-22adcd8a5940 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:34.522913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8abc4cfe-79f6-4442-bd21-780635883ede req-c3a577b6-cac9-4a62-8603-22adcd8a5940 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:34.570064 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8abc4cfe-79f6-4442-bd21-780635883ede req-c3a577b6-cac9-4a62-8603-22adcd8a5940 service nova] Creating event network-changed:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:20:34.599662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8abc4cfe-79f6-4442-bd21-780635883ede req-c3a577b6-cac9-4a62-8603-22adcd8a5940 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157676 Sep 16 14:20:34.603282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2278/4543] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:34.635896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:34.638550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:34.681899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:34.685511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:34.687268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:34.690661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:34.692336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:34.696410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:35.340645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:35.377372 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0d5e56d-e416-41c8-b3c6-2ac62057c1de tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.770163 Sep 16 14:20:35.388524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2279/4544] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:34 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:35.414284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:35.418006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:35.450149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:35.455646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:35.456426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:35.457708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:35.458560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:35.459338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:36.669513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Updating instance_info_cache with network_info: [{"id": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0", "address": "fa:16:3e:83:cb:a0", "network": {"id": "ac5da4a3-1bcd-41b9-ba8e-1490ef09e6a5", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-884274418-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b63cdaceb99945cb9c685b43e06845b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5a05f410-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:20:36.728889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Releasing lock "refresh_cache-4586981e-4f62-4dfe-875e-4e968deaff31" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:20:36.729766 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5feec231-7692-4cda-b085-5768c7ba5291 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action" status: 202 len: 0 microversion: 2.1 time: 8.720787 Sep 16 14:20:36.731546 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2266/4545] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:28 2022] POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action => generated 0 bytes in 8723 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:20:36.742027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:36.743036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:36.744350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:36.757579 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3235cbcf-d454-4cd0-a67d-a6263078eff2 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1466 microversion: 2.1 time: 1.365599 Sep 16 14:20:36.759321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:36.762834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:36.765451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:36.766119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:36.767268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:36.769958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:36.771536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:36.779809 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2280/4546] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:35 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1466 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:36.787009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:36.790514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:36.801524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:36.802559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:36.803546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:36.804651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:36.805376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:36.806182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:36.991634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.010697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.018239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd27093df5e3843a6824cdea9b3d2d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a92f54ff5e40f584f47f990e2ce82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.022246 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-700c5b28-0d95-43ec-8390-6d8a1ea43c3d tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 200 len: 1366 microversion: 2.47 time: 0.240315 Sep 16 14:20:37.024692 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2281/4547] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:36 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:37.039931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:37.041438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:37.060354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:37.061986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:37.067115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:37.067115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:37.071801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:37.072587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:37.585193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.627477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.633890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.639450 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b41cd2f-9985-42bd-b1a0-6aace948c216 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.906681 Sep 16 14:20:37.643877 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2267/4548] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:36 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:37.675480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.191"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:37.688781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:37.719381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-63bcbbb8-b5d1-42ab-8751-4fb75007e655 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.690115 Sep 16 14:20:37.720936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2282/4549] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:37 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:37.791300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:37.800220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:37.819793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:37.835770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:37.854265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:37.855834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:37.856603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:37.860780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:38.301181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:38.333503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:38.342662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:38.344059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:38.345925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:38.347220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:38.348317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:38.380341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:38.747545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:38.761560 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e68eecc-1a4c-4481-9ab6-cdfec86608d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 200 len: 1466 microversion: 2.1 time: 0.978742 Sep 16 14:20:38.768339 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2283/4550] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:37 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 1466 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:38.779354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:38.780273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] [instance: 1f53aca3-4f47-4df5-a10b-dc30dd967141] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:38.825740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:38.826397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:38.831792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:38.833042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:38.833269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:38.833712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:38.885879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] HTTP exception thrown: Instance 1f53aca3-4f47-4df5-a10b-dc30dd967141 could not be found. Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Request method failure captured: Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 HTTP/1.1 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIYh73hay98U8Of-4ILNrUbE77ym1qEh2vhZzIo8QqXFfvn_1S8R6I0rxkDWUunNnexer6_oYOeBhhqAk9PxL9THy4xx5ANBHgW8XlNbbgZ9OO51RPBEGVLx1NUboNufm6Jz-TEi-S8jd3nhaOz6ycoDim1dsHdcO5OpDHH_IQF8YmU Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.47 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c3a92f54ff5e40f584f47f990e2ce82c Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersAaction247Test-1370722987 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c3a92f54ff5e40f584f47f990e2ce82c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3a92f54ff5e40f584f47f990e2ce82c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c3a92f54ff5e40f584f47f990e2ce82c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3a92f54ff5e40f584f47f990e2ce82c"}]}] Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersAaction247Test-1370722987 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c3a92f54ff5e40f584f47f990e2ce82c Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersAaction247Test-1370722987 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersAaction247Test-1370722987-project Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: d27093df5e3843a6824cdea9b3d2d188 Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersAaction247Test-1370722987-project Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1f53aca3-4f47-4df5-a10b-dc30dd967141 could not be found. Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1f53aca3-4f47-4df5-a10b-dc30dd967141'} Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f53aca3-4f47-4df5-a10b-dc30dd967141 could not be found. Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f53aca3-4f47-4df5-a10b-dc30dd967141 could not be found. Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:38.887823 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f53aca3-4f47-4df5-a10b-dc30dd967141 could not be found. Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] Returning 404 to user: Instance 1f53aca3-4f47-4df5-a10b-dc30dd967141 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:20:38.894435 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01121352-58e1-466d-9568-63898515c4b5 tempest-ServersAaction247Test-1370722987 tempest-ServersAaction247Test-1370722987-project] 10.222.0.60 "GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141" status: 404 len: 111 microversion: 2.47 time: 0.123667 Sep 16 14:20:38.901166 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2284/4551] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:38 2022] GET /compute/v2.1/servers/1f53aca3-4f47-4df5-a10b-dc30dd967141 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:20:38.917993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d2231ed5-2cce-4b9c-a519-5e63d85cf6fb req-946d5ee6-2a37-4b02-b8bf-643a6dd1738c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef04c10e-16a9-4508-b71c-bbab6320d996", "name": "network-vif-deleted", "tag": "c00b799c-3038-4487-9407-741fe77db3a0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:38.961149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d2231ed5-2cce-4b9c-a519-5e63d85cf6fb req-946d5ee6-2a37-4b02-b8bf-643a6dd1738c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:38.965831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d2231ed5-2cce-4b9c-a519-5e63d85cf6fb req-946d5ee6-2a37-4b02-b8bf-643a6dd1738c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:38.967009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d2231ed5-2cce-4b9c-a519-5e63d85cf6fb req-946d5ee6-2a37-4b02-b8bf-643a6dd1738c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:39.006101 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d2231ed5-2cce-4b9c-a519-5e63d85cf6fb req-946d5ee6-2a37-4b02-b8bf-643a6dd1738c service nova] Creating event network-vif-deleted:c00b799c-3038-4487-9407-741fe77db3a0 for instance ef04c10e-16a9-4508-b71c-bbab6320d996 on n-h2-858129-2 Sep 16 14:20:39.019030 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d2231ed5-2cce-4b9c-a519-5e63d85cf6fb req-946d5ee6-2a37-4b02-b8bf-643a6dd1738c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111747 Sep 16 14:20:39.024029 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2285/4552] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:39.031614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:39.032719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:39.074644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:39.076013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:39.081316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:39.085592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:39.090100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:39.091357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:39.263188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "refresh_cache-4586981e-4f62-4dfe-875e-4e968deaff31" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 14:20:39.264063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquired lock "refresh_cache-4586981e-4f62-4dfe-875e-4e968deaff31" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 14:20:39.584583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:39.594830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:39.600309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:39.612795 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6354715b-2ee0-4406-aa3a-dfab91868422 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.586980 Sep 16 14:20:39.627795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2286/4553] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:39 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:39.638638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:39.639599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:39.660153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:39.660666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:39.661100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:39.661844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:39.662302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:39.662772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:40.231989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:40.250735 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b5203b0a-2605-45ce-a599-e8e9e6ea35c8 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.621378 Sep 16 14:20:40.255200 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2287/4554] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:39 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:40.261563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:40.262189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: ef04c10e-16a9-4508-b71c-bbab6320d996] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:40.284793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:40.286368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:40.288236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:40.290712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:40.291457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:40.292165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:40.317533 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] HTTP exception thrown: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 could not be found. Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Request method failure captured: Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 HTTP/1.1 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIXnZZmMtvZTJ_lwiEENcsnm-m7wWCc-xpA7MdL8d6-4i5Jr_v6yU32Z93_ohqdexWCB6S0rFuqRxL_vKhOqpjVoRcHbF5JqiWfxms-FgtmWbLGm89FChI6G9-Ielpue-OYbJNn9dkONu07d7fhb-QaqY7s3GIjFTtCQrI4LJiOlkQU Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 330f65aebd344c99b97cdcddb5ca9637 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-LiveMigrationNegativeTest-1723165820 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_330f65aebd344c99b97cdcddb5ca9637", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/330f65aebd344c99b97cdcddb5ca9637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/330f65aebd344c99b97cdcddb5ca9637"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/330f65aebd344c99b97cdcddb5ca9637"}]}] Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-LiveMigrationNegativeTest-1723165820 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 330f65aebd344c99b97cdcddb5ca9637 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1723165820 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-LiveMigrationNegativeTest-1723165820-project Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d4685e0517e49a5a9bed15b266aa244 Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-LiveMigrationNegativeTest-1723165820-project Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 could not be found. Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'ef04c10e-16a9-4508-b71c-bbab6320d996'} Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 could not be found. Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 could not be found. Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:40.319848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 could not be found. Sep 16 14:20:40.324588 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:20:40.329394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Returning 404 to user: Instance ef04c10e-16a9-4508-b71c-bbab6320d996 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:20:40.330711 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-972c5302-8ed8-4b71-a0c5-bdfa64be7e56 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996" status: 404 len: 111 microversion: 2.1 time: 0.074404 Sep 16 14:20:40.331887 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2288/4555] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:40 2022] GET /compute/v2.1/servers/ef04c10e-16a9-4508-b71c-bbab6320d996 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:20:40.344159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:40.344665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:40.365797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:40.366996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:40.371197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:40.372222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:40.372862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:40.373457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:40.408399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:20:40.553503 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c980168d-9010-4e65-8370-a41a4c6c61a9 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 204 len: 0 microversion: 2.1 time: 0.214124 Sep 16 14:20:40.557478 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2289/4556] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:20:40 2022] DELETE /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:20:40.581785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:40.588370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:40.605642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:40.607464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:40.608977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:40.610773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:40.612818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:40.613993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:41.039722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:41.054963 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61dfd7cf-67ac-4344-87c1-ee6f6a4483d4 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1475 microversion: 2.1 time: 0.490867 Sep 16 14:20:41.058596 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2290/4557] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:40 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:41.066955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:41.068050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:41.097942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:41.098580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:41.100315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:41.101898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:41.102384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:41.105860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:41.611669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:42.007104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Building network info cache for instance {{(pid=128642) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 16 14:20:42.391938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:42.444098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:42.462212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:42.471253 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-afa9166a-45cf-401d-959d-b33b34f8b937 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 1.405645 Sep 16 14:20:42.483355 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2291/4558] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:41 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:42.508469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d37467c1-5261-42e1-a82d-9e4bae7cfa8b req-121f3c49-8aa4-4da1-8579-94de7a82e004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3153368d-9e71-4785-a916-da3beb231ad5", "tag": "5fe5d8af-7e6a-4d33-aa08-99932addda05"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:42.536048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d37467c1-5261-42e1-a82d-9e4bae7cfa8b req-121f3c49-8aa4-4da1-8579-94de7a82e004 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:42.537109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d37467c1-5261-42e1-a82d-9e4bae7cfa8b req-121f3c49-8aa4-4da1-8579-94de7a82e004 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:42.539907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d37467c1-5261-42e1-a82d-9e4bae7cfa8b req-121f3c49-8aa4-4da1-8579-94de7a82e004 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:42.593887 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d37467c1-5261-42e1-a82d-9e4bae7cfa8b req-121f3c49-8aa4-4da1-8579-94de7a82e004 service nova] Creating event network-changed:5fe5d8af-7e6a-4d33-aa08-99932addda05 for instance 3153368d-9e71-4785-a916-da3beb231ad5 on n-h1-858129-2 Sep 16 14:20:42.610865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d37467c1-5261-42e1-a82d-9e4bae7cfa8b req-121f3c49-8aa4-4da1-8579-94de7a82e004 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124573 Sep 16 14:20:42.613719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2292/4559] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:42.627820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:42.629517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:42.648044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:42.654928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:42.655494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:42.670536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:42.671367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:42.672183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:44.874135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:44.880511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:44.909310 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4307a17-9e55-465f-a77d-282ac4168977 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 2.290341 Sep 16 14:20:44.911630 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2293/4560] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:42 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:44.938627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:44.943023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:44.970939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:44.971963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:44.972643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:44.977174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:44.980555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:44.981601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:45.800263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:45.818792 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-daf5d4e3-8d3d-4796-b523-f9e095a64319 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1475 microversion: 2.1 time: 0.903359 Sep 16 14:20:45.819414 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2294/4561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:44 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1475 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:45.830250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c5bf8785-d67c-4c5e-aa3b-1c7a7ca18005 req-2204a127-d45c-4979-b238-b31a02ebffe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:45.857974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c5bf8785-d67c-4c5e-aa3b-1c7a7ca18005 req-2204a127-d45c-4979-b238-b31a02ebffe4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:45.858558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c5bf8785-d67c-4c5e-aa3b-1c7a7ca18005 req-2204a127-d45c-4979-b238-b31a02ebffe4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:45.859011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c5bf8785-d67c-4c5e-aa3b-1c7a7ca18005 req-2204a127-d45c-4979-b238-b31a02ebffe4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:45.889077 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c5bf8785-d67c-4c5e-aa3b-1c7a7ca18005 req-2204a127-d45c-4979-b238-b31a02ebffe4 service nova] Creating event network-changed:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:20:45.923938 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c5bf8785-d67c-4c5e-aa3b-1c7a7ca18005 req-2204a127-d45c-4979-b238-b31a02ebffe4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102220 Sep 16 14:20:45.924790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2295/4562] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:45.930238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:45.931028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:45.961431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:45.967690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:45.968428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:45.969665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:45.970173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:45.970657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:46.524009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Updating instance_info_cache with network_info: [{"id": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0", "address": "fa:16:3e:83:cb:a0", "network": {"id": "ac5da4a3-1bcd-41b9-ba8e-1490ef09e6a5", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-884274418-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b63cdaceb99945cb9c685b43e06845b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5a05f410-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128642) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:20:46.537939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:46.551924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Releasing lock "refresh_cache-4586981e-4f62-4dfe-875e-4e968deaff31" {{(pid=128642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 14:20:46.553308 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1ab17ff0-ddab-4096-b534-82c8998ce213 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action" status: 202 len: 0 microversion: 2.1 time: 8.907434 Sep 16 14:20:46.570499 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2268/4563] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:20:37 2022] POST /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31/action => generated 0 bytes in 8925 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 16 14:20:46.576545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:46.581631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-30c1e253-6544-4bfa-ad8a-7d26bd103f28 req-df7b1971-d5cb-4552-920c-666e0cfdbdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca04c82-192b-4332-a1fa-403ea76d08b8", "name": "network-vif-unplugged", "status": "completed", "tag": "134616fd-43b1-4efe-9344-360d15ee384f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:46.589696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:46.592827 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ce57ea9-1607-4f4d-9f61-1000f038a559 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.666613 Sep 16 14:20:46.594274 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2296/4564] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:45 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:46.622134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:46.629347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:46.632523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-30c1e253-6544-4bfa-ad8a-7d26bd103f28 req-df7b1971-d5cb-4552-920c-666e0cfdbdaa service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:46.633698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-30c1e253-6544-4bfa-ad8a-7d26bd103f28 req-df7b1971-d5cb-4552-920c-666e0cfdbdaa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:46.636689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-30c1e253-6544-4bfa-ad8a-7d26bd103f28 req-df7b1971-d5cb-4552-920c-666e0cfdbdaa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:46.643787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:46.644657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:46.645268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:46.646747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:46.647441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:46.655269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:46.660335 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-30c1e253-6544-4bfa-ad8a-7d26bd103f28 req-df7b1971-d5cb-4552-920c-666e0cfdbdaa service nova] Creating event network-vif-unplugged:134616fd-43b1-4efe-9344-360d15ee384f for instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 on n-h1-858129-2 Sep 16 14:20:46.667236 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-30c1e253-6544-4bfa-ad8a-7d26bd103f28 req-df7b1971-d5cb-4552-920c-666e0cfdbdaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095055 Sep 16 14:20:46.668254 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2269/4565] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:46.677452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-464166c9-369c-49e8-ab2f-c49ebbe49272 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '.version_select at 0x7f724c568430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:47.208497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:47.255276 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d8911b8-4752-419c-976c-7fca6d680051 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.650008 Sep 16 14:20:47.260032 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2297/4566] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:46 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:47.289819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:47.321365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:47.355480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:47.356530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:47.361477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:47.366005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:47.369431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:47.372016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:47.557491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:47.557956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:47.558626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:47.559256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lazy-loading 'fault' on Instance uuid 0ca04c82-192b-4332-a1fa-403ea76d08b8 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:20:47.758072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4685e0517e49a5a9bed15b266aa244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330f65aebd344c99b97cdcddb5ca9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:47.767186 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2adada06-83b6-4dc0-bff6-ce660cd3f3f1 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 200 len: 1309 microversion: 2.1 time: 0.505813 Sep 16 14:20:47.770796 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2298/4567] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:47 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:47.786689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:47.787843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:47.800215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:47.801016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:47.801457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:47.802218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:47.802734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:47.803175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:48.437495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:48.463319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:48.471999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:48.473390 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e9f4b0e-f914-43cb-b38d-3e0acc6bdd5a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.699149 Sep 16 14:20:48.475124 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2299/4568] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:47 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:48.488635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2c30d48c-3b08-429a-a507-55863b4e18ed req-f27f97e9-163f-4ffe-b09d-091f74734a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca04c82-192b-4332-a1fa-403ea76d08b8", "name": "network-vif-deleted", "tag": "134616fd-43b1-4efe-9344-360d15ee384f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:48.514976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2c30d48c-3b08-429a-a507-55863b4e18ed req-f27f97e9-163f-4ffe-b09d-091f74734a53 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:48.519245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2c30d48c-3b08-429a-a507-55863b4e18ed req-f27f97e9-163f-4ffe-b09d-091f74734a53 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:48.524145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2c30d48c-3b08-429a-a507-55863b4e18ed req-f27f97e9-163f-4ffe-b09d-091f74734a53 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:48.559729 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2c30d48c-3b08-429a-a507-55863b4e18ed req-f27f97e9-163f-4ffe-b09d-091f74734a53 service nova] Creating event network-vif-deleted:134616fd-43b1-4efe-9344-360d15ee384f for instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 on n-h1-858129-2 Sep 16 14:20:48.578127 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2c30d48c-3b08-429a-a507-55863b4e18ed req-f27f97e9-163f-4ffe-b09d-091f74734a53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101211 Sep 16 14:20:48.583668 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2300/4569] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:48.596949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:48.597828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:48.619386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:48.626056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:48.627101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:48.628147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:48.628930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:48.629611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:49.083372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-464166c9-369c-49e8-ab2f-c49ebbe49272 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/ef101a90-77f5-4f13-abcb-876d2e751e8d" status: 202 len: 0 microversion: 2.1 time: 2.410975 Sep 16 14:20:49.084756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2270/4570] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:20:46 2022] DELETE /compute/v2.1/os-floating-ips/ef101a90-77f5-4f13-abcb-876d2e751e8d => generated 0 bytes in 2413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:49.095693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:49.097581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] [instance: 0ca04c82-192b-4332-a1fa-403ea76d08b8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:49.112425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:49.114744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:49.116725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:49.121933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:49.134797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:49.136244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:49.137448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:49.153339 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-600f18a8-3ac4-4c9b-9f46-5f083a048fb4 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.567997 Sep 16 14:20:49.154341 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2301/4571] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:48 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:49.186260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8caf321e-84c4-4f89-a1ea-e2f39c57d6e6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '.version_select at 0x7f724c4c1820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:49.192882 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] HTTP exception thrown: Instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 could not be found. Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Request method failure captured: Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 HTTP/1.1 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIXnZZmMtvZTJ_lwiEENcsnm-m7wWCc-xpA7MdL8d6-4i5Jr_v6yU32Z93_ohqdexWCB6S0rFuqRxL_vKhOqpjVoRcHbF5JqiWfxms-FgtmWbLGm89FChI6G9-Ielpue-OYbJNn9dkONu07d7fhb-QaqY7s3GIjFTtCQrI4LJiOlkQU Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 330f65aebd344c99b97cdcddb5ca9637 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-LiveMigrationNegativeTest-1723165820 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_330f65aebd344c99b97cdcddb5ca9637", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/330f65aebd344c99b97cdcddb5ca9637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/330f65aebd344c99b97cdcddb5ca9637"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/330f65aebd344c99b97cdcddb5ca9637"}]}] Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-LiveMigrationNegativeTest-1723165820 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 330f65aebd344c99b97cdcddb5ca9637 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1723165820 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-LiveMigrationNegativeTest-1723165820-project Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d4685e0517e49a5a9bed15b266aa244 Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-LiveMigrationNegativeTest-1723165820-project Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 could not be found. Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0ca04c82-192b-4332-a1fa-403ea76d08b8'} Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 could not be found. Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 could not be found. Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:49.210866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 could not be found. Sep 16 14:20:49.215908 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:49.220599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] Returning 404 to user: Instance 0ca04c82-192b-4332-a1fa-403ea76d08b8 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:20:49.222890 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3811d30-ae87-4683-9e84-1f4856c42169 tempest-LiveMigrationNegativeTest-1723165820 tempest-LiveMigrationNegativeTest-1723165820-project] 10.222.0.60 "GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8" status: 404 len: 111 microversion: 2.1 time: 0.136551 Sep 16 14:20:49.224159 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2271/4572] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:49 2022] GET /compute/v2.1/servers/0ca04c82-192b-4332-a1fa-403ea76d08b8 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:20:49.512012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:49.513515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:49.560233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:49.564675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:49.567826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:49.575914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:49.577794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:49.579078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:49.872589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8caf321e-84c4-4f89-a1ea-e2f39c57d6e6 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/a46e9d6c-ead1-4079-bfc0-55acf2e6dccb" status: 202 len: 0 microversion: 2.1 time: 0.691483 Sep 16 14:20:49.873435 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2302/4573] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:20:49 2022] DELETE /compute/v2.1/os-security-groups/a46e9d6c-ead1-4079-bfc0-55acf2e6dccb => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:20:49.883980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:49.885254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:49.913771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:49.914171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:49.914678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:49.919697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:49.926147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:49.926681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:50.038334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:20:50.123090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:50.139093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:50.147800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:50.151557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-426b8143-4ccb-41e9-a13c-ca0de1886ee5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.648837 Sep 16 14:20:50.155463 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2272/4574] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:49 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:50.186871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:50.187828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:50.200397 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-137513d3-078f-4e8c-9b99-47bb8a5da93f tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 204 len: 0 microversion: 2.1 time: 0.322453 Sep 16 14:20:50.205256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2303/4575] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:20:49 2022] DELETE /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:20:50.219726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:50.220865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:50.224181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:50.224725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:50.225180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:50.228018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:50.228703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:50.230995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:50.237447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:50.237980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:50.238553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:50.246971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:50.247735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:50.248388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:51.002192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:51.015261 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4c9b447-5a10-47ed-b930-53e75eddf430 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1510 microversion: 2.1 time: 0.807812 Sep 16 14:20:51.035072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:51.038189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2304/4576] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:50 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1510 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:51.089455 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4f6400e-90c4-4f51-9388-5372b43855f7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.904629 Sep 16 14:20:51.108674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2273/4577] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:50 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:51.214283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:51.214945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:51.232591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:51.238239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:51.240483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:51.245010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:51.255847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:51.256935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:51.896093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:51.919627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:51.927693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:51.928981 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8be63341-5d62-4c8e-9a4e-152309164d3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.718739 Sep 16 14:20:51.931483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2305/4578] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:51 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:52.066818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:52.078954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:52.123098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:52.124409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:52.125531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:52.129273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:52.134281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:52.138714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:52.155419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:52.158425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:52.212457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:52.218093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:52.227483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:52.229424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:52.237897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:52.238825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:53.065450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:53.082773 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d28174d-d92e-475e-a0d3-f628f25847ac tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1510 microversion: 2.1 time: 1.038797 Sep 16 14:20:53.084331 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2274/4579] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:52 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1510 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:53.106381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b51ca991-318f-46bd-9329-5e81a6c16b42 req-4b73b797-a052-4c7b-98c6-2bca789a0f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3153368d-9e71-4785-a916-da3beb231ad5", "name": "network-vif-plugged", "status": "completed", "tag": "5fe5d8af-7e6a-4d33-aa08-99932addda05"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:53.141257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b51ca991-318f-46bd-9329-5e81a6c16b42 req-4b73b797-a052-4c7b-98c6-2bca789a0f2b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:53.142549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b51ca991-318f-46bd-9329-5e81a6c16b42 req-4b73b797-a052-4c7b-98c6-2bca789a0f2b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:53.148935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b51ca991-318f-46bd-9329-5e81a6c16b42 req-4b73b797-a052-4c7b-98c6-2bca789a0f2b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:53.158058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:53.188906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70528790-de98-40b8-8ed5-71274e76eed7 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 1.042062 Sep 16 14:20:53.200304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2306/4580] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:52 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:53.211699 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b51ca991-318f-46bd-9329-5e81a6c16b42 req-4b73b797-a052-4c7b-98c6-2bca789a0f2b service nova] Creating event network-vif-plugged:5fe5d8af-7e6a-4d33-aa08-99932addda05 for instance 3153368d-9e71-4785-a916-da3beb231ad5 on n-h1-858129-2 Sep 16 14:20:53.218611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:53.223957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:53.226004 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b51ca991-318f-46bd-9329-5e81a6c16b42 req-4b73b797-a052-4c7b-98c6-2bca789a0f2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140119 Sep 16 14:20:53.231446 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2275/4581] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:20:53.244229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:53.244865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:53.245584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:53.246352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:53.251256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:53.251732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:53.688263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:53.705417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:53.707350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:53.708809 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7d2e5512-148a-44ea-b6b5-106aabed3545 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.507358 Sep 16 14:20:53.709616 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2307/4582] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:53 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:54.123545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:54.124316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:54.142836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:54.145632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:54.146915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:54.148795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:54.149306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:54.151464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:54.219003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:54.219784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:54.235381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:54.235887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:54.236446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:54.238468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:54.238468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:54.238468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:54.859307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:54.884863 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c03c0385-eeff-4d1d-91ee-75942fc0be21 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1510 microversion: 2.1 time: 0.774381 Sep 16 14:20:54.904580 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2276/4583] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:54 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1510 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:54.927820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:54.934673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:54.949859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:54.952434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:54.953337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:54.956933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:54.958427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:54.960219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:55.109114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:55.125159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-66633248-8b95-4616-bafc-0c61e0f464fc tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.911281 Sep 16 14:20:55.125703 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2308/4584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:54 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:55.919763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:55.920497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:55.940499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:55.943072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:55.944520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:55.945385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:55.945871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:55.948861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:56.020068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:56.039182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:56.041555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:56.048773 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf0aadb9-5db1-46b2-88c3-ef8d0d6ec35f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 1.137944 Sep 16 14:20:56.050263 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2277/4585] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:54 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:56.149814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:56.150793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:56.174139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:56.187749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:56.189038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:56.191709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:56.193124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:56.194259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:57.022246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:57.028012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:57.053499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-170e37b5-b788-4717-81c9-983611402ea4 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1510 microversion: 2.1 time: 1.137715 Sep 16 14:20:57.069266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bee97fa9-850c-44d9-8fb7-afa12451d98d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1315 microversion: 2.1 time: 0.923850 Sep 16 14:20:57.073710 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2278/4586] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:56 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:20:57.079448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:57.080091 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2309/4587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:55 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1510 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:57.088509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:57.099177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:57.100103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:57.100794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:57.103476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:57.115245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:57.116110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:57.555690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:57.567870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:57.571938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:57.573736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-480359dc-91f4-4aa6-b762-b873806df03a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.498210 Sep 16 14:20:57.591376 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2279/4588] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:57 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:57.919110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-16a24580-6990-4cc2-91d4-be13590108cd req-1e1215df-3788-4723-9432-29df223e848e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586981e-4f62-4dfe-875e-4e968deaff31", "name": "network-vif-deleted", "tag": "5a05f410-5977-4c12-88a0-b3ec6c9c7ff0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:20:57.936420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:57.948591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-16a24580-6990-4cc2-91d4-be13590108cd req-1e1215df-3788-4723-9432-29df223e848e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:57.949532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-16a24580-6990-4cc2-91d4-be13590108cd req-1e1215df-3788-4723-9432-29df223e848e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:57.950175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-16a24580-6990-4cc2-91d4-be13590108cd req-1e1215df-3788-4723-9432-29df223e848e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:58.000825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-16a24580-6990-4cc2-91d4-be13590108cd req-1e1215df-3788-4723-9432-29df223e848e service nova] Creating event network-vif-deleted:5a05f410-5977-4c12-88a0-b3ec6c9c7ff0 for instance 4586981e-4f62-4dfe-875e-4e968deaff31 on n-h2-858129-2 Sep 16 14:20:58.013129 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-16a24580-6990-4cc2-91d4-be13590108cd req-1e1215df-3788-4723-9432-29df223e848e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103435 Sep 16 14:20:58.015068 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2310/4589] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:20:58.082656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:58.083554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:58.098282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:58.109423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:58.113440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:58.115200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:58.116335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:58.117479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:58.163134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:20:58.187791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:58.189082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:58.190141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:58.191269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lazy-loading 'fault' on Instance uuid 4586981e-4f62-4dfe-875e-4e968deaff31 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:20:58.325164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f90da4c8d440fea434af70421f0cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63cdaceb99945cb9c685b43e06845b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:58.356891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9847e05-9701-4cc0-921e-89e150e94e35 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 200 len: 1313 microversion: 2.1 time: 0.278869 Sep 16 14:20:58.359596 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2311/4590] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:58 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:20:58.370970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:58.372656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:58.387918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:58.389487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:58.390951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:58.393246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:58.394641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:58.396322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:58.448743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a0f8960-96f5-4e2c-97ab-e57bde978402 tempest-NetworksTest-2041680314 tempest-NetworksTest-2041680314-project-admin] Calling method '.version_select at 0x7f724c334c10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:59.356838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:59.397554 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-68e7b98e-a946-4727-982e-711624a78441 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1465 microversion: 2.1 time: 1.035489 Sep 16 14:20:59.403277 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2312/4591] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:58 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1465 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:59.418507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:59.424905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:59.444584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:59.450816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:59.451814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:59.453174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:59.454038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:59.459204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:59.553661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a0f8960-96f5-4e2c-97ab-e57bde978402 tempest-NetworksTest-2041680314 tempest-NetworksTest-2041680314-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 6716 microversion: 2.1 time: 1.493265 Sep 16 14:20:59.562638 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2280/4592] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:20:58 2022] GET /compute/v2.1/os-networks => generated 6716 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:20:59.573167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:59.573949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] [instance: 4586981e-4f62-4dfe-875e-4e968deaff31] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:59.596625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:59.597181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:59.597641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:59.598434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:59.604207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:59.604673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:59.641726 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] HTTP exception thrown: Instance 4586981e-4f62-4dfe-875e-4e968deaff31 could not be found. Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Request method failure captured: Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 HTTP/1.1 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIXQI5-9VZ_lBFEn2XuVJ9hH6qRK6-MKxSp4_I5MRclQez9FZcN0DZU8FK0vh8YggOOGKZuMUE838RSLC-GpBmSdSTHe1LNaLa-tDssh4ia5HBHe9dc6va8O_KzQh58dg5cuJ5rEALEYs-RQO2OcwwlpFDceFdL09HnP_ZofxrmZsGk Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b63cdaceb99945cb9c685b43e06845b2 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1286867361 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b63cdaceb99945cb9c685b43e06845b2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b63cdaceb99945cb9c685b43e06845b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b63cdaceb99945cb9c685b43e06845b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b63cdaceb99945cb9c685b43e06845b2"}]}] Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1286867361 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b63cdaceb99945cb9c685b43e06845b2 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1286867361 Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerRescueTestJSONUnderV235-1286867361-project Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 32f90da4c8d440fea434af70421f0cbe Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1286867361-project Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 4586981e-4f62-4dfe-875e-4e968deaff31 could not be found. Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4586981e-4f62-4dfe-875e-4e968deaff31'} Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4586981e-4f62-4dfe-875e-4e968deaff31 could not be found. Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4586981e-4f62-4dfe-875e-4e968deaff31 could not be found. Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:59.645194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4586981e-4f62-4dfe-875e-4e968deaff31 could not be found. Sep 16 14:20:59.649171 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:20:59.656850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] Returning 404 to user: Instance 4586981e-4f62-4dfe-875e-4e968deaff31 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:20:59.661065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8eef26e2-d4b5-439e-97db-5f23130ee9a2 tempest-ServerRescueTestJSONUnderV235-1286867361 tempest-ServerRescueTestJSONUnderV235-1286867361-project] 10.222.0.60 "GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31" status: 404 len: 111 microversion: 2.1 time: 0.097028 Sep 16 14:20:59.664594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2281/4593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:20:59 2022] GET /compute/v2.1/servers/4586981e-4f62-4dfe-875e-4e968deaff31 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:20:59.678810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:20:59.682137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:20:59.697822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:59.701046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:59.701956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:59.702968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:20:59.705630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:20:59.706854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:20:59.775719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:20:59.880358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:59.906014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:59.909839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:20:59.913355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-beb56c67-b8e8-44f7-a327-87fb74a1ed4e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.507703 Sep 16 14:20:59.929675 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2313/4594] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:20:59 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:20:59.942470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b09a5e83-a9fc-4e05-a600-54b5f70deaa6 tempest-NetworksTest-2041680314 tempest-NetworksTest-2041680314-project-admin] Calling method '.version_select at 0x7f724c3a8430>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:00.017958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8aa8a81e-e89e-48d3-bf3b-54497e7851ea tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 204 len: 0 microversion: 2.1 time: 0.347153 Sep 16 14:21:00.021989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2282/4595] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:20:59 2022] DELETE /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:21:00.041636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:00.044439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:00.070070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:00.071008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:00.071717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:00.073501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:00.074206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:00.080235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:00.499934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:00.501111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b09a5e83-a9fc-4e05-a600-54b5f70deaa6 tempest-NetworksTest-2041680314 tempest-NetworksTest-2041680314-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks/e94f8ce7-f79e-45b6-8df0-31adffa70cd7" status: 200 len: 652 microversion: 2.1 time: 0.570125 Sep 16 14:21:00.502194 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2314/4596] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:20:59 2022] GET /compute/v2.1/os-networks/e94f8ce7-f79e-45b6-8df0-31adffa70cd7 => generated 652 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:00.518383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73cf915a-203b-4fb8-91c5-0012484bb34b tempest-NetworksTest-2041680314 tempest-NetworksTest-2041680314-project-admin] Calling method '.version_select at 0x7f724c3a8820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:00.550113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00697af3-35b2-4e0a-ab8c-05c193da2e09 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1471 microversion: 2.1 time: 0.525930 Sep 16 14:21:00.558275 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2283/4597] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:00 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1471 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:00.759791 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73cf915a-203b-4fb8-91c5-0012484bb34b tempest-NetworksTest-2041680314 tempest-NetworksTest-2041680314-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 6716 microversion: 2.1 time: 0.248279 Sep 16 14:21:00.761613 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2315/4598] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:21:00 2022] GET /compute/v2.1/os-networks => generated 6716 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:00.965855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:00.967718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:00.987253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:00.990835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:00.991773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:00.993189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:00.994906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:00.996158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:01.479350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:01.515438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:01.534897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:01.541760 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-570fb6a2-7e66-47ae-b681-68af47f6df7c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1740 microversion: 2.20 time: 0.583090 Sep 16 14:21:01.551166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2284/4599] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:00 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1740 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:01.600030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:01.602383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:01.628270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:01.630042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:01.631714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:01.633836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:01.635207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:01.636398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:02.248664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:02.295500 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed6548d4-eebc-490a-b7dd-2864a9dc1710 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1471 microversion: 2.1 time: 0.700262 Sep 16 14:21:02.313087 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2316/4600] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:01 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1471 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:02.576641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:02.584090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:02.604590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:02.615541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:02.616410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:02.617793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:02.619103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:02.620018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:03.142532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:03.171666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:03.175327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:03.184998 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de807689-d76d-4dfc-a1db-de860b45dea7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1722 microversion: 2.20 time: 0.615841 Sep 16 14:21:03.188674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2285/4601] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:02 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1722 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:03.353513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:03.356540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:03.397598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:03.399320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:03.405898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:03.407170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:03.417837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:03.419411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:03.761325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8f174467-2bce-40de-8983-e8ee600996ab req-f97e317b-d85b-4944-95ec-d707339ea111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "name": "network-vif-unplugged", "status": "completed", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:03.790680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8f174467-2bce-40de-8983-e8ee600996ab req-f97e317b-d85b-4944-95ec-d707339ea111 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:03.792128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8f174467-2bce-40de-8983-e8ee600996ab req-f97e317b-d85b-4944-95ec-d707339ea111 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:03.792934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8f174467-2bce-40de-8983-e8ee600996ab req-f97e317b-d85b-4944-95ec-d707339ea111 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:03.829046 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8f174467-2bce-40de-8983-e8ee600996ab req-f97e317b-d85b-4944-95ec-d707339ea111 service nova] Creating event network-vif-unplugged:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:21:03.850179 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8f174467-2bce-40de-8983-e8ee600996ab req-f97e317b-d85b-4944-95ec-d707339ea111 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094525 Sep 16 14:21:03.854348 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2286/4602] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:03.943335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:03.960559 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f2a5e729-c6f6-4361-aad6-8b0a2c0b21c2 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1471 microversion: 2.1 time: 0.616751 Sep 16 14:21:03.974959 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2317/4603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:03 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1471 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:04.226058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:04.229209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:04.249507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:04.250949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:04.253287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:04.256046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:04.256866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:04.260857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:04.315534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:04.930159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:04.947158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:04.951391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:04.956591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41009a67-3efe-4fb5-a7de-d0467ec8081f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1722 microversion: 2.20 time: 0.741769 Sep 16 14:21:04.961537 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2287/4604] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:04 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1722 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:04.991449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:04.992909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:05.012978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:05.014295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:05.017519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:05.019081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:05.021742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:05.022472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:05.243591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:05.249208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:05.264866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:05.265730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:05.266730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:05.268482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:05.269498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:05.270209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:05.274984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:05.284364 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45d4c8a0-7586-43b2-9c60-a7896e5dab1d tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1471 microversion: 2.1 time: 0.296922 Sep 16 14:21:05.285361 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2318/4605] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:04 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:05.392641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13f4e97c-508b-4a60-bd6b-1689a601a7e0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.154335 Sep 16 14:21:05.401271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:05.401824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:05.403718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2288/4606] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:21:05 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:21:05.412731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:05.413391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:05.414088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:05.414941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:05.417839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:05.422651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:05.687148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:05.699666 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-778b316b-bf33-4b61-92a7-f79f13fb4dca tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1670 microversion: 2.1 time: 0.302979 Sep 16 14:21:05.705598 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2319/4607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:05 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:21:06.022101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:06.023015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:06.040010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:06.041156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:06.041612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:06.042363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:06.048006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:06.048647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:06.311646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:06.313091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:06.328445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:06.331814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:06.332437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:06.333735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:06.337487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:06.338352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:06.495186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:06.511123 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-528573cb-84f3-40b4-9d40-68a06cf6d533 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1429 microversion: 2.1 time: 0.205657 Sep 16 14:21:06.530294 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2320/4608] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:06 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1429 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:21:06.637004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:06.648347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:06.650430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:06.651696 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7284f09-5acd-4de0-8756-ead169acc0c9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1722 microversion: 2.20 time: 0.635057 Sep 16 14:21:06.655212 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2289/4609] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:06 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1722 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:06.736555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:06.737695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:06.746306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:06.747221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:06.748274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:06.752825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:06.753496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:06.754047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.108864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:07.125437 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f217e528-0cff-4dbc-806f-3e2bbd09e3e5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1670 microversion: 2.1 time: 0.394234 Sep 16 14:21:07.131483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2321/4610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:06 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:07.283043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ef1d36db-67d7-496a-a371-fd4083863b26 req-074c5770-bc11-44ac-a90c-0a27d1b4f5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3153368d-9e71-4785-a916-da3beb231ad5", "name": "network-vif-deleted", "tag": "5fe5d8af-7e6a-4d33-aa08-99932addda05"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:07.299535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:07.302838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ef1d36db-67d7-496a-a371-fd4083863b26 req-074c5770-bc11-44ac-a90c-0a27d1b4f5fc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:07.303498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ef1d36db-67d7-496a-a371-fd4083863b26 req-074c5770-bc11-44ac-a90c-0a27d1b4f5fc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:07.304570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ef1d36db-67d7-496a-a371-fd4083863b26 req-074c5770-bc11-44ac-a90c-0a27d1b4f5fc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.326244 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ef1d36db-67d7-496a-a371-fd4083863b26 req-074c5770-bc11-44ac-a90c-0a27d1b4f5fc service nova] Creating event network-vif-deleted:5fe5d8af-7e6a-4d33-aa08-99932addda05 for instance 3153368d-9e71-4785-a916-da3beb231ad5 on n-h1-858129-2 Sep 16 14:21:07.332680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ef1d36db-67d7-496a-a371-fd4083863b26 req-074c5770-bc11-44ac-a90c-0a27d1b4f5fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054751 Sep 16 14:21:07.336185 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2290/4611] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:07.489600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c66183c9-6d32-4d99-8356-b44892fd4fc3 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:07.499721 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c66183c9-6d32-4d99-8356-b44892fd4fc3 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.221789 Sep 16 14:21:07.500647 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2322/4612] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:21:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:07.561955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:07.563834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:07.595246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:07.599674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:07.601176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.609323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:07.613594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:07.616062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.703652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:07.705780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:07.738947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:07.739833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:07.740587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.741878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:07.742716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:07.751896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.759745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:07.761062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:07.761680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:07.769898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lazy-loading 'fault' on Instance uuid 3153368d-9e71-4785-a916-da3beb231ad5 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:21:07.869259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65213802525402ab4bead244eec6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669931d2145e4d49adc4ac9cd4fbd0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:07.886855 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-03772722-6a30-48e9-b4d2-770143848295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 200 len: 1305 microversion: 2.1 time: 0.337373 Sep 16 14:21:07.888649 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2291/4613] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:07 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 1305 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:08.188807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:08.191817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:08.207199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:08.212352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:08.214388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:08.215608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:08.216526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:08.222501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:08.223296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:08.227168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:08.235727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:08.240201 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad445ddf-b207-458e-bc89-d02263dbf89d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1725 microversion: 2.20 time: 0.557252 Sep 16 14:21:08.242617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2323/4614] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:07 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1725 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:08.273487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dcc0ceb-fac9-44f4-b34e-9672e18fb8bf"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:08.277575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:08.286005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:08.287708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:08.288336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:08.289337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:08.290600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:08.291353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:08.467184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:08.490617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47f9d9d2-87a2-43e1-bbe8-cfbdf2309a6a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.314813 Sep 16 14:21:08.492876 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2292/4615] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:08 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:21:08.649324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2313fd09-3b64-460f-b32a-058152311275 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1374424075", "imageRef": "401a6329-ec85-45da-8f73-735bcb6c9468", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:08.739313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-2313fd09-3b64-460f-b32a-058152311275 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:21:08.874701 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b2ea26fc-9a92-4736-a2e2-8674a5cc682f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.603096 Sep 16 14:21:08.875922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2324/4616] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Sep 16 14:21:08 2022] POST /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 188 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 14:21:08.920883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:08.922259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] [instance: 3153368d-9e71-4785-a916-da3beb231ad5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:08.934876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:08.936091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:08.937302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:08.939242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:08.940260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:08.941166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:08.976073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] HTTP exception thrown: Instance 3153368d-9e71-4785-a916-da3beb231ad5 could not be found. Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Request method failure captured: Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 HTTP/1.1 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIYiMAHEDfN6ZB6CfrJcYmj9r6K8RjePIpTAzeII9IwJZEJn1tBbuhDLjX_53tcUM8ONAQBftIp0reL3BLlSfJS12Ya3oJL5Eoj546xAJfJYcRVF1AhDW0yLBESb8-3hyEH-mUdDZXSbAiEuAPbtVDDVtxhuIOEQyE1MSkvfe5p29pc Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 669931d2145e4d49adc4ac9cd4fbd0b5 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-VolumesNegativeTest-1865694743 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_669931d2145e4d49adc4ac9cd4fbd0b5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/669931d2145e4d49adc4ac9cd4fbd0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/669931d2145e4d49adc4ac9cd4fbd0b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/669931d2145e4d49adc4ac9cd4fbd0b5"}]}] Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-VolumesNegativeTest-1865694743 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 669931d2145e4d49adc4ac9cd4fbd0b5 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-VolumesNegativeTest-1865694743 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-VolumesNegativeTest-1865694743-project Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b65213802525402ab4bead244eec6601 Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-VolumesNegativeTest-1865694743-project Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 3153368d-9e71-4785-a916-da3beb231ad5 could not be found. Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '3153368d-9e71-4785-a916-da3beb231ad5'} Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3153368d-9e71-4785-a916-da3beb231ad5 could not be found. Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3153368d-9e71-4785-a916-da3beb231ad5 could not be found. Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:08.980320 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3153368d-9e71-4785-a916-da3beb231ad5 could not be found. Sep 16 14:21:08.989414 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:08.991903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] Returning 404 to user: Instance 3153368d-9e71-4785-a916-da3beb231ad5 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:08.993885 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aebb3590-1706-4e04-8471-78d5a82d1295 tempest-VolumesNegativeTest-1865694743 tempest-VolumesNegativeTest-1865694743-project] 10.222.0.60 "GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5" status: 404 len: 111 microversion: 2.1 time: 0.080186 Sep 16 14:21:08.996124 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2325/4617] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:08 2022] GET /compute/v2.1/servers/3153368d-9e71-4785-a916-da3beb231ad5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:21:09.234213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2313fd09-3b64-460f-b32a-058152311275 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2313fd09-3b64-460f-b32a-058152311275 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] Request method failure captured: Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 143 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIZTnLTJBMql-eV6d0oC01b9a3v4cnx4xi7L1NfnZ0S2hQeXFh2vucyCf31VLOH6RhUfjAZG6ljgbXdds5U1g84g2aXHD8ucAomg8q7viHKUZ_HSzVlRBtHgAuN5iK9V-jH-fyA1EpAZj1MOR609JFNlhKRe0YQBjdmvWMgib29n1OU Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b849d8359fbf4d389cb932554c4f9521 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-FlavorsV2NegativeTest-545719894 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b849d8359fbf4d389cb932554c4f9521", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b849d8359fbf4d389cb932554c4f9521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b849d8359fbf4d389cb932554c4f9521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b849d8359fbf4d389cb932554c4f9521"}]}] Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-FlavorsV2NegativeTest-545719894 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b849d8359fbf4d389cb932554c4f9521 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-545719894 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-FlavorsV2NegativeTest-545719894-project Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 754142500979478abae060cc1d15a452 Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-FlavorsV2NegativeTest-545719894-project Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1374424075", "imageRef": "401a6329-ec85-45da-8f73-735bcb6c9468", "flavorRef": "452"}} Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: exception: Flavor's memory is too small for requested image. Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1374424075', 'imageRef': '401a6329-ec85-45da-8f73-735bcb6c9468', 'flavorRef': '452'}}} Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:21:09.236834 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2313fd09-3b64-460f-b32a-058152311275 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2313fd09-3b64-460f-b32a-058152311275 tempest-FlavorsV2NegativeTest-545719894 tempest-FlavorsV2NegativeTest-545719894-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.596926 Sep 16 14:21:09.253725 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2293/4618] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:21:08 2022] POST /compute/v2.1/servers => generated 93 bytes in 599 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:21:09.284037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:09.285412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:09.299497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:09.301292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:09.302151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:09.313961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:09.315376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:09.316447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:10.332448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 14:21:10.562139 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e40048c9-c292-4038-9111-58566dacb8d4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/action" status: 202 len: 0 microversion: 2.20 time: 1.296259 Sep 16 14:21:10.563611 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2326/4619] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:21:09 2022] POST /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/action => generated 0 bytes in 1299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:21:10.574523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:10.575120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:10.607796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:10.608590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:10.612643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:10.617198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:10.619568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:10.620027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:11.368212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:11.384728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:11.386287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:11.404012 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-625b8c71-1259-42cf-bd9e-a1b23688f2fb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1751 microversion: 2.20 time: 0.836098 Sep 16 14:21:11.431137 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2294/4620] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:10 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1751 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:12.183830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc1e83e6-0322-4c2d-b94f-72094d27ee7c tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Action: 'create', calling method: .version_select at 0x7f724c4c1af0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:12.214341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dc1e83e6-0322-4c2d-b94f-72094d27ee7c tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Getting quotas for project 11cdaf54a9e741048d234c4bc40854ba. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:21:12.220956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dc1e83e6-0322-4c2d-b94f-72094d27ee7c tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Getting quotas for user fd763981db044e5b8996b9b08a814741 and project 11cdaf54a9e741048d234c4bc40854ba. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:21:12.299303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-581350770", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "7fe53641-ce8b-424a-b6a3-528649e71c6c"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:12.345619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dc1e83e6-0322-4c2d-b94f-72094d27ee7c tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Getting quotas for project 11cdaf54a9e741048d234c4bc40854ba. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:21:12.378067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-dc1e83e6-0322-4c2d-b94f-72094d27ee7c tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Getting quotas for user fd763981db044e5b8996b9b08a814741 and project 11cdaf54a9e741048d234c4bc40854ba. Resources: {'server_groups'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:21:12.434090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc1e83e6-0322-4c2d-b94f-72094d27ee7c tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.394753 Sep 16 14:21:12.435501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] validate_networks() for [('7fe53641-ce8b-424a-b6a3-528649e71c6c', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:21:12.440351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2327/4621] 10.222.0.60 () {62 vars in 1214 bytes} [Fri Sep 16 14:21:12 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:21:12.452712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:12.453410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:12.475567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:12.476889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:12.479605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:12.481945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:12.483902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:12.485935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:14.156627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:14.174449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:14.181592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:14.200715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:14.204165 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af6d5908-6326-430d-85cf-f796fe641392 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1751 microversion: 2.20 time: 1.761460 Sep 16 14:21:14.204780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2328/4622] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:12 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1751 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:14.261876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4fe8cc79-ad21-42ab-a1d4-00006e30d0f1 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:14.339200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4fe8cc79-ad21-42ab-a1d4-00006e30d0f1 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.108809 Sep 16 14:21:14.351523 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2329/4623] 10.222.0.60 () {60 vars in 1193 bytes} [Fri Sep 16 14:21:14 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:21:14.405701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-060e7b23-ac39-4df5-a576-b7937ff6d9a0 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:14.478077 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-060e7b23-ac39-4df5-a576-b7937ff6d9a0 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e" status: 200 len: 235 microversion: 2.64 time: 0.118215 Sep 16 14:21:14.505188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2330/4624] 10.222.0.60 () {60 vars in 1304 bytes} [Fri Sep 16 14:21:14 2022] GET /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e => generated 235 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:21:14.526437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-361a349f-3c20-4056-83bc-85fbadcb0b71 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:14.696142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-361a349f-3c20-4056-83bc-85fbadcb0b71 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e" status: 204 len: 0 microversion: 2.64 time: 0.188280 Sep 16 14:21:14.696950 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2331/4625] 10.222.0.60 () {60 vars in 1307 bytes} [Fri Sep 16 14:21:14 2022] DELETE /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:21:14.709299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3c52687-fd4d-45cd-b86b-43a3d95f65a3 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:14.760796 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f3c52687-fd4d-45cd-b86b-43a3d95f65a3 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] HTTP exception thrown: Instance group ff4a9e26-4bb3-4b73-a892-0de47b6f887e could not be found. Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3c52687-fd4d-45cd-b86b-43a3d95f65a3 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Request method failure captured: Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e HTTP/1.1 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIZXgE3h_DBBybReN0XjuRQvdbjIRrGAopXdBjJPGSXqb-19y9GhuB5alNkeHq1CAd7FJEumYGk0Fo3o0MfF-G9ZTkayMBkae46l5N9HYzTiBId_RA640ZzGrcVZN71QWFmAgTkYeRJyKvZDkWzPLzq7EUrmcorZKUuJYn-1CSmYSMI Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.64 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 11cdaf54a9e741048d234c4bc40854ba Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerGroup264TestJSON-198064406 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11cdaf54a9e741048d234c4bc40854ba", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11cdaf54a9e741048d234c4bc40854ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11cdaf54a9e741048d234c4bc40854ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11cdaf54a9e741048d234c4bc40854ba"}]}] Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerGroup264TestJSON-198064406 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 11cdaf54a9e741048d234c4bc40854ba Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerGroup264TestJSON-198064406 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerGroup264TestJSON-198064406-project Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: fd763981db044e5b8996b9b08a814741 Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerGroup264TestJSON-198064406-project Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance group ff4a9e26-4bb3-4b73-a892-0de47b6f887e could not be found. Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'ff4a9e26-4bb3-4b73-a892-0de47b6f887e'} Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ff4a9e26-4bb3-4b73-a892-0de47b6f887e could not be found. Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ff4a9e26-4bb3-4b73-a892-0de47b6f887e could not be found. Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:14.771779 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:14.778387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:14.778387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:14.778387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:14.778387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:14.778387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ff4a9e26-4bb3-4b73-a892-0de47b6f887e could not be found. Sep 16 14:21:14.778387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:14.786284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3c52687-fd4d-45cd-b86b-43a3d95f65a3 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] Returning 404 to user: Instance group ff4a9e26-4bb3-4b73-a892-0de47b6f887e could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:14.791696 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3c52687-fd4d-45cd-b86b-43a3d95f65a3 tempest-ServerGroup264TestJSON-198064406 tempest-ServerGroup264TestJSON-198064406-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e" status: 404 len: 117 microversion: 2.64 time: 0.087236 Sep 16 14:21:14.799489 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2332/4626] 10.222.0.60 () {60 vars in 1307 bytes} [Fri Sep 16 14:21:14 2022] DELETE /compute/v2.1/os-server-groups/ff4a9e26-4bb3-4b73-a892-0de47b6f887e => generated 117 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:21:15.238778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:15.238778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:15.247495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:15.278561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:15.279327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:15.282596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:15.288595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:15.289397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:16.381446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:21:16.382336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:21:16.385711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:21:16.388830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:21:16.393353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:21:16.531929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:16.538668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:16.549995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:16.559050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:16.562019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:16.568355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:16.665356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Getting quotas for project 7aba83cbf78c421da0a3e6b85c436877. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:21:16.691091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Getting quotas for user e9558a1e8b394863ba1f6a503bf8bdf5 and project 7aba83cbf78c421da0a3e6b85c436877. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:21:16.765848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:21:16.785584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:21:17.075900 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0969f77-c424-4e19-bace-f0a42d3c257b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.920050 Sep 16 14:21:17.085349 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2295/4627] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4931 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:21:17.634899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:17.660613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:17.666860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:17.672256 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b908e79-c3bc-4d10-8ae1-a744ffec7d38 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1753 microversion: 2.20 time: 2.440923 Sep 16 14:21:17.695894 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2333/4628] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:15 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1753 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:17.710749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98026ae0-1be1-4fee-bb63-81b850cfb239 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:17.714748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-98026ae0-1be1-4fee-bb63-81b850cfb239 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:18.007659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0be3509f-317a-44ef-acce-e432d041cf38 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] 10.222.0.60 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.919525 Sep 16 14:21:18.016928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98026ae0-1be1-4fee-bb63-81b850cfb239 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:18.026013 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2296/4629] 10.222.0.60 () {58 vars in 1128 bytes} [Fri Sep 16 14:21:17 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 939 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 14:21:18.034958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98026ae0-1be1-4fee-bb63-81b850cfb239 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:18.039858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4bda438-7e47-4bd4-8f85-65fd1c181d84 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Calling method '.version_select at 0x7f724c568b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:18.049647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98026ae0-1be1-4fee-bb63-81b850cfb239 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:18.051306 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98026ae0-1be1-4fee-bb63-81b850cfb239 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1258 microversion: 2.21 time: 0.354071 Sep 16 14:21:18.061753 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2334/4630] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:17 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1258 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:18.150060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f4bda438-7e47-4bd4-8f85-65fd1c181d84 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] HTTP exception thrown: Image not found. Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4bda438-7e47-4bd4-8f85-65fd1c181d84 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Request method failure captured: Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIZbvn0APnubLtrESNYupGP-p8fFe29Q0oD6peZtRgBCasiVO0zHJAQY2KiUVvRfU44RWaodO_czaYP2OUypRNkkeiUoCyVLJ-SIUnNW5m0O6NbfnN8e4xBW4oByEE0BDTdfJ5UA9rmw3Q4C0hTt3qNAAYe1ReAOF-P1CW87bJKP6Mc Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adc5e96b6db44e838438f841839f8435", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adc5e96b6db44e838438f841839f8435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}] Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b0f26fea34764430b5e24cb1c96fca16 Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '-1'} Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.152461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:21:18.156603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.162177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4bda438-7e47-4bd4-8f85-65fd1c181d84 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:18.163440 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4bda438-7e47-4bd4-8f85-65fd1c181d84 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] 10.222.0.60 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.135951 Sep 16 14:21:18.164336 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2297/4631] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Sep 16 14:21:18 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:21:18.176196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b82626a8-41b7-48a4-a4f6-1ebd773c7ed2 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Calling method '.version_select at 0x7f724c362820>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:18.237029 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b82626a8-41b7-48a4-a4f6-1ebd773c7ed2 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] HTTP exception thrown: Image not found. Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b82626a8-41b7-48a4-a4f6-1ebd773c7ed2 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Request method failure captured: Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/images/b7a29575-0ec3-46c1-8ddf-6d07dfae96cj HTTP/1.1 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIZbvn0APnubLtrESNYupGP-p8fFe29Q0oD6peZtRgBCasiVO0zHJAQY2KiUVvRfU44RWaodO_czaYP2OUypRNkkeiUoCyVLJ-SIUnNW5m0O6NbfnN8e4xBW4oByEE0BDTdfJ5UA9rmw3Q4C0hTt3qNAAYe1ReAOF-P1CW87bJKP6Mc Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adc5e96b6db44e838438f841839f8435", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adc5e96b6db44e838438f841839f8435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}] Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b0f26fea34764430b5e24cb1c96fca16 Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'b7a29575-0ec3-46c1-8ddf-6d07dfae96cj'} Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7a29575-0ec3-46c1-8ddf-6d07dfae96cj to delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7a29575-0ec3-46c1-8ddf-6d07dfae96cj could not be found. Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.239892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:21:18.245516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.250725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b82626a8-41b7-48a4-a4f6-1ebd773c7ed2 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:18.251954 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b82626a8-41b7-48a4-a4f6-1ebd773c7ed2 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] 10.222.0.60 "DELETE /compute/v2.1/images/b7a29575-0ec3-46c1-8ddf-6d07dfae96cj" status: 404 len: 62 microversion: 2.1 time: 0.080948 Sep 16 14:21:18.254840 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2335/4632] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:18 2022] DELETE /compute/v2.1/images/b7a29575-0ec3-46c1-8ddf-6d07dfae96cj => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:21:18.272199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1cd655ce-6b8f-4f3c-a438-7c9082fc482a tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Calling method '.version_select at 0x7f7251817790>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:18.321775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1cd655ce-6b8f-4f3c-a438-7c9082fc482a tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] HTTP exception thrown: Image not found. Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1cd655ce-6b8f-4f3c-a438-7c9082fc482a tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Request method failure captured: Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/add7a81d-683f-4d5d-a8cf-78eddaaf2c8d1 HTTP/1.1 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIZbvn0APnubLtrESNYupGP-p8fFe29Q0oD6peZtRgBCasiVO0zHJAQY2KiUVvRfU44RWaodO_czaYP2OUypRNkkeiUoCyVLJ-SIUnNW5m0O6NbfnN8e4xBW4oByEE0BDTdfJ5UA9rmw3Q4C0hTt3qNAAYe1ReAOF-P1CW87bJKP6Mc Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adc5e96b6db44e838438f841839f8435", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adc5e96b6db44e838438f841839f8435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}] Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b0f26fea34764430b5e24cb1c96fca16 Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'add7a81d-683f-4d5d-a8cf-78eddaaf2c8d1'} Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image add7a81d-683f-4d5d-a8cf-78eddaaf2c8d1 to delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image add7a81d-683f-4d5d-a8cf-78eddaaf2c8d1 could not be found. Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.323955 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:21:18.328958 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.330628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1cd655ce-6b8f-4f3c-a438-7c9082fc482a tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:18.331649 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1cd655ce-6b8f-4f3c-a438-7c9082fc482a tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] 10.222.0.60 "DELETE /compute/v2.1/images/add7a81d-683f-4d5d-a8cf-78eddaaf2c8d1" status: 404 len: 62 microversion: 2.1 time: 0.071314 Sep 16 14:21:18.337623 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2298/4633] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:21:18 2022] DELETE /compute/v2.1/images/add7a81d-683f-4d5d-a8cf-78eddaaf2c8d1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:21:18.343800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40f815ca-1191-4026-97f6-3dd9c9ebf897 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Calling method '.version_select at 0x7f724c37cee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:18.430982 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-40f815ca-1191-4026-97f6-3dd9c9ebf897 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] HTTP exception thrown: Image not found. Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40f815ca-1191-4026-97f6-3dd9c9ebf897 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Request method failure captured: Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/images/tempest-invalid-1968948406 HTTP/1.1 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIZbvn0APnubLtrESNYupGP-p8fFe29Q0oD6peZtRgBCasiVO0zHJAQY2KiUVvRfU44RWaodO_czaYP2OUypRNkkeiUoCyVLJ-SIUnNW5m0O6NbfnN8e4xBW4oByEE0BDTdfJ5UA9rmw3Q4C0hTt3qNAAYe1ReAOF-P1CW87bJKP6Mc Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adc5e96b6db44e838438f841839f8435", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adc5e96b6db44e838438f841839f8435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}] Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b0f26fea34764430b5e24cb1c96fca16 Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: exception: Image not found. Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'tempest-invalid-1968948406'} Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1968948406 to delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1968948406 could not be found. Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.433363 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:21:18.438339 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.441053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40f815ca-1191-4026-97f6-3dd9c9ebf897 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Returning 404 to user: Image not found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:18.442179 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40f815ca-1191-4026-97f6-3dd9c9ebf897 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] 10.222.0.60 "DELETE /compute/v2.1/images/tempest-invalid-1968948406" status: 404 len: 62 microversion: 2.1 time: 0.103400 Sep 16 14:21:18.443035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2336/4634] 10.222.0.60 () {58 vars in 1206 bytes} [Fri Sep 16 14:21:18 2022] DELETE /compute/v2.1/images/tempest-invalid-1968948406 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:21:18.453258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce45c1e8-6a8c-41f9-854e-49f8ffb89137 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Calling method '.version_select at 0x7f724c4a4d30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:18.552596 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ce45c1e8-6a8c-41f9-854e-49f8ffb89137 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] HTTP exception thrown: Image not found. Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce45c1e8-6a8c-41f9-854e-49f8ffb89137 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Request method failure captured: Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/images/22e90d3e-89e6-480c-bb69-f43027fde51d HTTP/1.1 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIZbvn0APnubLtrESNYupGP-p8fFe29Q0oD6peZtRgBCasiVO0zHJAQY2KiUVvRfU44RWaodO_czaYP2OUypRNkkeiUoCyVLJ-SIUnNW5m0O6NbfnN8e4xBW4oByEE0BDTdfJ5UA9rmw3Q4C0hTt3qNAAYe1ReAOF-P1CW87bJKP6Mc Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adc5e96b6db44e838438f841839f8435", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adc5e96b6db44e838438f841839f8435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adc5e96b6db44e838438f841839f8435"}]}] Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: adc5e96b6db44e838438f841839f8435 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-306601777 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b0f26fea34764430b5e24cb1c96fca16 Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-306601777-project Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: exception: Image not found. Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '22e90d3e-89e6-480c-bb69-f43027fde51d'} Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22e90d3e-89e6-480c-bb69-f43027fde51d to delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22e90d3e-89e6-480c-bb69-f43027fde51d could not be found. Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.554906 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce45c1e8-6a8c-41f9-854e-49f8ffb89137 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] Returning 404 to user: Image not found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:21:18.563689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce45c1e8-6a8c-41f9-854e-49f8ffb89137 tempest-ImagesDeleteNegativeTestJSON-306601777 tempest-ImagesDeleteNegativeTestJSON-306601777-project] 10.222.0.60 "DELETE /compute/v2.1/images/22e90d3e-89e6-480c-bb69-f43027fde51d" status: 404 len: 62 microversion: 2.1 time: 0.110314 Sep 16 14:21:18.568781 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2299/4635] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:21:18 2022] DELETE /compute/v2.1/images/22e90d3e-89e6-480c-bb69-f43027fde51d => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:21:18.715545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:18.717006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:18.751694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:18.755191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:18.756695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:18.765265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:18.766837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:18.769179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:19.091088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3457d7f4-67fa-4641-b460-11b53d1f6af3 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:19.093692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3457d7f4-67fa-4641-b460-11b53d1f6af3 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:19.451047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3457d7f4-67fa-4641-b460-11b53d1f6af3 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:19.465258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3457d7f4-67fa-4641-b460-11b53d1f6af3 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:19.471152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3457d7f4-67fa-4641-b460-11b53d1f6af3 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:19.473463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3457d7f4-67fa-4641-b460-11b53d1f6af3 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1258 microversion: 2.21 time: 0.387884 Sep 16 14:21:19.477156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2300/4636] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:19 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1258 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:19.946200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:19.965952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:19.967477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:19.974113 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec1a71c9-d334-45fd-ab5c-e363e8fd3394 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1753 microversion: 2.20 time: 1.261813 Sep 16 14:21:19.977019 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2337/4637] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:18 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1753 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:20.510918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:20.512311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:20.521693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:20.523302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:20.524065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:20.538303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:20.543288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:20.544257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:20.983825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:21.000209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:21.002562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:21.016175 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ad697f70-d466-42a5-82e7-abc953e3f862 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1310 microversion: 2.21 time: 0.508866 Sep 16 14:21:21.021654 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2301/4638] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:20 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1310 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:21.033177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:21.035417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:21.056121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:21.057060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:21.058536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:21.067954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:21.072071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:21.074372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:22.053874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:22.054744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:22.067074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:22.076682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:22.077646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:22.078289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:22.079282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:22.079938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:22.080620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:22.107477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:22.113336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:22.117067 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50faeeb2-81c9-4d1d-8126-57f5795ce73e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1753 microversion: 2.20 time: 1.087949 Sep 16 14:21:22.135854 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2338/4639] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:21 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1753 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:22.712929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:22.726310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:22.749207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:22.750958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-feef2223-1add-4f18-bfa0-955908bf19e8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1316 microversion: 2.21 time: 0.703316 Sep 16 14:21:22.757622 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2302/4640] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:22 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1316 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:23.182680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:23.188291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:23.220736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:23.221946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:23.223017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:23.228468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:23.229768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:23.233689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:23.788880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:23.809520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:23.863406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:23.866466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:23.870585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:23.881888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:23.892508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:23.902366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:25.365377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:25.384258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:25.386321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:25.390861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e5194dfb-e3fb-4b2d-8917-c53644adcce8 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 1.610983 Sep 16 14:21:25.401847 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2303/4641] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:23 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:25.406867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:25.448235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:25.457881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:25.466710 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-735519d6-f695-4cc6-80aa-6d19bfb11358 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1753 microversion: 2.20 time: 2.289834 Sep 16 14:21:25.471722 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2339/4642] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:23 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1753 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:26.432062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:26.432743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:26.444871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:26.445402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:26.446380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:26.459000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:26.459506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:26.466658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:26.530086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:26.531529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:26.554141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:26.557230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:26.560414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:26.564860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:26.565808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:26.569239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:26.634992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:28.028703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:28.071222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:28.087730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:28.090966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:28.094827 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa1161d6-fa7c-4c06-a19e-4a47366f5de0 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 1.666751 Sep 16 14:21:28.097640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2304/4643] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:26 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:28.144687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:28.203709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:28.205404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:28.207050 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0701a00-b025-454d-a5f2-2c28f1dcdfc6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1753 microversion: 2.20 time: 1.681174 Sep 16 14:21:28.208305 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2340/4644] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:26 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1753 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:29.148413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:29.149928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:29.172318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:29.181713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:29.183863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:29.186777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:29.187780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:29.189587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:29.263910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:29.264754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:29.268839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:29.284871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:29.285382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:29.294884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:29.296032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:29.296525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:29.296969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:29.464778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:30.041344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:30.060603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:30.067387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:30.069510 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f315e41-2efa-4377-b506-9eea2d043ec7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 0.930332 Sep 16 14:21:30.085925 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2305/4645] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:29 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:30.097372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-36fb8a89-9faa-415f-a7c9-f4c908b3c77b req-c30d5e23-0c53-4f9a-baec-e6af5f758980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4f5ad-0eb2-413c-999c-2f3b1fa03978", "tag": "7e8922c0-f1b6-4f6a-ac8c-85b63a708131"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:30.122797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-36fb8a89-9faa-415f-a7c9-f4c908b3c77b req-c30d5e23-0c53-4f9a-baec-e6af5f758980 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:30.123617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-36fb8a89-9faa-415f-a7c9-f4c908b3c77b req-c30d5e23-0c53-4f9a-baec-e6af5f758980 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:30.123987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-36fb8a89-9faa-415f-a7c9-f4c908b3c77b req-c30d5e23-0c53-4f9a-baec-e6af5f758980 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:30.148814 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-36fb8a89-9faa-415f-a7c9-f4c908b3c77b req-c30d5e23-0c53-4f9a-baec-e6af5f758980 service nova] Creating event network-changed:7e8922c0-f1b6-4f6a-ac8c-85b63a708131 for instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 on n-h2-858129-2 Sep 16 14:21:30.158097 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-36fb8a89-9faa-415f-a7c9-f4c908b3c77b req-c30d5e23-0c53-4f9a-baec-e6af5f758980 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072043 Sep 16 14:21:30.159599 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2306/4646] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:30.333918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:30.352065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:30.353727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:30.356906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df850a12-5284-44e6-804c-480aac50ac93 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.104330 Sep 16 14:21:30.360398 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2341/4647] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:29 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:31.100377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:31.101470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:31.109637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:31.110466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:31.111132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:31.112116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:31.112791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:31.113408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:31.420367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:31.421652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:31.430922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:31.431721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:31.432376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:31.433353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:31.434023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:31.435384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:31.976987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:32.036398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:32.045923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:32.049671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce5bb5e5-f4d7-4cee-8ba1-2154751b9142 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 0.953928 Sep 16 14:21:32.052162 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2307/4648] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:31 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:32.553387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:32.588026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:32.599323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:32.605656 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-129b17b7-075c-46e2-86a0-9bb144353b0c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.188429 Sep 16 14:21:32.607826 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2342/4649] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:31 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:33.102576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:33.103620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:33.116461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:33.117791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:33.118895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:33.120569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:33.121643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:33.122630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:33.636361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:33.637698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:33.645710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:33.646540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:33.647175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:33.648105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:33.648757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:33.649900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:34.056768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:34.074179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:34.076155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:34.077710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e43a4c1-3c7f-4e79-b35b-ddf791f69ece tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 0.983074 Sep 16 14:21:34.080640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2308/4650] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:33 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:34.594954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:34.629364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:34.635751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:34.638990 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c6c7210-4a66-4cf8-a918-e3fa572696b7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.006578 Sep 16 14:21:34.644704 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2343/4651] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:33 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:35.130682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:35.138156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:35.168820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:35.169335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:35.173095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:35.175206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:35.175756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:35.177451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:35.200763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:35.680319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:35.681888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:35.702674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:35.712298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:35.713169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:35.714195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:35.716901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:35.717736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:36.974895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:37.007415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:37.010436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:37.011722 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9785ef81-21b3-4760-b1cf-8d22b93329f6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.337558 Sep 16 14:21:37.012225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:37.026141 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2344/4652] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:35 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:37.073302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:37.084513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:37.091441 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a78f34c3-cedd-4383-95c0-acc2c0cc9f42 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 1.967389 Sep 16 14:21:37.092585 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2309/4653] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:35 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:38.070035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:38.071705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:38.092151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:38.094198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:38.095266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:38.099876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:38.101475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:38.104500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:38.120798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:38.123165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:38.130231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:38.164010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:38.165404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:38.169629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:38.178491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:38.179774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:38.185071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:40.429431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:40.463666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:40.467488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:40.478484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:40.488627 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ce36624-fcb6-4e06-9b51-da163cfcd508 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 2.425983 Sep 16 14:21:40.492729 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2345/4654] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:38 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:40.494695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:40.506079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:40.507920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a513e79-46aa-4bba-b7cb-784773e8b68b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 2.393271 Sep 16 14:21:40.528789 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2310/4655] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:38 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:41.304710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-eafcae88-aef8-4fb3-9936-f2383a724671 req-f1a54692-553e-4482-b17f-4e24979fe36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4f5ad-0eb2-413c-999c-2f3b1fa03978", "name": "network-vif-plugged", "status": "completed", "tag": "7e8922c0-f1b6-4f6a-ac8c-85b63a708131"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:41.332079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eafcae88-aef8-4fb3-9936-f2383a724671 req-f1a54692-553e-4482-b17f-4e24979fe36d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:41.335525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eafcae88-aef8-4fb3-9936-f2383a724671 req-f1a54692-553e-4482-b17f-4e24979fe36d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:41.336275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eafcae88-aef8-4fb3-9936-f2383a724671 req-f1a54692-553e-4482-b17f-4e24979fe36d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:41.368547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-eafcae88-aef8-4fb3-9936-f2383a724671 req-f1a54692-553e-4482-b17f-4e24979fe36d service nova] Creating event network-vif-plugged:7e8922c0-f1b6-4f6a-ac8c-85b63a708131 for instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 on n-h2-858129-2 Sep 16 14:21:41.384888 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-eafcae88-aef8-4fb3-9936-f2383a724671 req-f1a54692-553e-4482-b17f-4e24979fe36d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095689 Sep 16 14:21:41.385891 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2346/4656] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:41.527520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:41.529290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:41.545722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:41.547201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:41.574199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:41.576948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:41.577449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:41.577917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:41.591673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:41.593072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:41.593585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:41.596013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:41.597125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:41.597585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:41.603026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:41.607328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:43.799895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:43.819069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:43.825625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:43.827884 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9fc5863b-d27d-4e15-8588-f3820f0dc844 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 2.289093 Sep 16 14:21:43.842381 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2347/4657] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:41 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:43.917070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:43.967868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:43.982671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:43.989882 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be36c539-30a8-431a-89e3-d76a8cd33648 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 2.469856 Sep 16 14:21:44.001733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2311/4658] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:41 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 2477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:44.875910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:44.876764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:44.896158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:44.896675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:44.897341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:44.899248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:44.900211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:44.901040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:44.981563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=69 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:45.053568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:45.055087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:45.076192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:45.083666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:45.085076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:45.092499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:45.097990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:45.100356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:46.037150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:46.062046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:46.067448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:46.069085 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01a150f6-4758-4eee-8c55-6174cc3b9857 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1358 microversion: 2.21 time: 1.199649 Sep 16 14:21:46.074320 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2348/4659] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:44 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1358 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:46.098155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:46.110801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:46.112783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:46.114332 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e228de7-5141-4ffe-affd-d7847e6bf711 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.069226 Sep 16 14:21:46.115184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2312/4660] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:45 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:47.105419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:47.109485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:47.143927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:47.144516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:47.145005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:47.145774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:47.146243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:47.150782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:47.180585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:47.181401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:47.216839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:47.219254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:47.220774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:47.223344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:47.227781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:47.238159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:47.814959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:47.876119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:47.884199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:47.888646 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44fe4185-fb61-4dd6-a030-b3f98ba51788 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.712890 Sep 16 14:21:47.897328 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2313/4661] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:47 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:48.097418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:48.113795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:48.120713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:48.122544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-614be0fe-f9bf-4422-b489-bb420bd11b35 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1551 microversion: 2.21 time: 1.021278 Sep 16 14:21:48.142714 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2349/4662] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:47 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1551 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:48.165183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:48.171582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:48.221831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:48.226101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:48.227938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:48.230530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:48.231885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:48.234892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:48.279730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:21:48.474184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 204 len: 0 microversion: 2.21 time: 0.317528 Sep 16 14:21:48.481162 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2314/4663] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:21:48 2022] DELETE /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:21:48.497563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:48.501119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:48.565858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:48.566947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:48.570888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:48.574326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:48.578593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:48.579452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:48.918321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:48.923184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a24e6cbf-7a7b-48ad-84a8-e6502db23d61 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006862 Sep 16 14:21:48.923971 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2315/4664] 10.222.0.60 () {56 vars in 886 bytes} [Fri Sep 16 14:21:48 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 16 14:21:48.961433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:48.963275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:48.994492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:48.995380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:48.996190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:49.006378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:49.007502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:49.012154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:49.452701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:49.471472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:49.473818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:49.475645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ea1101c-3572-4b96-9ada-e105282afa3b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.550312 Sep 16 14:21:49.476474 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2316/4665] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:48 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:49.584379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:49.598989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:49.602894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:49.609154 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e519ac9f-a620-4f0f-9699-11a3202d7397 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1557 microversion: 2.21 time: 1.123149 Sep 16 14:21:49.611175 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2350/4666] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:48 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1557 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:50.525108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:50.532391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:50.544920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:50.550650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:50.551475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:50.552551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:50.557342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:50.558224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:50.642324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:50.643843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:50.669782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:50.670841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:50.671579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:50.675549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:50.676964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:50.684865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:52.305701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:52.320398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:52.322517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:52.323782 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0541d01-86ab-4504-a62c-1975a8385f10 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.807048 Sep 16 14:21:52.345816 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2317/4667] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:50 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:52.576110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:52.608484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:52.615876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:52.618605 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8a07aa33-9b42-4ece-a576-2610ad375329 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1557 microversion: 2.21 time: 1.980071 Sep 16 14:21:52.626765 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2351/4668] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:50 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1557 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:53.396274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:53.397664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:53.409131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:53.417331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:53.423402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:53.425418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:53.427775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:53.429617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:53.672358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:53.673727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:53.748162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:53.766617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:53.769805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:53.775203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:53.777368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:53.778131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:55.153355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:55.171909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:55.173541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:55.175618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31c69021-065e-4cc6-b68f-2dc85239a041 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.782911 Sep 16 14:21:55.176679 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2318/4669] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:53 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:55.249497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:55.267526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:55.280114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:55.284835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6fe8d707-d41d-42e0-b52d-7eb1052a9ee7 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1557 microversion: 2.21 time: 1.619920 Sep 16 14:21:55.289056 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2352/4670] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:53 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1557 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:56.125773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7869757d-5b06-4d45-8e1d-61b22ad590ab req-23083a1b-746c-4d25-9b75-eb867a9b6d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4f5ad-0eb2-413c-999c-2f3b1fa03978", "name": "network-vif-deleted", "tag": "7e8922c0-f1b6-4f6a-ac8c-85b63a708131"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:21:56.199300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7869757d-5b06-4d45-8e1d-61b22ad590ab req-23083a1b-746c-4d25-9b75-eb867a9b6d2d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:56.201175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7869757d-5b06-4d45-8e1d-61b22ad590ab req-23083a1b-746c-4d25-9b75-eb867a9b6d2d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:56.202128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7869757d-5b06-4d45-8e1d-61b22ad590ab req-23083a1b-746c-4d25-9b75-eb867a9b6d2d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:56.221469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:56.222302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:56.227657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7869757d-5b06-4d45-8e1d-61b22ad590ab req-23083a1b-746c-4d25-9b75-eb867a9b6d2d service nova] Creating event network-vif-deleted:7e8922c0-f1b6-4f6a-ac8c-85b63a708131 for instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 on n-h2-858129-2 Sep 16 14:21:56.234303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:56.237473 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7869757d-5b06-4d45-8e1d-61b22ad590ab req-23083a1b-746c-4d25-9b75-eb867a9b6d2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139206 Sep 16 14:21:56.238336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:56.238956 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2319/4671] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:21:56.239093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:56.240009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:56.251298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:56.252185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:56.363903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:56.366988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:56.394198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:56.396191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:56.398675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:56.401619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:56.403576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:56.404887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:56.563438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:56.577136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:56.578746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:56.580475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49aecbef-df27-44fb-ad28-5a0315a07984 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1515 microversion: 2.21 time: 0.240449 Sep 16 14:21:56.581582 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2320/4672] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:56 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:56.591554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:56.623341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:56.625769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:56.627502 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-548320e0-691f-4ee5-ad5e-5a373e7bc310 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.410367 Sep 16 14:21:56.628938 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2353/4673] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:56 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:57.609544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:57.610295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:57.641155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:57.641781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:57.642427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:57.646255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:57.647051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:57.649185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:57.679643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:57.681604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:57.712568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:57.718583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:57.719368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:57.722453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:57.724895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:57.728209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:57.794067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:57.803676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:57.804345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:57.809168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lazy-loading 'fault' on Instance uuid 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:21:58.034972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:58.045616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:58.050802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:58.056438 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef972aa2-0ce5-4771-b926-1f7ab0876d5f tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1348 microversion: 2.21 time: 0.450997 Sep 16 14:21:58.065878 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2321/4674] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:57 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1348 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:58.454232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:58.466937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:58.468924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:58.474886 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b699df03-d2b5-4067-9012-5d209a7e9fff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.799387 Sep 16 14:21:58.476229 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2354/4675] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:57 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:21:59.105179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:59.116351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:59.162231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:59.175620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:59.182237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:59.201085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:59.202267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:59.203219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:59.347060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:59.348519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:59.349567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:59.350667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lazy-loading 'fault' on Instance uuid 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:21:59.533569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:21:59.544074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:21:59.548501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:59.582856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:59.585500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9558a1e8b394863ba1f6a503bf8bdf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aba83cbf78c421da0a3e6b85c436877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:21:59.594070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72a7a21a-1861-41fd-b767-88389777b949 tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 200 len: 1348 microversion: 2.21 time: 0.507658 Sep 16 14:21:59.600342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2322/4676] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:59 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 1348 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:21:59.602384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=28 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:21:59.611197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:59.639130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:59.641714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:21:59.652313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:21:59.654182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:21:59.654764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:00.523154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:00.543811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:00.548158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:00.551688 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee84a99a-b34e-402d-aae0-9bb54672f794 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.027894 Sep 16 14:22:00.554124 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2355/4677] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:21:59 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:22:00.636784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:00.637882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:00.678352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:00.679732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Calling method '.version_select at 0x7f724c25a670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:00.681047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:00.681202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:00.682457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:00.688700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:00.694042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:00.757042 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] HTTP exception thrown: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Request method failure captured: Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 HTTP/1.1 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIZXDTXpPwDvDBdXRuWXS6RkYwCcYIOjsE1TRE27vu4JH1EHRY2wtwbqesQXgbtj1CVCf2yjV3YYEjDUY62LMMc_T7TDFuLR4-3p4FkiJgKjD8ci8IK7R0lipeQcP_VTxVdalsQrJzlyaG1MtcZFI8kFKdy_Oc7NHJlvasdEXhGBsVg Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.21 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 7aba83cbf78c421da0a3e6b85c436877 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aba83cbf78c421da0a3e6b85c436877", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aba83cbf78c421da0a3e6b85c436877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aba83cbf78c421da0a3e6b85c436877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aba83cbf78c421da0a3e6b85c436877"}]}] Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 7aba83cbf78c421da0a3e6b85c436877 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceActionsV221TestJSON-520082107-project Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e9558a1e8b394863ba1f6a503bf8bdf5 Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceActionsV221TestJSON-520082107-project Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '36c4f5ad-0eb2-413c-999c-2f3b1fa03978'} Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.760041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Returning 404 to user: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2722ccaa-5f3a-4a08-99ef-75b64833009b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 404 len: 111 microversion: 2.21 time: 0.140440 Sep 16 14:22:00.771939 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2356/4678] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:00 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:22:00.792823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '.version_select at 0x7f724c2fb160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:00.809123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:22:00.810075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:00.810222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.security_group_api [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Neutron security group 84683f9a-5923-45a6-90d5-826f566f5282 not found {{(pid=128642) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:22:00.812796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] HTTP exception thrown: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.812796 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Request method failure captured: Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/os-security-groups/84683f9a-5923-45a6-90d5-826f566f5282 HTTP/1.1 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaIy-t8bvTsOc_Ui-elP3zfIVy3VoYQbKkWm1atIJ02wxMC73IUxz0bf04CvU0iS2hAS-CVhp9NvThY41G0P4k7WpHHhEl9aAvb_MAKiHyyfHg8Z2KPBTUbSRmNc5xk1jX2nJe6PIQt6QyL4_IwZ2EauKLTZ_m49RlRm1K1N789v9E Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_435f86f54eaa4e718e593b869c656746", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/435f86f54eaa4e718e593b869c656746"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}] Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 9e3bb8930f3d466d81377734bb48ac80 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '84683f9a-5923-45a6-90d5-826f566f5282'} Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:22:00.816749 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Returning 404 to user: Security group 84683f9a-5923-45a6-90d5-826f566f5282 does not exist Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-a5f32355-a543-4369-8f35-0052213f8f32'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7aead3b8-759a-4c40-a7ee-21c58ccc2196 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/84683f9a-5923-45a6-90d5-826f566f5282" status: 404 len: 194 microversion: 2.1 time: 0.453052 Sep 16 14:22:00.829875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2323/4679] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:22:00 2022] DELETE /compute/v2.1/os-security-groups/84683f9a-5923-45a6-90d5-826f566f5282 => generated 194 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:22:00.840173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:00.840173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:00.840173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:00.840173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:00.840173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:00.840173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:00.845658 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-78702b22-f353-4f58-bfcf-8cbb5197ec8d tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.012866 Sep 16 14:22:00.856018 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2324/4680] 10.222.0.60 () {58 vars in 1164 bytes} [Fri Sep 16 14:22:00 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 14:22:00.880406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44b0a4fc-1a43-4b2c-8df6-cbc9a74bb2db tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Calling method '.version_select at 0x7f724c4471f0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:01.059349 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a7122bf-40be-4472-a898-0b590632ccfc tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.279105 Sep 16 14:22:01.059967 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2357/4681] 10.222.0.60 () {60 vars in 1337 bytes} [Fri Sep 16 14:22:00 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978/os-instance-actions => generated 611 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:22:01.081440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:01.081962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:01.092053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:01.092668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:01.093000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:01.093753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:01.098306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:01.098870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:01.132373 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] HTTP exception thrown: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Request method failure captured: Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 HTTP/1.1 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIZXDTXpPwDvDBdXRuWXS6RkYwCcYIOjsE1TRE27vu4JH1EHRY2wtwbqesQXgbtj1CVCf2yjV3YYEjDUY62LMMc_T7TDFuLR4-3p4FkiJgKjD8ci8IK7R0lipeQcP_VTxVdalsQrJzlyaG1MtcZFI8kFKdy_Oc7NHJlvasdEXhGBsVg Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.21 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 7aba83cbf78c421da0a3e6b85c436877 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aba83cbf78c421da0a3e6b85c436877", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aba83cbf78c421da0a3e6b85c436877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aba83cbf78c421da0a3e6b85c436877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aba83cbf78c421da0a3e6b85c436877"}]}] Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 7aba83cbf78c421da0a3e6b85c436877 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceActionsV221TestJSON-520082107-project Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e9558a1e8b394863ba1f6a503bf8bdf5 Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceActionsV221TestJSON-520082107-project Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '36c4f5ad-0eb2-413c-999c-2f3b1fa03978'} Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:22:01.134119 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.138371 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.140866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Returning 404 to user: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:01.141986 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e9ca5c2b-9fdb-4cf0-b0f4-d9d914ce940e tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 404 len: 111 microversion: 2.21 time: 0.064674 Sep 16 14:22:01.146636 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2358/4682] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:22:01 2022] DELETE /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:01.152653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:01.153604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] [instance: 36c4f5ad-0eb2-413c-999c-2f3b1fa03978] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:01.161222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:01.162383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:01.163504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:01.166144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:01.166974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:01.167615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:01.201525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] HTTP exception thrown: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Request method failure captured: Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 HTTP/1.1 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIZXDTXpPwDvDBdXRuWXS6RkYwCcYIOjsE1TRE27vu4JH1EHRY2wtwbqesQXgbtj1CVCf2yjV3YYEjDUY62LMMc_T7TDFuLR4-3p4FkiJgKjD8ci8IK7R0lipeQcP_VTxVdalsQrJzlyaG1MtcZFI8kFKdy_Oc7NHJlvasdEXhGBsVg Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.21 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 7aba83cbf78c421da0a3e6b85c436877 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7aba83cbf78c421da0a3e6b85c436877", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aba83cbf78c421da0a3e6b85c436877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7aba83cbf78c421da0a3e6b85c436877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7aba83cbf78c421da0a3e6b85c436877"}]}] Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 7aba83cbf78c421da0a3e6b85c436877 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-520082107 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-InstanceActionsV221TestJSON-520082107-project Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: e9558a1e8b394863ba1f6a503bf8bdf5 Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-InstanceActionsV221TestJSON-520082107-project Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '36c4f5ad-0eb2-413c-999c-2f3b1fa03978'} Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.204834 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] Returning 404 to user: Instance 36c4f5ad-0eb2-413c-999c-2f3b1fa03978 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:01.208858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-864ad516-42ae-409d-a986-15f74183136b tempest-InstanceActionsV221TestJSON-520082107 tempest-InstanceActionsV221TestJSON-520082107-project] 10.222.0.60 "GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978" status: 404 len: 111 microversion: 2.21 time: 0.059115 Sep 16 14:22:01.215570 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2359/4683] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:01 2022] GET /compute/v2.1/servers/36c4f5ad-0eb2-413c-999c-2f3b1fa03978 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:01.576158 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44b0a4fc-1a43-4b2c-8df6-cbc9a74bb2db tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.718282 Sep 16 14:22:01.580564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2325/4684] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 14:22:00 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:01.599880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d56d3ab1-1c76-4ee6-8c6a-8823804e4588 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Calling method '.version_select at 0x7f724c34a3a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:01.600841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:01.602798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:01.611958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:01.612798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:01.613651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:01.614690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:01.615353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:01.615981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:02.564839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:02.615644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:02.621242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:02.625954 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-014619dd-1d18-417e-838d-b23afb84e86e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.029796 Sep 16 14:22:02.653061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2326/4685] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:01 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:22:02.667407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-d56d3ab1-1c76-4ee6-8c6a-8823804e4588 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:22:02.668835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d56d3ab1-1c76-4ee6-8c6a-8823804e4588 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 16 14:22:02.668835 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d56d3ab1-1c76-4ee6-8c6a-8823804e4588 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Request method failure captured: Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/os-security-groups/1f84ac0b-7a42-4278-a0bb-08b972113ab5 HTTP/1.1 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaIy-t8bvTsOc_Ui-elP3zfIVy3VoYQbKkWm1atIJ02wxMC73IUxz0bf04CvU0iS2hAS-CVhp9NvThY41G0P4k7WpHHhEl9aAvb_MAKiHyyfHg8Z2KPBTUbSRmNc5xk1jX2nJe6PIQt6QyL4_IwZ2EauKLTZ_m49RlRm1K1N789v9E Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_435f86f54eaa4e718e593b869c656746", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/435f86f54eaa4e718e593b869c656746"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}] Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 9e3bb8930f3d466d81377734bb48ac80 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: exception: Insufficient rights for removing default security group. Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1f84ac0b-7a42-4278-a0bb-08b972113ab5'} Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:22:02.671544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] Sep 16 14:22:02.675633 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.687973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d56d3ab1-1c76-4ee6-8c6a-8823804e4588 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 16 14:22:02.687973 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-862ba5b5-1dda-4144-bb1f-34b43064042c'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:02.689850 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d56d3ab1-1c76-4ee6-8c6a-8823804e4588 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/1f84ac0b-7a42-4278-a0bb-08b972113ab5" status: 400 len: 182 microversion: 2.1 time: 1.096922 Sep 16 14:22:02.690749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2360/4686] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:22:01 2022] DELETE /compute/v2.1/os-security-groups/1f84ac0b-7a42-4278-a0bb-08b972113ab5 => generated 182 bytes in 1100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:02.715203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Calling method '.version_select at 0x7f724c3348b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:02.757809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG neutronclient.v2_0.client [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist", "detail": ""}} {{(pid=128642) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:22:02.759050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.security_group_api [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Neutron security group 4be61e2e-f752-4246-b661-9f4a23b05109 not found {{(pid=128642) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:22:02.759597 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] HTTP exception thrown: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.759597 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Request method failure captured: Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-security-groups/4be61e2e-f752-4246-b661-9f4a23b05109 HTTP/1.1 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaIy-t8bvTsOc_Ui-elP3zfIVy3VoYQbKkWm1atIJ02wxMC73IUxz0bf04CvU0iS2hAS-CVhp9NvThY41G0P4k7WpHHhEl9aAvb_MAKiHyyfHg8Z2KPBTUbSRmNc5xk1jX2nJe6PIQt6QyL4_IwZ2EauKLTZ_m49RlRm1K1N789v9E Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_435f86f54eaa4e718e593b869c656746", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/435f86f54eaa4e718e593b869c656746"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}] Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 9e3bb8930f3d466d81377734bb48ac80 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: exception: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4be61e2e-f752-4246-b661-9f4a23b05109'} Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:22:02.761752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Returning 404 to user: Security group 4be61e2e-f752-4246-b661-9f4a23b05109 does not exist Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: Neutron server returns request_ids: ['req-2bb0052d-01d4-41cb-a9a8-9c350895b911'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:02.768942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af69efb3-fafc-4322-b3a7-5f236f3eb453 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/4be61e2e-f752-4246-b661-9f4a23b05109" status: 404 len: 194 microversion: 2.1 time: 0.058559 Sep 16 14:22:02.776539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2327/4687] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:22:02 2022] GET /compute/v2.1/os-security-groups/4be61e2e-f752-4246-b661-9f4a23b05109 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:22:02.781479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Action: 'update', calling method: .version_select at 0x7f724c4c11f0>, body: {"security_group": {"name": "tempest-sg-123121912", "description": "tempest-description-39187060"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:02.924036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist", "detail": ""}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 14:22:02.924690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Neutron security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac not found {{(pid=128643) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 16 14:22:02.925259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] HTTP exception thrown: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.925259 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Request method failure captured: Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/os-security-groups/480d4d14-fbc7-433e-9b5f-eb48f0202aac HTTP/1.1 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 99 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaIy-t8bvTsOc_Ui-elP3zfIVy3VoYQbKkWm1atIJ02wxMC73IUxz0bf04CvU0iS2hAS-CVhp9NvThY41G0P4k7WpHHhEl9aAvb_MAKiHyyfHg8Z2KPBTUbSRmNc5xk1jX2nJe6PIQt6QyL4_IwZ2EauKLTZ_m49RlRm1K1N789v9E Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_435f86f54eaa4e718e593b869c656746", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/435f86f54eaa4e718e593b869c656746"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/435f86f54eaa4e718e593b869c656746"}]}] Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 435f86f54eaa4e718e593b869c656746 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-85628268 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 9e3bb8930f3d466d81377734bb48ac80 Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-85628268-project Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: {"security_group": {"name": "tempest-sg-123121912", "description": "tempest-description-39187060"}} Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: method: Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: exception: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '480d4d14-fbc7-433e-9b5f-eb48f0202aac', 'body': {'security_group': {'name': 'tempest-sg-123121912', 'description': 'tempest-description-39187060'}}} Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 16 14:22:02.927377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] Returning 404 to user: Security group 480d4d14-fbc7-433e-9b5f-eb48f0202aac does not exist Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: Neutron server returns request_ids: ['req-9494ebdb-e3f0-4169-8965-e008eec2dbf6'] {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d572e231-9caf-4bfe-b94e-bdfabf1ed348 tempest-SecurityGroupsNegativeTestJSON-85628268 tempest-SecurityGroupsNegativeTestJSON-85628268-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/480d4d14-fbc7-433e-9b5f-eb48f0202aac" status: 404 len: 194 microversion: 2.1 time: 0.155076 Sep 16 14:22:02.937573 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2361/4688] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Sep 16 14:22:02 2022] PUT /compute/v2.1/os-security-groups/480d4d14-fbc7-433e-9b5f-eb48f0202aac => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:22:03.686970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:03.687807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:03.703571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:03.704075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:03.704526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:03.705281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:03.705749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:03.710447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:04.249994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:04.319117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:04.326826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:04.342014 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17fdcb26-9e66-47ca-988a-1b2df20a5b9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.669489 Sep 16 14:22:04.347932 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2328/4689] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:03 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:22:05.392311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:05.395029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:05.436800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:05.437304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:05.437753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:05.458660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:05.459339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:05.459802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:06.898336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-35373f2c-7fa2-4c0d-b39c-bf75458c96a4 tempest-ExtensionsTest-680402550 tempest-ExtensionsTest-680402550-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:06.901731 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-35373f2c-7fa2-4c0d-b39c-bf75458c96a4 tempest-ExtensionsTest-680402550 tempest-ExtensionsTest-680402550-project] 10.222.0.60 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 1.076080 Sep 16 14:22:06.906978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2329/4690] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 14:22:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:06.921590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c1b181f-0325-4dfb-9cdb-d9a2db4ae196 tempest-ExtensionsTest-680402550 tempest-ExtensionsTest-680402550-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:06.925217 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c1b181f-0325-4dfb-9cdb-d9a2db4ae196 tempest-ExtensionsTest-680402550 tempest-ExtensionsTest-680402550-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016756 Sep 16 14:22:06.931682 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2330/4691] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Sep 16 14:22:06 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:22:07.153964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:07.185981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:07.189117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:07.191404 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-92943542-8673-4264-9e2c-73580b0e262d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.812356 Sep 16 14:22:07.193959 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2362/4692] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:05 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:22:08.225074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:08.225985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:08.262559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:08.264070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:08.278462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:08.283682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:08.284584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:08.285406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:08.425120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:09.150065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:09.165698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:09.180644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:09.183498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59c9fedb-6bee-49b6-a334-f3cbdfbb3acc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.961925 Sep 16 14:22:09.217394 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2331/4693] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:08 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:22:10.247572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:10.254178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:10.284384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:10.285266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:10.286076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:10.287469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:10.288260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:10.288857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:11.131712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:11.146776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:11.148304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:11.158071 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-999551f8-72c8-4907-bdd1-b88d5a18795b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 0.915631 Sep 16 14:22:11.165936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2363/4694] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:10 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:22:11.672026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:11.672646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:11.688078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:11.696255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:11.697079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:11.697707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:11.698671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:11.701390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:11.702027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:12.193190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:12.195274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:12.211292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:12.214217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:12.215020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:12.217550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:12.221406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:12.221979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:13.904139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:13.917176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-452d0ebb-09f6-42d2-9f9c-5ca260806815 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 2.251737 Sep 16 14:22:13.918182 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2332/4695] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:11 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:13.929054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d44831eb-aec8-4bb6-bf57-f41a24de386f req-5af746bc-f0c4-4222-9828-eb79428206a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "name": "network-vif-plugged", "status": "completed", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:13.973040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d44831eb-aec8-4bb6-bf57-f41a24de386f req-5af746bc-f0c4-4222-9828-eb79428206a8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:13.973546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d44831eb-aec8-4bb6-bf57-f41a24de386f req-5af746bc-f0c4-4222-9828-eb79428206a8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:13.973995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d44831eb-aec8-4bb6-bf57-f41a24de386f req-5af746bc-f0c4-4222-9828-eb79428206a8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:14.005004 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d44831eb-aec8-4bb6-bf57-f41a24de386f req-5af746bc-f0c4-4222-9828-eb79428206a8 service nova] Creating event network-vif-plugged:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:22:14.019502 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d44831eb-aec8-4bb6-bf57-f41a24de386f req-5af746bc-f0c4-4222-9828-eb79428206a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099776 Sep 16 14:22:14.022037 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2333/4696] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:14.464823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1189510839", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:14.561498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] validate_networks() for [('4e265fd5-52bc-47bb-af24-2c89589c7a06', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:22:15.553718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:15.557008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=76 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:15.596241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:15.607385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:15.610618 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0dd93e44-01c5-401d-9278-9586665cc056 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 3.425161 Sep 16 14:22:15.611208 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2364/4697] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:12 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 3427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:22:15.637882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:15.642069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:15.672143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:15.672768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:15.673246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:15.673973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:15.677512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:15.680194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:18.504543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:22:18.505460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:22:18.505460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:22:18.506611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:22:18.507098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:22:18.517105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:18.531298 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c34a3ada-e671-4fc8-88a6-9eb3aab7b1d1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 2.912672 Sep 16 14:22:18.531953 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2365/4698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:15 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 2917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:18.559417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:18.560675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:18.561654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:18.562752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:18.564134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:18.567770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:18.569026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:18.572084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:18.578336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:18.579661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:18.581963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:18.584183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:18.585074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:18.587539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:18.647217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Getting quotas for project 6a4c0f62449a419594af6e73b821cc31. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:18.667138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Getting quotas for user 2d093d019a504159871c04a88352f43f and project 6a4c0f62449a419594af6e73b821cc31. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:18.717327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:22:18.721144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:22:18.900763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-330d0f9d-d3d5-4e6d-9e37-2f01900797c2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.876954 Sep 16 14:22:18.915916 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2334/4699] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:22:18.928362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:18.931307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:18.982891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:18.987892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:18.994046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:19.000349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:19.005085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:19.006998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:20.392087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:20.433184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:20.443328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:20.447355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a58fbc02-1c57-4fb9-aca9-ecb29c98976d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1809 microversion: 2.20 time: 1.901140 Sep 16 14:22:20.448351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2366/4700] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:18 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1809 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:22:20.463912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:20.466847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:20.483727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:20.486923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:20.487512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:20.494517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:20.495536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:20.496186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:20.496333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:20.508921 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-408571b3-4853-4e0c-b277-7e627ac9b39d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.589812 Sep 16 14:22:20.511169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2335/4701] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:18 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:20.553879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:20.557715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:20.582953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:20.587593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:20.591779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:20.594942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:20.598682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:20.599416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:20.884003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:20.909024 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a759f62-8fe9-43d8-ad0b-70940c933287 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1213 microversion: 2.1 time: 0.458276 Sep 16 14:22:20.915856 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2367/4702] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:20 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1213 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:20.993743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:21.004209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c434260-de0c-49ed-8a4c-259a076341a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.454270 Sep 16 14:22:21.011764 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2336/4703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:20 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:21.431256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1907369104", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f64a9d39-280d-4bfc-99d8-7531ba64697a"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:21.478049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:21.478652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:21.487841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:21.494610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:21.495076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:21.501391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:21.502072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:21.502342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:21.611842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] validate_networks() for [('f64a9d39-280d-4bfc-99d8-7531ba64697a', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:22:22.404119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:22.423232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:22.424733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:22.438263 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e42e4434-e85c-4775-96c1-5cc6c554726a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1796 microversion: 2.20 time: 0.964162 Sep 16 14:22:22.444341 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2337/4704] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:22:21 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1796 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:22:22.462204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:22.467632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:22.485962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:22.488114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:22.489503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:22.491166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:22.492039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:22.494661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:22.716288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:22.732982 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8314169d-05c0-45fa-a542-76bcad61f284 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1275 microversion: 2.1 time: 0.286429 Sep 16 14:22:22.740383 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2338/4705] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:22 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:22.964675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:22:22.965281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:22:22.966047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:22:22.967045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:22:22.967625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:22:23.002433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:23.009320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:23.011516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:23.015561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:23.016512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:23.018119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:23.127840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:23.155916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for user 7b08b72cf46345f2a3c88a6251b1c996 and project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:23.185459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:22:23.197684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:22:23.330396 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-782d1e0f-08bc-48b5-ba6a-0c9f562f89f0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.904556 Sep 16 14:22:23.332658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2368/4706] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:22:23.353675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ab12c4d-18f3-466d-af30-31c56de4ae9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:23.356487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ab12c4d-18f3-466d-af30-31c56de4ae9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:23.541580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ab12c4d-18f3-466d-af30-31c56de4ae9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:23.562082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ab12c4d-18f3-466d-af30-31c56de4ae9b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1215 microversion: 2.1 time: 0.216375 Sep 16 14:22:23.572429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2339/4707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:23 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:23.789993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:23.791346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:23.842615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:23.843137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:23.843587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:23.844369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:23.844839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:23.845269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:24.097309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:24.123751 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41e254ef-f437-403e-9313-cf8f655a76fa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1275 microversion: 2.1 time: 0.346749 Sep 16 14:22:24.128181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2369/4708] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:23 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:24.609690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:24.614234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:24.639710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:24.646107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:24.647258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:24.648349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:24.651325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:24.654113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:25.150063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:25.150714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:25.183354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:25.184112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:25.184785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:25.186031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:25.224889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:25.231509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:25.265585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:25.276659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ed2e216-fc74-408d-9fdf-7bd031670443 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1219 microversion: 2.1 time: 0.670974 Sep 16 14:22:25.277538 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2340/4709] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:24 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1219 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:27.031896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4236d6db-cf04-45b8-879f-751711c2328c tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Action: 'create', calling method: .version_select at 0x7f724c03e700>, body: {"keypair": {"name": "tempest-TestServerBasicOps-757546372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFH1alF7c74QFcHjeFJ7SUZwNmamYVoIF7m93ksIvoFahYOzcrTegxS5PjeRsFUMWxVSInlj7qIlqDB1yPabGc+/ZoNp3TOxLR+zkslj+Qun5DHQHgs7iaPKxuQA5xYNA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:27.106166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4236d6db-cf04-45b8-879f-751711c2328c tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Getting quotas for project eaaad41e9f2141e3af895994b0f722ef. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:27.132561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4236d6db-cf04-45b8-879f-751711c2328c tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Getting quotas for user 8a43d12320824d39bb777e43f226e98c and project eaaad41e9f2141e3af895994b0f722ef. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:27.216744 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4236d6db-cf04-45b8-879f-751711c2328c tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.008123 Sep 16 14:22:27.231493 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2341/4710] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:22:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:27.244778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:27.247502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:27.269041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:27.270328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:27.271103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:27.272784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:27.276069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:27.277175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:27.688130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:27.710049 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be88f82a-8a21-48ee-a372-a5ecb4af0538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1317 microversion: 2.1 time: 2.564093 Sep 16 14:22:27.711629 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2370/4711] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:25 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1317 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:27.721590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:27.728960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8987d456-9ab6-4ac2-b678-f7ce1cc19500 req-eabfe237-bc19-403f-8f74-b60c6e7113d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934b7a08-9fa8-431c-a6fa-6a255e516dbf", "tag": "342f4453-24ce-4b24-b685-977cf8c2a703"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:27.737907 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-afeaee49-261a-4bbc-a195-8ab73d3b53f8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1273 microversion: 2.1 time: 0.504175 Sep 16 14:22:27.744204 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2342/4712] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:27 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1273 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:27.785747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8987d456-9ab6-4ac2-b678-f7ce1cc19500 req-eabfe237-bc19-403f-8f74-b60c6e7113d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:27.786590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8987d456-9ab6-4ac2-b678-f7ce1cc19500 req-eabfe237-bc19-403f-8f74-b60c6e7113d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:27.787256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8987d456-9ab6-4ac2-b678-f7ce1cc19500 req-eabfe237-bc19-403f-8f74-b60c6e7113d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:27.804559 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8987d456-9ab6-4ac2-b678-f7ce1cc19500 req-eabfe237-bc19-403f-8f74-b60c6e7113d6 service nova] Creating event network-changed:342f4453-24ce-4b24-b685-977cf8c2a703 for instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf on n-h1-858129-2 Sep 16 14:22:27.811538 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8987d456-9ab6-4ac2-b678-f7ce1cc19500 req-eabfe237-bc19-403f-8f74-b60c6e7113d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097536 Sep 16 14:22:27.812818 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2371/4713] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:28.737358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:28.738154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:28.741109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:28.757381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:28.757743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:28.758083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:28.777560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:28.784333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:28.786932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:28.797591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:28.797815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:28.798371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:28.798878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:28.799971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:28.800990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:28.802155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:28.803051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:29.558061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:29.580315 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-49fdc619-8da9-4e49-8c15-bd9ba9cc97f9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1273 microversion: 2.1 time: 0.804798 Sep 16 14:22:29.583288 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2372/4714] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:28 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1273 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:29.751472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:29.763439 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62bcbabe-c770-473e-8c3f-6a47548eec45 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1317 microversion: 2.1 time: 1.030033 Sep 16 14:22:29.803777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2343/4715] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:28 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1317 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:29.879968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f03285e-9312-4f75-a718-bb895d33a50e tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-946058908", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:29.884947 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1f03285e-9312-4f75-a718-bb895d33a50e tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] HTTP exception thrown: min_count must be <= max_count Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f03285e-9312-4f75-a718-bb895d33a50e tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Request method failure captured: Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 183 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIakQKQl0HCTLs7l-ZSDk7ViiS6M7JzwsVEFkJ5OpKoL-gzwoCXozWR5GEZIGtFMEvrs9EaOPn6Sj7k2w6lgzYDAJOyJXqumfTK4NEi1hgoySVzWW2qt-LRsRJI9lv9IlON5v3NrQfZg9JGA1A3OHoVUgJfx50nEZk-R_A0NUc7NnzU Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1ca20b1f88ed47b4946d05335682e842", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}] Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7c5092deafcc491badb9d2d2c497a918 Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-946058908", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: exception: min_count must be <= max_count Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-946058908', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 16 14:22:29.890251 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:29.897379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f03285e-9312-4f75-a718-bb895d33a50e tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Returning 400 to user: min_count must be <= max_count {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:29.899602 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f03285e-9312-4f75-a718-bb895d33a50e tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.315276 Sep 16 14:22:29.903696 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2373/4716] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:29 2022] POST /compute/v2.1/servers => generated 74 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:22:30.081544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62a35d9e-a672-475b-a235-fd89099e4430 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1403862584", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "max_count": 0}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62a35d9e-a672-475b-a235-fd89099e4430 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Request method failure captured: Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 168 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIakQKQl0HCTLs7l-ZSDk7ViiS6M7JzwsVEFkJ5OpKoL-gzwoCXozWR5GEZIGtFMEvrs9EaOPn6Sj7k2w6lgzYDAJOyJXqumfTK4NEi1hgoySVzWW2qt-LRsRJI9lv9IlON5v3NrQfZg9JGA1A3OHoVUgJfx50nEZk-R_A0NUc7NnzU Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1ca20b1f88ed47b4946d05335682e842", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}] Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7c5092deafcc491badb9d2d2c497a918 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1403862584", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "max_count": 0}} Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1403862584', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'max_count': 0}}} Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 0 Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:22:30.106085 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.110314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62a35d9e-a672-475b-a235-fd89099e4430 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:30.112245 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62a35d9e-a672-475b-a235-fd89099e4430 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040653 Sep 16 14:22:30.114350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2344/4717] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:30 2022] POST /compute/v2.1/servers => generated 130 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:30.410633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e69a164-88cc-490e-9c0f-dba0fad2930c tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1682975553", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "max_count": 2.5}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e69a164-88cc-490e-9c0f-dba0fad2930c tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Request method failure captured: Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 170 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIakQKQl0HCTLs7l-ZSDk7ViiS6M7JzwsVEFkJ5OpKoL-gzwoCXozWR5GEZIGtFMEvrs9EaOPn6Sj7k2w6lgzYDAJOyJXqumfTK4NEi1hgoySVzWW2qt-LRsRJI9lv9IlON5v3NrQfZg9JGA1A3OHoVUgJfx50nEZk-R_A0NUc7NnzU Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1ca20b1f88ed47b4946d05335682e842", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}] Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7c5092deafcc491badb9d2d2c497a918 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1682975553", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "max_count": 2.5}} Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1682975553', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'max_count': 2.5}}} Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 2.5 Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:22:30.418729 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 16 14:22:30.423214 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.435585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e69a164-88cc-490e-9c0f-dba0fad2930c tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:30.436781 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e69a164-88cc-490e-9c0f-dba0fad2930c tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034112 Sep 16 14:22:30.437886 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2374/4718] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:30 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:30.541881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b66750ee-ee1a-4953-9ae9-c92b74cc4783 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1806001338", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 0}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b66750ee-ee1a-4953-9ae9-c92b74cc4783 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Request method failure captured: Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 168 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIakQKQl0HCTLs7l-ZSDk7ViiS6M7JzwsVEFkJ5OpKoL-gzwoCXozWR5GEZIGtFMEvrs9EaOPn6Sj7k2w6lgzYDAJOyJXqumfTK4NEi1hgoySVzWW2qt-LRsRJI9lv9IlON5v3NrQfZg9JGA1A3OHoVUgJfx50nEZk-R_A0NUc7NnzU Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1ca20b1f88ed47b4946d05335682e842", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}] Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7c5092deafcc491badb9d2d2c497a918 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1806001338", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 0}} Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1806001338', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'min_count': 0}}} Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 0 Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:22:30.548850 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 16 14:22:30.553061 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:22:30.562843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b66750ee-ee1a-4953-9ae9-c92b74cc4783 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:30.564216 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b66750ee-ee1a-4953-9ae9-c92b74cc4783 tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027067 Sep 16 14:22:30.576262 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2345/4719] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:30 2022] POST /compute/v2.1/servers => generated 130 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:30.612396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:30.613383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:30.615842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:30.632808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:30.635021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:30.635710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:30.636707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:30.641446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:30.642358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:30.810354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:30.811901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:30.832274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:30.833171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:30.834046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:30.835167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:30.835992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:30.836674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:32.140026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:32.183960 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-063f79f7-4351-43a3-9750-f0d208694946 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 1.575820 Sep 16 14:22:32.184834 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2375/4720] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:30 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:32.205628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29e608d2-6a00-4ddc-b631-ed32485bf9bf tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-705824500", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 2.5}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29e608d2-6a00-4ddc-b631-ed32485bf9bf tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Request method failure captured: Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 169 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIakQKQl0HCTLs7l-ZSDk7ViiS6M7JzwsVEFkJ5OpKoL-gzwoCXozWR5GEZIGtFMEvrs9EaOPn6Sj7k2w6lgzYDAJOyJXqumfTK4NEi1hgoySVzWW2qt-LRsRJI9lv9IlON5v3NrQfZg9JGA1A3OHoVUgJfx50nEZk-R_A0NUc7NnzU Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1ca20b1f88ed47b4946d05335682e842", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1ca20b1f88ed47b4946d05335682e842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1ca20b1f88ed47b4946d05335682e842"}]}] Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 1ca20b1f88ed47b4946d05335682e842 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1062715167 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7c5092deafcc491badb9d2d2c497a918 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1062715167-project Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-705824500", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "min_count": 2.5}} Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-705824500', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'min_count': 2.5}}} Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 2.5 Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:22:32.219092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-29e608d2-6a00-4ddc-b631-ed32485bf9bf tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-29e608d2-6a00-4ddc-b631-ed32485bf9bf tempest-MultipleCreateNegativeTestJSON-1062715167 tempest-MultipleCreateNegativeTestJSON-1062715167-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034603 Sep 16 14:22:32.228949 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2376/4721] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:22:32.675745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:32.698591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66107a97-63ec-4c8c-9553-d398bcc0459a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1317 microversion: 2.1 time: 1.890333 Sep 16 14:22:32.701813 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2346/4722] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:30 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1317 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:33.056862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3f5406cc-bdb5-4b26-a593-e470ed23c1c3 req-05163da8-3dec-443d-b9aa-01b51b061070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1560f05f-f9f7-421f-8e53-4406518d7426", "tag": "a6eb5c04-618a-4f58-8894-5f5d745c30de"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:33.087976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:33.110275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3f5406cc-bdb5-4b26-a593-e470ed23c1c3 req-05163da8-3dec-443d-b9aa-01b51b061070 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:33.111460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3f5406cc-bdb5-4b26-a593-e470ed23c1c3 req-05163da8-3dec-443d-b9aa-01b51b061070 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:33.112265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3f5406cc-bdb5-4b26-a593-e470ed23c1c3 req-05163da8-3dec-443d-b9aa-01b51b061070 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:33.173492 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3f5406cc-bdb5-4b26-a593-e470ed23c1c3 req-05163da8-3dec-443d-b9aa-01b51b061070 service nova] Creating event network-changed:a6eb5c04-618a-4f58-8894-5f5d745c30de for instance 1560f05f-f9f7-421f-8e53-4406518d7426 on n-h2-858129-2 Sep 16 14:22:33.183522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:33.190764 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3f5406cc-bdb5-4b26-a593-e470ed23c1c3 req-05163da8-3dec-443d-b9aa-01b51b061070 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137625 Sep 16 14:22:33.192120 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2377/4723] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:33.209963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:33.212522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:33.241204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:33.242597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:33.249827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:33.250808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:33.251915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:33.253618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:33.729859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:33.732108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:33.754654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:33.755954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:33.756887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:33.758379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:33.759040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:33.774232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:34.076139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:34.100193 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fcb3a1d9-50a4-4ba5-9db1-4ce5256f5cb7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 0.887661 Sep 16 14:22:34.101733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2347/4724] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:33 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:34.600031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:34.611790 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-db9d08f2-4381-4fad-a4c0-cfe3ccd0bb62 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1317 microversion: 2.1 time: 0.888616 Sep 16 14:22:34.612394 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2378/4725] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:33 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1317 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:35.129928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:35.131613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:35.151625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:35.153433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:35.154539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:35.158084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:35.159226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:35.164602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:35.641043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:35.643231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:35.660773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:35.662734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:35.664897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:35.668043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:35.669884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:35.673373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:36.112759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:36.121969 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce3cb6fc-210e-4583-87e1-c95b00fdd2b8 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 0.996196 Sep 16 14:22:36.138574 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2348/4726] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:35 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:36.289012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:36.324440 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8cf78db8-5fc8-4efb-aace-6de1d8b18cbe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1317 microversion: 2.1 time: 0.688695 Sep 16 14:22:36.328924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2379/4727] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:35 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:36.655961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-148271722", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-757546372", "security_groups": [{"name": "tempest-secgroup-smoke-1718425536"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "aa44a557-0f22-457e-8a8a-eaebda3c5a6a"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:37.146595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:37.147222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:37.161783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:37.166563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:37.167945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:37.172163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:37.172936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:37.173449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:37.174073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:37.306539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] validate_networks() for [('aa44a557-0f22-457e-8a8a-eaebda3c5a6a', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:22:37.886241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:37.901182 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86654886-4d2c-4c44-a139-99bebb6c1f38 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 0.759730 Sep 16 14:22:37.901889 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2380/4728] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:37 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:37.931665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b4394728-554d-4c9a-bbbd-34ab3617e50e req-ec1d6f51-bac9-4c7e-97a9-6e5266204852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934b7a08-9fa8-431c-a6fa-6a255e516dbf", "name": "network-vif-plugged", "status": "completed", "tag": "342f4453-24ce-4b24-b685-977cf8c2a703"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:37.981622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b4394728-554d-4c9a-bbbd-34ab3617e50e req-ec1d6f51-bac9-4c7e-97a9-6e5266204852 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:37.984505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b4394728-554d-4c9a-bbbd-34ab3617e50e req-ec1d6f51-bac9-4c7e-97a9-6e5266204852 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:37.988301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b4394728-554d-4c9a-bbbd-34ab3617e50e req-ec1d6f51-bac9-4c7e-97a9-6e5266204852 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:38.030960 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b4394728-554d-4c9a-bbbd-34ab3617e50e req-ec1d6f51-bac9-4c7e-97a9-6e5266204852 service nova] Creating event network-vif-plugged:342f4453-24ce-4b24-b685-977cf8c2a703 for instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf on n-h1-858129-2 Sep 16 14:22:38.058378 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b4394728-554d-4c9a-bbbd-34ab3617e50e req-ec1d6f51-bac9-4c7e-97a9-6e5266204852 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129391 Sep 16 14:22:38.062235 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2381/4729] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:38.079397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:38.081975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:38.098332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:38.100536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:38.101881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:38.103388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:38.106900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:38.121645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:39.119360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:39.130159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3c8d3f24-2f06-4a83-9016-5841da651e6f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1317 microversion: 2.1 time: 1.064439 Sep 16 14:22:39.138645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2382/4730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:38 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1317 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:39.146156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:39.153980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:39.172460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:39.172955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:39.173572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:39.174496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:39.175111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:39.175702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:39.467820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Getting quotas for project eaaad41e9f2141e3af895994b0f722ef. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:39.476143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Getting quotas for user 8a43d12320824d39bb777e43f226e98c and project eaaad41e9f2141e3af895994b0f722ef. Resources: dict_keys(['metadata_items']) {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:39.520011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:22:39.520476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:22:39.520974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:22:39.521392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:22:39.521808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:22:39.550884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:39.552085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:39.552560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:39.553409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:39.553802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:39.554793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:39.579977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=76 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:39.595263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Getting quotas for project eaaad41e9f2141e3af895994b0f722ef. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:39.603233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Getting quotas for user 8a43d12320824d39bb777e43f226e98c and project eaaad41e9f2141e3af895994b0f722ef. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:39.619111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:22:39.621435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:22:39.698883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48385e3a-7715-49f1-a352-6014e2573821 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.047235 Sep 16 14:22:39.707241 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2349/4731] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:22:39.715210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-adbda645-f16e-4614-81a6-063a12461f81 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:39.715850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-adbda645-f16e-4614-81a6-063a12461f81 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:39.842205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-adbda645-f16e-4614-81a6-063a12461f81 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:39.863468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:39.869272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-adbda645-f16e-4614-81a6-063a12461f81 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1301 microversion: 2.1 time: 0.160123 Sep 16 14:22:39.872779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2350/4732] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:39 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1301 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:39.883456 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cea8069c-fb9b-4182-a2c7-b3b8e3eb7216 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 0.742032 Sep 16 14:22:39.884109 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2383/4733] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:39 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:40.171056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:40.171643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:40.194033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:40.195723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:40.196306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:40.196998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:40.197832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:40.200586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:40.906850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-479cebe3-3dd7-4fe1-8cfe-34c5c967a36f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:40.907863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-479cebe3-3dd7-4fe1-8cfe-34c5c967a36f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:41.425616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-479cebe3-3dd7-4fe1-8cfe-34c5c967a36f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:41.446461 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-479cebe3-3dd7-4fe1-8cfe-34c5c967a36f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1301 microversion: 2.1 time: 0.545745 Sep 16 14:22:41.456821 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2384/4734] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:40 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1301 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:41.946715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:41.968895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8880d92-565b-4087-821d-105432f3528d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.809388 Sep 16 14:22:41.973457 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2351/4735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:40 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:42.254312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:42.258548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:42.276354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1245924861", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:42.323453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:42.324062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:42.326384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:42.327692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:42.328933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:42.332227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:42.334836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:42.481984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] validate_networks() for [('4e265fd5-52bc-47bb-af24-2c89589c7a06', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:22:43.151321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:43.167228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-07f42a3e-437b-46d4-a2cd-9da010669886 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 1.708329 Sep 16 14:22:43.186126 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2385/4736] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:41 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:43.186126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:43.186126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:43.186126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:43.186126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:43.188565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:43.191808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:43.192800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:43.193540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:43.401664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:43.415954 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d21f578d-191a-4faa-977c-5b33fd129e9a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1359 microversion: 2.1 time: 0.246572 Sep 16 14:22:43.433648 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2386/4737] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:43 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:43.672274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6ce2623f-282f-405f-a2bc-bd7f003a05d9 req-c703f4cd-32c0-4469-9be5-368983702f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1560f05f-f9f7-421f-8e53-4406518d7426", "name": "network-vif-plugged", "status": "completed", "tag": "a6eb5c04-618a-4f58-8894-5f5d745c30de"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:43.718118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6ce2623f-282f-405f-a2bc-bd7f003a05d9 req-c703f4cd-32c0-4469-9be5-368983702f69 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:43.719163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6ce2623f-282f-405f-a2bc-bd7f003a05d9 req-c703f4cd-32c0-4469-9be5-368983702f69 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:43.720083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6ce2623f-282f-405f-a2bc-bd7f003a05d9 req-c703f4cd-32c0-4469-9be5-368983702f69 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:43.766757 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6ce2623f-282f-405f-a2bc-bd7f003a05d9 req-c703f4cd-32c0-4469-9be5-368983702f69 service nova] Creating event network-vif-plugged:a6eb5c04-618a-4f58-8894-5f5d745c30de for instance 1560f05f-f9f7-421f-8e53-4406518d7426 on n-h2-858129-2 Sep 16 14:22:43.778367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6ce2623f-282f-405f-a2bc-bd7f003a05d9 req-c703f4cd-32c0-4469-9be5-368983702f69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114319 Sep 16 14:22:43.783788 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2387/4738] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:22:44.232026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:44.234322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:44.262770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:44.270736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:44.272342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:44.275221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:44.279362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:44.283855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:44.376791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:22:44.377362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:22:44.377688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:22:44.378156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:22:44.378618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:22:44.412561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:44.413102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:44.415372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:44.417075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:44.419003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:44.419447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:44.471206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Getting quotas for project 6a4c0f62449a419594af6e73b821cc31. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:44.479020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Getting quotas for user 2d093d019a504159871c04a88352f43f and project 6a4c0f62449a419594af6e73b821cc31. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:44.501389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:22:44.503954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:22:44.621057 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2b445f0a-7efa-4ce6-aa03-b32e13fd8b64 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.349375 Sep 16 14:22:44.622933 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2352/4739] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:22:44.640736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:44.642683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:44.670430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:44.672334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:44.674443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:44.679801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:44.681035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:44.684410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:44.890395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:44.926634 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36e03039-92f6-4e84-bfeb-d6799a5bc56f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1359 microversion: 2.1 time: 0.291355 Sep 16 14:22:44.928031 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2353/4740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:44 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:44.956540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:44.972901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:44.977019 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52349696-a36c-400a-99ff-8c6ccea2ab33 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 0.762205 Sep 16 14:22:44.980977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf57eb5a-2bc8-4628-ac4d-52da6cf641a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:44.985102 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2388/4741] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:44 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:44.986260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf57eb5a-2bc8-4628-ac4d-52da6cf641a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:45.231568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf57eb5a-2bc8-4628-ac4d-52da6cf641a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:45.240879 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf57eb5a-2bc8-4628-ac4d-52da6cf641a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1217 microversion: 2.1 time: 0.272944 Sep 16 14:22:45.242550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2354/4742] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:44 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1217 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:45.977796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:45.981843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:46.044641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:46.047537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:46.057413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:46.057790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:46.058852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:46.064395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:46.072173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:46.074347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:46.122202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:46.136427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:46.139246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:46.142092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:46.142975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:46.143768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:46.793890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:46.811251 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1beb16f8-a906-44c5-8be4-f40d8b7da0fd tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1359 microversion: 2.1 time: 0.841537 Sep 16 14:22:46.815742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2389/4743] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:45 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1359 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:46.821244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:46.830308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:46.849056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:46.849938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:46.850758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:46.852896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:46.857268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:46.858114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:47.051624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:47.066733 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-862e897f-74da-472a-9873-3a425356da5a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1269 microversion: 2.1 time: 0.249289 Sep 16 14:22:47.075703 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2390/4744] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:46 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:47.656274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1602422494", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "edd0c130-0d71-4b98-b965-0df644fb2e52"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:47.713862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:47.785730 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-119e493b-d6cf-4e44-b761-3be03149daa2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1315 microversion: 2.1 time: 1.748704 Sep 16 14:22:47.799298 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2355/4745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:46 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1315 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:47.844468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] validate_networks() for [('edd0c130-0d71-4b98-b965-0df644fb2e52', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:22:47.875239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:47.876389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:47.938802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:47.943531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:47.944851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:47.950906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:47.959340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:47.965648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:49.078921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:49.096081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91d4c71d-d6a4-4502-82d3-16a95e737d86 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 1.236166 Sep 16 14:22:49.096841 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2356/4746] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:47 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:22:49.111224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:49.116090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:49.131981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:49.134853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:49.138082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:49.139740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:49.141033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:49.144294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:49.915281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:49.932724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98dfc9c5-ca97-4b3b-a18a-a6a485b5038a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1275 microversion: 2.1 time: 0.834455 Sep 16 14:22:49.947227 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2357/4747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:49 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1275 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:49.947227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:49.947227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:49.951234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:49.952153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:49.952823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:49.953921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:49.954661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:49.955593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:50.391103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:50.404184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6383235a-3032-4016-b611-246c259df0bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1501 microversion: 2.1 time: 0.469248 Sep 16 14:22:50.427591 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2358/4748] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:49 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1501 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:50.437504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:50.438436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:50.447881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:50.448530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:50.449069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:50.450360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:50.451774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:50.452528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.017425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:51.049185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f0262e8-abca-4621-9ec3-9418e4f243f5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 0.619474 Sep 16 14:22:51.050323 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2359/4749] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:50 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:51.071321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:51.072343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:51.092622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:51.093486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:51.094250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.097495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:51.098184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:51.098934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.195984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:22:51.196863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:22:51.197949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:22:51.207472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:22:51.208782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:22:51.244135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:51.246340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:51.247812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.249610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:51.259827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:51.261319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.349661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Getting quotas for project 31c31e5d3722447b8d6f49585a19144e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:22:51.368314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Getting quotas for user 000370dc2ad84f22940251ee1b08c0a8 and project 31c31e5d3722447b8d6f49585a19144e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:22:51.412200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:22:51.420761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:22:51.723389 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30c8fe02-3e3d-4133-a814-a2b0452ae676 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.644502 Sep 16 14:22:51.738909 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2391/4750] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:22:51.753987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:51.759702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:51.798716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:51.800121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:51.801309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.803677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:51.805800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:51.810802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:51.833919 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.security_group_api [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Removing security group 250151fa-63b6-4785-98a0-3962b5543956 from port a6eb5c04-618a-4f58-8894-5f5d745c30de Sep 16 14:22:52.045336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:52.056043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-738243de-29e0-442a-a9d7-d1b1f8178dd2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1275 microversion: 2.1 time: 0.313648 Sep 16 14:22:52.059562 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2392/4751] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:51 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1275 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:52.078954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83a86a30-a5c5-40c9-bbfe-a87ee777f2eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:52.079840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83a86a30-a5c5-40c9-bbfe-a87ee777f2eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:52.275248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83a86a30-a5c5-40c9-bbfe-a87ee777f2eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:52.286454 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83a86a30-a5c5-40c9-bbfe-a87ee777f2eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1218 microversion: 2.1 time: 0.214973 Sep 16 14:22:52.289360 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2393/4752] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:52 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1218 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:52.301302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:52.302658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:52.332712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:52.333255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:52.333704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:52.334475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:52.334935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:52.346824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:53.438836 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-958da165-5bbf-4c68-9787-f4dca4da5003 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426/action" status: 202 len: 0 microversion: 2.1 time: 2.386899 Sep 16 14:22:53.439944 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2360/4753] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:22:51 2022] POST /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426/action => generated 0 bytes in 2389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:22:53.450065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-738cba72-59a1-43ae-9a43-fa1d024abf77 req-dd8a6f0e-8818-4a17-9181-4a3b896912ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e159bca0-0aa7-49e7-8786-e45f6ab9c955", "tag": "958ce341-a491-4067-98bc-32737a0751ab"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:53.478714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-738cba72-59a1-43ae-9a43-fa1d024abf77 req-dd8a6f0e-8818-4a17-9181-4a3b896912ea service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:53.481189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-738cba72-59a1-43ae-9a43-fa1d024abf77 req-dd8a6f0e-8818-4a17-9181-4a3b896912ea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:53.481665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-738cba72-59a1-43ae-9a43-fa1d024abf77 req-dd8a6f0e-8818-4a17-9181-4a3b896912ea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:53.520796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-738cba72-59a1-43ae-9a43-fa1d024abf77 req-dd8a6f0e-8818-4a17-9181-4a3b896912ea service nova] Creating event network-changed:958ce341-a491-4067-98bc-32737a0751ab for instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 on n-h1-858129-2 Sep 16 14:22:53.552000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-738cba72-59a1-43ae-9a43-fa1d024abf77 req-dd8a6f0e-8818-4a17-9181-4a3b896912ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110195 Sep 16 14:22:53.553313 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2361/4754] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:53.577325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:53.580773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:53.608408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:53.609121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:53.610645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:53.611857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:53.613794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:53.617664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:53.861988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:53.914347 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-971c568f-44e1-4d01-9ce5-b1c2854e65c6 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 1.621961 Sep 16 14:22:53.917691 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2394/4755] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:52 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:53.924832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:53.925673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:53.951747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:53.952507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:53.953145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:53.954226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:53.954898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:53.955839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:54.076780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:54.096840 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d34aa2e-bd18-454d-bf3a-e22a33f7bc41 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 0.541115 Sep 16 14:22:54.097774 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2362/4756] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:53 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:54.115490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:54.116117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:54.156294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:54.159557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:54.161831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:54.166950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:54.167883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:54.172580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:54.456540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:54.666640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:54.677367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1457a330-a49f-47a9-ba61-afa19d81852d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1270 microversion: 2.1 time: 0.757995 Sep 16 14:22:54.697824 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2395/4757] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:53 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1270 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:54.697824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-362a2b95-0bed-44f9-83ce-709b4e602dae req-b403d55b-ec59-4a78-8102-9551ba5847db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1560f05f-f9f7-421f-8e53-4406518d7426", "tag": "a6eb5c04-618a-4f58-8894-5f5d745c30de"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:22:54.724375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-362a2b95-0bed-44f9-83ce-709b4e602dae req-b403d55b-ec59-4a78-8102-9551ba5847db service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:54.725143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-362a2b95-0bed-44f9-83ce-709b4e602dae req-b403d55b-ec59-4a78-8102-9551ba5847db service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:54.726459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-362a2b95-0bed-44f9-83ce-709b4e602dae req-b403d55b-ec59-4a78-8102-9551ba5847db service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:54.824867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:54.881205 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-768d99bb-13c6-40a3-8ad0-c6914bb371c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1459 microversion: 2.1 time: 0.779264 Sep 16 14:22:54.882619 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2363/4758] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:54 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1459 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:54.963891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:54.966502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:54.999759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:55.002478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:55.004848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:55.008169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:55.009307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:55.014089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:55.240269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=20 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:22:55.486193 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-362a2b95-0bed-44f9-83ce-709b4e602dae req-b403d55b-ec59-4a78-8102-9551ba5847db service nova] Creating event network-changed:a6eb5c04-618a-4f58-8894-5f5d745c30de for instance 1560f05f-f9f7-421f-8e53-4406518d7426 on n-h2-858129-2 Sep 16 14:22:55.502047 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-362a2b95-0bed-44f9-83ce-709b4e602dae req-b403d55b-ec59-4a78-8102-9551ba5847db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.817317 Sep 16 14:22:55.503172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2396/4759] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:22:55.517704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:55.519951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:55.535939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:55.538307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:55.538955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:55.542123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:55.542772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:55.564799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:56.145619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:56.170820 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2091e7e-f1ae-4989-9de3-2385d34055a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.218555 Sep 16 14:22:56.199235 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2364/4760] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:54 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:56.234919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:56.236123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:56.279886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:56.283034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:56.286164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:56.312369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:56.316267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:56.323801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:56.347306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:56.366246 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2974a613-df61-46ea-9a87-6d9c340cf5a7 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 0.859930 Sep 16 14:22:56.368280 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2397/4761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:55 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:56.380765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:56.385852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:56.402540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:56.404216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:56.405952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:56.410720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:56.411337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:56.412013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:56.600501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:56.608714 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3e95415-7024-432d-98ad-dc91a97fd9eb tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1276 microversion: 2.1 time: 0.238703 Sep 16 14:22:56.618026 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2398/4762] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:56 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:56.635054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:56.635054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:56.662252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:56.662793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:56.663238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:56.664533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:56.664995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:56.665425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:57.216549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:57.252788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bef0fdb0-2689-4e78-9e7e-e53bbdba5580 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 1.042370 Sep 16 14:22:57.267015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2365/4763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:56 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:57.413236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:57.416416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:57.457965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:57.459444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:57.460485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:57.468021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:57.469564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:57.481816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:58.177791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:58.203439 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a49a2fac-9cce-4cb2-8e80-38bf91e839bd tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.583287 Sep 16 14:22:58.205037 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2399/4764] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:56 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:58.227210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:58.228798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:58.261571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:58.264287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:58.265448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:58.268938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:58.273355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:58.275885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:58.592211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:22:58.636132 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dbc4be35-8b8c-4689-a77f-277736a07d8b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1276 microversion: 2.1 time: 0.428879 Sep 16 14:22:58.650611 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2400/4765] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:58 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1276 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:22:58.697010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:22:58.698150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:22:58.741582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:58.774877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:58.776663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:22:58.784002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:22:58.785021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:22:58.819498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:00.047212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:00.060117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2747480-ac8a-4207-bcd0-7c88ace79f8f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 2.653764 Sep 16 14:23:00.060733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2366/4766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:57 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:00.075829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:00.078653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:00.098176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:00.099134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:00.102088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:00.105820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:00.108684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:00.111016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:00.506076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:00.559496 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ecd6070-c14a-4a0a-a349-127e4f3d9de1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.904305 Sep 16 14:23:00.561768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2401/4767] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:22:58 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:01.310567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:01.427139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:01.463181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-636434922", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "11d812ef-ce2f-404d-bf9f-17e2007639c1"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:01.467606 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa023f38-f472-4e4f-835f-b6d1dc4dbc89 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 1.403188 Sep 16 14:23:01.472876 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2367/4768] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:00 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:01.494392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:01.495854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:01.506733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:01.526381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:01.527321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:01.533814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:01.537741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:01.543069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:01.545671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:01.627170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] validate_networks() for [('11d812ef-ce2f-404d-bf9f-17e2007639c1', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:23:02.282423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:03.043770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:03.106501 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8732b01-d235-418d-b8eb-f43f48d465c9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 1.630703 Sep 16 14:23:03.109082 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2368/4769] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:01 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:03.126958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:03.128083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:03.149386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:03.150680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:03.151492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:03.153108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:03.154276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:03.155368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:03.768017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:03.779827 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d737e70f-e4a6-4284-ad86-d3106fc0e43e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.668475 Sep 16 14:23:03.818919 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2369/4770] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:03 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:03.831573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b4584ed7-56ef-4e28-a5ad-bd81757d954b req-b0d98fa3-0243-477b-879f-bbe7fbcda110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448f58d2-be6a-4483-a06c-89e5c5e22868", "tag": "be738bb6-b59a-4547-b477-e86b4689c9d1"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:03.862504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4584ed7-56ef-4e28-a5ad-bd81757d954b req-b0d98fa3-0243-477b-879f-bbe7fbcda110 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:03.863296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4584ed7-56ef-4e28-a5ad-bd81757d954b req-b0d98fa3-0243-477b-879f-bbe7fbcda110 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:03.864693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4584ed7-56ef-4e28-a5ad-bd81757d954b req-b0d98fa3-0243-477b-879f-bbe7fbcda110 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:03.870352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:03.880483 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b4584ed7-56ef-4e28-a5ad-bd81757d954b req-b0d98fa3-0243-477b-879f-bbe7fbcda110 service nova] Creating event network-changed:be738bb6-b59a-4547-b477-e86b4689c9d1 for instance 448f58d2-be6a-4483-a06c-89e5c5e22868 on n-h2-858129-2 Sep 16 14:23:03.891156 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b4584ed7-56ef-4e28-a5ad-bd81757d954b req-b0d98fa3-0243-477b-879f-bbe7fbcda110 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070176 Sep 16 14:23:03.892092 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2370/4771] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:03.915238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:03.922287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:03.940157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:03.943461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:03.945726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:03.947980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:03.949331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:03.950645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:04.596888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:04.628484 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa58008d-f25b-4b82-970c-f03968cbbf7e tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 0.734290 Sep 16 14:23:04.630324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:23:04.631038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:23:04.631295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:23:04.631700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:23:04.632097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2371/4772] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:03 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:04.632234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:23:04.651123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:04.652748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:04.660976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:04.661766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:04.662523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:04.664352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:04.668373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:04.668649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:04.669059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:04.673078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:04.674444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:04.677586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:04.678324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:04.679155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:04.722850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Getting quotas for project 3ab1cf65d1784a5295e5c69b51e634cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:23:04.735147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Getting quotas for user 721240f82fa84c92b74c9ca3e46270b0 and project 3ab1cf65d1784a5295e5c69b51e634cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:23:04.778740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:23:04.783906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:23:04.978633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf93ccf8-1048-4bba-9f06-4dd450086a9a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.414818 Sep 16 14:23:04.980499 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2402/4773] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:23:04.998865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:05.000814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:05.024830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:05.031751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:05.037140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:05.041090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:05.045900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:05.048156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:05.341670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:05.361594 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3cc37a5f-9231-4909-9363-7e74c46122e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 0.726765 Sep 16 14:23:05.364175 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2372/4774] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:04 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:05.389772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-101309429", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f64a9d39-280d-4bfc-99d8-7531ba64697a"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:05.586636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] validate_networks() for [('f64a9d39-280d-4bfc-99d8-7531ba64697a', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:23:06.186599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:06.200717 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-42376e4d-40b0-4568-8e76-8ace7147ba2c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 1.208733 Sep 16 14:23:06.201878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2403/4775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:04 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:06.214029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:06.214671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:06.237360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:06.238584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:06.239278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:06.240282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:06.241283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:06.242487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:06.489859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:06.506505 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1e69e2c0-b2f7-4cd0-9988-f8a94d52b44d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1228 microversion: 2.1 time: 0.299850 Sep 16 14:23:06.508515 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2404/4776] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:06 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1228 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:06.516527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:06.517334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:06.530179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:06.533733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:06.534700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:06.535971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:06.536943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:06.538696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:07.942663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:07.989310 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e2beee8-d9ee-4c76-9d20-b902e85b9cf1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 1.479452 Sep 16 14:23:07.990291 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2405/4777] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:06 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:08.020820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7dd0fd3f-54fa-4bc9-8624-e7d4efe0e2a1 req-73fba190-4e70-4eb2-b946-0f80aef49125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808fa331-04a9-4998-987f-0dd30ba2bffc", "tag": "d2fd2438-14c5-4150-8d84-6e6cecaf4f20"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:08.041538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7dd0fd3f-54fa-4bc9-8624-e7d4efe0e2a1 req-73fba190-4e70-4eb2-b946-0f80aef49125 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.042126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7dd0fd3f-54fa-4bc9-8624-e7d4efe0e2a1 req-73fba190-4e70-4eb2-b946-0f80aef49125 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.042925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7dd0fd3f-54fa-4bc9-8624-e7d4efe0e2a1 req-73fba190-4e70-4eb2-b946-0f80aef49125 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.073170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7dd0fd3f-54fa-4bc9-8624-e7d4efe0e2a1 req-73fba190-4e70-4eb2-b946-0f80aef49125 service nova] Creating event network-changed:d2fd2438-14c5-4150-8d84-6e6cecaf4f20 for instance 808fa331-04a9-4998-987f-0dd30ba2bffc on n-h1-858129-2 Sep 16 14:23:08.084117 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7dd0fd3f-54fa-4bc9-8624-e7d4efe0e2a1 req-73fba190-4e70-4eb2-b946-0f80aef49125 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079449 Sep 16 14:23:08.087814 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2406/4778] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:08.097589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-cf6e1585-a17d-4ea7-94e7-a086d28b3cff req-2983ffa9-068b-441e-839b-1aaa7720b9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e159bca0-0aa7-49e7-8786-e45f6ab9c955", "name": "network-vif-plugged", "status": "completed", "tag": "958ce341-a491-4067-98bc-32737a0751ab"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:08.124745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cf6e1585-a17d-4ea7-94e7-a086d28b3cff req-2983ffa9-068b-441e-839b-1aaa7720b9e7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.125564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cf6e1585-a17d-4ea7-94e7-a086d28b3cff req-2983ffa9-068b-441e-839b-1aaa7720b9e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.126283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cf6e1585-a17d-4ea7-94e7-a086d28b3cff req-2983ffa9-068b-441e-839b-1aaa7720b9e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.156593 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-cf6e1585-a17d-4ea7-94e7-a086d28b3cff req-2983ffa9-068b-441e-839b-1aaa7720b9e7 service nova] Creating event network-vif-plugged:958ce341-a491-4067-98bc-32737a0751ab for instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 on n-h1-858129-2 Sep 16 14:23:08.168308 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-cf6e1585-a17d-4ea7-94e7-a086d28b3cff req-2983ffa9-068b-441e-839b-1aaa7720b9e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078377 Sep 16 14:23:08.171541 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2407/4779] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:08.186316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:08.188055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:08.209519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.211027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.212185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.213871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.215032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.216131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.248725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:23:08.249455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:23:08.250625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:23:08.251570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:23:08.252602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:23:08.304791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.314042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.319877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.321646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.326202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.327395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.407542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:23:08.425627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Getting quotas for user 7b08b72cf46345f2a3c88a6251b1c996 and project c22dd0c01bde40a0a0f194f91e180d03. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:23:08.483194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:23:08.495106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:23:08.684390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d0e57b1-e26a-4907-a83c-43c77f4a0a26 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.315307 Sep 16 14:23:08.691067 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2373/4780] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:23:08.709817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:08.710391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:08.755569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.756291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.758920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:08.759902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:08.760594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:08.762101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:09.195016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:09.218772 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-587e3606-beed-49a0-bc3d-d066cfddf912 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 1.038154 Sep 16 14:23:09.247403 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2408/4781] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:08 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:09.273431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:09.275374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:09.320528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:09.321521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:09.322721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:09.324223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:09.325065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:09.325891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:09.772555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:09.786392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:09.789654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:09.797589 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a89f481-c02d-457e-8a53-b8dd2854fa51 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 1.103875 Sep 16 14:23:09.798674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2374/4782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:08 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:09.821968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:09.822951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:09.848825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:09.853600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:09.854792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:09.856261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:09.862478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:09.863300 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f7696aa-672d-4647-b999-9d3b873b1bca tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1282 microversion: 2.1 time: 0.607038 Sep 16 14:23:09.863877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:09.891581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2409/4783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:09 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1282 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:09.921797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:09.922516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:09.937326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:09.939967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:09.940576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:09.943286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:09.945316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:09.949577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:10.162209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:10.179949 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-73e6721c-9bb8-495f-8b16-d1aeb70e8a46 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1218 microversion: 2.1 time: 0.379128 Sep 16 14:23:10.180398 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2375/4784] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:09 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1218 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:10.290334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:10.293706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:10.311885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:10.312704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:10.313384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:10.314337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:10.314898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:10.315329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:10.577654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:10.587868 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9275a85f-20f8-4265-ae4f-7396609e8287 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 0.694706 Sep 16 14:23:10.604158 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2410/4785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:09 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:10.842839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:10.843698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:10.854692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:10.855487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:10.858197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:10.859306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:10.862829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:10.864264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:10.880041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:10.908592 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6ee2791-82f4-4bec-84a1-643d1b0a85ea tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 0.628626 Sep 16 14:23:10.914089 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2376/4786] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:10 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:10.937674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:10.939261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:10.955488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:10.956828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:10.957949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:10.960667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:10.961889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:10.963066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:11.290604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:11.312384 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c639f73b-7fd2-49de-922c-cbefc0b98081 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 0.473544 Sep 16 14:23:11.340567 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2411/4787] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:10 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:11.347669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:11.349516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:11.381086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:11.386837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:11.390455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:11.392903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:11.394614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:11.395616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:11.629612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:11.646578 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e76605b-8971-4538-9739-37c20b6a7efc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1210 microversion: 2.1 time: 0.300762 Sep 16 14:23:11.648831 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2412/4788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:11 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1210 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:11.663012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:11.665542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:11.684381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:11.688498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:11.689273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:11.690235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:11.692316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:11.695547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:11.715685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:11.733980 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-35282b36-12e8-4482-a1d9-667479a54e87 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.815832 Sep 16 14:23:11.735047 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2377/4789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:10 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:11.776211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1b82ac37-643a-4cab-8965-485cca94f56b req-04b2071e-b53d-41a5-95fe-7cb947f617e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448f58d2-be6a-4483-a06c-89e5c5e22868", "name": "network-vif-plugged", "status": "completed", "tag": "be738bb6-b59a-4547-b477-e86b4689c9d1"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:11.797743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1b82ac37-643a-4cab-8965-485cca94f56b req-04b2071e-b53d-41a5-95fe-7cb947f617e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:11.798243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1b82ac37-643a-4cab-8965-485cca94f56b req-04b2071e-b53d-41a5-95fe-7cb947f617e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:11.799573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1b82ac37-643a-4cab-8965-485cca94f56b req-04b2071e-b53d-41a5-95fe-7cb947f617e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:11.839245 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1b82ac37-643a-4cab-8965-485cca94f56b req-04b2071e-b53d-41a5-95fe-7cb947f617e2 service nova] Creating event network-vif-plugged:be738bb6-b59a-4547-b477-e86b4689c9d1 for instance 448f58d2-be6a-4483-a06c-89e5c5e22868 on n-h2-858129-2 Sep 16 14:23:11.855316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1b82ac37-643a-4cab-8965-485cca94f56b req-04b2071e-b53d-41a5-95fe-7cb947f617e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082491 Sep 16 14:23:11.859128 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2378/4790] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:23:11.950369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:11.957382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:12.006227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.009682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.010854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.013456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.023406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.026107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.545053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:12.576637 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7ce198e8-a4a9-400f-8ef8-1ccc3a3922b5 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1427 microversion: 2.1 time: 0.924858 Sep 16 14:23:12.579944 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2413/4791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:11 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1427 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:12.603277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:12.606255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:12.621489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.622994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.624027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.625582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.627165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.628779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.637931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:12.652804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-128bc231-c45f-4058-bd81-5fa0f2170979 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 0.716582 Sep 16 14:23:12.667098 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2379/4792] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:11 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:12.694082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:12.696295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:12.709626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:12.713208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.714457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.715497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.717086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.718513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.719552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.900669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:12.925109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30761af5-4ea8-4f91-a497-30b23c1fd1b5 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1266 microversion: 2.1 time: 0.240486 Sep 16 14:23:12.927056 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2380/4793] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:12 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:12.943629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:12.945851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:12.976911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.979108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.980130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:12.981732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:12.982886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:12.984379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:13.010348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:13.024381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-85c03e1b-0975-4642-9ff7-d117eb4ad079 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 0.440626 Sep 16 14:23:13.026496 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2414/4794] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:12 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:13.374355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:13.408043 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec225276-456b-4710-b38e-828f4e262a8b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.478870 Sep 16 14:23:13.423695 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2381/4795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:12 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:13.626048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:13.626048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:13.640828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:13.643191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:13.645927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:13.648126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:13.649800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:13.650770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:13.697765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:13.698364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:13.713578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:13.714278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:13.714645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:13.715308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:13.715775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:13.716204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.208077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:14.209535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:14.220317 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-47770d2c-ed57-47cc-9ded-cc891592be1b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1607 microversion: 2.1 time: 0.601213 Sep 16 14:23:14.222068 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2415/4796] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:13 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1607 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:14.228115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:14.228988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:14.238824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.240324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.241086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.242740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.244675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.245401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.253334 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f1b9dfc7-3615-42c2-a4be-2a46077f2c21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1317 microversion: 2.1 time: 0.560138 Sep 16 14:23:14.277038 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2382/4797] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:13 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:14.285686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:14.292859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:14.322679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.323607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.327154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.328285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.328965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.329620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.553020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:14.568374 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f73d9766-7fbc-4dc4-ae4a-2bae47763d3e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1272 microversion: 2.1 time: 0.344539 Sep 16 14:23:14.571874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2416/4798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:14 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:14.587633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2acddd69-5467-4aaf-8588-acecb3c779f3 req-1ae47358-e8fb-4389-8757-f0791cd468f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d", "tag": "0e55f3a2-2218-4ea4-bed2-44bd27e5956a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:14.617392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2acddd69-5467-4aaf-8588-acecb3c779f3 req-1ae47358-e8fb-4389-8757-f0791cd468f5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.619276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2acddd69-5467-4aaf-8588-acecb3c779f3 req-1ae47358-e8fb-4389-8757-f0791cd468f5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.619853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2acddd69-5467-4aaf-8588-acecb3c779f3 req-1ae47358-e8fb-4389-8757-f0791cd468f5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.650990 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2acddd69-5467-4aaf-8588-acecb3c779f3 req-1ae47358-e8fb-4389-8757-f0791cd468f5 service nova] Creating event network-changed:0e55f3a2-2218-4ea4-bed2-44bd27e5956a for instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d on n-h2-858129-2 Sep 16 14:23:14.664952 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2acddd69-5467-4aaf-8588-acecb3c779f3 req-1ae47358-e8fb-4389-8757-f0791cd468f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089619 Sep 16 14:23:14.667034 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2417/4799] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:14.682219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:14.683139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:14.709152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:14.714458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.715465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.716327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.717723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.720300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.727131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.804569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:14.923020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:14.937778 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d551135-3c6a-4ea6-ab38-9734e590ef8f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 0.659036 Sep 16 14:23:14.945564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2383/4800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:14 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:14.961809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:14.962975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:14.975148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.976402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.980059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:14.980954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:14.983022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:14.983526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.310020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:15.329224 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee7b8662-62e4-4ae4-b144-9f1c35e10490 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1607 microversion: 2.1 time: 0.660579 Sep 16 14:23:15.334350 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2418/4801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:14 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1607 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:15.369855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:15.371061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:15.383859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.384794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.385587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.387045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.388478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.389506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.689692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:15.708760 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74ccae8e-656e-453c-b5b0-b0e291a0f10a tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.756399 Sep 16 14:23:15.709658 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2384/4802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:14 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:15.723558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:15.724368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:15.740758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.742242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.742986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.744336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.745088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.745757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.815596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:15.832726 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-314b91fd-e9a9-484c-901a-4e7e0f4c19eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1506 microversion: 2.1 time: 0.472410 Sep 16 14:23:15.834051 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2419/4803] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:15 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:15.840517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:15.842162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:15.857314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.858205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.858871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.859759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.860376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.860956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.954930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:15.964415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec0bfc05-0a38-43ca-a0f1-353491ae5837 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1272 microversion: 2.1 time: 0.128887 Sep 16 14:23:15.978840 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2420/4804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:15 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:15.987383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:15.988156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:15.995470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.996261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.996856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:15.998039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:15.998699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:15.999289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:16.029236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:23:16.170082 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5cec4b1-476b-48d1-bb99-befe81890534 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "DELETE /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 204 len: 0 microversion: 2.1 time: 0.188905 Sep 16 14:23:16.170318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:16.173393 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2421/4805] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:23:15 2022] DELETE /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:23:16.188668 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2aa2ffa2-c885-49f6-90e5-64e87561d538 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1607 microversion: 2.1 time: 0.476496 Sep 16 14:23:16.189033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:16.191363 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2385/4806] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:15 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1607 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:16.191549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:16.198996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-689b629e-0024-46eb-9683-f88ab8f6d2eb req-a1e81b44-f5c5-4c6f-9853-d96246fc0d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808fa331-04a9-4998-987f-0dd30ba2bffc", "name": "network-vif-plugged", "status": "completed", "tag": "d2fd2438-14c5-4150-8d84-6e6cecaf4f20"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:16.205863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:16.206231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:16.207112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:16.207871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:16.210665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:16.211327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:16.225967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-689b629e-0024-46eb-9683-f88ab8f6d2eb req-a1e81b44-f5c5-4c6f-9853-d96246fc0d4f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:16.239123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-689b629e-0024-46eb-9683-f88ab8f6d2eb req-a1e81b44-f5c5-4c6f-9853-d96246fc0d4f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:16.241909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-689b629e-0024-46eb-9683-f88ab8f6d2eb req-a1e81b44-f5c5-4c6f-9853-d96246fc0d4f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:16.283151 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-689b629e-0024-46eb-9683-f88ab8f6d2eb req-a1e81b44-f5c5-4c6f-9853-d96246fc0d4f service nova] Creating event network-vif-plugged:d2fd2438-14c5-4150-8d84-6e6cecaf4f20 for instance 808fa331-04a9-4998-987f-0dd30ba2bffc on n-h1-858129-2 Sep 16 14:23:16.293761 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-689b629e-0024-46eb-9683-f88ab8f6d2eb req-a1e81b44-f5c5-4c6f-9853-d96246fc0d4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100489 Sep 16 14:23:16.295576 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2386/4807] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:16.305448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:16.318862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:16.342637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:16.361985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:16.364903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:16.373251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:16.388169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:16.390198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:16.955097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:16.981428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bee6fcbf-3ae0-435a-8c5c-e5f41a6478c1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 0.806239 Sep 16 14:23:16.982723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2422/4808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:16 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:17.001125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:17.002060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:17.028891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:17.029845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:17.030680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:17.031986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:17.032811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:17.033580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:17.034676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:17.044689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fc52acb6-1188-4153-ac76-34dcfff5abe2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1512 microversion: 2.1 time: 0.747246 Sep 16 14:23:17.053484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2387/4809] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:16 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1512 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:17.068835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:17.073443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:17.085533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:17.086050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:17.088702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:17.089661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:17.090326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:17.091095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:17.514069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:17.544181 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65083d2e-ba23-418d-bdc9-3e5dc477fb0a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.488876 Sep 16 14:23:17.552020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:17.553072 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2388/4810] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:17 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:17.595318 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f1f4a37-d4ef-47cf-9486-a1724712282d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.610474 Sep 16 14:23:17.609001 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2423/4811] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:16 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:18.036004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:18.039239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:18.058318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.061247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.062497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.065805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.067297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.068640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.105813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:18.106675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:18.125182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.125986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.126661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.127591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.128252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.128850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.167276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:18.371667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:18.456959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:18.603844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:18.605644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:18.635516 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3a8977ad-e2fc-4b52-9d5a-0b219408ff11 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1512 microversion: 2.1 time: 0.533662 Sep 16 14:23:18.637318 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-60cb4b99-ba8a-4421-96d3-514478c71ac0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1318 microversion: 2.1 time: 0.612283 Sep 16 14:23:18.639416 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2389/4812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:18 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:18.661307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:18.662473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:18.664528 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2424/4813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:18 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:18.670525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.671300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.671918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.672864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.673738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.674362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.677766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:18.678390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:18.708879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.709386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.709830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.710652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:18.711119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:18.711561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:18.761703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:19.460578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:19.468958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-479ce3b6-9576-4d95-99c8-cad44623b455 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.812851 Sep 16 14:23:19.469559 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2390/4814] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:18 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:19.480501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5e6c26b3-f731-4c47-882c-a69fd0b827ed req-6e170652-254d-4280-9b12-4c10145f1ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46b2920-223c-4458-909a-94742db97084", "tag": "3dc93432-3220-4665-a0e0-4cdb12d4b42f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:19.488088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:19.503482 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8b56a2ff-baec-4160-9202-7c51ec838a74 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.837612 Sep 16 14:23:19.522544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2425/4815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:18 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:19.523816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5e6c26b3-f731-4c47-882c-a69fd0b827ed req-6e170652-254d-4280-9b12-4c10145f1ff0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:19.523816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5e6c26b3-f731-4c47-882c-a69fd0b827ed req-6e170652-254d-4280-9b12-4c10145f1ff0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:19.523816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5e6c26b3-f731-4c47-882c-a69fd0b827ed req-6e170652-254d-4280-9b12-4c10145f1ff0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:19.535622 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5e6c26b3-f731-4c47-882c-a69fd0b827ed req-6e170652-254d-4280-9b12-4c10145f1ff0 service nova] Creating event network-changed:3dc93432-3220-4665-a0e0-4cdb12d4b42f for instance a46b2920-223c-4458-909a-94742db97084 on n-h1-858129-2 Sep 16 14:23:19.541476 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5e6c26b3-f731-4c47-882c-a69fd0b827ed req-6e170652-254d-4280-9b12-4c10145f1ff0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065658 Sep 16 14:23:19.542459 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2391/4816] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:19.662576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:19.665246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:19.681456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:19.682082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:19.682827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:19.683950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:19.684607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:19.692563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:19.693559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:19.698314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:19.718470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:19.719531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:19.720969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:19.724386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:19.725326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:19.726608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:20.391961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:20.403918 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d17b647-174b-4b2b-839c-4386d33ee9f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1512 microversion: 2.1 time: 0.716033 Sep 16 14:23:20.407521 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2392/4817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:19 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1512 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:20.516575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:20.518025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:20.525161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:20.540448 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a667ad3d-065c-46f2-ae26-b2861a02c6ab tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1508 microversion: 2.1 time: 0.881911 Sep 16 14:23:20.556189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2426/4818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:19 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1508 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:20.565660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:20.567114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:20.571904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:20.572936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:20.575823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:20.577126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:20.582199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:20.583590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:20.603027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:20.603833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:20.604447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:20.605561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:20.606202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:20.606824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:21.549482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:21.577770 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a2b7646-27bc-4d7c-a35d-4fcdc13c7848 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 1.065269 Sep 16 14:23:21.583946 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2393/4819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:20 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:21.607092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:21.608497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:21.629308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:21.631169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:21.632490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:21.635081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:21.636644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:21.637570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:21.683998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:21.705662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4f690bf-ff4e-4982-9d16-40183d346f44 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 1.147122 Sep 16 14:23:21.712422 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2427/4820] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:20 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:21.733013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:21.735242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:21.743389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:21.745527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:21.746288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:21.747207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:21.747829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:21.749509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:22.528919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:22.559705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c708ea5-c23c-4e12-8c59-05c293373d91 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1508 microversion: 2.1 time: 0.971583 Sep 16 14:23:22.560855 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2394/4821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:21 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1508 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:22.585444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-163a2ed0-67a2-4f4a-8ec8-681dcca428f4 req-b09ce5d4-14e4-4ebf-9532-a779d732ed0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448f58d2-be6a-4483-a06c-89e5c5e22868", "name": "network-vif-unplugged", "status": "completed", "tag": "be738bb6-b59a-4547-b477-e86b4689c9d1"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:22.626364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-163a2ed0-67a2-4f4a-8ec8-681dcca428f4 req-b09ce5d4-14e4-4ebf-9532-a779d732ed0e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:22.632303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-163a2ed0-67a2-4f4a-8ec8-681dcca428f4 req-b09ce5d4-14e4-4ebf-9532-a779d732ed0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:22.638488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-163a2ed0-67a2-4f4a-8ec8-681dcca428f4 req-b09ce5d4-14e4-4ebf-9532-a779d732ed0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:22.662452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-163a2ed0-67a2-4f4a-8ec8-681dcca428f4 req-b09ce5d4-14e4-4ebf-9532-a779d732ed0e service nova] Creating event network-vif-unplugged:be738bb6-b59a-4547-b477-e86b4689c9d1 for instance 448f58d2-be6a-4483-a06c-89e5c5e22868 on n-h2-858129-2 Sep 16 14:23:22.688284 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-163a2ed0-67a2-4f4a-8ec8-681dcca428f4 req-b09ce5d4-14e4-4ebf-9532-a779d732ed0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122684 Sep 16 14:23:22.692539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2395/4822] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:22.713554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:22.721848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:22.738580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:22.739840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:22.740879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:22.742558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:22.743667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:22.744715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:22.799550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:22.841762 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d4517fc-0a46-49ee-bc12-1fb485d63910 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1512 microversion: 2.1 time: 1.123328 Sep 16 14:23:22.843578 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2428/4823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:21 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1512 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:22.858452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:22.861851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:22.883158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:22.887373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:22.888309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:22.890721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:22.892600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:22.894590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:22.995808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:23:22.998204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:23:22.999467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:23:23.001180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:23:23.002036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:23:23.190758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:23.233625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.242176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.242670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:23.247815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.248535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.248993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:23.361534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7b628d6-9090-41ec-bf71-6ad010734a04 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "POST /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc/action" status: 202 len: 1110 microversion: 2.1 time: 0.666462 Sep 16 14:23:23.362104 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2396/4824] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:23:22 2022] POST /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc/action => generated 1110 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 16 14:23:23.417095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:23.418838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:23.430492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.431382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.432138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:23.433156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.433846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.434589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:23.601366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:23.671233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50e6cefe-02d1-4175-85b2-169a0b4cbb68 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.824193 Sep 16 14:23:23.672213 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2429/4825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:22 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:23.678343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-96f43af9-b0d1-47dd-a902-e093eb6c500a req-9d5a6dba-a5be-4149-b4a6-35ec30d8c9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448f58d2-be6a-4483-a06c-89e5c5e22868", "name": "network-vif-deleted", "tag": "be738bb6-b59a-4547-b477-e86b4689c9d1"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:23.696494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-96f43af9-b0d1-47dd-a902-e093eb6c500a req-9d5a6dba-a5be-4149-b4a6-35ec30d8c9cb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.697400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-96f43af9-b0d1-47dd-a902-e093eb6c500a req-9d5a6dba-a5be-4149-b4a6-35ec30d8c9cb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.698140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-96f43af9-b0d1-47dd-a902-e093eb6c500a req-9d5a6dba-a5be-4149-b4a6-35ec30d8c9cb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:23.722074 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-96f43af9-b0d1-47dd-a902-e093eb6c500a req-9d5a6dba-a5be-4149-b4a6-35ec30d8c9cb service nova] Creating event network-vif-deleted:be738bb6-b59a-4547-b477-e86b4689c9d1 for instance 448f58d2-be6a-4483-a06c-89e5c5e22868 on n-h2-858129-2 Sep 16 14:23:23.737593 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-96f43af9-b0d1-47dd-a902-e093eb6c500a req-9d5a6dba-a5be-4149-b4a6-35ec30d8c9cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059567 Sep 16 14:23:23.742219 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2430/4826] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:23.754276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:23.760887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:23.779779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.780980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.781912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:23.783223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:23.783979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:23.784714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:24.128916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:24.145800 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1a6b5c4-1baf-49b7-b77c-d168257816b1 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.752408 Sep 16 14:23:24.148231 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2397/4827] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:23 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:24.159384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:24.161425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:24.178880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:24.180540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:24.181883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:24.185658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:24.187582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:24.188903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:24.227634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:24.251582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dec957bf-4ad9-4cc9-8f21-6ce743bf9abd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.507548 Sep 16 14:23:24.253659 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2431/4828] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:23 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:24.263633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:24.264424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:24.265113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:24.265811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lazy-loading 'fault' on Instance uuid 448f58d2-be6a-4483-a06c-89e5c5e22868 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:23:24.326523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:24.339064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cff3e3be-79e4-4a5b-a49b-04eaad5d619f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 200 len: 1307 microversion: 2.1 time: 0.185052 Sep 16 14:23:24.352815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2398/4829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:24 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:24.369486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9bab1854-e57e-4b4e-8ef9-e2ac9d2e2a9f req-abce3518-6f70-49c2-802d-849e432d2472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e159bca0-0aa7-49e7-8786-e45f6ab9c955", "tag": "958ce341-a491-4067-98bc-32737a0751ab"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:24.388412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9bab1854-e57e-4b4e-8ef9-e2ac9d2e2a9f req-abce3518-6f70-49c2-802d-849e432d2472 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:24.389360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9bab1854-e57e-4b4e-8ef9-e2ac9d2e2a9f req-abce3518-6f70-49c2-802d-849e432d2472 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:24.391000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9bab1854-e57e-4b4e-8ef9-e2ac9d2e2a9f req-abce3518-6f70-49c2-802d-849e432d2472 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:24.408388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9bab1854-e57e-4b4e-8ef9-e2ac9d2e2a9f req-abce3518-6f70-49c2-802d-849e432d2472 service nova] Creating event network-changed:958ce341-a491-4067-98bc-32737a0751ab for instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 on n-h1-858129-2 Sep 16 14:23:24.416049 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9bab1854-e57e-4b4e-8ef9-e2ac9d2e2a9f req-abce3518-6f70-49c2-802d-849e432d2472 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051833 Sep 16 14:23:24.417540 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2432/4830] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:24.695701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:24.696334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:24.705786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:24.706311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:24.712236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:24.713051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:24.713550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:24.714002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:25.077367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3ffca19e-8e94-46c8-9bb0-fae993d28d75 req-e3c5f855-6b9a-4f75-9d8d-875876d0bab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d", "name": "network-vif-plugged", "status": "completed", "tag": "0e55f3a2-2218-4ea4-bed2-44bd27e5956a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:25.110276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3ffca19e-8e94-46c8-9bb0-fae993d28d75 req-e3c5f855-6b9a-4f75-9d8d-875876d0bab8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:25.111599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3ffca19e-8e94-46c8-9bb0-fae993d28d75 req-e3c5f855-6b9a-4f75-9d8d-875876d0bab8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:25.112688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3ffca19e-8e94-46c8-9bb0-fae993d28d75 req-e3c5f855-6b9a-4f75-9d8d-875876d0bab8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:25.147642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:25.154518 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3ffca19e-8e94-46c8-9bb0-fae993d28d75 req-e3c5f855-6b9a-4f75-9d8d-875876d0bab8 service nova] Creating event network-vif-plugged:0e55f3a2-2218-4ea4-bed2-44bd27e5956a for instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d on n-h2-858129-2 Sep 16 14:23:25.159748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-940acaed-a9ff-4b73-b18f-ec827d30843a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.468611 Sep 16 14:23:25.160374 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2399/4831] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:24 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:25.182379 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3ffca19e-8e94-46c8-9bb0-fae993d28d75 req-e3c5f855-6b9a-4f75-9d8d-875876d0bab8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113384 Sep 16 14:23:25.186715 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2433/4832] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:25.195266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:25.196765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:25.208429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:25.209293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:25.209968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:25.213196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:25.213981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:25.218623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:25.325731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:25.328708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:25.371574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:25.375141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:25.377189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:25.380496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:25.382940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:25.384990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:26.193770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:26.208164 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47740c9d-4eff-4f63-a3e6-6bf906e62a7f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 1.017326 Sep 16 14:23:26.215282 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2400/4833] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:25 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:26.231479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:26.232356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:26.242564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:26.245334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:26.251230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:26.252325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:26.253177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:26.253803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:26.270983 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 HTTP/1.1 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '448f58d2-be6a-4483-a06c-89e5c5e22868'} Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:26.275380 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:23:26.280742 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:26.283024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:26.284281 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b8f8cc6-de13-4027-9e1b-fac1f8f87ad4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 404 len: 111 microversion: 2.1 time: 0.067671 Sep 16 14:23:26.285539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2401/4834] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:26 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:23:26.299577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:26.300588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:26.309546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:26.310362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:26.311193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:26.312138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:26.312980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:26.313590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:26.966184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:26.980294 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0dcf3aa0-cf63-4ae9-a9db-100f7d406731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 1.703945 Sep 16 14:23:26.983190 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2434/4835] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:25 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:27.006066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:27.008044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:27.028203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:27.031027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:27.033076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:27.035314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:27.036395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:27.037537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:27.171140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:27.184837 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-941e6ff1-d9ee-4ec4-9ec8-1aab58016568 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.897970 Sep 16 14:23:27.190941 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2402/4836] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:26 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:27.243909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:27.244872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:27.253635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:27.254536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:27.256511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:27.267579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:27.268593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:27.269264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:27.663023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:27.707617 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98dd955b-ee99-4d4b-a1d9-566ce8e261a0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.710926 Sep 16 14:23:27.723616 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2435/4837] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:26 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:27.796464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:27.809481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bba0b28f-6fb0-4dff-ae73-9ca8fc02802f tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1324 microversion: 2.1 time: 0.571641 Sep 16 14:23:27.811196 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2403/4838] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:27 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:27.990968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9165ef1-9c8e-44fe-a49b-6a4d9b16b384 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9165ef1-9c8e-44fe-a49b-6a4d9b16b384 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 163 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": 12345, "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 12345 Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:23:28.000346 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 16 14:23:28.009816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:28.014193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9165ef1-9c8e-44fe-a49b-6a4d9b16b384 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:28.016415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9165ef1-9c8e-44fe-a49b-6a4d9b16b384 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.033403 Sep 16 14:23:28.017778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2436/4839] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:27 2022] POST /compute/v2.1/servers => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:28.033877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:28.050476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:28.066536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.067678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.068695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.070291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.071424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.072262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.078838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:28.082989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:28.097067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.097686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.098146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.103809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.104629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.105189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.807060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:28.835922 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4e1366c8-e874-4b9e-9515-4e275b4e4491 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.796658 Sep 16 14:23:28.838979 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2437/4840] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:28 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:28.851361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:28.852449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:28.861197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.862742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.863476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.864900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.865829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.866766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.882201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:28.915004 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-464d7944-d863-4f7f-aa7c-e27d873b4bd9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.890506 Sep 16 14:23:28.925732 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2404/4841] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:28 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:28.941231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:28.942352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:28.979383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.980250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.981117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:28.984784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:28.988147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:28.989491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.271765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:29.289227 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3708ffa6-7fac-4753-89f4-50632772fa2f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.445872 Sep 16 14:23:29.290921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2438/4842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:28 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:29.329811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:29.331960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:29.351701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.352766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.353475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.354802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.357796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.360348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.388072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:29.395895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:29.414189 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16f3f1ee-06e5-4810-84c5-0162b73b2dc3 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1521 microversion: 2.1 time: 0.486629 Sep 16 14:23:29.416941 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2405/4843] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:28 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:29.466843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:29.467830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:29.479994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.481693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.485127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.486233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.492287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.494285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.540846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] HTTP exception thrown: Instance is not a member of specified network Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Request method failure captured: Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d/ips/invalid HTTP/1.1 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIbC5TPF5Bz8LbwzAH6xRf_hpBInORNgn6vQ2DeutSLG1heibcIY-i7GSJpETM6G7aVAGOXNVSe7B2r_bZNHzvl5TCuYUSZgCyn9S7uKWpZ_6ooFOBefOSjfCpT58qJ8T0_mqoD-OScwA10o-lbpJHsU1M42JNCQmcW6nfgOTP5QJyw Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3ab1cf65d1784a5295e5c69b51e634cd Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ab1cf65d1784a5295e5c69b51e634cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ab1cf65d1784a5295e5c69b51e634cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ab1cf65d1784a5295e5c69b51e634cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ab1cf65d1784a5295e5c69b51e634cd"}]}] Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3ab1cf65d1784a5295e5c69b51e634cd Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerAddressesNegativeTestJSON-342095804-project Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 721240f82fa84c92b74c9ca3e46270b0 Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-342095804-project Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance is not a member of specified network Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d', 'id': 'invalid'} Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 16 14:23:29.561483 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.567374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:29.570266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f74a2837-d8db-4e46-8b26-97c5a76ca0d0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.112096 Sep 16 14:23:29.572104 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2406/4844] 10.222.0.60 () {58 vars in 1272 bytes} [Fri Sep 16 14:23:29 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d/ips/invalid => generated 91 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:23:29.592819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2ace1a9-f46c-44fc-999b-5e2cbdd599f0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:29.593711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2ace1a9-f46c-44fc-999b-5e2cbdd599f0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Failed to fetch instance by id 999 {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 14:23:29.594638 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d2ace1a9-f46c-44fc-999b-5e2cbdd599f0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] HTTP exception thrown: Instance 999 could not be found. Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2ace1a9-f46c-44fc-999b-5e2cbdd599f0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Request method failure captured: Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIbC5TPF5Bz8LbwzAH6xRf_hpBInORNgn6vQ2DeutSLG1heibcIY-i7GSJpETM6G7aVAGOXNVSe7B2r_bZNHzvl5TCuYUSZgCyn9S7uKWpZ_6ooFOBefOSjfCpT58qJ8T0_mqoD-OScwA10o-lbpJHsU1M42JNCQmcW6nfgOTP5QJyw Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3ab1cf65d1784a5295e5c69b51e634cd Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ab1cf65d1784a5295e5c69b51e634cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ab1cf65d1784a5295e5c69b51e634cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ab1cf65d1784a5295e5c69b51e634cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ab1cf65d1784a5295e5c69b51e634cd"}]}] Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3ab1cf65d1784a5295e5c69b51e634cd Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerAddressesNegativeTestJSON-342095804-project Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 721240f82fa84c92b74c9ca3e46270b0 Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-342095804-project Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 999 could not be found. Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '999'} Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 16 14:23:29.597959 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:29.609951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2ace1a9-f46c-44fc-999b-5e2cbdd599f0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:29.612423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2ace1a9-f46c-44fc-999b-5e2cbdd599f0 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.028730 Sep 16 14:23:29.624405 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2407/4845] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 14:23:29 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:23:29.630667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:29.631384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:29.643671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.644656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.646294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.647541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.648455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.649159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.699676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:23:29.740824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:29.763061 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81c283cd-5308-4bf2-9db7-bec4afc757a9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.469876 Sep 16 14:23:29.764684 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2439/4846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:29 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:29.924820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:29.929326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:29.964123 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f5af0909-458b-4a6a-ba77-b036a61bbdbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 204 len: 0 microversion: 2.1 time: 0.333041 Sep 16 14:23:29.972538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.973407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.973596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2408/4847] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:23:29 2022] DELETE /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:23:29.974157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.979363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:29.983948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:29.985250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:29.993779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:29.997217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:30.024314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:30.028114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:30.029430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:30.031049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:30.031765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:30.033691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:30.551763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:30.561342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b911085a-2c94-4bf8-8d79-10adb9ccac1d tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1527 microversion: 2.1 time: 0.585767 Sep 16 14:23:30.563033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2409/4848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:29 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1527 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:30.590266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:30.633612 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5914c7d4-9c82-4162-8c74-a9dd9a86563f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.732979 Sep 16 14:23:30.642118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2440/4849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:29 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:30.658313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-881c8d04-3721-42a1-8873-cdf4bb2608bb req-3495e8d3-024c-4b6c-ba86-95e9e53d8608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46b2920-223c-4458-909a-94742db97084", "name": "network-vif-plugged", "status": "completed", "tag": "3dc93432-3220-4665-a0e0-4cdb12d4b42f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:30.694255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-881c8d04-3721-42a1-8873-cdf4bb2608bb req-3495e8d3-024c-4b6c-ba86-95e9e53d8608 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:30.695372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-881c8d04-3721-42a1-8873-cdf4bb2608bb req-3495e8d3-024c-4b6c-ba86-95e9e53d8608 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:30.695678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-881c8d04-3721-42a1-8873-cdf4bb2608bb req-3495e8d3-024c-4b6c-ba86-95e9e53d8608 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:30.729042 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-881c8d04-3721-42a1-8873-cdf4bb2608bb req-3495e8d3-024c-4b6c-ba86-95e9e53d8608 service nova] Creating event network-vif-plugged:3dc93432-3220-4665-a0e0-4cdb12d4b42f for instance a46b2920-223c-4458-909a-94742db97084 on n-h1-858129-2 Sep 16 14:23:30.736313 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-881c8d04-3721-42a1-8873-cdf4bb2608bb req-3495e8d3-024c-4b6c-ba86-95e9e53d8608 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092431 Sep 16 14:23:30.744337 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2441/4850] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:30.751609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:30.755419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:30.774291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:30.778580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:30.779057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:30.779829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:30.780310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:30.781975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.098033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:31.099897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:31.121389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:31.122281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:31.123366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.124678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:31.125572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:31.126346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.244390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55ae0ffc-ac68-4abb-a7c4-cc6dfdcfaca5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments/0dcc0ceb-fac9-44f4-b34e-9672e18fb8bf" status: 200 len: 194 microversion: 2.20 time: 0.679390 Sep 16 14:23:31.280448 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2410/4851] 10.222.0.60 () {60 vars in 1454 bytes} [Fri Sep 16 14:23:30 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments/0dcc0ceb-fac9-44f4-b34e-9672e18fb8bf => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:31.375515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:31.410563 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7d4e082d-da2e-46d3-b92b-98767908e19a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.663437 Sep 16 14:23:31.412853 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2442/4852] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:30 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:31.452683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:31.453488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:31.484322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:31.484963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:31.485414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.486177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:31.486765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:31.493666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.613035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:31.614351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:31.648031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:31.656630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:31.658182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:31.661016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.665974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:31.670906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:31.674117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:31.783760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lazy-loading 'services' on Instance uuid 71ac39ea-a915-4f5b-991a-f086e509d8ba {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:23:32.094225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c658062c-c751-4885-93b1-4170d5d03c27 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments/0dcc0ceb-fac9-44f4-b34e-9672e18fb8bf" status: 202 len: 0 microversion: 2.20 time: 0.652551 Sep 16 14:23:32.095314 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2411/4853] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Sep 16 14:23:31 2022] DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments/0dcc0ceb-fac9-44f4-b34e-9672e18fb8bf => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:23:32.103729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:32.105264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:32.114160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:32.114945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:32.115630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:32.117482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:32.118349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:32.119744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:32.413736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:32.447222 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7b7be15-8d6a-46d2-bcb3-afbdf0a60bbf tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1527 microversion: 2.1 time: 0.837632 Sep 16 14:23:32.473904 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2443/4854] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:31 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1527 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:32.496042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:32.531788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:32.551761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:32.553420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:32.555648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:32.556428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:32.556903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:32.557327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:32.621243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:32.633951 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94baca07-11a5-429d-b940-d5093ddeeb50 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.534521 Sep 16 14:23:32.634804 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2412/4855] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:32 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:32.636531 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7bf3e980-e433-467a-8843-f94f643b9883 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170516 Sep 16 14:23:32.642638 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2444/4856] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:32 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:32.643600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:32.644430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:32.670220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:32.671156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:32.672048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:32.674005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:32.674877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:32.675567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.149265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:33.175898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a21c9ce4-d4e0-4aaf-bd32-5cfcc05bd50e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1314 microversion: 2.1 time: 0.537594 Sep 16 14:23:33.208625 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2413/4857] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:32 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:33.344631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-fa92c06f-39bd-437b-9109-080bca44012b req-a9ddb204-0d43-4f51-8abf-baa5566417d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d", "name": "network-vif-deleted", "tag": "0e55f3a2-2218-4ea4-bed2-44bd27e5956a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:33.402380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fa92c06f-39bd-437b-9109-080bca44012b req-a9ddb204-0d43-4f51-8abf-baa5566417d3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.406644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fa92c06f-39bd-437b-9109-080bca44012b req-a9ddb204-0d43-4f51-8abf-baa5566417d3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.410534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fa92c06f-39bd-437b-9109-080bca44012b req-a9ddb204-0d43-4f51-8abf-baa5566417d3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.480826 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-fa92c06f-39bd-437b-9109-080bca44012b req-a9ddb204-0d43-4f51-8abf-baa5566417d3 service nova] Creating event network-vif-deleted:0e55f3a2-2218-4ea4-bed2-44bd27e5956a for instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d on n-h2-858129-2 Sep 16 14:23:33.490078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:33.490078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:33.500719 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-fa92c06f-39bd-437b-9109-080bca44012b req-a9ddb204-0d43-4f51-8abf-baa5566417d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163060 Sep 16 14:23:33.502116 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2445/4858] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:33.515568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f794856-0be2-41da-8876-15ffeb09fde4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1787334206", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5f9fefb6-aa1e-400b-b273-93a1aec8d8c7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:33.523094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.524766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.528013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.535299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.539802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.542580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.643800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.644949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.645988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.647419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lazy-loading 'fault' on Instance uuid 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:23:33.778876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-5f794856-0be2-41da-8876-15ffeb09fde4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Block Device 5f9fefb6-aa1e-400b-b273-93a1aec8d8c7 is not bootable. Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f794856-0be2-41da-8876-15ffeb09fde4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 358 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1787334206", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5f9fefb6-aa1e-400b-b273-93a1aec8d8c7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: exception: Block Device 5f9fefb6-aa1e-400b-b273-93a1aec8d8c7 is not bootable. Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1787334206', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5f9fefb6-aa1e-400b-b273-93a1aec8d8c7'}], 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5f9fefb6-aa1e-400b-b273-93a1aec8d8c7 is not bootable. Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:33.791330 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5f9fefb6-aa1e-400b-b273-93a1aec8d8c7 is not bootable. Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5f9fefb6-aa1e-400b-b273-93a1aec8d8c7 is not bootable. Sep 16 14:23:33.795555 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:33.799433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f794856-0be2-41da-8876-15ffeb09fde4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Block Device 5f9fefb6-aa1e-400b-b273-93a1aec8d8c7 is not bootable. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:33.800830 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f794856-0be2-41da-8876-15ffeb09fde4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.296691 Sep 16 14:23:33.802472 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2446/4859] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:33 2022] POST /compute/v2.1/servers => generated 110 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:33.811003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721240f82fa84c92b74c9ca3e46270b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab1cf65d1784a5295e5c69b51e634cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:33.814735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:33.824993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:33.835252 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24b26581-a131-4e6b-9337-ffafe5ca8368 tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 200 len: 1314 microversion: 2.1 time: 0.356238 Sep 16 14:23:33.836381 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2414/4860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:33 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:33.844416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.845469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.848755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.850198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.851459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.863296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.867691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:33.874855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:33.890393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.895732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.901423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.908055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:33.914778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:33.917879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:33.939834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:33.999293 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c79bd7b-9a5a-4fec-953e-53523203fd44 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191516 Sep 16 14:23:34.001537 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2447/4861] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:33 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:34.010450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:34.011514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:34.025289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:34.026475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:34.026943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:34.028229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:34.028947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:34.029788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.090288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:35.121867 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-06c56919-53aa-4b83-b0e9-7575135c056c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 1.265507 Sep 16 14:23:35.127743 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2415/4862] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:33 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:35.148903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:35.154038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:35.180591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.182560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.183643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.185235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.186547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.187573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.254929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:35.275358 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fbdebff4-7e18-4940-a8cf-76af750693e0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.269993 Sep 16 14:23:35.275966 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2448/4863] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:34 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:35.283149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:35.288877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] [instance: 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:35.318383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.318921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.319935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.320639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.321089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.321509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.367509 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] HTTP exception thrown: Instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d could not be found. Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Request method failure captured: Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d HTTP/1.1 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIbC5TPF5Bz8LbwzAH6xRf_hpBInORNgn6vQ2DeutSLG1heibcIY-i7GSJpETM6G7aVAGOXNVSe7B2r_bZNHzvl5TCuYUSZgCyn9S7uKWpZ_6ooFOBefOSjfCpT58qJ8T0_mqoD-OScwA10o-lbpJHsU1M42JNCQmcW6nfgOTP5QJyw Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 3ab1cf65d1784a5295e5c69b51e634cd Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ab1cf65d1784a5295e5c69b51e634cd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ab1cf65d1784a5295e5c69b51e634cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ab1cf65d1784a5295e5c69b51e634cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ab1cf65d1784a5295e5c69b51e634cd"}]}] Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 3ab1cf65d1784a5295e5c69b51e634cd Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-342095804 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerAddressesNegativeTestJSON-342095804-project Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 721240f82fa84c92b74c9ca3e46270b0 Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-342095804-project Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d could not be found. Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d'} Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d could not be found. Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d could not be found. Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:35.382269 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d could not be found. Sep 16 14:23:35.392676 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:35.400000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] Returning 404 to user: Instance 8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:35.401414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00368f0c-b741-4a4b-976a-7cef25588f9b tempest-ServerAddressesNegativeTestJSON-342095804 tempest-ServerAddressesNegativeTestJSON-342095804-project] 10.222.0.60 "GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d" status: 404 len: 111 microversion: 2.1 time: 0.123717 Sep 16 14:23:35.407953 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2449/4864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:35 2022] GET /compute/v2.1/servers/8e1cc7d6-f1d8-476b-9a32-57b57cd21c7d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:23:35.424664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:35.431245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:35.451824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.454217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.456580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.463818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.464792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.465469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.557629 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-92b67670-3647-4417-98d9-11b92252acbb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147692 Sep 16 14:23:35.558871 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2450/4865] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:35 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:35.576760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:35.579354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:35.592735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.594262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.595297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.597025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.599012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.600123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.647810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:35.681372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-38f0051d-a837-421f-a585-541f75298312 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1501 microversion: 2.1 time: 0.549927 Sep 16 14:23:35.683552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2416/4866] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:35 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:35.730048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:35.735666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:35.775489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.776176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.776860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.779912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:35.780701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:35.791370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:35.994678 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d65b340e-5a6d-43e7-88fa-d97174c97594 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084/action" status: 202 len: 0 microversion: 2.1 time: 0.286880 Sep 16 14:23:35.995896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2417/4867] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:23:35 2022] POST /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:23:36.018086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:36.039806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:36.061979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:36.062942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:36.063753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:36.064167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:36.073993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:36.074951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:36.075781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:36.088951 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3f9c02e-2b89-4ed5-8ae3-b17dfe683801 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.519632 Sep 16 14:23:36.089565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2451/4868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:35 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:36.171270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:36.171898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:36.183266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:36.183764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:36.184197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:36.185139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:36.189291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:36.189999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:36.778181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:36.814791 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc126a96-2ebd-4eef-9605-c1d9e9de7333 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.639335 Sep 16 14:23:36.814791 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2452/4869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:36 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:36.848758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:36.861113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:36.875481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:36.890850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:36.892169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:36.895904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:36.899625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:36.901257 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-adea278d-421c-42b7-aea2-ec11deeefe0c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1506 microversion: 2.1 time: 0.897541 Sep 16 14:23:36.902275 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2418/4870] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:36 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1506 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:36.903438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:36.905946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:37.039519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7feda864-9612-4881-ba56-0ffe742bc08b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207504 Sep 16 14:23:37.040601 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2453/4871] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:36 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:37.860001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:37.861877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:37.883256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:37.887022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:37.892053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:37.896253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:37.897880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:37.899847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:37.964966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:37.966057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:37.996782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:37.997846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:37.998922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:38.000211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:38.001018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:38.001752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:38.426156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:38.450311 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c99f1c77-ee79-40e9-9e4c-8bd4baf25976 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.600019 Sep 16 14:23:38.466968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2419/4872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:37 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:38.490464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:38.496422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:38.501157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:38.508720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:38.509579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:38.510524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:38.511855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:38.512759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:38.513882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:38.516929 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98250c56-4e29-4ee8-82fa-ed7a9e91746e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1486 microversion: 2.1 time: 0.570028 Sep 16 14:23:38.521694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:38.527985 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2454/4873] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:37 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1486 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:38.582597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:38.586244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:38.609740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fc8db20-f6e6-41a8-908a-e83caff172b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140735 Sep 16 14:23:38.615459 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2420/4874] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:38 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:38.619057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:38.621788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:38.626666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:38.628182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:38.629042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:38.630996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:38.716179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lazy-loading 'flavor' on Instance uuid a46b2920-223c-4458-909a-94742db97084 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:23:39.063377 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aea7c46d-6a72-47a0-a6a3-c250e69d0589 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084/action" status: 202 len: 0 microversion: 2.1 time: 0.496412 Sep 16 14:23:39.065612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2455/4875] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:23:38 2022] POST /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:23:39.083513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:39.086797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:39.106050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.107541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.109280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.111408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.112721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.114093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.430430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:39.475536 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac541c78-b908-4d30-9cfa-9b186a9852a7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1492 microversion: 2.1 time: 0.402597 Sep 16 14:23:39.476605 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2421/4876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:39 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1492 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:39.492466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:39.493697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:39.506487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.512640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.513361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.514803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.517233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.517898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.627745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:39.631900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:39.643164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.644059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.644974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.646748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.647775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.648588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.755696 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa6548b7-3aa0-4258-b8fe-59889c7ead26 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135711 Sep 16 14:23:39.756222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2422/4877] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:39 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:23:39.770298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72d9ba02-ca11-46ea-9394-8a8a54f8da90 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-184141205", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "destination_type": "local"}, {"source_type": "volume", "uuid": "0cd47fab-b06a-4404-bd70-c3deb7f44cf2", "destination_type": "invalid"}], "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72d9ba02-ca11-46ea-9394-8a8a54f8da90 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 494 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-184141205", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "destination_type": "local"}, {"source_type": "volume", "uuid": "0cd47fab-b06a-4404-bd70-c3deb7f44cf2", "destination_type": "invalid"}], "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-184141205', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0cd47fab-b06a-4404-bd70-c3deb7f44cf2', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'invalid' Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:39.777398 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72d9ba02-ca11-46ea-9394-8a8a54f8da90 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72d9ba02-ca11-46ea-9394-8a8a54f8da90 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020957 Sep 16 14:23:39.782255 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2423/4878] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:39 2022] POST /compute/v2.1/servers => generated 155 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:39.791074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:39.792023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:39.805306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.806573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.807257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.808933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:39.810596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:39.811270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:39.843131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:39.858185 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f595787-9ee5-4af8-a730-1605ee650736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.371601 Sep 16 14:23:39.860798 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2456/4879] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:39 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:40.175969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:40.197757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74ce1906-ec88-4b6e-b679-a9897dc4f8d5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.412544 Sep 16 14:23:40.223656 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2424/4880] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:39 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:40.242803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:40.244138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:40.261610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.263300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.263971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.264918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.265766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.266427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.496054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:40.519376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:40.519925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:40.522064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:40.523244 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1eef526-f877-45ed-bc82-363dd51a50fe tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.284458 Sep 16 14:23:40.524317 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2457/4881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:40 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:40.535312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.535931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.536394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.537131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.537607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.538588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.770287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:40.773041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:40.800820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.801335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.801783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.802563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.803029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.803557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.863398 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a6d8ad7d-ef74-434f-91d0-5ebfbb5eb27f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097793 Sep 16 14:23:40.864343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2458/4882] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:40 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 14:23:40.877807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d6459ed-ad22-4047-92cd-9608af61f5f1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-77434493", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d6459ed-ad22-4047-92cd-9608af61f5f1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 490 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-77434493", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-77434493', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.883642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 16 14:23:40.887543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:40.891509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d6459ed-ad22-4047-92cd-9608af61f5f1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:40.892953 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d6459ed-ad22-4047-92cd-9608af61f5f1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.021917 Sep 16 14:23:40.894569 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2459/4883] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:40 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:40.900164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:40.902036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:40.911867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.912656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.913731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.914757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:40.915439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:40.916033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:40.941955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:40.969530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bb208da0-e636-43f9-9f27-0aee37ca0b35 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1492 microversion: 2.1 time: 0.453834 Sep 16 14:23:40.983131 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2425/4884] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:40 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1492 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:40.998615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:41.008030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:41.026677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:41.027988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:41.029047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:41.030619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:41.031761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:41.032875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:41.228860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:41.263116 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30b69302-b4ba-48cd-b0a1-45ebbe23093a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.363819 Sep 16 14:23:41.265581 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2460/4885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:40 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:41.359553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:41.379084 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba2d037f-3341-4cce-99ec-5e6ea36186f9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.393882 Sep 16 14:23:41.382820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2426/4886] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:40 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:41.426197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:41.427392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:41.437068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:41.437771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:41.438921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:41.441044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:41.442148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:41.442908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:41.878910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:41.881566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:41.890539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:41.891236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:41.891941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:41.892901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:41.893888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:41.894536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:41.934434 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-edfc510d-c6ae-4994-a526-63c314af7f0a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059492 Sep 16 14:23:41.941909 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2427/4887] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:23:41 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:41.997558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:42.014394 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d3e56f24-1f7b-4ff5-b5c2-d214ffd23490 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.592511 Sep 16 14:23:42.016537 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2461/4888] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:41 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:42.032199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:42.032878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:42.061371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.063195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.066176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.068382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.069636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.071773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.162662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:42.165992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:42.181141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.182658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.184598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.187114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.188296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.191272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.268039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:23:42.385337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:42.512453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0444815f-6415-409e-8673-82fa52100aa9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 204 len: 0 microversion: 2.20 time: 0.362289 Sep 16 14:23:42.513127 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2462/4889] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:23:42 2022] DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 14:23:42.531709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fee0134-c996-4a25-8f53-9e69468ba30d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fee0134-c996-4a25-8f53-9e69468ba30d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 416 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.547299 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fee0134-c996-4a25-8f53-9e69468ba30d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:42.555420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fee0134-c996-4a25-8f53-9e69468ba30d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.037617 Sep 16 14:23:42.563256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2463/4890] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:42 2022] POST /compute/v2.1/servers => generated 619 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:42.579564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:42.582658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:42.617727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:42.627367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.628129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.628755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.630306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.631946 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44910b9c-0915-4193-b26e-ddb5aeaafb3d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1513 microversion: 2.1 time: 0.619736 Sep 16 14:23:42.632752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2428/4891] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:42 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1513 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:42.633017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.633588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.651634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:42.654804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:42.676721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.677599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.678631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:42.684453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:42.685138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:42.685899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:43.125137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:43.134383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:43.136485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:43.137955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-033619af-195c-4be1-acfb-89ff4fca732d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 0.503833 Sep 16 14:23:43.138801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2429/4892] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:23:42 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:23:43.159533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:43.160417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:43.169083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:43.169844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:43.170509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:43.174204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:43.174982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:43.175839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:43.203997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:43.232615 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0a540c15-5a7d-4680-9960-0024c3edfbe9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.672363 Sep 16 14:23:43.233441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2464/4893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:42 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:43.660216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:43.661756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:43.670617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:43.671533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:43.672523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:43.673611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:43.674092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:43.674581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:43.879879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:43.890531 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0c1797af-0537-4aa0-9420-96cd12f74fc3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.750271 Sep 16 14:23:43.891352 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2430/4894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:43 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:43.933082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:43.934249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:43.941843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:43.944294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:43.945381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:43.954104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:43.955107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:43.955967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:44.411085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:44.422801 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a7866224-b784-4cdc-90f9-c92b57edd919 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1513 microversion: 2.1 time: 0.767229 Sep 16 14:23:44.424863 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2465/4895] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:43 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1513 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:44.444787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a4e4f41c-e2f5-41e8-8c01-da1c2313cf45 req-8b439fbc-7a91-41f3-88e2-04c2e4e25fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46b2920-223c-4458-909a-94742db97084", "name": "network-vif-plugged", "status": "completed", "tag": "3dc93432-3220-4665-a0e0-4cdb12d4b42f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:44.464586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a4e4f41c-e2f5-41e8-8c01-da1c2313cf45 req-8b439fbc-7a91-41f3-88e2-04c2e4e25fea service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:44.465230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a4e4f41c-e2f5-41e8-8c01-da1c2313cf45 req-8b439fbc-7a91-41f3-88e2-04c2e4e25fea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:44.465807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a4e4f41c-e2f5-41e8-8c01-da1c2313cf45 req-8b439fbc-7a91-41f3-88e2-04c2e4e25fea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:44.481650 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a4e4f41c-e2f5-41e8-8c01-da1c2313cf45 req-8b439fbc-7a91-41f3-88e2-04c2e4e25fea service nova] Creating event network-vif-plugged:3dc93432-3220-4665-a0e0-4cdb12d4b42f for instance a46b2920-223c-4458-909a-94742db97084 on n-h1-858129-2 Sep 16 14:23:44.487485 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a4e4f41c-e2f5-41e8-8c01-da1c2313cf45 req-8b439fbc-7a91-41f3-88e2-04c2e4e25fea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060539 Sep 16 14:23:44.492088 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2466/4896] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:44.499028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:44.499768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:44.507254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:44.507951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:44.508187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:44.509117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:44.509574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:44.510199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:45.125022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:45.136741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0610baf-44ca-427a-9f91-357922daed15 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.208683 Sep 16 14:23:45.151607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2431/4897] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:43 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:45.182660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:45.183552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:45.200998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:45.201924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:45.203969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:45.204842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:45.207412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:45.208010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:45.627722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:45.638956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:45.640585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:45.642142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e9bad88a-99c3-4715-b999-b053277cca16 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1724 microversion: 2.20 time: 1.148485 Sep 16 14:23:45.642760 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2467/4898] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:23:44 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1724 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:23:45.650076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-48bc62b9-0c1d-4bcd-bb27-878a1f8db58b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-337756421", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": -1, "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:45.669077 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-48bc62b9-0c1d-4bcd-bb27-878a1f8db58b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Flavor -1 could not be found. Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-48bc62b9-0c1d-4bcd-bb27-878a1f8db58b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 205 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-337756421", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": -1, "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: exception: Flavor -1 could not be found. Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-337756421', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': -1, 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:45.684041 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-48bc62b9-0c1d-4bcd-bb27-878a1f8db58b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-48bc62b9-0c1d-4bcd-bb27-878a1f8db58b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.045918 Sep 16 14:23:45.694047 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2468/4899] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:45 2022] POST /compute/v2.1/servers => generated 73 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:23:45.705160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:45.705837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:45.721711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:45.723049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:45.725172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:45.727260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:45.728450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:45.729414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:46.216484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:46.230123 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f7cc12c-59ae-4ef9-adf0-56657d376549 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 1.076983 Sep 16 14:23:46.231245 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2432/4900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:45 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:46.239779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:46.241473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:46.264458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:46.265585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:46.271393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:46.274760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:46.275913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:46.277049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:46.606107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:46.630381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d145d15f-ee85-4e2a-9cb4-23503daa1e52 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1513 microversion: 2.1 time: 0.931478 Sep 16 14:23:46.631482 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2469/4901] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:45 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1513 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:46.690981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:46.692033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:46.699605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:46.700835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:46.703484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:46.705657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:46.707035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:46.710210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:47.126012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:47.155049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:47.173762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:47.174881 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-849c0156-e2f1-4c55-8d45-814cdf74119f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.940248 Sep 16 14:23:47.176635 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2433/4902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:46 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:47.178285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:47.192957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0a77a68-2811-43c0-a4aa-b1e39fc04157 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 200 len: 1656 microversion: 2.20 time: 0.494635 Sep 16 14:23:47.198460 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2470/4903] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:23:46 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 1656 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:23:47.214603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:47.223750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:47.251722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:47.255808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:47.257008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:47.257934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:47.258753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:47.260823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:47.810389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e41c2a8d-04e6-4172-b4a5-6ca01e208cff req-f6407e9f-26b8-4db5-93d3-e4978fa27d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ac39ea-a915-4f5b-991a-f086e509d8ba", "name": "network-vif-deleted", "tag": "4feef519-f628-4187-8bd5-d800bac60f10"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:47.852846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e41c2a8d-04e6-4172-b4a5-6ca01e208cff req-f6407e9f-26b8-4db5-93d3-e4978fa27d8b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:47.854460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e41c2a8d-04e6-4172-b4a5-6ca01e208cff req-f6407e9f-26b8-4db5-93d3-e4978fa27d8b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:47.858242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e41c2a8d-04e6-4172-b4a5-6ca01e208cff req-f6407e9f-26b8-4db5-93d3-e4978fa27d8b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:47.896898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e41c2a8d-04e6-4172-b4a5-6ca01e208cff req-f6407e9f-26b8-4db5-93d3-e4978fa27d8b service nova] Creating event network-vif-deleted:4feef519-f628-4187-8bd5-d800bac60f10 for instance 71ac39ea-a915-4f5b-991a-f086e509d8ba on n-h2-858129-2 Sep 16 14:23:47.914049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e41c2a8d-04e6-4172-b4a5-6ca01e208cff req-f6407e9f-26b8-4db5-93d3-e4978fa27d8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.733474 Sep 16 14:23:47.916019 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2434/4904] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:23:47.928250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:47.929012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:47.932558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:47.945256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:47.946078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:47.946725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:47.947647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:47.948307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:47.948925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:48.010394 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a30560c4-0a57-47dc-8508-98a9c7d2b6e5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.806484 Sep 16 14:23:48.013551 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2471/4905] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:47 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:48.031517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:48.034125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:48.109332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:48.113683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:48.115626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:48.121167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:48.125470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:48.129786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:48.830370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:48.841423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7758113-a02e-4493-b3c0-c6b9a613e35f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.917589 Sep 16 14:23:48.863078 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2435/4906] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:47 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:48.872556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b01a77c1-fb4d-49e1-b6e8-1845295521b9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1894022640", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b01a77c1-fb4d-49e1-b6e8-1845295521b9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 173 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1894022640", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1894022640', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi -1 Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:23:48.895993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 16 14:23:48.901057 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:48.906171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b01a77c1-fb4d-49e1-b6e8-1845295521b9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:48.907577 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b01a77c1-fb4d-49e1-b6e8-1845295521b9 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.043001 Sep 16 14:23:48.908856 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2436/4907] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:48 2022] POST /compute/v2.1/servers => generated 145 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:48.920788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:48.922520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:48.938942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:48.939907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:48.941837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:48.942899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:48.950904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:48.951791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:48.990263 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] HTTP exception thrown: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Request method failure captured: Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba HTTP/1.1 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIWa4-Y0Ua5K-hQb4nN5FixexB-iaA9GvS1t_xrHBX45UZvCBAqbUZzEtJpd59lsMyep16GxVXlcZmet68hjFLa8FskpzNmQFXaWZusm0__sTWCQpJ7qSSXOU950wBm0VgqJZOhkvXkpsoSOoS0babnF7zPB9CwifT59FxOiHXxAYSw Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d8057a5157844b15bb19ece760a72ce5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}] Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6830539834e941eaa36dcb955b57194d Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '71ac39ea-a915-4f5b-991a-f086e509d8ba'} Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:49.004401 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:23:49.009292 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:23:49.013312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Returning 404 to user: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:49.014573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5f8a664-203d-4c28-b63a-fe4ca03329c4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 404 len: 111 microversion: 2.20 time: 0.104325 Sep 16 14:23:49.015419 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2437/4908] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:23:48 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:49.021294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:49.022928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:49.043990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:49.044683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:49.045271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:49.046129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:49.046790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:49.047314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:49.118071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:49.132804 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-771cd180-6a74-4a46-8f2c-41dce5aba449 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 1.117020 Sep 16 14:23:49.167633 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2472/4909] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:48 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:49.181188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b207353-7787-4ffe-933c-83546c794cbc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '.version_select at 0x7f724c646550>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:49.203900 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b207353-7787-4ffe-933c-83546c794cbc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [06bb6011-c533-4d38-a08e-8776a507e591] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 14:23:49.401740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:49.414917 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-342adc83-e204-49e3-b920-f98ceefab845 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.396592 Sep 16 14:23:49.420665 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2438/4910] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:49 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:49.469815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:49.472218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:49.488276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:49.493071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:49.495148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:49.496804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:49.501728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:49.505728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:50.212171 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b207353-7787-4ffe-933c-83546c794cbc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [06bb6011-c533-4d38-a08e-8776a507e591] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 35880. Sep 16 14:23:50.280230 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b207353-7787-4ffe-933c-83546c794cbc tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632741643" status: 204 len: 0 microversion: 2.20 time: 1.110989 Sep 16 14:23:50.281321 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2473/4911] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 14:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632741643 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:23:50.298324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:50.300608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:50.319138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:50.323332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:50.324813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:50.328356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:50.329486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:50.330444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:50.632845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:50.669681 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d922955d-da43-4287-8815-426c99bdf138 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.204502 Sep 16 14:23:50.671493 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2439/4912] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:49 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:50.684496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:50.695646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:50.726581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:50.727474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:50.728284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:50.729585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:50.746292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:50.747389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:50.856045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:23:52.115377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:52.135962 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c22c1a3-793b-4aa4-999b-69320bd6b32b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 1.852214 Sep 16 14:23:52.141670 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2474/4913] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:50 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:52.151041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01dc825c-5c0b-47d8-9cff-930d60a561a2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-673991294", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:52.170087 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-01dc825c-5c0b-47d8-9cff-930d60a561a2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01dc825c-5c0b-47d8-9cff-930d60a561a2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 215 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-673991294", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-673991294', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:52.175892 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 16 14:23:52.182462 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:52.186311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01dc825c-5c0b-47d8-9cff-930d60a561a2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:52.188327 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01dc825c-5c0b-47d8-9cff-930d60a561a2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.043865 Sep 16 14:23:52.192216 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2475/4914] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:52 2022] POST /compute/v2.1/servers => generated 123 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:23:52.207305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:52.208676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:52.236297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:52.236813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:52.237262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:52.244616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:52.246128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:52.246834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:52.271790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:52.312605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67b481f7-26d1-41ca-8027-18c90ab92d81 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 1.635198 Sep 16 14:23:52.317377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2440/4915] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:50 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:52.668499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:52.708575 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6879dfcf-6363-40bc-913c-424fbe53c965 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.487987 Sep 16 14:23:52.713196 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2476/4916] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:52 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:52.782102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:52.782825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:52.810993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:52.811512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:52.814048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:52.815363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:52.816032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:52.817498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:53.174984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:53.176140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:53.220489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:53.221456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:53.222703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:53.224384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:53.226117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:53.227252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:53.607804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:53.637611 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-78ace475-ae3e-4297-9730-998a09ad4d5f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.873072 Sep 16 14:23:53.641436 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2441/4917] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:52 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:53.660888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:53.665758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:53.703575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:53.704810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:53.706665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:53.710082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:53.711458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:53.713469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:54.027498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:54.051302 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b1ef8919-636e-4046-a13b-aefbde06aff3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.884847 Sep 16 14:23:54.076303 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2477/4918] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:53 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:54.099681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0d3cac6-8b04-47ce-863e-dd712313c309 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1441350395", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-key-610627865", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:54.195707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-b0d3cac6-8b04-47ce-863e-dd712313c309 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] validate_networks() for [('4e265fd5-52bc-47bb-af24-2c89589c7a06', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:23:54.272677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:54.285556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41af8d1b-997e-4f86-aa91-f8a6a27c9137 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.642150 Sep 16 14:23:54.292078 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2442/4919] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:53 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:55.112971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:55.115216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:55.136365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:55.137400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:55.138126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:55.144983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:55.145690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:55.145998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:55.596633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b0d3cac6-8b04-47ce-863e-dd712313c309 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Invalid key_name provided. Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0d3cac6-8b04-47ce-863e-dd712313c309 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 246 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1441350395", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-key-610627865", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid key_name provided. Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1441350395', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'key_name': 'tempest-key-610627865', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-610627865 not found for user 2d093d019a504159871c04a88352f43f Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:55.601133 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0d3cac6-8b04-47ce-863e-dd712313c309 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid key_name provided. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0d3cac6-8b04-47ce-863e-dd712313c309 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.525517 Sep 16 14:23:55.611453 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2478/4920] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:54 2022] POST /compute/v2.1/servers => generated 70 bytes in 1528 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 16 14:23:55.620801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5afe606-8332-457a-ba4c-a8bb52af1783 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'create', calling method: .version_select at 0x7f724c518430>, body: {"keypair": {"name": "tempest-keypair-1385613269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhvdV5A6Ypugq62H4yy1Oty8SdoR/wEULI4ttF4lgvo3nw/L0eaUInw+HINA+HCgpClC0TydjdABmaqRBPAyfTaxSX2c5rM7K//wrWr+qrPmKnCBgj/WtixWaEtbzETyg=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:55.651605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a5afe606-8332-457a-ba4c-a8bb52af1783 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for project d8057a5157844b15bb19ece760a72ce5. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:23:55.663791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a5afe606-8332-457a-ba4c-a8bb52af1783 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for user 6830539834e941eaa36dcb955b57194d and project d8057a5157844b15bb19ece760a72ce5. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:23:55.716269 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5afe606-8332-457a-ba4c-a8bb52af1783 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108866 Sep 16 14:23:55.719142 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2479/4921] 10.222.0.60 () {62 vars in 1200 bytes} [Fri Sep 16 14:23:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 14:23:55.730688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:55.732238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:55.744801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:55.746056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:55.747113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:55.749737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:55.750983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:55.752076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:56.027827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:56.049483 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cbb6c988-e578-480b-a60a-50a304a7c535 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1515 microversion: 2.1 time: 0.953865 Sep 16 14:23:56.050787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2443/4922] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:55 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1515 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:56.077894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:56.079399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:56.103812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:56.104954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:56.109341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:56.110984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:56.112103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:56.119747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:56.406067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:56.417304 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67fe71dd-b713-420c-96a7-2d488335d398 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.696327 Sep 16 14:23:56.421247 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2480/4923] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:55 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:56.669062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:56.698020 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7e1ddc9-1d86-413e-a97a-6cb12d0f2507 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.637826 Sep 16 14:23:56.702818 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2444/4924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:56 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:56.733834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:56.735819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:56.755066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:56.755960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:56.757257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:56.763572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:56.764483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:56.765274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:57.092967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:57.094440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:57.110217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:57.110778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:57.111868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:57.112025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:57.112389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:57.112810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:57.135421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:57.144007 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2392a850-693c-41c2-9c85-ff302ebc765a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.417826 Sep 16 14:23:57.158847 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2481/4925] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:56 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:57.407355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d01ef161-f60d-45e7-adc9-f4e96b582e1a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267640731", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:23:57.684726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.security_group_api [None req-d01ef161-f60d-45e7-adc9-f4e96b582e1a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Neutron security group does_not_exist not found {{(pid=128643) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 16 14:23:57.686550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d01ef161-f60d-45e7-adc9-f4e96b582e1a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d01ef161-f60d-45e7-adc9-f4e96b582e1a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 258 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1267640731", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1267640731', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 16 14:23:57.700664 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 16 14:23:57.706030 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:23:57.720413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d01ef161-f60d-45e7-adc9-f4e96b582e1a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:23:57.724078 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d01ef161-f60d-45e7-adc9-f4e96b582e1a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.318993 Sep 16 14:23:57.724751 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2482/4926] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:23:57 2022] POST /compute/v2.1/servers => generated 106 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:23:57.748357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:57.749436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:57.773312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:57.774011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:57.774645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:57.775533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:57.776132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:57.776682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:57.784893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:57.831116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f89aa325-3210-42a5-b61c-5aa23c053ecf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1521 microversion: 2.1 time: 0.743358 Sep 16 14:23:57.842485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2445/4927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:57 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1521 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:23:57.882314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:57.885733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:57.918243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:57.918704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:57.919472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:57.922447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:57.927048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:57.931970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:58.335391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:58.392799 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-12d37002-8201-4325-9692-870f9d966622 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.665537 Sep 16 14:23:58.420650 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2483/4928] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:57 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:58.615654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:23:58.626345 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d408d816-47b4-4826-bfcd-a1e171dc0129 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.781849 Sep 16 14:23:58.633092 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2446/4929] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:57 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:23:58.658820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:58.660131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:58.676453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:58.680741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:58.683241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:58.684581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:58.687005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:58.687725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:58.870018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:23:58.870664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:23:58.886099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:58.886641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:58.887091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:23:58.887823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:23:58.888314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:23:58.898211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:00.197370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:00.210865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0929e573-2f7c-413a-bc1b-ca95bfd30616 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.556020 Sep 16 14:24:00.229222 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2484/4930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:58 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:00.234569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:00.244016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:00.262086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:00.262990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:00.266387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:00.268102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:00.270001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:00.273219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:00.405574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:00.422680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4a32af3-8342-4c21-8f98-9331be7f8861 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1521 microversion: 2.1 time: 1.556679 Sep 16 14:24:00.424958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2447/4931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:23:58 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1521 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:00.444266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4288a85c-d0ef-4daa-af7b-67ec22b97080 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:00.445641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4288a85c-d0ef-4daa-af7b-67ec22b97080 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 970963f9-1de9-463c-ae89-c237b90c7899] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:00.466585 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4288a85c-d0ef-4daa-af7b-67ec22b97080 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 970963f9-1de9-463c-ae89-c237b90c7899 could not be found. Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4288a85c-d0ef-4daa-af7b-67ec22b97080 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/970963f9-1de9-463c-ae89-c237b90c7899 HTTP/1.1 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 970963f9-1de9-463c-ae89-c237b90c7899 could not be found. Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '970963f9-1de9-463c-ae89-c237b90c7899'} Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970963f9-1de9-463c-ae89-c237b90c7899 could not be found. Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970963f9-1de9-463c-ae89-c237b90c7899 could not be found. Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:00.470102 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970963f9-1de9-463c-ae89-c237b90c7899 could not be found. Sep 16 14:24:00.481980 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:00.495793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4288a85c-d0ef-4daa-af7b-67ec22b97080 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 970963f9-1de9-463c-ae89-c237b90c7899 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:00.497981 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4288a85c-d0ef-4daa-af7b-67ec22b97080 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "DELETE /compute/v2.1/servers/970963f9-1de9-463c-ae89-c237b90c7899" status: 404 len: 111 microversion: 2.1 time: 0.070886 Sep 16 14:24:00.500094 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2448/4932] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:24:00 2022] DELETE /compute/v2.1/servers/970963f9-1de9-463c-ae89-c237b90c7899 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:00.516845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:00.518493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:00.558312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:00.559697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:00.564333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:00.565957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:00.579616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:00.580837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:00.696324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:00.711708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5c151a8-8ca0-4df9-8dfa-509952e9f4c4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.480137 Sep 16 14:24:00.712823 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2485/4933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:00 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:00.792021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bcbd3463-05b8-4c69-870d-09cb73106fa0 req-9f51d987-09e6-41a5-afd1-b7c369d1e19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808fa331-04a9-4998-987f-0dd30ba2bffc", "name": "network-vif-unplugged", "status": "completed", "tag": "d2fd2438-14c5-4150-8d84-6e6cecaf4f20"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:00.797997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:00.818634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bcbd3463-05b8-4c69-870d-09cb73106fa0 req-9f51d987-09e6-41a5-afd1-b7c369d1e19a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:00.820222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bcbd3463-05b8-4c69-870d-09cb73106fa0 req-9f51d987-09e6-41a5-afd1-b7c369d1e19a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:00.821038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bcbd3463-05b8-4c69-870d-09cb73106fa0 req-9f51d987-09e6-41a5-afd1-b7c369d1e19a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:00.846061 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bcbd3463-05b8-4c69-870d-09cb73106fa0 req-9f51d987-09e6-41a5-afd1-b7c369d1e19a service nova] Creating event network-vif-unplugged:d2fd2438-14c5-4150-8d84-6e6cecaf4f20 for instance 808fa331-04a9-4998-987f-0dd30ba2bffc on n-h1-858129-2 Sep 16 14:24:00.868534 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bcbd3463-05b8-4c69-870d-09cb73106fa0 req-9f51d987-09e6-41a5-afd1-b7c369d1e19a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080651 Sep 16 14:24:00.875625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2486/4934] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:24:01.039433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:01.052620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e6d5f3f-497b-48ce-8bec-7952f084d691 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.547933 Sep 16 14:24:01.053676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2449/4935] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:00 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:01.081697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:01.083547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:01.093310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:01.094125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:01.094844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:01.096196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:01.096922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:01.097671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:01.103841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:01.476565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:01.480352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:01.495344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:01.498137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:01.500977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:01.505421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:01.506314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:01.507619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:01.689533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:01.704871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-efce3a8e-7903-4304-aee8-38383da39d21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.627964 Sep 16 14:24:01.706792 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2487/4936] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:01 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:01.740454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c805c65-4347-437f-a598-e70b5c96b298 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:01.745147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8c805c65-4347-437f-a598-e70b5c96b298 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 14:24:01.746893 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-8c805c65-4347-437f-a598-e70b5c96b298 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c805c65-4347-437f-a598-e70b5c96b298 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 9223372036854775808 could not be found. Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9223372036854775808'} Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:01.752621 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:01.765037 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:01.765037 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:01.765037 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:01.765037 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 16 14:24:01.765037 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:01.777310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c805c65-4347-437f-a598-e70b5c96b298 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:01.784879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c805c65-4347-437f-a598-e70b5c96b298 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.050334 Sep 16 14:24:01.788502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2488/4937] 10.222.0.60 () {58 vars in 1188 bytes} [Fri Sep 16 14:24:01 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:24:01.808045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:01.816844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:01.852723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:01.853240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:01.853684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:01.854466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:01.854937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:01.855382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:02.141881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:02.162106 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96e1cbba-d9b8-4c78-ba03-f19ef7b13f17 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1521 microversion: 2.1 time: 0.709838 Sep 16 14:24:02.165020 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2450/4938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:01 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1521 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:02.174446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:02.176251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:02.189014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:02.190287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:02.191441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:02.193216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:02.195054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:02.196316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:02.569015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:02.582580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-995489f4-42a9-4a11-b0b5-0cca83e3818c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.785984 Sep 16 14:24:02.583501 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2489/4939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:01 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:02.595387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-991468891", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5285c9a9-50e4-40cd-8364-0a426267378e"}], "security_groups": [{"name": "tempest-securitygroup--68688693"}], "key_name": "tempest-keypair-1385613269", "user_data": "}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:03.143022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:03.158219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2dd3dc82-4919-4f8e-a5dc-06b85aa4dcd3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.991151 Sep 16 14:24:03.159245 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2451/4940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:02 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:03.172801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] validate_networks() for [('5285c9a9-50e4-40cd-8364-0a426267378e', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:24:03.188693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:03.189728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:03.202759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:03.203699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:03.204414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:03.205417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:03.206139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:03.206870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:03.695601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:03.719354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c50a72a-004b-41d3-8a3a-1d3816c039bf tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1521 microversion: 2.1 time: 0.533991 Sep 16 14:24:03.720687 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2452/4941] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:03 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:03.726697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:03.731429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:03.744524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:03.747179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:03.750313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:03.751480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:03.752235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:03.755346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:04.747381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:04.763074 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8971e3d9-622f-400b-a40b-0edacd9388b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.040808 Sep 16 14:24:04.764462 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2453/4942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:03 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:04.778837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:04.781541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:04.818464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:04.828141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:04.832839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:04.834457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:04.838925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:04.843608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:05.023691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:24:05.025010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:24:05.025853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:24:05.026759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:24:05.027580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:24:05.042967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:05.043934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:05.044663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:05.046691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:05.047616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:05.048308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:05.081849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for project d8057a5157844b15bb19ece760a72ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:24:05.092698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Getting quotas for user 6830539834e941eaa36dcb955b57194d and project d8057a5157844b15bb19ece760a72ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:24:05.121115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:24:05.124895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:24:05.332618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:05.332967 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8056e6d5-32bf-41d9-b9f4-c61e3b070687 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.703136 Sep 16 14:24:05.337088 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2490/4943] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:24:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:24:05.351318 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-683b134f-690e-4031-89e9-679025dd4586 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.584929 Sep 16 14:24:05.353405 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2454/4944] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:04 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:05.364157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4237f5de-daaf-4d99-84ed-a5261f914c82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:05.365403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4237f5de-daaf-4d99-84ed-a5261f914c82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Failed to fetch instance by id -1 {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 16 14:24:05.366780 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4237f5de-daaf-4d99-84ed-a5261f914c82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance -1 could not be found. Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4237f5de-daaf-4d99-84ed-a5261f914c82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance -1 could not be found. Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '-1'} Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:05.372733 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:05.383286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:05.383286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:05.383286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 16 14:24:05.383286 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:05.384240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:05.384240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:05.386875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4237f5de-daaf-4d99-84ed-a5261f914c82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:05.388782 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4237f5de-daaf-4d99-84ed-a5261f914c82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.033076 Sep 16 14:24:05.390548 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2455/4945] 10.222.0.60 () {58 vars in 1137 bytes} [Fri Sep 16 14:24:05 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:24:05.400782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-839e4dc2-5f31-4a19-8026-743e09292ec7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:05.402277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-839e4dc2-5f31-4a19-8026-743e09292ec7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:05.449489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:05.450459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:05.451260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:05.452581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:05.453434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:05.454310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:05.799430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-839e4dc2-5f31-4a19-8026-743e09292ec7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:05.844899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-839e4dc2-5f31-4a19-8026-743e09292ec7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:05.849387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-839e4dc2-5f31-4a19-8026-743e09292ec7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:05.852867 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-839e4dc2-5f31-4a19-8026-743e09292ec7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1281 microversion: 2.20 time: 0.459003 Sep 16 14:24:05.859529 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2456/4946] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:05 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1281 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:05.864767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:05.869035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:05.886336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:05.887059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:05.887720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:05.888716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:05.889302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:05.889858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:06.166148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:06.180490 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b3ceca4-c098-4294-ba71-62f69ed0a04b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1521 microversion: 2.1 time: 0.841799 Sep 16 14:24:06.181114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2491/4947] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:05 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1521 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:06.368055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:06.378928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:06.379559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:06.386692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:06.387497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:06.388129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:06.389140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:06.389909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:06.390701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:06.425028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c85f0c6-4d21-4770-90a4-8fc70bfa3c72 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.563618 Sep 16 14:24:06.438982 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2457/4948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:05 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:06.512204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:06.513125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:06.520233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:06.521022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:06.521642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:06.523941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:06.526110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:06.527694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:06.941649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:06.958291 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b993841-6560-4107-baff-67c753cb5107 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.583916 Sep 16 14:24:06.959272 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2492/4949] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:06 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:06.966758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bd82a524-ea76-460c-a9a7-3b258500d827 req-2b8ac168-bb90-49bc-aa6e-6ad4cce8ec3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808fa331-04a9-4998-987f-0dd30ba2bffc", "name": "network-vif-plugged", "status": "completed", "tag": "d2fd2438-14c5-4150-8d84-6e6cecaf4f20"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:06.984756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bd82a524-ea76-460c-a9a7-3b258500d827 req-2b8ac168-bb90-49bc-aa6e-6ad4cce8ec3a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:06.985554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bd82a524-ea76-460c-a9a7-3b258500d827 req-2b8ac168-bb90-49bc-aa6e-6ad4cce8ec3a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:06.986161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bd82a524-ea76-460c-a9a7-3b258500d827 req-2b8ac168-bb90-49bc-aa6e-6ad4cce8ec3a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:07.050561 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bd82a524-ea76-460c-a9a7-3b258500d827 req-2b8ac168-bb90-49bc-aa6e-6ad4cce8ec3a service nova] Creating event network-vif-plugged:d2fd2438-14c5-4150-8d84-6e6cecaf4f20 for instance 808fa331-04a9-4998-987f-0dd30ba2bffc on n-h1-858129-2 Sep 16 14:24:07.063231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:07.073507 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bd82a524-ea76-460c-a9a7-3b258500d827 req-2b8ac168-bb90-49bc-aa6e-6ad4cce8ec3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110518 Sep 16 14:24:07.076475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d26ce711-7049-477f-88a7-048d2bbaf6ba tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.598925 Sep 16 14:24:07.079205 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2493/4950] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:07.081989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2458/4951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:06 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:07.087162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:07.088139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:07.104068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00516c7c-2f0d-4d17-97fe-f69c2e3db642 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:07.104350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:07.107518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:07.107774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-00516c7c-2f0d-4d17-97fe-f69c2e3db642 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: efc7ade4-804b-4149-b2eb-8ffc3f7bf510] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:07.109461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:07.110542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:07.115299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-00516c7c-2f0d-4d17-97fe-f69c2e3db642 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance efc7ade4-804b-4149-b2eb-8ffc3f7bf510 could not be found. Sep 16 14:24:07.125427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:07.126177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00516c7c-2f0d-4d17-97fe-f69c2e3db642 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/efc7ade4-804b-4149-b2eb-8ffc3f7bf510/action HTTP/1.1 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 19 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: {"forceDelete": {}} Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance efc7ade4-804b-4149-b2eb-8ffc3f7bf510 could not be found. Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'efc7ade4-804b-4149-b2eb-8ffc3f7bf510', 'body': {'forceDelete': {}}} Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc7ade4-804b-4149-b2eb-8ffc3f7bf510 could not be found. Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc7ade4-804b-4149-b2eb-8ffc3f7bf510 could not be found. Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:07.133255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:07.138573 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:07.138573 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:07.138573 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc7ade4-804b-4149-b2eb-8ffc3f7bf510 could not be found. Sep 16 14:24:07.138573 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:07.138573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00516c7c-2f0d-4d17-97fe-f69c2e3db642 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance efc7ade4-804b-4149-b2eb-8ffc3f7bf510 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:07.138573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00516c7c-2f0d-4d17-97fe-f69c2e3db642 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/efc7ade4-804b-4149-b2eb-8ffc3f7bf510/action" status: 404 len: 111 microversion: 2.1 time: 0.037059 Sep 16 14:24:07.145926 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2459/4952] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:07 2022] POST /compute/v2.1/servers/efc7ade4-804b-4149-b2eb-8ffc3f7bf510/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:07.153749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:07.174146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:07.200337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:07.201322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:07.202433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:07.205941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:07.207494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:07.210349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:07.476926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:07.513790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:07.524036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:07.532245 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0d751d6b-d7db-4c65-a47f-d0467c0a63b2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1285 microversion: 2.20 time: 0.444566 Sep 16 14:24:07.535778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2494/4953] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:07 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1285 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:07.558212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:07.580201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:07.595229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:07.596109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:07.597117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:07.598054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:07.598732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:07.599357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.044405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:08.047594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:08.084033 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae5c9e66-940b-49d2-a1a2-567122c85ce2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.934033 Sep 16 14:24:08.091392 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2460/4954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:07 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:08.099985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:08.101837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:08.118060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.121308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.122000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.122948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.127003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.128394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.213923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:08.229709 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e185c545-cfad-4a96-b537-0101df92cf2b tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1521 microversion: 2.1 time: 0.691878 Sep 16 14:24:08.234223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2495/4955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:07 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:08.242721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:08.253720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:08.270547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.271510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.272804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.278003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.279692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.280458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.809192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:08.821478 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-301b36b1-0c3c-4bbd-8dce-280fef2ae2ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.585723 Sep 16 14:24:08.822971 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2496/4956] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:08 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:08.828318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:08.829503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:08.838135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.839065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.840557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.841855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.846075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:08.854335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.855311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.865463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f2d00e3-69cd-436d-a2e4-9f3a9990b8c7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.772071 Sep 16 14:24:08.867101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2461/4957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:08 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:08.880540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49d8b1df-6212-4133-aa50-ce375f430dc8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:08.889964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49d8b1df-6212-4133-aa50-ce375f430dc8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: eaa2f87a-9215-459f-b884-e5d4b8ba32a4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:08.918043 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-49d8b1df-6212-4133-aa50-ce375f430dc8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance eaa2f87a-9215-459f-b884-e5d4b8ba32a4 could not be found. Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49d8b1df-6212-4133-aa50-ce375f430dc8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/eaa2f87a-9215-459f-b884-e5d4b8ba32a4/action HTTP/1.1 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 39 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: {"os-getConsoleOutput": {"length": 10}} Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance eaa2f87a-9215-459f-b884-e5d4b8ba32a4 could not be found. Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'eaa2f87a-9215-459f-b884-e5d4b8ba32a4', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa2f87a-9215-459f-b884-e5d4b8ba32a4 could not be found. Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa2f87a-9215-459f-b884-e5d4b8ba32a4 could not be found. Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:08.926894 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:08.932679 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:08.932679 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:08.932679 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:08.932679 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:08.932679 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa2f87a-9215-459f-b884-e5d4b8ba32a4 could not be found. Sep 16 14:24:08.932679 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:08.934241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49d8b1df-6212-4133-aa50-ce375f430dc8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance eaa2f87a-9215-459f-b884-e5d4b8ba32a4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:08.935807 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49d8b1df-6212-4133-aa50-ce375f430dc8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/eaa2f87a-9215-459f-b884-e5d4b8ba32a4/action" status: 404 len: 111 microversion: 2.1 time: 0.066818 Sep 16 14:24:08.942498 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2462/4958] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:08 2022] POST /compute/v2.1/servers/eaa2f87a-9215-459f-b884-e5d4b8ba32a4/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:08.954900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:08.957075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:08.986694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.988745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.990927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:08.993492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:08.995731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:08.996545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:09.938479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:09.948340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:09.950652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:09.952324 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f45d2b9-ac6d-4c34-9080-d879ba4e037a tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1339 microversion: 2.20 time: 1.128055 Sep 16 14:24:09.953742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2497/4959] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:08 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1339 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:09.958793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:09.960478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:09.967547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:09.968451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:09.969150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:09.970146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:09.970984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:09.971669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:10.540131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:10.565538 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59400fff-1fab-482c-b66d-c206e760902f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.621068 Sep 16 14:24:10.578841 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2463/4960] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:08 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:10.607827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:10.621247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:10.636496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=76 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:10.644091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:10.650316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:10.652832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:10.654291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:10.657518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:10.659056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:10.702538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:10.720079 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5509ffbb-9fbd-45c7-8374-67562fad0402 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1506 microversion: 2.1 time: 0.764831 Sep 16 14:24:10.723332 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2498/4961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:09 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1506 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:10.738077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:10.741324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:10.771355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:10.771941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:10.776735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:10.779092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:10.779871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:10.781176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:11.630776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:11.646898 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a6e5e581-45e3-412c-a3e0-9baa2521dd8a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.922011 Sep 16 14:24:11.662880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:11.664212 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2499/4962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:10 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:11.673746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:11.674740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:11.682774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:11.683953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:11.686281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:11.688106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:11.688739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:11.689198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:11.722096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0430561d-111b-4406-a0c9-ada993eb9dc0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 1.129061 Sep 16 14:24:11.723417 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2464/4963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:10 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:11.728724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:11.739893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:11.764140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:11.780321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:11.784155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:11.800090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:11.806390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:11.807246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:12.652600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:12.666924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:12.673259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:12.679604 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4a0fd95d-0534-457e-be4c-d4eeddb8cdaa tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 200 len: 1506 microversion: 2.1 time: 1.012917 Sep 16 14:24:12.680906 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2500/4964] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:11 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 1506 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:12.683488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:12.689458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de96300b-ca5d-4005-8d5b-11eebfc462f6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:12.690095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de96300b-ca5d-4005-8d5b-11eebfc462f6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:12.695172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a70798cb-ba91-4919-bdef-39ffc82b2220 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.970952 Sep 16 14:24:12.722857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2465/4965] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:11 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:12.728937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:12.729617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:12.734024 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-de96300b-ca5d-4005-8d5b-11eebfc462f6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d could not be found. Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de96300b-ca5d-4005-8d5b-11eebfc462f6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/0a7980dd-9d9f-42d8-8dd1-1bdde471d68d HTTP/1.1 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d could not be found. Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0a7980dd-9d9f-42d8-8dd1-1bdde471d68d'} Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d could not be found. Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d could not be found. Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:12.735796 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:12.749875 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:12.749875 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:12.749875 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:12.749875 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d could not be found. Sep 16 14:24:12.749875 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:12.749875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de96300b-ca5d-4005-8d5b-11eebfc462f6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 0a7980dd-9d9f-42d8-8dd1-1bdde471d68d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:12.754442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:12.754442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:12.754442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:12.755045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:12.755486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:12.755753 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de96300b-ca5d-4005-8d5b-11eebfc462f6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/0a7980dd-9d9f-42d8-8dd1-1bdde471d68d" status: 404 len: 111 microversion: 2.1 time: 0.066705 Sep 16 14:24:12.757310 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2501/4966] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:12 2022] GET /compute/v2.1/servers/0a7980dd-9d9f-42d8-8dd1-1bdde471d68d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:12.766121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:12.766800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:12.769286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:12.808570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:12.809063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:12.809703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:12.810705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:12.811355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:12.811962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:12.839313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:24:13.016251 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68d12e62-28c8-49f1-b28c-d6c596605e35 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 204 len: 0 microversion: 2.1 time: 0.291958 Sep 16 14:24:13.017132 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2466/4967] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:24:12 2022] DELETE /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:24:13.025989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:13.040231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:13.064817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:13.072233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:13.072976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:13.074269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:13.083239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:13.084047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:13.620756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:13.652321 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04692a6d-79e0-4b51-b1bf-2d8bbe59e61b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1508 microversion: 2.1 time: 0.633229 Sep 16 14:24:13.659820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2467/4968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:13 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1508 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:13.670031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1684262604", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "edd0c130-0d71-4b98-b965-0df644fb2e52"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:13.894723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] validate_networks() for [('edd0c130-0d71-4b98-b965-0df644fb2e52', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:24:14.201920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:14.228536 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d943cc30-48e1-4737-a35f-9f60a70d2b4c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.466213 Sep 16 14:24:14.229637 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2502/4969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:12 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:14.262909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:14.270992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:14.303872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:14.319538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:14.320174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:14.323368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:14.324383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:14.326196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:15.052302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:15.080332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:15.112530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:15.114178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:15.119941 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a3f90bd-1b9a-49cb-88e6-66f2e10d50b6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.884177 Sep 16 14:24:15.125124 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2503/4970] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:14 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:15.132225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:15.132856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:15.146395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:15.160086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:15.160935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:15.161568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:15.162646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:15.163310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:15.164092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:15.837406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:16.653869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:16.673673 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30c1cf26-457e-4b42-8c1f-c811869fcabd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.546906 Sep 16 14:24:16.675937 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2504/4971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:15 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:16.685465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:16.687042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:16.699416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:16.700644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:16.704066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:16.705698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:16.707037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:16.708713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:17.209582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:24:17.210539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:24:17.211373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:24:17.214293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:24:17.215092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:24:17.269623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:17.271140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:17.276080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:17.279464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:17.281801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:17.285772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:17.335508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Getting quotas for project 31c31e5d3722447b8d6f49585a19144e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:24:17.350461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Getting quotas for user 000370dc2ad84f22940251ee1b08c0a8 and project 31c31e5d3722447b8d6f49585a19144e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:24:17.380295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:24:17.385321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:24:17.528904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0e83d4a-f198-40bd-a5d7-069477daa757 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.866343 Sep 16 14:24:17.530688 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2468/4972] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:24:17.540976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:17.542594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:17.566514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:17.572782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:17.573549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:17.574562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:17.575422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:17.576193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:17.896126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:17.915697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b2543f1a-4a8e-4ed2-9cff-33259ac668e6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1505 microversion: 2.1 time: 1.237645 Sep 16 14:24:17.916672 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2505/4973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:16 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1505 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:17.921480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6d494cc6-ba00-464e-9ac5-c68daf1e72a9 req-63a4283b-effd-4b21-b1db-ef22ae5e8222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808fa331-04a9-4998-987f-0dd30ba2bffc", "name": "network-vif-deleted", "tag": "d2fd2438-14c5-4150-8d84-6e6cecaf4f20"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:17.951358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6d494cc6-ba00-464e-9ac5-c68daf1e72a9 req-63a4283b-effd-4b21-b1db-ef22ae5e8222 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:17.951856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6d494cc6-ba00-464e-9ac5-c68daf1e72a9 req-63a4283b-effd-4b21-b1db-ef22ae5e8222 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:17.952277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6d494cc6-ba00-464e-9ac5-c68daf1e72a9 req-63a4283b-effd-4b21-b1db-ef22ae5e8222 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:18.013156 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6d494cc6-ba00-464e-9ac5-c68daf1e72a9 req-63a4283b-effd-4b21-b1db-ef22ae5e8222 service nova] Creating event network-vif-deleted:d2fd2438-14c5-4150-8d84-6e6cecaf4f20 for instance 808fa331-04a9-4998-987f-0dd30ba2bffc on n-h1-858129-2 Sep 16 14:24:18.065520 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6d494cc6-ba00-464e-9ac5-c68daf1e72a9 req-63a4283b-effd-4b21-b1db-ef22ae5e8222 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145229 Sep 16 14:24:18.072917 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2506/4974] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:18.128843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c37d27b-3054-4007-8c37-e54ba6ee6e2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1401510615", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c37d27b-3054-4007-8c37-e54ba6ee6e2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 238 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1401510615", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1401510615', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.171700 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 16 14:24:18.183387 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:18.192847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c37d27b-3054-4007-8c37-e54ba6ee6e2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:18.194475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c37d27b-3054-4007-8c37-e54ba6ee6e2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.113605 Sep 16 14:24:18.204080 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2507/4975] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:24:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:24:18.227383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52057a58-2fd3-4c8b-9ab8-bf55bfb04ca9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:18.228141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52057a58-2fd3-4c8b-9ab8-bf55bfb04ca9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:18.255330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:18.309210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:18.323409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:18.332880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0991c674-17c7-4ab2-ba69-3fd7447d7ee6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.797783 Sep 16 14:24:18.336524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2469/4976] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:17 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:18.370479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:18.375281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:18.419961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:18.421573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:18.423468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:18.440469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:18.445140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:18.447238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:18.728582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-52057a58-2fd3-4c8b-9ab8-bf55bfb04ca9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:18.748477 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52057a58-2fd3-4c8b-9ab8-bf55bfb04ca9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1218 microversion: 2.1 time: 0.542418 Sep 16 14:24:18.749468 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2508/4977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:18 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1218 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:18.779653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6027a527-16a6-4f74-aa29-9654f8385c93 req-762a9c1d-ef72-45e3-9432-43139e95d77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46b2920-223c-4458-909a-94742db97084", "name": "network-vif-unplugged", "status": "completed", "tag": "3dc93432-3220-4665-a0e0-4cdb12d4b42f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:18.809174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6027a527-16a6-4f74-aa29-9654f8385c93 req-762a9c1d-ef72-45e3-9432-43139e95d77f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:18.809671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6027a527-16a6-4f74-aa29-9654f8385c93 req-762a9c1d-ef72-45e3-9432-43139e95d77f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:18.810112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6027a527-16a6-4f74-aa29-9654f8385c93 req-762a9c1d-ef72-45e3-9432-43139e95d77f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:18.840612 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6027a527-16a6-4f74-aa29-9654f8385c93 req-762a9c1d-ef72-45e3-9432-43139e95d77f service nova] Creating event network-vif-unplugged:3dc93432-3220-4665-a0e0-4cdb12d4b42f for instance a46b2920-223c-4458-909a-94742db97084 on n-h1-858129-2 Sep 16 14:24:18.855584 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6027a527-16a6-4f74-aa29-9654f8385c93 req-762a9c1d-ef72-45e3-9432-43139e95d77f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091659 Sep 16 14:24:18.856750 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2509/4978] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:18.975841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:18.976541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:18.992440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:18.993934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:18.995674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.000824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.003914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.040212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.106041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:19.203472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:19.220764 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6d6a6a7-e861-4ea1-890e-f100c5dc6d66 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.880317 Sep 16 14:24:19.222245 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2470/4979] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:18 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:19.258796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:19.260082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:19.269263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.270950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.274852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.277457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.277457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.277866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.512486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:19.527413 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15fc639f-b33c-495b-80b0-973d83ea68bc tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1505 microversion: 2.1 time: 0.555779 Sep 16 14:24:19.529362 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2510/4980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:18 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:19.561985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:19.563285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:19.574446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.575459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.576299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.577897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.578766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.579563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.656524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:19.675606 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-610661c4-f65b-4cf1-af64-fc9c176aadee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.422469 Sep 16 14:24:19.677409 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2471/4981] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:19 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:19.782950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:19.784032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:19.804171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.805028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.805833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:19.807109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:19.807911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:19.808694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.043151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:20.057552 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc758fb3-15d3-4da5-81bb-0bd14905304d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1214 microversion: 2.1 time: 0.283009 Sep 16 14:24:20.059240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2472/4982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:19 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:20.067237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9171c8e-9810-4898-b3f1-cd0b2113d7aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1493397772", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9171c8e-9810-4898-b3f1-cd0b2113d7aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 235 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1493397772", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1493397772', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.077382 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 16 14:24:20.082186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:20.089859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9171c8e-9810-4898-b3f1-cd0b2113d7aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:20.093066 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9171c8e-9810-4898-b3f1-cd0b2113d7aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.032203 Sep 16 14:24:20.101606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2473/4983] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:24:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:24:20.109043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:20.125858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:20.127993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:20.128678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:20.129938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:20.134488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d6f4952-3b83-4cdc-91f6-89ea3f324303 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.593207 Sep 16 14:24:20.135882 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2511/4984] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:19 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:20.151765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.152599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.153952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.155109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.155914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.156934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.252960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-706f1cf6-324b-4f8f-80b3-9ef2394b0eca req-90134428-09d5-4de2-a14f-87642321ff9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:20.269130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-706f1cf6-324b-4f8f-80b3-9ef2394b0eca req-90134428-09d5-4de2-a14f-87642321ff9c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.269962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-706f1cf6-324b-4f8f-80b3-9ef2394b0eca req-90134428-09d5-4de2-a14f-87642321ff9c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.270732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-706f1cf6-324b-4f8f-80b3-9ef2394b0eca req-90134428-09d5-4de2-a14f-87642321ff9c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.293264 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-706f1cf6-324b-4f8f-80b3-9ef2394b0eca req-90134428-09d5-4de2-a14f-87642321ff9c service nova] Creating event network-changed:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:24:20.304280 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-706f1cf6-324b-4f8f-80b3-9ef2394b0eca req-90134428-09d5-4de2-a14f-87642321ff9c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056116 Sep 16 14:24:20.306146 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2512/4985] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:24:20.574844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:20.576445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:20.578136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:20.598287 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb4d2f38-364e-4d68-a591-3101b0063b69 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.491518 Sep 16 14:24:20.599440 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2474/4986] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:20 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:20.602096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.605813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.606739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.607813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.610559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.612564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.630963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:20.633368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:20.656321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.657012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.657740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:20.659846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:20.660704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:20.663245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:21.075109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:21.131033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:21.142886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-366d6598-77c4-45c6-8790-f5e6b350a4bc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.516146 Sep 16 14:24:21.148147 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50a4c793-1bd6-4439-9d28-732f9f5c5366 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1505 microversion: 2.1 time: 0.581791 Sep 16 14:24:21.149568 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2475/4987] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:20 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:21.152911 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2513/4988] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:20 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:21.167248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:21.181389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:21.184480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:21.185361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:21.200813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:21.201909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:21.202709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:21.203038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:21.205133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:21.205957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:21.206689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:21.210107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:21.214696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:21.216023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:21.220991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:21.223111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:21.502027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:21.512964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:21.520098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:21.522910 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b575d84-a91f-492c-be28-56fc5f7572ba tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.354145 Sep 16 14:24:21.527932 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2514/4989] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:21 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:21.552092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-994e2079-d0bb-4d1c-adae-3e04b761f72e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:21.553650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-994e2079-d0bb-4d1c-adae-3e04b761f72e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 76499748-965d-4041-9635-235531444101] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:21.571358 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-994e2079-d0bb-4d1c-adae-3e04b761f72e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 76499748-965d-4041-9635-235531444101 could not be found. Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-994e2079-d0bb-4d1c-adae-3e04b761f72e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/76499748-965d-4041-9635-235531444101/action HTTP/1.1 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 13 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: {"pause": {}} Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 76499748-965d-4041-9635-235531444101 could not be found. Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '76499748-965d-4041-9635-235531444101', 'body': {'pause': {}}} Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76499748-965d-4041-9635-235531444101 could not be found. Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76499748-965d-4041-9635-235531444101 could not be found. Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:21.578830 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:21.585843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:21.585843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:21.585843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76499748-965d-4041-9635-235531444101 could not be found. Sep 16 14:24:21.585843 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:21.587587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-994e2079-d0bb-4d1c-adae-3e04b761f72e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 76499748-965d-4041-9635-235531444101 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:21.589599 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-994e2079-d0bb-4d1c-adae-3e04b761f72e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/76499748-965d-4041-9635-235531444101/action" status: 404 len: 111 microversion: 2.1 time: 0.059797 Sep 16 14:24:21.590977 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2515/4990] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:21 2022] POST /compute/v2.1/servers/76499748-965d-4041-9635-235531444101/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:21.958585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-974801487", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:22.063867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:22.077405 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb87815b-a08e-4315-8346-62b697e8dc2d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1214 microversion: 2.1 time: 0.926353 Sep 16 14:24:22.079624 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2476/4991] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:21 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1214 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:22.102215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:22.103333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:22.117411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:22.118839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:22.119853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:22.126044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:22.126930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:22.127605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:22.160892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] validate_networks() for [('81185f65-5716-49c9-992a-ff1c1b07f22a', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:24:22.801261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:22.839758 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48460151-79a4-4932-8003-1bcfcaf38df2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.756422 Sep 16 14:24:22.858751 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2477/4992] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:22 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:22.869373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:22.873724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:22.899762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:22.900387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:22.900916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:22.901726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:22.902266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:22.902889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:22.939307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:23.718104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:23.743234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-36c9d293-5f05-445c-bbc6-9f53b1d804a4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 200 len: 1448 microversion: 2.1 time: 0.881185 Sep 16 14:24:23.746173 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2478/4993] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:22 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 1448 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:23.753969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:23.755476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:23.767403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:23.769958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:23.771417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:23.773359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:23.774310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:23.775837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:23.977340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:24:23.978199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:24:23.987933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:24:23.989141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:24:23.990322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:24:24.032742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:24.033947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:24.035054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:24.036696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:24.040370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:24.041434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:24.108482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Getting quotas for project ae06c4ada55746289de65e12379de8d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:24:24.131702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Getting quotas for user 9e66569ee5124501a096d4201eabbd1a and project ae06c4ada55746289de65e12379de8d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:24:24.160315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:24:24.165952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:24:24.336860 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f87bdc5f-cd84-47bc-849c-5036595fd2da tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.742988 Sep 16 14:24:24.343588 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2516/4994] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:24:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:24:24.369674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:24.371551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:24.390351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:24.391646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:24.395161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:24.398067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:24.399485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:24.400584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:25.347100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:25.367777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:25.371124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:25.376036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bedf48c6-6544-41c3-b297-32b4eeded4e0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 1.626039 Sep 16 14:24:25.378110 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2479/4995] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:23 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:25.386224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:25.387521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:25.405481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:25.407842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:25.409143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:25.410560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:25.411427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:25.412136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:25.666819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:25.679192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:25.696278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b709b59-f3a7-445e-b907-16c86d034661 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.350479 Sep 16 14:24:25.696899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2517/4996] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:24 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:25.699167 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41f32179-745e-4cdd-9b91-07ee11037bb1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1276 microversion: 2.1 time: 0.319468 Sep 16 14:24:25.704009 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2480/4997] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:25 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:25.723272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:25.727671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:25.735969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:25.737694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:25.747432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:25.748236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:25.758036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:25.759197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:25.760473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:25.763162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:25.765518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:25.766188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:25.766893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:25.771058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:25.773376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:25.776137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:26.229468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:26.253426 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a80a0bc-8704-42b8-ac1c-b779d4eee596 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1209 microversion: 2.1 time: 0.544873 Sep 16 14:24:26.254388 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2481/4998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:25 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1209 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:26.273827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:26.286163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:26.317883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:26.324429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:26.327132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:26.330228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:26.334882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:26.336170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:26.423385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:26.440405 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d4314fd2-5a17-469c-93c0-f0c9ae9266d4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.737840 Sep 16 14:24:26.450188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2518/4999] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:25 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:26.458168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:26.458825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:26.476932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:26.477432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:26.477866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:26.478624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:26.479082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:26.479510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:26.564900 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-07b43e8e-cf3b-4ace-b74a-c5e0299cfb44 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.303186 Sep 16 14:24:26.566179 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2482/5000] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:26 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:26.587658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:26.588674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:26.652774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:26.654889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:26.656499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:26.658222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:26.659413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:26.660474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:27.339608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:27.369106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:27.813656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:27.852339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:27.858230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:27.861889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fa7e31e2-78f3-4fc5-a4d6-6f428472183d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 1.409301 Sep 16 14:24:27.880028 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2519/5001] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:26 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:27.910538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:27.911925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:27.926580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:27.929804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:27.931497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:27.933333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:27.936050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:27.937257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:28.017192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:28.048582 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ce7137f-f7d9-4668-96af-ad453eaf9ca1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.478969 Sep 16 14:24:28.075515 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2483/5002] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:26 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:28.107131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:28.113856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:28.132633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:28.136916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:28.140842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:28.142448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:28.144419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:28.151163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.228293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:29.265777 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1dd11132-5daa-498f-af0b-140f84e9ff05 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1491 microversion: 2.1 time: 1.384222 Sep 16 14:24:29.267080 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2520/5003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:27 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1491 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:29.273433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:29.274352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:29.282622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.283444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.284104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.285035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.285673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.286273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.425036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:29.436540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e657747-ba39-419e-af20-407e253e767d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 1.358969 Sep 16 14:24:29.438093 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2484/5004] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:28 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:29.457471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:29.458911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:29.476378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.477817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.480053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.481818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.483071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.484234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.498608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:29.523541 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7c5aed2-0ece-4216-b03b-bced8d020d31 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1271 microversion: 2.1 time: 0.253849 Sep 16 14:24:29.524223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2521/5005] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:29 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:29.549785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a432467c-0316-435e-9102-aae706025bac req-acd618da-95ef-4c32-b61b-d563b60d095e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "name": "network-vif-plugged", "status": "completed", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:29.577292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:29.585457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a432467c-0316-435e-9102-aae706025bac req-acd618da-95ef-4c32-b61b-d563b60d095e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.585457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a432467c-0316-435e-9102-aae706025bac req-acd618da-95ef-4c32-b61b-d563b60d095e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.585942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a432467c-0316-435e-9102-aae706025bac req-acd618da-95ef-4c32-b61b-d563b60d095e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.606702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a432467c-0316-435e-9102-aae706025bac req-acd618da-95ef-4c32-b61b-d563b60d095e service nova] Creating event network-vif-plugged:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:24:29.613637 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a432467c-0316-435e-9102-aae706025bac req-acd618da-95ef-4c32-b61b-d563b60d095e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079877 Sep 16 14:24:29.615104 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2522/5006] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:29.621149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:29.621871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:29.629009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.629567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.630015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:29.630798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:29.631820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:29.632252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.121270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:30.131792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:30.133445 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4dbb87f1-a10f-4bcf-b5f6-c8afe25d8cc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.693356 Sep 16 14:24:30.134262 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2485/5007] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:29 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:30.148777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:30.154321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:30.158437 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abdb7e93-8748-43ae-ada5-3fee782a7037 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.541490 Sep 16 14:24:30.159054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2523/5008] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:29 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:30.170769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:30.170769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:30.175366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.177225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.178047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.179217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.179882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.180531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.190347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:30.191063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:30.206692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.207459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.208081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.208999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.210239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.214289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.227874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'pause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state paused Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 13 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: {"pause": {}} Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'pause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state paused Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'pause': {}}} Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state paused. Cannot pause while the instance is in this state. Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state paused Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:30.231325 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state paused Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'pause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state paused {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e9943f9-7aa8-4140-9b7c-a2a7a6fec152 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 143 microversion: 2.1 time: 0.080755 Sep 16 14:24:30.239534 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2486/5009] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:30 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 143 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:24:30.262930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:30.266669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:30.285441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.285987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.286467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.287325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.287922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.289347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.632110 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a490db3-3134-466b-8855-b902b80218d7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.386839 Sep 16 14:24:30.639785 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2487/5010] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:30 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:30.654058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:30.654972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:30.673488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.674035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.674511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:30.675249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:30.675713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:30.676144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:31.187625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:31.200984 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ec222c1-823c-4ffb-bf09-06421add8dc3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 1.026938 Sep 16 14:24:31.207084 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2524/5011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:30 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:31.221527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:31.223050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:31.241036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:31.241935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:31.242614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:31.243668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:31.244399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:31.245954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:31.585518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:31.601130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8a56383-b337-4322-bdf3-89ef4b5fa731 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.958723 Sep 16 14:24:31.602777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2488/5012] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:30 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:31.611773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:31.612903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:31.624012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:31.625096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:31.625770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:31.626978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:31.627726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:31.628402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:31.683840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:31.736228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91ec726e-311e-4252-91e6-f7d436f05410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.519682 Sep 16 14:24:31.739524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2525/5013] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:31 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:31.751101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:31.754484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:31.785650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:31.786661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:31.788093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:31.789432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:31.790570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:31.791280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:32.510038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:32.511528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:32.521213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:32.529056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:32.530311 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5de1f5f-7681-4e97-9172-36eaa3c9de82 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1405 microversion: 2.20 time: 0.789671 Sep 16 14:24:32.537883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2526/5014] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:31 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1405 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:32.543499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-358a41a2-910f-491b-a866-9687df7f0e99 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:32.559984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358a41a2-910f-491b-a866-9687df7f0e99 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:32.560462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358a41a2-910f-491b-a866-9687df7f0e99 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:32.561463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-358a41a2-910f-491b-a866-9687df7f0e99 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:32.562965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81103262-4184-4b0e-a47a-5784c84d18df tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.957522 Sep 16 14:24:32.565962 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2489/5015] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:31 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:32.633647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-358a41a2-910f-491b-a866-9687df7f0e99 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Going to try to stop instance {{(pid=128643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:24:32.742440 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-358a41a2-910f-491b-a866-9687df7f0e99 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.202653 Sep 16 14:24:32.745529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2527/5016] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:32 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:32.773103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:32.773952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:32.788351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:32.788855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:32.789300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:32.793715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:32.794745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:32.797544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:32.917234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-abb996e5-c8c3-4dc0-b64f-61a1608ed191 req-123d940a-d2cc-415b-bdf8-2f046647bffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4619fe9-8701-4a1a-ae30-7d6d00d828d8", "tag": "d56ec400-272e-4e25-ba6b-be7535a1a3c5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:32.936632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-abb996e5-c8c3-4dc0-b64f-61a1608ed191 req-123d940a-d2cc-415b-bdf8-2f046647bffc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:32.937487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-abb996e5-c8c3-4dc0-b64f-61a1608ed191 req-123d940a-d2cc-415b-bdf8-2f046647bffc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:32.939088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-abb996e5-c8c3-4dc0-b64f-61a1608ed191 req-123d940a-d2cc-415b-bdf8-2f046647bffc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:32.967478 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-abb996e5-c8c3-4dc0-b64f-61a1608ed191 req-123d940a-d2cc-415b-bdf8-2f046647bffc service nova] Creating event network-changed:d56ec400-272e-4e25-ba6b-be7535a1a3c5 for instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 on n-h2-858129-2 Sep 16 14:24:32.979859 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-abb996e5-c8c3-4dc0-b64f-61a1608ed191 req-123d940a-d2cc-415b-bdf8-2f046647bffc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410509 Sep 16 14:24:32.980760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2490/5017] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:32.986838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:32.987555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:32.995491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:32.996004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:32.996456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:32.997196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:32.997664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:32.998552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:33.765982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:33.778985 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c30f23b1-a202-4a19-a8cf-7752c6c432be tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.796640 Sep 16 14:24:33.780795 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2491/5018] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:32 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:33.786452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:33.787678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:33.798886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:33.799712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:33.800356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:33.801573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:33.802506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:33.803294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:33.826445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:33.845822 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7ed723da-4593-4cc2-9b8b-68c989c39538 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.098201 Sep 16 14:24:33.852287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2528/5019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:32 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:33.869163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:33.870182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:33.895060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:33.895882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:33.899344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:33.900440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:33.901143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:33.902394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:33.938594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:34.066619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:34.149184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:34.504225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:34.509145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:34.523884 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f84421bb-0716-4b58-8fc6-47db79756031 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.669611 Sep 16 14:24:34.524849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2529/5020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:33 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:34.529952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:34.530739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:34.538249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.538782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.539221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.540391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.541089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.541695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.551632 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf346660-957e-4043-9b7f-fb60aa809b6f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.767227 Sep 16 14:24:34.554053 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2492/5021] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:33 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:34.560107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:34.561335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:34.572251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.573213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.573930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.574960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.575901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.576576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.602544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-987b55aa-b30c-4378-a33c-00db0be36c84 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.075968 Sep 16 14:24:34.603735 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2530/5022] 10.222.0.60 () {58 vars in 1293 bytes} [Fri Sep 16 14:24:34 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955/os-server-password => generated 116 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:34.633684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:34.636573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:34.645119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.647825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.648594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.649392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.650518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.650988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.668881 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868/action HTTP/1.1 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 28 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: {"reboot": {"type": "SOFT"}} Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '448f58d2-be6a-4483-a06c-89e5c5e22868', 'body': {'reboot': {'type': 'SOFT'}}} Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:34.671058 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:34.677091 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:34.682523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:34.683697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bdfdd031-5c99-4a7f-a2c0-26440d4b83cf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868/action" status: 404 len: 111 microversion: 2.1 time: 0.072602 Sep 16 14:24:34.685140 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2531/5023] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:34 2022] POST /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:34.703861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:34.705000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:34.713839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.714450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.715165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:34.716021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:34.720082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:34.720082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.234743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:35.252101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:35.256123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:35.259496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:35.262080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-862ff244-5d2a-4bfe-8f8a-fde7c860fd2b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1597 microversion: 2.20 time: 0.706551 Sep 16 14:24:35.263554 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2493/5024] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:24:34 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1597 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:24:35.273642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:35.274795 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eee0b7f7-98db-469b-96c0-c5404ab1ee09 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.580787 Sep 16 14:24:35.276443 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2532/5025] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:34 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:35.279355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:35.304860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:35.306198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:35.315512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:35.316501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:35.317137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.318808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:35.319512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:35.320648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.335537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:35.336661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:35.337485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.338900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:35.339922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:35.341025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.348640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:35.871417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:35.890722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08afa999-7e19-43bc-aa4b-d18b993ad062 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.625095 Sep 16 14:24:35.893074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2494/5026] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:35 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:35.909948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:35.911301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:35.923606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:35.924342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:35.925052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.926297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:35.926984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:35.927583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:35.963633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:35.997032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b14e722-789b-4eea-a5a5-97e7801c7300 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.691082 Sep 16 14:24:36.004728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2533/5027] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:35 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:36.019161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1523f57f-d370-488b-b03b-e0fa237698c8 req-f883b109-9550-4f9c-8ae2-a6b7a79e57d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658b4840-76eb-42e7-b222-c10b0b84ec47", "tag": "fa099d62-300c-40a6-9878-20983fd70326"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:36.032957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1523f57f-d370-488b-b03b-e0fa237698c8 req-f883b109-9550-4f9c-8ae2-a6b7a79e57d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.033870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1523f57f-d370-488b-b03b-e0fa237698c8 req-f883b109-9550-4f9c-8ae2-a6b7a79e57d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.034647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1523f57f-d370-488b-b03b-e0fa237698c8 req-f883b109-9550-4f9c-8ae2-a6b7a79e57d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.051512 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1523f57f-d370-488b-b03b-e0fa237698c8 req-f883b109-9550-4f9c-8ae2-a6b7a79e57d6 service nova] Creating event network-changed:fa099d62-300c-40a6-9878-20983fd70326 for instance 658b4840-76eb-42e7-b222-c10b0b84ec47 on n-h1-858129-2 Sep 16 14:24:36.058877 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1523f57f-d370-488b-b03b-e0fa237698c8 req-f883b109-9550-4f9c-8ae2-a6b7a79e57d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050326 Sep 16 14:24:36.060101 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2534/5028] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:36.069666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:36.070496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:36.078122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.079121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.080395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.081281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.081876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.082644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.259292 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3970ab8-05fe-4bcd-b8c3-d289b1557252 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.363730 Sep 16 14:24:36.272261 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2495/5029] 10.222.0.60 () {60 vars in 1316 bytes} [Fri Sep 16 14:24:35 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-interface => generated 284 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:24:36.281646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:36.282775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:36.295781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.298862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.301002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.304151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.311821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.313382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.759329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:36.780928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ec397bf-3f34-4df4-a05f-96afdad45a9a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.718940 Sep 16 14:24:36.801936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2535/5030] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:36 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:36.810902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-03811701-fe1f-4337-b541-c2af6fc73edb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:36.813770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-03811701-fe1f-4337-b541-c2af6fc73edb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 4f1a1629-20d1-4274-bdbf-e60afa90f926] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:36.820832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-03811701-fe1f-4337-b541-c2af6fc73edb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 4f1a1629-20d1-4274-bdbf-e60afa90f926 could not be found. Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-03811701-fe1f-4337-b541-c2af6fc73edb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/4f1a1629-20d1-4274-bdbf-e60afa90f926/action HTTP/1.1 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 28 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: {"reboot": {"type": "SOFT"}} Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 4f1a1629-20d1-4274-bdbf-e60afa90f926 could not be found. Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '4f1a1629-20d1-4274-bdbf-e60afa90f926', 'body': {'reboot': {'type': 'SOFT'}}} Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1a1629-20d1-4274-bdbf-e60afa90f926 could not be found. Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1a1629-20d1-4274-bdbf-e60afa90f926 could not be found. Sep 16 14:24:36.823151 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1a1629-20d1-4274-bdbf-e60afa90f926 could not be found. Sep 16 14:24:36.827737 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:36.830032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-03811701-fe1f-4337-b541-c2af6fc73edb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 4f1a1629-20d1-4274-bdbf-e60afa90f926 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:36.831375 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-03811701-fe1f-4337-b541-c2af6fc73edb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/4f1a1629-20d1-4274-bdbf-e60afa90f926/action" status: 404 len: 111 microversion: 2.1 time: 0.027587 Sep 16 14:24:36.832808 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2536/5031] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:36 2022] POST /compute/v2.1/servers/4f1a1629-20d1-4274-bdbf-e60afa90f926/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:36.842332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:36.842738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:36.843486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:36.853822 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0a6b7f2-83d1-4067-b723-a73b01c3b41b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.579619 Sep 16 14:24:36.854006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.854516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.854974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.870542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.870542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.870542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.871167 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2496/5032] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:36 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:36.922468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:36.923649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:36.934867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.935609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.936257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:36.937602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:36.938540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:36.939382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:37.322587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:37.344466 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6077f535-5f0c-45dd-8ba4-5d8607917dac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.505995 Sep 16 14:24:37.363158 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2537/5033] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:36 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:37.392694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:37.394028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:37.405605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:37.406932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:37.407781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:37.409482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:37.410816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:37.411847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:37.415552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:37.434108 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c985ae0b-0303-40f6-bdb5-4ed0478b6361 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.519526 Sep 16 14:24:37.435384 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2497/5034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:36 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:37.824229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:37.832412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:37.839057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:37.856803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:37.860670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:37.864157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:37.867236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:37.868277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:37.869264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:37.882076 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7824386f-9e0c-4314-ac7d-69f35533a1fd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.488899 Sep 16 14:24:37.894509 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2538/5035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:37 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:37.914340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:37.918682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:37.953321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:37.954287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:37.955217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:37.956738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:37.958447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:37.959438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:38.993172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:39.011003 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdf9855f-98b7-4195-9f9f-b9bd8aebe732 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 1.194797 Sep 16 14:24:39.026532 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2498/5036] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:37 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:39.029886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:39.036564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:39.042699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:39.051662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02f1a741-655e-478d-8017-bbfdedf2c1b7 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 1.165550 Sep 16 14:24:39.056961 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2539/5037] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:37 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:39.058449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.059947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.060696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.061970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.062745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.064847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.081154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:39.085659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:39.088137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868/action HTTP/1.1 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 65 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '448f58d2-be6a-4483-a06c-89e5c5e22868', 'body': {'rebuild': {'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b'}}} Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 16 14:24:39.091603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:24:39.096805 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:39.099749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.100760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.101160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:39.101527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.102759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0435c542-7895-424a-b306-e91ff5a947ae tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868/action" status: 404 len: 111 microversion: 2.1 time: 0.077485 Sep 16 14:24:39.103797 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2499/5038] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:39 2022] POST /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:39.104023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.104706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.105434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.119069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:39.122358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:39.145269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.147057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.148001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.149164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.149899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.152631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.676418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:39.685560 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-186da1c4-eb07-4999-8d06-92129de6927e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.575065 Sep 16 14:24:39.686438 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2500/5039] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:39 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:39.708124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:39.729386 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-74891efb-e075-403a-b6a8-b7e05e67097c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.670287 Sep 16 14:24:39.730303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:39.731423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:39.746523 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2540/5040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:39 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:39.755469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.756475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.757296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:39.758663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:39.759527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:39.760313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.041167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:40.043070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:40.051183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.052278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.053850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.054953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.055879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.056709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.251520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:40.264875 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a67a4a3-e7ad-4ffe-8345-1d9de4ed35dd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.541128 Sep 16 14:24:40.266363 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2501/5041] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:39 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:40.274022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9823b3a5-ddd0-4d50-b75e-6106a0c5a1bb req-b5787a9c-c157-421d-b076-50df2e29193f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:40.289029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9823b3a5-ddd0-4d50-b75e-6106a0c5a1bb req-b5787a9c-c157-421d-b076-50df2e29193f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.290085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9823b3a5-ddd0-4d50-b75e-6106a0c5a1bb req-b5787a9c-c157-421d-b076-50df2e29193f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.290916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9823b3a5-ddd0-4d50-b75e-6106a0c5a1bb req-b5787a9c-c157-421d-b076-50df2e29193f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.313200 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9823b3a5-ddd0-4d50-b75e-6106a0c5a1bb req-b5787a9c-c157-421d-b076-50df2e29193f service nova] Creating event network-changed:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:24:40.343960 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9823b3a5-ddd0-4d50-b75e-6106a0c5a1bb req-b5787a9c-c157-421d-b076-50df2e29193f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074038 Sep 16 14:24:40.347304 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2502/5042] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:40.355178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:40.356675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:40.364939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.366874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.367865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.369610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.370377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.371143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.416481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:40.451191 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2996c2ff-ebc1-4dbe-839e-423f5cb23a0f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.416528 Sep 16 14:24:40.452241 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2541/5043] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:40 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:40.461728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcc7804e-da19-493d-a773-a3b7c5ec338e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:40.477344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bcc7804e-da19-493d-a773-a3b7c5ec338e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:40.496546 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bcc7804e-da19-493d-a773-a3b7c5ec338e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee could not be found. Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcc7804e-da19-493d-a773-a3b7c5ec338e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee/action HTTP/1.1 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 65 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee could not be found. Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee', 'body': {'rebuild': {'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b'}}} Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee could not be found. Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 16 14:24:40.500703 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee could not be found. Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee could not be found. Sep 16 14:24:40.510726 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:40.514118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bcc7804e-da19-493d-a773-a3b7c5ec338e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:40.516161 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bcc7804e-da19-493d-a773-a3b7c5ec338e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee/action" status: 404 len: 111 microversion: 2.1 time: 0.061993 Sep 16 14:24:40.517975 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2542/5044] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:40 2022] POST /compute/v2.1/servers/0e65b3d8-c3e6-4b96-ab9e-fd8ae7b6bfee/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:40.536919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:40.539052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:40.555576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.556927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.559489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:40.561731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:40.563020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:40.564102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.065758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:41.079079 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9bec2a1-7be5-4f6c-ac41-b2f426e7c513 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.729390 Sep 16 14:24:41.080911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2503/5045] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:40 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:41.088535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:41.089902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:41.098482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:41.102194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.103828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.104578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.107564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.108326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.109010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.127061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:41.153108 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8131a5f5-5075-4883-a81b-c0eaac305d20 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.627471 Sep 16 14:24:41.154217 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2543/5046] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:40 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:41.178673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-65058917-bd63-4721-a160-28f541f1ac38 req-1cecc086-1250-4c68-8ae8-3d054a9bb9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4619fe9-8701-4a1a-ae30-7d6d00d828d8", "name": "network-vif-plugged", "status": "completed", "tag": "d56ec400-272e-4e25-ba6b-be7535a1a3c5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:41.202663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-65058917-bd63-4721-a160-28f541f1ac38 req-1cecc086-1250-4c68-8ae8-3d054a9bb9b3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.203884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-65058917-bd63-4721-a160-28f541f1ac38 req-1cecc086-1250-4c68-8ae8-3d054a9bb9b3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.204880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-65058917-bd63-4721-a160-28f541f1ac38 req-1cecc086-1250-4c68-8ae8-3d054a9bb9b3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.227500 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-65058917-bd63-4721-a160-28f541f1ac38 req-1cecc086-1250-4c68-8ae8-3d054a9bb9b3 service nova] Creating event network-vif-plugged:d56ec400-272e-4e25-ba6b-be7535a1a3c5 for instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 on n-h2-858129-2 Sep 16 14:24:41.237127 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-65058917-bd63-4721-a160-28f541f1ac38 req-1cecc086-1250-4c68-8ae8-3d054a9bb9b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073926 Sep 16 14:24:41.238929 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2544/5047] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:41.250674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:41.252474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:41.265186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.266602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.267665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.269264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.269953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.270693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.733563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:41.772782 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5d7d536f-76cf-432d-a00c-f279c4089ba5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.686399 Sep 16 14:24:41.779722 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2504/5048] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:41 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:41.798968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:41.800544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:41.817518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.823497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.824717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.833855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:41.835162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:41.836196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:41.919000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:41.943142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67ef7948-db08-4e8f-bf05-3649ece3566b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.701595 Sep 16 14:24:41.944559 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2545/5049] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:41 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:41.997469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26d279a9-3665-4b16-9939-a9d06a53c968 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:41.999045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-26d279a9-3665-4b16-9939-a9d06a53c968 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: c5b3b34f-77ac-4cf5-9239-00e5531817d3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:42.012434 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-26d279a9-3665-4b16-9939-a9d06a53c968 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance c5b3b34f-77ac-4cf5-9239-00e5531817d3 could not be found. Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26d279a9-3665-4b16-9939-a9d06a53c968 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/c5b3b34f-77ac-4cf5-9239-00e5531817d3/action HTTP/1.1 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 15 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: {"restore": {}} Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance c5b3b34f-77ac-4cf5-9239-00e5531817d3 could not be found. Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'c5b3b34f-77ac-4cf5-9239-00e5531817d3', 'body': {'restore': {}}} Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b3b34f-77ac-4cf5-9239-00e5531817d3 could not be found. Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b3b34f-77ac-4cf5-9239-00e5531817d3 could not be found. Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:42.018377 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:42.030360 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:42.030360 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:42.030360 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b3b34f-77ac-4cf5-9239-00e5531817d3 could not be found. Sep 16 14:24:42.030360 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:24:42.044467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26d279a9-3665-4b16-9939-a9d06a53c968 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance c5b3b34f-77ac-4cf5-9239-00e5531817d3 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:42.050354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26d279a9-3665-4b16-9939-a9d06a53c968 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/c5b3b34f-77ac-4cf5-9239-00e5531817d3/action" status: 404 len: 111 microversion: 2.1 time: 0.067405 Sep 16 14:24:42.062505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2546/5050] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:41 2022] POST /compute/v2.1/servers/c5b3b34f-77ac-4cf5-9239-00e5531817d3/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:24:42.086375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:42.089273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:42.121630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:42.123426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:42.125477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:42.128193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:42.135672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:42.136679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:42.387739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:42.401736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-474c4cda-7114-4273-99cf-99d2a980c88d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.619711 Sep 16 14:24:42.402548 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2505/5051] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:41 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:42.407737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:42.410868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:42.424590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:42.426964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:42.427578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:42.428585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:42.429382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:42.429930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:42.747343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:42.779316 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71696b6d-0163-4d93-b535-1f6ae926bd2b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.712886 Sep 16 14:24:42.782327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2547/5052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:42 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:42.826836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:42.830378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:42.859373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:42.860291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:42.861133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:42.862569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:42.863740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:42.864777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.022633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:43.039209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db49f2bf-e853-41ce-bcaa-f3d78a289805 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1678 microversion: 2.1 time: 0.634857 Sep 16 14:24:43.041662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2506/5053] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:42 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1678 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:43.053232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:43.055333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:43.072907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.074328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.075420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.077483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.078612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.080047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.687109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:43.712548 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37103ba3-f547-47a1-9d3e-eb00fd57dcec tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1318 microversion: 2.1 time: 0.895569 Sep 16 14:24:43.715253 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2548/5054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:42 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1318 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:43.729941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:43.733372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:43.752434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.754071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.754639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.755384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.755940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.756372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.759692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:43.805021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e464d9d-b0c8-43b0-8611-61c09db2dba2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.760775 Sep 16 14:24:43.807003 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2507/5055] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:43 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:43.850213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:43.850753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:43.879002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.883620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.884525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.885524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.887111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.889604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.936487 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'restore' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 15 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: {"restore": {}} Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'restore' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'restore': {}}} Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state active. Cannot restore while the instance is in this state. Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:43.938866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'restore' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-437c5960-07fc-4742-b306-d499721119c5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 145 microversion: 2.1 time: 0.099354 Sep 16 14:24:43.948974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2508/5056] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:43 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:24:43.951994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:43.952624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:43.959786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.960296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.961542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:43.962904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:43.963414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:43.963872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.005435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:44.030588 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc955efe-0c01-414c-a9fd-7249dd74494b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.312196 Sep 16 14:24:44.043103 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2549/5057] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:43 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:44.085222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:44.086214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:44.098980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.101140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.102172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.103749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.104806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.105778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.193078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:44.208292 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d24bc4c0-85da-4ddc-b10a-aa0139e9077b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.259202 Sep 16 14:24:44.209680 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2509/5058] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:43 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:44.254664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:44.255595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:44.262464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.263293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.263910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.265123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.265770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.266380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.461815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:44.471742 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6dc18658-0658-4e5c-82cc-fe4e68782541 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1655 microversion: 2.1 time: 0.394061 Sep 16 14:24:44.481003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2550/5059] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:44 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1655 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:44.514666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:44.525231 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55b29baa-9005-4fb0-b897-d45dd855aa81 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.274891 Sep 16 14:24:44.526056 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2510/5060] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:44 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:44.531578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a1f004d-1997-47df-abbb-22882c3c1060 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:44.539160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a1f004d-1997-47df-abbb-22882c3c1060 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.539956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a1f004d-1997-47df-abbb-22882c3c1060 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.540763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a1f004d-1997-47df-abbb-22882c3c1060 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.569314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a1f004d-1997-47df-abbb-22882c3c1060 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Going to try to start instance {{(pid=128642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 14:24:44.619337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:44.632717 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a1f004d-1997-47df-abbb-22882c3c1060 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.104968 Sep 16 14:24:44.633354 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2511/5061] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:44 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:44.640982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92769057-1856-493d-a5a2-de28db8ada21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:44.641925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92769057-1856-493d-a5a2-de28db8ada21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 16895790-26a9-403c-95da-22ed257cb115] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:44.652404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-92769057-1856-493d-a5a2-de28db8ada21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 16895790-26a9-403c-95da-22ed257cb115 could not be found. Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92769057-1856-493d-a5a2-de28db8ada21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/16895790-26a9-403c-95da-22ed257cb115/action HTTP/1.1 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 14 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: {"resume": {}} Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 16895790-26a9-403c-95da-22ed257cb115 could not be found. Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '16895790-26a9-403c-95da-22ed257cb115', 'body': {'resume': {}}} Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16895790-26a9-403c-95da-22ed257cb115 could not be found. Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16895790-26a9-403c-95da-22ed257cb115 could not be found. Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:44.658648 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:44.664492 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:44.664492 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:44.664492 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16895790-26a9-403c-95da-22ed257cb115 could not be found. Sep 16 14:24:44.664492 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:44.664492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92769057-1856-493d-a5a2-de28db8ada21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 16895790-26a9-403c-95da-22ed257cb115 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:44.664492 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92769057-1856-493d-a5a2-de28db8ada21 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/16895790-26a9-403c-95da-22ed257cb115/action" status: 404 len: 111 microversion: 2.1 time: 0.026853 Sep 16 14:24:44.665596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2512/5062] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:44 2022] POST /compute/v2.1/servers/16895790-26a9-403c-95da-22ed257cb115/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:44.671839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:44.672632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:44.672959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-af0d8a04-7a46-4844-8759-1acdbcfc1f30 req-dec2cc54-76c8-4f0c-838f-ae29177fe18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658b4840-76eb-42e7-b222-c10b0b84ec47", "name": "network-vif-plugged", "status": "completed", "tag": "fa099d62-300c-40a6-9878-20983fd70326"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:44.681670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.682733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.683438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.684596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.685491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.686173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.688311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-af0d8a04-7a46-4844-8759-1acdbcfc1f30 req-dec2cc54-76c8-4f0c-838f-ae29177fe18b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.688816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-af0d8a04-7a46-4844-8759-1acdbcfc1f30 req-dec2cc54-76c8-4f0c-838f-ae29177fe18b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.690394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-af0d8a04-7a46-4844-8759-1acdbcfc1f30 req-dec2cc54-76c8-4f0c-838f-ae29177fe18b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.696372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:44.707263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-af0d8a04-7a46-4844-8759-1acdbcfc1f30 req-dec2cc54-76c8-4f0c-838f-ae29177fe18b service nova] Creating event network-vif-plugged:fa099d62-300c-40a6-9878-20983fd70326 for instance 658b4840-76eb-42e7-b222-c10b0b84ec47 on n-h1-858129-2 Sep 16 14:24:44.712943 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-af0d8a04-7a46-4844-8759-1acdbcfc1f30 req-dec2cc54-76c8-4f0c-838f-ae29177fe18b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239007 Sep 16 14:24:44.714213 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2551/5063] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:24:44.722810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:44.724014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:44.733970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.734845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.735539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:44.736467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:44.737119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:44.737727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.104292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:45.116820 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7b07916-3ea2-440d-86e3-fff5384ce3b3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1664 microversion: 2.1 time: 0.449861 Sep 16 14:24:45.117795 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2513/5064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:44 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1664 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:45.128941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:45.131284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:45.143924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.145507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.147739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.149978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.152993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.154388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.159006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:45.179041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-307f54f2-02a5-411b-ae78-4833d82fa06a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.462431 Sep 16 14:24:45.180239 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2552/5065] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:44 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:45.186968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:45.188293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:45.196255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.197144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.197944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.199142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.200006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.200652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.561844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:45.576833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:45.577170 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a978eae6-738f-425c-a35b-2a96639fadb9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1508 microversion: 2.1 time: 0.455975 Sep 16 14:24:45.579480 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2514/5066] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:45 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:45.586296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:45.586951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:45.597196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-510079d2-0298-4ddb-996b-4c662d29193c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.415404 Sep 16 14:24:45.600465 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2553/5067] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:45 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:45.606854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.613958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.614965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.616275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.616806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.617197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.623621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:45.623621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:45.638382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.639398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.640451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.641852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.646102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.647060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.918783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:45.934513 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82278155-c555-4987-a826-39b7bb20887e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.352260 Sep 16 14:24:45.936737 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2515/5068] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:45 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:45.937396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:45.954979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21588506-7e47-482e-850f-4f6e3c96c297 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1508 microversion: 2.1 time: 0.337703 Sep 16 14:24:45.956040 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2554/5069] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:45 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:45.961109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:45.962385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:45.970162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.970785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.971303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.972156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.972698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.973200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.980132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:45.982926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:45.989436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.990003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.990564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:45.991497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:45.991921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:45.992427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.019926 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'resume' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 14 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: {"resume": {}} Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'resume' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'resume': {}}} Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state active. Cannot resume while the instance is in this state. Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:46.023461 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:46.029020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'resume' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:46.030676 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7cfe9624-ba33-4632-8dc6-7f7621a8ac53 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 144 microversion: 2.1 time: 0.075011 Sep 16 14:24:46.031765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2516/5070] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:45 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:24:46.044145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:46.046105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:46.051790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.052294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.052801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.053524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.053986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.054469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.100922 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62f297a1-5074-4770-8213-43f169a38d8e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "PUT /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1080 microversion: 2.1 time: 0.125335 Sep 16 14:24:46.109875 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2555/5071] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:24:45 2022] PUT /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1080 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:46.136885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:46.137700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:46.145228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.145727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.146346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.147037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.147700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.148264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.379108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:46.400008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0ba761df-91ee-42c7-b7f0-aebb867b9977 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.362048 Sep 16 14:24:46.401766 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2517/5072] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:46 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:46.411113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:46.412417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:46.425627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.429103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.430315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.431683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.432865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.433964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.464631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:46.485865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61e048e6-176b-4430-bfab-bf6659425181 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1506 microversion: 2.1 time: 0.352526 Sep 16 14:24:46.487783 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2556/5073] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:46 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:46.495087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:46.496083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:46.504662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.505491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.506233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.507532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:46.510701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:46.511610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:46.939708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:46.949549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:46.951818 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52991e17-9f41-41d4-8f8a-68d855a60af9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1664 microversion: 2.1 time: 0.548262 Sep 16 14:24:46.953245 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2518/5074] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:46 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1664 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:46.966818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:46.968075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:46.973581 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0db1560c-6e40-4bea-8070-d59cbe884489 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.482802 Sep 16 14:24:46.986544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2557/5075] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:46 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:46.989610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:46.997741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:47.000386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.000889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.001383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.002305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.008915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.008915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.013901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.019383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.020544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.024480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.025483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.026168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.827837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:47.837768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:47.861505 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ac52c45-e89d-468a-accb-64aa268a389c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1506 microversion: 2.1 time: 0.906211 Sep 16 14:24:47.863384 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2519/5076] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:46 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1506 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:47.872632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8794585-1d49-4bab-9de0-919e679b7db0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:47.875058 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c6583bd-ff92-4066-83c4-9f46ccc58366 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1313 microversion: 2.1 time: 0.878655 Sep 16 14:24:47.876048 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2558/5077] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:46 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8794585-1d49-4bab-9de0-919e679b7db0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 160 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4e265fd5-52bc-47bb-af24-2c89589c7a06"}]}} Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b', 'flavorRef': '452', 'networks': [{'uuid': '4e265fd5-52bc-47bb-af24-2c89589c7a06'}]}}} Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '' Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:24:47.881248 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:24:47.890759 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:47.902586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:47.903507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8794585-1d49-4bab-9de0-919e679b7db0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:47.904677 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8794585-1d49-4bab-9de0-919e679b7db0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.039330 Sep 16 14:24:47.909981 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2520/5078] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:24:47 2022] POST /compute/v2.1/servers => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:24:47.915061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:47.916541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:47.917894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:47.926854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.927470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.928147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.928844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.929119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.930141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.930509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.931454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.932246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:47.932603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:47.933689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:47.934740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.098948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:24:48.100613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:24:48.100613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:24:48.101124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:24:48.101791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:24:48.204380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:48.215291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:48.228254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.231185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.231849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.233102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.234545 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da6b9ed5-932a-4c79-bf9a-130aeb8b1c78 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.321885 Sep 16 14:24:48.235099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.235573 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2521/5079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:47 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:48.236573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.256205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:48.256889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:48.280553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.281502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.282317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.283276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.283921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.284527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.343360 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-085301d8-ed5c-4b1f-bcb5-f24856ccd3d3 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "POST /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8/action" status: 202 len: 1112 microversion: 2.1 time: 0.448759 Sep 16 14:24:48.358461 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2559/5080] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:47 2022] POST /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8/action => generated 1112 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 16 14:24:48.369865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:48.370557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:48.381656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.382240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.382702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.383423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.383883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.384300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.645594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:48.666856 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3806ff1c-1918-48c8-8824-c8c86474355a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.423586 Sep 16 14:24:48.677212 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2522/5081] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:48 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:48.677453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:48.695993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9868bbe-963f-44ab-b246-784b4191d174 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.344426 Sep 16 14:24:48.696811 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2560/5082] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:48 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:48.699246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:48.699869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:48.708815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:48.711467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:48.715802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.718293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.720275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.722637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.723946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.725512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.729516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.731607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.732332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:48.734838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:48.736947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:48.737757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.003125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:49.017937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3e5e9d4-fa4d-4c78-b116-a7db84234262 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.336963 Sep 16 14:24:49.019148 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2523/5083] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:48 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:49.032165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c26722b-015a-4fb6-8f5b-8fa23dd4a6f7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:49.035478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c26722b-015a-4fb6-8f5b-8fa23dd4a6f7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: e821753d-8af3-4d29-bb80-93eebbeeb3af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.049663 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7c26722b-015a-4fb6-8f5b-8fa23dd4a6f7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance e821753d-8af3-4d29-bb80-93eebbeeb3af could not be found. Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c26722b-015a-4fb6-8f5b-8fa23dd4a6f7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/e821753d-8af3-4d29-bb80-93eebbeeb3af/action HTTP/1.1 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 14 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: {"shelve": {}} Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e821753d-8af3-4d29-bb80-93eebbeeb3af could not be found. Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e821753d-8af3-4d29-bb80-93eebbeeb3af', 'body': {'shelve': {}}} Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e821753d-8af3-4d29-bb80-93eebbeeb3af could not be found. Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e821753d-8af3-4d29-bb80-93eebbeeb3af could not be found. Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:24:49.061052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:24:49.065869 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:24:49.065869 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:24:49.065869 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e821753d-8af3-4d29-bb80-93eebbeeb3af could not be found. Sep 16 14:24:49.065869 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:24:49.067875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c26722b-015a-4fb6-8f5b-8fa23dd4a6f7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance e821753d-8af3-4d29-bb80-93eebbeeb3af could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:24:49.069605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c26722b-015a-4fb6-8f5b-8fa23dd4a6f7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/e821753d-8af3-4d29-bb80-93eebbeeb3af/action" status: 404 len: 111 microversion: 2.1 time: 0.049241 Sep 16 14:24:49.070459 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2524/5084] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:49 2022] POST /compute/v2.1/servers/e821753d-8af3-4d29-bb80-93eebbeeb3af/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:24:49.075707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:49.082038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:49.082970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.090519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-efaced65-f11c-480f-9467-040552184fa6 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.387535 Sep 16 14:24:49.095455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.096340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.097040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.097958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2561/5085] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:48 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:49.098263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.098977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.099675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.122883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:49.123638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.147497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.148054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.148934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.157881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.158385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.160370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.343705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:49.367453 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-41134f33-ec7e-427a-ad3c-bc61873c578c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1499 microversion: 2.1 time: 0.295304 Sep 16 14:24:49.379513 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2525/5086] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:49 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1499 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:49.395173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:49.396651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.419449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.425634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.430170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.431067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.432874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.433407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.514920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:49.530504 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f3a9b51-bee6-4861-9980-06d386918103 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.423784 Sep 16 14:24:49.540915 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2562/5087] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:49 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:49.546771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:49.549754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.563955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.567143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.567776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.572623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.573401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.574468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.626160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lazy-loading 'flavor' on Instance uuid 658b4840-76eb-42e7-b222-c10b0b84ec47 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:24:49.747515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:49.773283 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9833ece-aaa5-42b5-808d-746820b07916 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.390770 Sep 16 14:24:49.775442 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2526/5088] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:49 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:49.781981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:49.789619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.804274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.804781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.805227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.805967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.806448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.806884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.835331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:49.868414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6285a318-eb33-4972-bd06-136b221d7d2e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "POST /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47/action" status: 200 len: 32 microversion: 2.1 time: 0.324837 Sep 16 14:24:49.869158 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2563/5089] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:49 2022] POST /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:24:49.891503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:49.901123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:49.923454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.924009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.924479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:49.926841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:49.931633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:49.932209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.160807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:50.189167 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec4b9604-f69c-4c36-a1d1-7170285aa2ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.412414 Sep 16 14:24:50.198972 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2527/5090] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:49 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:50.212487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:50.218481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:50.236608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:50.238650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:50.241389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.242490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:50.243744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:50.244322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.490899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:50.504138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-58c9df4d-9084-4959-af14-0d1b6b131090 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.624407 Sep 16 14:24:50.518070 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2564/5091] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:49 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:50.532240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:50.534538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:50.552319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:50.557041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:50.558111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.565693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:50.566603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:50.567399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.637998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:50.661262 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0754d74a-e858-4f4c-b6a8-7bda1cb84e0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.459823 Sep 16 14:24:50.674814 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2528/5092] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:50 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:50.689770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:50.698897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:50.731925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:50.732807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:50.733577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.734986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:50.738477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:50.739545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:50.796666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lazy-loading 'flavor' on Instance uuid 934b7a08-9fa8-431c-a6fa-6a255e516dbf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:24:50.957612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:50.964048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:50.978098 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f23c332d-b5e3-43c8-b8cb-6ac71f019097 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.458170 Sep 16 14:24:50.979406 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2565/5093] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:50 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:50.986624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:50.987278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:51.011552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.012066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.012512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.013280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.013747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.014175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.230336 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8649efc5-6846-4b3f-b62b-0c4af993f9cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.552825 Sep 16 14:24:51.232101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2529/5094] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:50 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:51.246227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:51.253973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:51.281831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.286493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.332220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.338346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.339877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.343084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.487574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:51.500850 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f86e7620-339a-43c7-a7b0-c498bdad7899 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.520166 Sep 16 14:24:51.501625 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2566/5095] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:50 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:51.534562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:51.535336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:51.550601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.551621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.552302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.553860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.555143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.556274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.584369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lazy-loading 'flavor' on Instance uuid 138dc7b6-7648-46cc-9712-c32e2ab8fcdb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:24:51.734830 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-badee7fb-f509-48b8-8bfd-a3291a550bc1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.198275 Sep 16 14:24:51.734830 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2567/5096] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:51 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:51.737584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:51.738210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:51.745883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.747276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.747732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.749032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.756479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.757463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.817782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:51.847305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b212a73-f0c4-48f8-a79a-b28bbf5b49cd tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.609250 Sep 16 14:24:51.863229 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2530/5097] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:51 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:51.902907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:51.903610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:51.921847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.921847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.922395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:51.930171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:51.930171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:51.930171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:52.235975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:52.249366 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8727e2ae-3f1b-4207-9742-f96998be7cbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.517403 Sep 16 14:24:52.250491 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2568/5098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:51 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:52.280284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:52.282196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:52.289522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:52.290361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:52.291080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:52.292137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:52.292820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:52.293451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:52.436933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:52.454067 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-393629ec-7600-46f9-8525-463fb84c1dd2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1676 microversion: 2.1 time: 0.589162 Sep 16 14:24:52.455001 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2531/5099] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:51 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1676 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:52.706157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:52.719893 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1cdc9db3-db2d-417d-a888-a7dc9f2a73d1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.451490 Sep 16 14:24:52.720931 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2569/5100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:52 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:52.910115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:52.914208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:52.928711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:52.929324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:52.933978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:52.935179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:52.935945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:52.936497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.274575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:53.275568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:53.284364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:53.287656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.288700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.289381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.290463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.291571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.292219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.409013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:53.428328 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34118c0f-d2c9-43f4-a4a3-e56ae5b6b69d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.521475 Sep 16 14:24:53.429220 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2532/5101] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:52 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:53.497266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:53.497529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:53.508688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.513882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.514529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.515665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.516356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.516988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.562081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:53.590005 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4cfcac90-d73e-46cd-ac86-f67f84a7b702 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.319736 Sep 16 14:24:53.594336 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2570/5102] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:53 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:53.751338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:53.765553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb338e2c-a3e3-4e0e-a963-4e5e1283cd4e tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1659 microversion: 2.1 time: 0.272487 Sep 16 14:24:53.767265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:53.769511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:53.788288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.790427 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2533/5103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:53 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1659 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:53.791130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.793185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.796422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.796422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.796422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.809945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:24:53.810568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:53.838363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.839234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.840095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.841066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.841549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.841984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.954504 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f292e9c7-c4a6-4c72-88a2-3be6dc59521f tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action" status: 202 len: 0 microversion: 2.1 time: 0.156739 Sep 16 14:24:53.956111 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2534/5104] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:24:53 2022] POST /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:24:53.967046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:53.968081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:53.976856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.977676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.978347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:53.979398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:53.980811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:53.981470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:54.234493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:54.258294 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a61dcc45-2967-4505-a734-9ad4d6469c9d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.496603 Sep 16 14:24:54.273086 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2571/5105] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:53 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:54.315237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:54.343081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d30d076-ee9b-4499-b9a3-9466c6f412b9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1665 microversion: 2.1 time: 0.379814 Sep 16 14:24:54.346465 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2535/5106] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:53 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1665 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:54.470296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:54.475054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:54.506553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:54.507473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:54.508131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:54.509090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:54.509742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:54.510374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:54.649340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:54.649972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:54.656951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:54.657730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:54.658670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:54.659582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:54.660228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:54.660844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:54.893125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:54.920811 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb4146c8-c47f-41ed-b970-12f7c4a8b171 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.459598 Sep 16 14:24:54.924828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2572/5107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:54 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:54.987988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:55.003636 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-23693493-e0af-485c-94b3-69b01be3b1a4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.373342 Sep 16 14:24:55.022221 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2536/5108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:54 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:55.323227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:55.324952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:55.341573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:55.343295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:55.344255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:55.345827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:55.346860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:55.347783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:55.385735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:55.386358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:55.396135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:55.397972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:55.398766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:55.399785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:55.401177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:55.401999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:55.755496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:55.775341 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ec6ed8b-4a59-43cd-af28-78824957b20f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.471139 Sep 16 14:24:55.777730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2573/5109] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:55 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:55.794588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:55.807869 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f165526f-2777-43ec-a74c-20aed2d82ac1 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1665 microversion: 2.1 time: 0.426267 Sep 16 14:24:55.821927 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2537/5110] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:55 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1665 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:55.949942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:55.951198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:55.964763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:55.964763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:55.965927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:55.967364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:55.968801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:55.969771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:56.029328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:56.030554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:56.039408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:56.040155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:56.040779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:56.041697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:56.042341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:56.042971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:56.486692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:56.501074 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-814213a6-950b-49c7-9af0-f0b5e979164f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.555978 Sep 16 14:24:56.513163 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2574/5111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:55 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:56.529310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:56.538199 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-098fb9a6-4623-4ffd-bacd-e7910b94de34 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.512711 Sep 16 14:24:56.539525 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2538/5112] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:56 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:56.809783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:56.811932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:56.826923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:56.828280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:56.829382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:56.831082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:56.831846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:56.832525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:56.833005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:56.833748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:56.853883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:56.854279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:56.858890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:56.862200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:56.862727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:56.863185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:57.371848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:57.388644 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b3ef42e4-61a5-4be9-866c-f22fb5197d8a tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.558877 Sep 16 14:24:57.389575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2539/5113] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:56 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:57.390230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:57.405385 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0f813fb-f9ed-4506-abff-291b5509dcb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.609072 Sep 16 14:24:57.418810 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2575/5114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:56 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:57.424491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:57.426208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:57.439424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:57.440464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:57.441528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:57.443088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:57.444510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:57.445307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:57.530867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:57.531694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:57.540908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:57.541606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:57.542185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:57.543140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:57.544030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:57.544590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:57.969032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:57.984793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa87b36b-0b09-408e-9e04-87ecffcc1392 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1668 microversion: 2.1 time: 0.568193 Sep 16 14:24:57.986501 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2540/5115] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:57 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1668 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:57.997764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:57.999906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:58.013361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:58.014767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:58.016681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:58.032948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:58.042242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:58.043737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:58.141242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:58.154559 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-da300ae3-65f0-4ffe-83fa-6f76ecc59929 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.628875 Sep 16 14:24:58.156079 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2576/5116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:57 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:24:58.165760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:58.167176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:58.178825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:58.180188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:58.181269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:58.182940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:58.184085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:58.185205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:58.241859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:24:58.257661 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.compute.api [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Working on deleting snapshot 422e1f41-28b2-46d6-b0dc-0299349f861c from shelved instance... Sep 16 14:24:58.513163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:58.529202 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b828684-2655-461b-b284-1f3823e8a5e2 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.540703 Sep 16 14:24:58.529824 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2541/5117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:57 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:58.541090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:58.541735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:58.564635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:58.565154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:58.565669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:58.566475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:58.566951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:58.567383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:58.946613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:58.970182 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fce054b6-ec7f-4bcd-946c-13b7ba170e5c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.438603 Sep 16 14:24:58.982806 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2542/5118] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:58 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:59.213424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:59.214827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:59.228597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:59.229468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:59.230625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:59.232484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:59.233635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:59.234657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:59.433933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:24:59.456278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Doing local delete in cell 08ea4950-b373-4785-aced-301964963f98(cell1) {{(pid=128643) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 16 14:24:59.457163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:59.457855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:59.458902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:59.459376 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.compute.api [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 16 14:24:59.465477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] deallocate_for_instance() {{(pid=128643) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 16 14:24:59.700170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:24:59.711234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1aea7de3-7619-42ae-b6d9-87d0008a0a87 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.507229 Sep 16 14:24:59.720854 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2543/5119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:59 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:24:59.732267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:24:59.733055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:24:59.740377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:59.742043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:59.743510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:24:59.744374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:24:59.745157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:24:59.746016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:00.226972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:00.254498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-518ee55a-843c-41ea-9377-a4b6740fa17f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.536563 Sep 16 14:25:00.256877 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2544/5120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:24:59 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:00.279567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:00.281213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:00.331676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:00.333177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:00.334821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:00.351086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:00.353356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:00.358849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:00.441517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:01.119741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:01.132166 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b831ee7-20d1-4a11-8175-71e1b339a125 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.873641 Sep 16 14:25:01.152099 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2545/5121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:00 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:01.156387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:01.157017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:01.179991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:01.181512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:01.182893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:01.189766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:01.191360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:01.192636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:01.278650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Updating instance_info_cache with network_info: [] {{(pid=128643) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 16 14:25:01.762139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:01.812206 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bfdcfc35-4932-42f8-8f3c-ddc3e3072eb5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.660238 Sep 16 14:25:01.814240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2546/5122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:01 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:01.841666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:01.847037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:01.868829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:01.872814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:01.873565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:01.874547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:01.879008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:01.880096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.108808 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e40b7e5a-9b6a-43aa-bf10-7c50ed6511c9 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 204 len: 0 microversion: 2.1 time: 3.949917 Sep 16 14:25:02.112665 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2577/5123] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:24:58 2022] DELETE /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 0 bytes in 3956 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:25:02.161725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c1dda174-d506-45c9-be85-06bae0fad6d2 req-d24e778c-7846-4c7c-ab12-9b51930f1cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46b2920-223c-4458-909a-94742db97084", "name": "network-vif-deleted", "tag": "3dc93432-3220-4665-a0e0-4cdb12d4b42f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:02.197316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1dda174-d506-45c9-be85-06bae0fad6d2 req-d24e778c-7846-4c7c-ab12-9b51930f1cec service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.197426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1dda174-d506-45c9-be85-06bae0fad6d2 req-d24e778c-7846-4c7c-ab12-9b51930f1cec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.198687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c1dda174-d506-45c9-be85-06bae0fad6d2 req-d24e778c-7846-4c7c-ab12-9b51930f1cec service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.238688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.server_external_events [req-c1dda174-d506-45c9-be85-06bae0fad6d2 req-d24e778c-7846-4c7c-ab12-9b51930f1cec service nova] Unable to find a host for instance a46b2920-223c-4458-909a-94742db97084. Dropping event network-vif-deleted {{(pid=128643) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 14:25:02.241212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c1dda174-d506-45c9-be85-06bae0fad6d2 req-d24e778c-7846-4c7c-ab12-9b51930f1cec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104185 Sep 16 14:25:02.242878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2578/5124] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 14:25:02.259614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:02.260838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: a46b2920-223c-4458-909a-94742db97084] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:02.270239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.271166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.271826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.272851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.276849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.277619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.286602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:02.299941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d8bdace-63fe-4b61-988a-e7f56c24c07f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.479090 Sep 16 14:25:02.301326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2547/5125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:01 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:02.312308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:02.313302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:02.322070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.323108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.323747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.324765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.325557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.327036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.329181 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] HTTP exception thrown: Instance a46b2920-223c-4458-909a-94742db97084 could not be found. Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Request method failure captured: Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 HTTP/1.1 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIRXx5WnZlChrhhpAc9BCgpT5hSLUirttqocULdnP1XI5qL8AqYTPlgehGobW3mIyXaGYjuEWmY8n7oL5TYpIVyDuVZ_4vj4MtPGWdGSrY3rzSEaadoSEv4eDD3TdCJB9cKtU60yOuE2cNWiSGUKWx7-tWLOf6LbHQvB56Ry6CQCEg0 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c22dd0c01bde40a0a0f194f91e180d03", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}] Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7b08b72cf46345f2a3c88a6251b1c996 Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance a46b2920-223c-4458-909a-94742db97084 could not be found. Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'a46b2920-223c-4458-909a-94742db97084'} Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46b2920-223c-4458-909a-94742db97084 could not be found. Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46b2920-223c-4458-909a-94742db97084 could not be found. Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:02.340277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46b2920-223c-4458-909a-94742db97084 could not be found. Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Returning 404 to user: Instance a46b2920-223c-4458-909a-94742db97084 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:25:02.348052 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8527560b-5f6f-420a-bf4e-5f4a04678836 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084" status: 404 len: 111 microversion: 2.1 time: 0.096829 Sep 16 14:25:02.356460 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2579/5126] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:02 2022] GET /compute/v2.1/servers/a46b2920-223c-4458-909a-94742db97084 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:25:02.374589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:02.375680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:02.409880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.410791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.411646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.413579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.414565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.415326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.498213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:25:02.703189 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2fe237f-62b9-42f5-9804-da51bfbb130b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 204 len: 0 microversion: 2.1 time: 0.338016 Sep 16 14:25:02.705003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2580/5127] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:25:02 2022] DELETE /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:25:02.723407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:02.725145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:02.747446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.748498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:02.748963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.750334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.752956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.754133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.757436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.760346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e40c174-fcc5-4e2e-b484-5d8a5719223c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.456845 Sep 16 14:25:02.761330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2548/5128] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:02 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:02.861868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:02.863100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:02.877694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.879158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.880040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:02.881216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:02.882060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:02.883090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:03.026750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:03.038702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e5587cc-32c9-41f7-9103-3a7494b4e48d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1465 microversion: 2.1 time: 0.324852 Sep 16 14:25:03.050051 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2581/5129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:02 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1465 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:03.242182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:03.262354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f984ab83-98e3-4043-9717-3ef58198ee02 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.404423 Sep 16 14:25:03.278444 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2549/5130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:02 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:03.350275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:03.351552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:03.360832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:03.369576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:03.370935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:03.372680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:03.373436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:03.374097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:03.600399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:03.610582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ea53b14b-db47-4b3a-876b-8dbe9743c858 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.268632 Sep 16 14:25:03.611505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2582/5131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:03 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:03.804724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:03.806046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:03.824885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:03.825727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:03.826821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:03.828156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:03.829023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:03.829813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:04.062561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:04.062973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:04.075859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:04.076369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:04.077787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:04.083169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:04.084160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:04.084796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:04.309247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:04.322074 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-569446de-7099-4b26-a6c0-394b843ac176 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1465 microversion: 2.1 time: 0.264123 Sep 16 14:25:04.323127 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2583/5132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:04 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1465 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:04.354900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:04.356246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:04.377216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:04.378906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:04.380241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:04.382490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:04.382986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:04.383432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:04.644135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:04.659104 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-206aff6a-db1e-4071-8067-32255462bbc2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.860310 Sep 16 14:25:04.660304 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2550/5133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:03 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:04.676448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:04.677084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:04.692549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:04.694274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:04.695102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:04.696175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:04.697062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:04.698035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:05.142246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:05.155830 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a1a3ff46-31a7-4ef7-ac5b-fe5434652b5d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.828059 Sep 16 14:25:05.156793 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2584/5134] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:04 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:05.350787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:05.351958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:05.392712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:05.394529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:05.395250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:05.398683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:05.402458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:05.403234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:05.406882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:05.435553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1c6e511-23d4-4d15-9f12-2300ae52fab3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.772747 Sep 16 14:25:05.439005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2551/5135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:04 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:05.688009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:05.689102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:05.698666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:05.699699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:05.700416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:05.701801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:05.702599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:05.703757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:05.722997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:05.736867 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31292f40-010b-4d29-9938-f5943888bc87 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1465 microversion: 2.1 time: 0.394846 Sep 16 14:25:05.754441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2585/5136] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:05 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1465 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:06.191971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:06.193776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:06.217293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:06.242743 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4208fd43-e200-438f-acd1-293a12638ae1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.560677 Sep 16 14:25:06.254510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2552/5137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:05 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:06.254769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.254769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.260975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:06.263717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.265375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.270361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:06.279889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a089e6cc-9248-4776-a996-2aeb66c98ef3 req-4f3678cd-612a-419f-bc21-54dc0dc65311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1560f05f-f9f7-421f-8e53-4406518d7426", "name": "network-vif-deleted", "tag": "a6eb5c04-618a-4f58-8894-5f5d745c30de"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:06.344747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a089e6cc-9248-4776-a996-2aeb66c98ef3 req-4f3678cd-612a-419f-bc21-54dc0dc65311 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.345613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a089e6cc-9248-4776-a996-2aeb66c98ef3 req-4f3678cd-612a-419f-bc21-54dc0dc65311 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.346377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a089e6cc-9248-4776-a996-2aeb66c98ef3 req-4f3678cd-612a-419f-bc21-54dc0dc65311 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:06.363626 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a089e6cc-9248-4776-a996-2aeb66c98ef3 req-4f3678cd-612a-419f-bc21-54dc0dc65311 service nova] Creating event network-vif-deleted:a6eb5c04-618a-4f58-8894-5f5d745c30de for instance 1560f05f-f9f7-421f-8e53-4406518d7426 on n-h2-858129-2 Sep 16 14:25:06.370793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a089e6cc-9248-4776-a996-2aeb66c98ef3 req-4f3678cd-612a-419f-bc21-54dc0dc65311 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112419 Sep 16 14:25:06.377577 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2553/5138] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:06.491749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:06.492815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:06.516879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.517393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.517842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:06.525072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.526864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.533441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:06.665541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:06.674476 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-741fee29-c145-4ec2-aeb4-2219c7a81a0e tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.494358 Sep 16 14:25:06.688728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2586/5139] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:06 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:06.768444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:06.769513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:06.813315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.828251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.834344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:06.836111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:06.840020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:06.841721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:07.046024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:07.053087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:07.054337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:07.057821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lazy-loading 'fault' on Instance uuid 1560f05f-f9f7-421f-8e53-4406518d7426 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:25:07.256367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:07.257436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:07.276917 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8ab4d56c-33a1-4d0e-b84c-ad7cfa73c089 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.790667 Sep 16 14:25:07.285583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2554/5140] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:06 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:07.286041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e70438e5-e875-4974-8e51-257bdb106fea tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 200 len: 1305 microversion: 2.1 time: 0.521757 Sep 16 14:25:07.291705 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2587/5141] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:06 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 1305 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:07.316524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:07.317309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:07.321352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:07.328099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:07.337217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:07.352677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:07.355084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:07.355841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:07.356480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:07.667410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:07.678037 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59f2249d-cf59-463e-ba54-39f0262afde1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.371784 Sep 16 14:25:07.679620 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2555/5142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:07 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:07.720093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:07.723317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:07.730764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:07.731727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:07.732364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:07.733344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:07.733994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:07.734670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:07.754560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:07.972443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:07.984838 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b75dde19-7eef-4e70-86e3-097eb66dfd93 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.274240 Sep 16 14:25:07.985461 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2588/5143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:07 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:08.345295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:08.362341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:08.371304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:08.376011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 1560f05f-f9f7-421f-8e53-4406518d7426] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:08.440003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.441073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.445421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.452093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.458744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.460665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.461901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.467480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.468478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.470127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.473443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.480529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.502659 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] HTTP exception thrown: Instance 1560f05f-f9f7-421f-8e53-4406518d7426 could not be found. Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Request method failure captured: Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 HTTP/1.1 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIRXx5WnZlChrhhpAc9BCgpT5hSLUirttqocULdnP1XI5qL8AqYTPlgehGobW3mIyXaGYjuEWmY8n7oL5TYpIVyDuVZ_4vj4MtPGWdGSrY3rzSEaadoSEv4eDD3TdCJB9cKtU60yOuE2cNWiSGUKWx7-tWLOf6LbHQvB56Ry6CQCEg0 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c22dd0c01bde40a0a0f194f91e180d03", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}] Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 7b08b72cf46345f2a3c88a6251b1c996 Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1560f05f-f9f7-421f-8e53-4406518d7426 could not be found. Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1560f05f-f9f7-421f-8e53-4406518d7426'} Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1560f05f-f9f7-421f-8e53-4406518d7426 could not be found. Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1560f05f-f9f7-421f-8e53-4406518d7426 could not be found. Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:08.505053 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1560f05f-f9f7-421f-8e53-4406518d7426 could not be found. Sep 16 14:25:08.510311 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:25:08.512865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Returning 404 to user: Instance 1560f05f-f9f7-421f-8e53-4406518d7426 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:25:08.513976 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-360a1ded-a261-4dac-b3c8-0365f465ee90 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426" status: 404 len: 111 microversion: 2.1 time: 0.189640 Sep 16 14:25:08.514602 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2589/5144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:08 2022] GET /compute/v2.1/servers/1560f05f-f9f7-421f-8e53-4406518d7426 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:25:08.534382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:08.535240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:08.545113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.545940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.546623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.547809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.548717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.549357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.588727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:25:08.773955 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e67cebc2-d7d8-4208-b8a0-8495b693d711 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 204 len: 0 microversion: 2.1 time: 0.250963 Sep 16 14:25:08.775708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2590/5145] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:25:08 2022] DELETE /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:25:08.788351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:08.789737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:08.804474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.805254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.805906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.807228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.807895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:08.808706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:08.939023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:08.954441 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a0ad32a-5772-4c25-94c0-685d94254808 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.640890 Sep 16 14:25:08.956326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2556/5146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:08 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:08.979639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:08.982150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:08.996494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:08.997078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:09.000145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:09.001113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:09.001621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:09.002075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:09.320300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:09.335780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:09.349352 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9bf153c-12b0-4b2f-b1d4-ebed98e8bdc8 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.568547 Sep 16 14:25:09.350825 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2591/5147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:08 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:09.367523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:09.369724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b62cc74-ab77-4a51-8246-65868606e261 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1507 microversion: 2.1 time: 0.411948 Sep 16 14:25:09.370341 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2557/5148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:08 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1507 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:09.374180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:09.390393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:09.391336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:09.392445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:09.393761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:09.394730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:09.395621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:09.752250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:09.784660 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d73b42f0-07c8-4c24-9c80-729ba2bf52aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.431441 Sep 16 14:25:09.788826 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2592/5149] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:09 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:09.983213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:09.984427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:09.995541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:09.996055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:09.998723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.002761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.003274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.003735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.373849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:10.375210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:10.383755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.384698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.385404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.387526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.388243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.389055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.534846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:10.572270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aad5ece7-fcfc-4d54-aa2a-31c75f59b78a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.592947 Sep 16 14:25:10.574145 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2558/5150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:09 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:10.583942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:10.585652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:10.597904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.599747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.601100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.603587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.604820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.606146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.950395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:10.969420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d728485-df60-4807-826f-6bc766e8c00a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.599959 Sep 16 14:25:10.970213 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2593/5151] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:10 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:10.976104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:10.976726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:10.991808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.992310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.992756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:10.993481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:10.993944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:10.994376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:11.159171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:11.173614 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79cf544c-6c02-42a9-b83b-0d96aad2968b tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1507 microversion: 2.1 time: 0.597364 Sep 16 14:25:11.174592 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2559/5152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:10 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:11.481494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:11.493464 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dafa9789-93b1-4065-8c50-a9053a28bf36 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.521772 Sep 16 14:25:11.495454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2594/5153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:10 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:11.601753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:11.603110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:11.619157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:11.619915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:11.620151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:11.621139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:11.621618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:11.622058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:11.868834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5559521f-e4a8-43fb-af93-edcf4d347b5e req-a2f7b40f-1863-4e3e-818f-492ab5c9ea6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5d4b40-951e-495f-8553-d5daeb0f8226", "name": "network-vif-deleted", "tag": "4dee8eb3-2471-4adb-9f15-ef6e2436605c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:11.888279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5559521f-e4a8-43fb-af93-edcf4d347b5e req-a2f7b40f-1863-4e3e-818f-492ab5c9ea6d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:11.889053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5559521f-e4a8-43fb-af93-edcf4d347b5e req-a2f7b40f-1863-4e3e-818f-492ab5c9ea6d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:11.889762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5559521f-e4a8-43fb-af93-edcf4d347b5e req-a2f7b40f-1863-4e3e-818f-492ab5c9ea6d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:11.915771 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5559521f-e4a8-43fb-af93-edcf4d347b5e req-a2f7b40f-1863-4e3e-818f-492ab5c9ea6d service nova] Creating event network-vif-deleted:4dee8eb3-2471-4adb-9f15-ef6e2436605c for instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 on n-h2-858129-2 Sep 16 14:25:11.934932 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5559521f-e4a8-43fb-af93-edcf4d347b5e req-a2f7b40f-1863-4e3e-818f-492ab5c9ea6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069897 Sep 16 14:25:11.937128 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2595/5154] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:25:11.998061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:11.999825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:12.008345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.009280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.010026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.011429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.012206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.012874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.063928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:12.080714 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3261f895-2d24-4566-ae9d-7c6ce8207a05 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.481575 Sep 16 14:25:12.083217 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2560/5155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:11 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:12.220322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:12.221215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:12.229308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.232728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.236623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.237731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.238449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.239111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.332406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.336497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.337160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.338372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lazy-loading 'fault' on Instance uuid 9e5d4b40-951e-495f-8553-d5daeb0f8226 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:25:12.584907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:12.595575 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5bf86e54-234f-44f7-9c49-c8414760ef59 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 200 len: 1305 microversion: 2.1 time: 0.378736 Sep 16 14:25:12.596231 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2561/5156] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:12 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 1305 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:12.612279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:12.619714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:12.631773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.632387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.632847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.633603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:12.634348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:12.634827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:12.653975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:12.662757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:12.665568 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e834148a-5dfc-441f-b9f9-6e24808d5ef4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.675554 Sep 16 14:25:12.666202 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2596/5157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:11 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:12.854282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:12.879907 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f2ccda8-a345-4474-9e1e-658ea0e019e1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.279214 Sep 16 14:25:12.881960 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2562/5158] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:12 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:13.112734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:13.113694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:13.136290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.147653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.148652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.149978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.151723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.152651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.621488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:13.622861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 9e5d4b40-951e-495f-8553-d5daeb0f8226] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:13.634519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.635306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.635948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.637328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.638004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.638731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.658834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] HTTP exception thrown: Instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 could not be found. Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Request method failure captured: Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 HTTP/1.1 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIRXx5WnZlChrhhpAc9BCgpT5hSLUirttqocULdnP1XI5qL8AqYTPlgehGobW3mIyXaGYjuEWmY8n7oL5TYpIVyDuVZ_4vj4MtPGWdGSrY3rzSEaadoSEv4eDD3TdCJB9cKtU60yOuE2cNWiSGUKWx7-tWLOf6LbHQvB56Ry6CQCEg0 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c22dd0c01bde40a0a0f194f91e180d03", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}] Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7b08b72cf46345f2a3c88a6251b1c996 Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 could not be found. Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9e5d4b40-951e-495f-8553-d5daeb0f8226'} Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 could not be found. Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 could not be found. Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:13.661052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 could not be found. Sep 16 14:25:13.668194 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:13.671036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Returning 404 to user: Instance 9e5d4b40-951e-495f-8553-d5daeb0f8226 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:25:13.672205 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62cb40ca-7504-4d56-a9aa-16576f6a8d0d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226" status: 404 len: 111 microversion: 2.1 time: 0.054657 Sep 16 14:25:13.678089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:13.681525 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2563/5159] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:13 2022] GET /compute/v2.1/servers/9e5d4b40-951e-495f-8553-d5daeb0f8226 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:25:13.688330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:13.689177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:13.700245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.701064 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-20d8c8ac-e646-4c9c-bc8a-9860eedbac7b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.594042 Sep 16 14:25:13.702055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.702750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.704065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.704748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.705424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.717286 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2597/5160] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:13 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:13.760187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:13.761653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:13.782636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.790681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:25:13.795681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.796485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.797779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:13.798625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:13.799427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:13.982870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e53b7d6f-bd21-4a53-970c-e5b4cff80a76 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 204 len: 0 microversion: 2.1 time: 0.298959 Sep 16 14:25:13.986842 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2564/5161] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:25:13 2022] DELETE /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:25:13.993171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:13.993890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:14.001446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:14.003132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:14.003132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:14.003616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:14.003800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:14.004098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:14.530690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:14.549807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d072510-1c52-4d9f-a641-69352c41b82d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1517 microversion: 2.1 time: 0.830421 Sep 16 14:25:14.551972 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2598/5162] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:13 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1517 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:14.562256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:14.565337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:14.582067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:14.584052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:14.587911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:14.592889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:14.606866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:14.607517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:14.619386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:14.665151 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40b3b4b4-a048-477e-a050-4c0ae45162ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.676424 Sep 16 14:25:14.668930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2565/5163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:13 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:14.757757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:14.764047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:14.780902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:14.782765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:14.783968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:14.785967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:14.787074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:14.787979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:15.286485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:15.327401 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d55354b-79a0-49c2-aeaf-e8b900e24cf4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1493 microversion: 2.1 time: 0.772012 Sep 16 14:25:15.331642 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2599/5164] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:14 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1493 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:15.469618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:15.506117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09b59304-0ab2-406a-968d-8c95eb858930 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.750698 Sep 16 14:25:15.506117 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2566/5165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:14 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:15.579458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:15.580927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:15.595613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:15.597677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:15.599031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:15.601705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:15.602947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:15.604189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:15.715687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:15.718901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:15.751670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:15.763063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:15.766370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:15.768658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:15.773300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:15.774313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:16.651291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:16.691954 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cec752fb-83be-4075-9d62-d8b6b8628914 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 1.119145 Sep 16 14:25:16.695426 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2600/5166] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:15 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:16.722187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:16.723427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:16.752332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:16.753566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:16.759581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:16.761261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:16.762451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:16.766938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:16.951429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:16.955363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:16.967923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:16.968503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lazy-loading 'fault' on Instance uuid d8d9e745-24af-4330-8609-eae8639f2901 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:25:17.085380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:17.099266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e20b4aef-9c52-4a6e-9c91-fac530e37799 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 1.390331 Sep 16 14:25:17.101068 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2567/5167] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:15 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:17.108895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-060f6e18-db76-498d-9f52-08d52af6bd42 req-e204b70b-0637-4ec5-b550-50498a7550c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d9e745-24af-4330-8609-eae8639f2901", "name": "network-vif-deleted", "tag": "6660a025-663e-4689-8952-3a3bad68b711"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:17.132139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-060f6e18-db76-498d-9f52-08d52af6bd42 req-e204b70b-0637-4ec5-b550-50498a7550c7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:17.132792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-060f6e18-db76-498d-9f52-08d52af6bd42 req-e204b70b-0637-4ec5-b550-50498a7550c7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:17.133374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-060f6e18-db76-498d-9f52-08d52af6bd42 req-e204b70b-0637-4ec5-b550-50498a7550c7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:17.157728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:17.161019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-060f6e18-db76-498d-9f52-08d52af6bd42 req-e204b70b-0637-4ec5-b550-50498a7550c7 service nova] Creating event network-vif-deleted:6660a025-663e-4689-8952-3a3bad68b711 for instance d8d9e745-24af-4330-8609-eae8639f2901 on n-h1-858129-2 Sep 16 14:25:17.169477 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-060f6e18-db76-498d-9f52-08d52af6bd42 req-e204b70b-0637-4ec5-b550-50498a7550c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066875 Sep 16 14:25:17.171697 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2568/5168] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:17.205743 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-decd63ad-1c12-4dcd-b9e3-c7681ebd1ddf tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 200 len: 1304 microversion: 2.1 time: 0.507252 Sep 16 14:25:17.218430 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2601/5169] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:16 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 1304 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:17.238301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:17.239617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:17.250577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:17.251079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:17.251513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:17.252234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:17.252695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:17.253122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:17.555244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:17.566291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-372a7d25-c53e-4a71-95d9-689a2710defe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.362766 Sep 16 14:25:17.567252 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2569/5170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:17 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:17.738985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:17.741052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:17.753641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:17.754137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:17.754625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:17.755405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:17.755897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:17.756326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.138192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:18.138764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:18.145702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.146787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.147230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.147935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.148396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.148817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.558365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:18.561193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:18.576108 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e347fa2e-06a5-468a-913e-ee69e072d64d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.438301 Sep 16 14:25:18.584601 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d9a02ff6-f2d2-4876-9f91-4cacc942db9a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 0.850535 Sep 16 14:25:18.587544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2602/5171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:17 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:18.587958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2570/5172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:18 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:18.602384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:18.603059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: d8d9e745-24af-4330-8609-eae8639f2901] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:18.611626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:18.614779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:18.620104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.620622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.621075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.627997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.628526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.628982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.638205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.638974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.639667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.640604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.641963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.642650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.659277 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] HTTP exception thrown: Instance d8d9e745-24af-4330-8609-eae8639f2901 could not be found. Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Request method failure captured: Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 HTTP/1.1 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIRXx5WnZlChrhhpAc9BCgpT5hSLUirttqocULdnP1XI5qL8AqYTPlgehGobW3mIyXaGYjuEWmY8n7oL5TYpIVyDuVZ_4vj4MtPGWdGSrY3rzSEaadoSEv4eDD3TdCJB9cKtU60yOuE2cNWiSGUKWx7-tWLOf6LbHQvB56Ry6CQCEg0 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c22dd0c01bde40a0a0f194f91e180d03", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}] Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7b08b72cf46345f2a3c88a6251b1c996 Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance d8d9e745-24af-4330-8609-eae8639f2901 could not be found. Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'd8d9e745-24af-4330-8609-eae8639f2901'} Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d9e745-24af-4330-8609-eae8639f2901 could not be found. Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d9e745-24af-4330-8609-eae8639f2901 could not be found. Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:18.660983 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d9e745-24af-4330-8609-eae8639f2901 could not be found. Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:18.666295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Returning 404 to user: Instance d8d9e745-24af-4330-8609-eae8639f2901 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:25:18.669177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6fba1a2-840b-4026-ba2c-ba3006f5948c tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901" status: 404 len: 111 microversion: 2.1 time: 0.080161 Sep 16 14:25:18.678515 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2571/5173] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:18 2022] GET /compute/v2.1/servers/d8d9e745-24af-4330-8609-eae8639f2901 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:25:18.702054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:18.702974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:18.710932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.712140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.712767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.713808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:18.714460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:18.716164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:18.785637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:25:18.938625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:18.955870 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b70f2b9-bf4f-43bc-9e44-091ea1a4393f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.352561 Sep 16 14:25:18.957738 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2603/5174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:18 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:19.003688 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c0956b7-0987-4da6-8807-286527a1bee0 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "DELETE /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 204 len: 0 microversion: 2.1 time: 0.312820 Sep 16 14:25:19.004728 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2572/5175] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:25:18 2022] DELETE /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:25:19.018122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:19.020356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:19.051308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:19.052304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:19.053671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:19.055126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:19.061413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:19.062550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:19.097906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:19.467256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:19.479752 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-854cb86c-546b-416b-86a0-3d4d82b166a3 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1674 microversion: 2.1 time: 0.469552 Sep 16 14:25:19.481003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2604/5176] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:19 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1674 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:19.606267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:19.608304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:19.625398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:19.626500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:19.635563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:19.640133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:19.640534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:19.641433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:19.642351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:19.643074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:19.643697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:19.644247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:19.645603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:19.646021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:19.649100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:19.649672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:19.977586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:19.996669 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8df19329-b1a9-4d66-a3ef-52b23fe2228b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.394211 Sep 16 14:25:20.003507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:20.011876 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2573/5177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:19 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:20.023010 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41c86806-abb1-40c6-b50c-8fef5aa51d9c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 0.402645 Sep 16 14:25:20.025133 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2605/5178] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:19 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:20.026530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:20.027458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:20.035948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:20.036917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:20.039175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:20.042115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:20.042923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:20.043795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:20.325401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:20.338668 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39e7f7e8-fd29-42b6-bed4-4885d6faaeeb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.324913 Sep 16 14:25:20.363010 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2574/5179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:20 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:20.511985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:20.513991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:20.532867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:20.535701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:20.539562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:20.541317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:20.548283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:20.549816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:20.951777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:20.964482 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eae1ec05-b470-47cb-97d5-970175d305cb tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1674 microversion: 2.1 time: 0.459305 Sep 16 14:25:20.985020 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2606/5180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:20 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1674 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:21.030334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:21.031682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:21.043731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.044757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.045505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:21.046953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.047773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.048999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:21.073160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:21.075373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:21.085754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.086887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.088289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:21.089675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.091001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.091720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:21.668435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:21.679002 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cca38e0b-147f-457d-a33d-75e55432ed1f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 0.615886 Sep 16 14:25:21.680335 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2607/5181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:21 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:21.690690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:21.691992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:21.697347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:21.720097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.726311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.727264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:21.728269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.728756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.729191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:21.896434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:21.913819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-35263444-4ab0-4c85-9d78-fa86ff1519b7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.889563 Sep 16 14:25:21.926440 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2575/5182] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:21 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:21.931527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5c0afa29-874b-4e0c-a377-61a94a0a9c8c req-87e6c5ae-8295-4f25-8c58-e3048f35186c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4619fe9-8701-4a1a-ae30-7d6d00d828d8", "name": "network-vif-unplugged", "status": "completed", "tag": "d56ec400-272e-4e25-ba6b-be7535a1a3c5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:21.948834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5c0afa29-874b-4e0c-a377-61a94a0a9c8c req-87e6c5ae-8295-4f25-8c58-e3048f35186c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:21.949334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5c0afa29-874b-4e0c-a377-61a94a0a9c8c req-87e6c5ae-8295-4f25-8c58-e3048f35186c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:21.949782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5c0afa29-874b-4e0c-a377-61a94a0a9c8c req-87e6c5ae-8295-4f25-8c58-e3048f35186c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.009711 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5c0afa29-874b-4e0c-a377-61a94a0a9c8c req-87e6c5ae-8295-4f25-8c58-e3048f35186c service nova] Creating event network-vif-unplugged:d56ec400-272e-4e25-ba6b-be7535a1a3c5 for instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 on n-h2-858129-2 Sep 16 14:25:22.018059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5c0afa29-874b-4e0c-a377-61a94a0a9c8c req-87e6c5ae-8295-4f25-8c58-e3048f35186c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101290 Sep 16 14:25:22.019065 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2576/5183] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:22.031050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:22.032883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:22.052612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.064951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.067219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.068800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.071185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.076243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.110290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:22.134976 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-347d0796-6c2a-4402-b230-fd1165ba1639 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.442869 Sep 16 14:25:22.137227 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2608/5184] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:21 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:22.251217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:22.266652 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-890f853f-844c-4bfd-ae4a-6a9182b10273 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1606 microversion: 2.1 time: 0.246011 Sep 16 14:25:22.271903 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2577/5185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:22 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1606 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:22.729632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:22.730761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:22.745711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.746650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.747339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.748745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.754268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.755104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.797985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ce010f56-e6d3-4d6c-9dea-ef05dd93ae14 req-7bdd53e2-00e2-4c4c-80cc-3bf04f2419f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138dc7b6-7648-46cc-9712-c32e2ab8fcdb", "name": "network-vif-deleted", "tag": "e21d4023-0443-4da4-80cb-942f329ec411"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:22.812277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ce010f56-e6d3-4d6c-9dea-ef05dd93ae14 req-7bdd53e2-00e2-4c4c-80cc-3bf04f2419f8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.813318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ce010f56-e6d3-4d6c-9dea-ef05dd93ae14 req-7bdd53e2-00e2-4c4c-80cc-3bf04f2419f8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.814046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ce010f56-e6d3-4d6c-9dea-ef05dd93ae14 req-7bdd53e2-00e2-4c4c-80cc-3bf04f2419f8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.829679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ce010f56-e6d3-4d6c-9dea-ef05dd93ae14 req-7bdd53e2-00e2-4c4c-80cc-3bf04f2419f8 service nova] Creating event network-vif-deleted:e21d4023-0443-4da4-80cb-942f329ec411 for instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb on n-h1-858129-2 Sep 16 14:25:22.841612 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ce010f56-e6d3-4d6c-9dea-ef05dd93ae14 req-7bdd53e2-00e2-4c4c-80cc-3bf04f2419f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048738 Sep 16 14:25:22.842245 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2578/5186] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:25:22.953896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:22.955035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:22.975268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.977496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.979543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:22.983066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:22.983856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:22.984314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:23.022627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:23.039220 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a794dd63-8365-472e-a405-38494ff60002 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 0.313634 Sep 16 14:25:23.039856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:23.056292 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2609/5187] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:22 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:23.163597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:23.164452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:23.183101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:23.184561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:23.186382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:23.188795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:23.190015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:23.191290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:23.278560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:23.292272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6dc52958-e7b0-4de9-9d58-11ca4d973574 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1533 microversion: 2.1 time: 0.349733 Sep 16 14:25:23.292952 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2579/5188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:22 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1533 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:23.324656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:23.325910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:23.333604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:23.334598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:23.335301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:23.336246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:23.336978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:23.337606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:23.448626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:23.460220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d7a40c0-fbcb-428e-acbe-17333c9c91b2 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1606 microversion: 2.1 time: 0.144926 Sep 16 14:25:23.461321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2580/5189] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:23 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1606 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:23.500894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:23.517196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0a256a5-5403-4278-bc0f-8b7b7703dba4 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.358421 Sep 16 14:25:23.518679 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2610/5190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:23 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:24.082507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:24.083191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:24.102941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:24.103471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:24.104891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:24.105772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:24.106262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:24.115670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:24.323443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:24.325013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:24.341035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:24.342036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:24.355230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:24.356367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:24.357065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:24.357713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:25.151719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:25.165689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-79771d0b-da47-4de4-8855-17ee1b53d951 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1533 microversion: 2.1 time: 0.847699 Sep 16 14:25:25.167444 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2611/5191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:24 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1533 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:25.179602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:25.195847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:25.215225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:25.220306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:25.220967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:25.222140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:25.222826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:25.224023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:25.227268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:25.267053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba099230-75ae-4545-946e-c617a9ca3a45 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 1.183861 Sep 16 14:25:25.269857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2581/5192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:24 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:25.288416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:25.293821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:25.330908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:25.331659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:25.331847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:25.332301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lazy-loading 'fault' on Instance uuid 138dc7b6-7648-46cc-9712-c32e2ab8fcdb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:25:25.337176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:25.343559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:25.349769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:25.352526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:25.354063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:25.355327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:25.459514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b08b72cf46345f2a3c88a6251b1c996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22dd0c01bde40a0a0f194f91e180d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:25.472170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01796a64-8071-485c-8b2d-16be9adb1875 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 200 len: 1328 microversion: 2.1 time: 0.303273 Sep 16 14:25:25.477732 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2612/5193] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:25 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 1328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:26.061119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:26.078788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5dc1467-da4e-4cd5-b1a8-e27c0824c31d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1505 microversion: 2.1 time: 0.804535 Sep 16 14:25:26.082177 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2582/5194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:25 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:26.199387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:26.200466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:26.210481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:26.214204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:26.215064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:26.217827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:26.218600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:26.221944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:26.323058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:26.325659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:26.339336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:26.342721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:26.345339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:26.351399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:26.352331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:26.353073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:27.158434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:27.174804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6840ad03-af3f-4cbc-b235-274267e94cd0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 0.856385 Sep 16 14:25:27.176044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2583/5195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:26 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:27.190891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:27.202996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] [instance: 138dc7b6-7648-46cc-9712-c32e2ab8fcdb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:27.227029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:27.227651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:27.228223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:27.233429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:27.234373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:27.235123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:27.281920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] HTTP exception thrown: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb could not be found. Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Request method failure captured: Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb HTTP/1.1 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIRXx5WnZlChrhhpAc9BCgpT5hSLUirttqocULdnP1XI5qL8AqYTPlgehGobW3mIyXaGYjuEWmY8n7oL5TYpIVyDuVZ_4vj4MtPGWdGSrY3rzSEaadoSEv4eDD3TdCJB9cKtU60yOuE2cNWiSGUKWx7-tWLOf6LbHQvB56Ry6CQCEg0 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c22dd0c01bde40a0a0f194f91e180d03", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c22dd0c01bde40a0a0f194f91e180d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c22dd0c01bde40a0a0f194f91e180d03"}]}] Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c22dd0c01bde40a0a0f194f91e180d03 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-688292966 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7b08b72cf46345f2a3c88a6251b1c996 Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-688292966-project Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb could not be found. Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '138dc7b6-7648-46cc-9712-c32e2ab8fcdb'} Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb could not be found. Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb could not be found. Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:25:27.296770 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb could not be found. Sep 16 14:25:27.301458 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:25:27.312351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Returning 404 to user: Instance 138dc7b6-7648-46cc-9712-c32e2ab8fcdb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:25:27.314713 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1211b73d-146d-4405-830b-36edbb5b5e5d tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb" status: 404 len: 111 microversion: 2.1 time: 0.133821 Sep 16 14:25:27.318193 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2584/5196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:27 2022] GET /compute/v2.1/servers/138dc7b6-7648-46cc-9712-c32e2ab8fcdb => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:25:27.329715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-418ea004-cf28-42b2-8441-027b67bcc557 req-42720506-9cef-4c60-ae78-f239c0a9e929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4619fe9-8701-4a1a-ae30-7d6d00d828d8", "name": "network-vif-plugged", "status": "completed", "tag": "d56ec400-272e-4e25-ba6b-be7535a1a3c5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:27.355665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-418ea004-cf28-42b2-8441-027b67bcc557 req-42720506-9cef-4c60-ae78-f239c0a9e929 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:27.356669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-418ea004-cf28-42b2-8441-027b67bcc557 req-42720506-9cef-4c60-ae78-f239c0a9e929 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:27.358280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-418ea004-cf28-42b2-8441-027b67bcc557 req-42720506-9cef-4c60-ae78-f239c0a9e929 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:27.400026 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-418ea004-cf28-42b2-8441-027b67bcc557 req-42720506-9cef-4c60-ae78-f239c0a9e929 service nova] Creating event network-vif-plugged:d56ec400-272e-4e25-ba6b-be7535a1a3c5 for instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 on n-h2-858129-2 Sep 16 14:25:27.451980 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-418ea004-cf28-42b2-8441-027b67bcc557 req-42720506-9cef-4c60-ae78-f239c0a9e929 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131586 Sep 16 14:25:27.452657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2585/5197] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:27.541780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:27.543491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:27.583989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:27.588564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:27.593015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:27.595701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:27.614461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:27.617438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:27.686808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:27.748957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1feaf047-1115-45b3-a82a-14ce36848a82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1533 microversion: 2.1 time: 1.553987 Sep 16 14:25:27.751926 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2613/5198] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:26 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1533 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:27.763214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2bd1fbd3-7b0a-48e6-a2a8-2f0f54a962f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] Calling method '.version_select at 0x7f724c4f9670>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:27.836775 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2bd1fbd3-7b0a-48e6-a2a8-2f0f54a962f4 tempest-ServerActionsTestJSON-688292966 tempest-ServerActionsTestJSON-688292966-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-320214297" status: 202 len: 0 microversion: 2.1 time: 0.082383 Sep 16 14:25:27.837770 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2614/5199] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:25:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-320214297 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:25:28.220049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:28.221141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:28.231676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:28.232597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:28.233296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:28.234562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:28.235308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:28.237377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:28.825971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:28.839268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31c4234c-d056-400c-bd56-ce4085173844 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1485 microversion: 2.1 time: 1.385247 Sep 16 14:25:28.840093 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2586/5200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:27 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1485 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:28.847169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:28.852520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:28.869661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:28.870526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:28.871162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:28.872190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:28.872875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:28.873518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:29.611487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:29.632798 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-42454c0d-03d5-4fe2-817d-d44e942d2c0a tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1523 microversion: 2.1 time: 1.416791 Sep 16 14:25:29.634595 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2615/5201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:28 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1523 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:29.655140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1470646698", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:29.778933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] validate_networks() for [('81185f65-5716-49c9-992a-ff1c1b07f22a', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:25:30.829517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:30.860178 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6cc03cb-eb11-436e-b767-07b703a8d37c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1533 microversion: 2.1 time: 2.018172 Sep 16 14:25:30.874333 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2587/5202] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:28 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1533 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:30.909846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b4d528b6-6d6a-494a-9862-ae47dd3f6497 req-37c1df89-383f-472f-81a6-6d94d006d044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934b7a08-9fa8-431c-a6fa-6a255e516dbf", "name": "network-vif-plugged", "status": "completed", "tag": "342f4453-24ce-4b24-b685-977cf8c2a703"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:30.961355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4d528b6-6d6a-494a-9862-ae47dd3f6497 req-37c1df89-383f-472f-81a6-6d94d006d044 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:30.969669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4d528b6-6d6a-494a-9862-ae47dd3f6497 req-37c1df89-383f-472f-81a6-6d94d006d044 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:30.975614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4d528b6-6d6a-494a-9862-ae47dd3f6497 req-37c1df89-383f-472f-81a6-6d94d006d044 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:31.020022 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b4d528b6-6d6a-494a-9862-ae47dd3f6497 req-37c1df89-383f-472f-81a6-6d94d006d044 service nova] Creating event network-vif-plugged:342f4453-24ce-4b24-b685-977cf8c2a703 for instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf on n-h1-858129-2 Sep 16 14:25:31.044172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b4d528b6-6d6a-494a-9862-ae47dd3f6497 req-37c1df89-383f-472f-81a6-6d94d006d044 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163942 Sep 16 14:25:31.049367 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2588/5203] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:31.069935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:31.071310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:31.095892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:31.097201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:31.098169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:31.103208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:31.104477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:31.105572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:31.769702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:31.783076 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f5600386-4816-4bd7-a614-5d5a12dcdeb4 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1508 microversion: 2.1 time: 0.729201 Sep 16 14:25:31.784180 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2589/5204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:31 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1508 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:31.831015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:31.832568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:31.846030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:31.847000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:31.852114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:31.852998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:31.853595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:31.854163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:32.171544 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:25:32.172291 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 14:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 (ip 10.222.0.60) !!! Sep 16 14:25:32.317073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:25:32.318536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:25:32.319677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:25:32.320188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:25:32.320609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:25:32.339047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:32.349797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88498c51-f900-4609-b378-561c4f37c5cc tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 200 len: 1508 microversion: 2.1 time: 0.523064 Sep 16 14:25:32.362602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2590/5205] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:31 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:32.363969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:32.364914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:32.398217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:32.399055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:32.399796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:32.400834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:32.401631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:32.402328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:32.414439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:32.414983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:32.415463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:32.423769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:32.424838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:32.429583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:32.593029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Getting quotas for project ae06c4ada55746289de65e12379de8d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:25:32.624273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Getting quotas for user 9e66569ee5124501a096d4201eabbd1a and project ae06c4ada55746289de65e12379de8d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:25:32.668043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:25:32.672931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:25:32.837564 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e22aa642-4084-4b3b-9655-73ddb119605e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.195044 Sep 16 14:25:32.843528 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2616/5206] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:25:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:25:32.872040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:32.886680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:32.924612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:32.941424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:32.942803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:32.944305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:32.944989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:32.945741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:33.062640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:25:33.297815 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-63574ec1-b0fb-45d5-8732-ab7d978150b5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 204 len: 0 microversion: 2.1 time: 0.449826 Sep 16 14:25:33.319683 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2617/5207] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:25:32 2022] DELETE /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:25:33.394940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e268d8c7-5f44-4a35-b2df-e2c25d955ada tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:33.403171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e268d8c7-5f44-4a35-b2df-e2c25d955ada tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:33.547935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e268d8c7-5f44-4a35-b2df-e2c25d955ada tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:33.574645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e268d8c7-5f44-4a35-b2df-e2c25d955ada tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1214 microversion: 2.1 time: 0.252658 Sep 16 14:25:33.575662 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2618/5208] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:33 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:33.769595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1173878877", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "edd0c130-0d71-4b98-b965-0df644fb2e52"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:33.771068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:33.806535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fed15e42-00fd-4036-8cd8-132bce2c75e8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.441811 Sep 16 14:25:33.809297 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2591/5209] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:32 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:33.977828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] validate_networks() for [('edd0c130-0d71-4b98-b965-0df644fb2e52', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:25:34.625694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:34.630943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:34.640885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:34.641742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:34.650560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:34.652163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:34.653165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:34.654065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:35.013328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:35.063059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0c12afc0-e578-4995-a349-f78f9fda7f0b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1218 microversion: 2.1 time: 0.436590 Sep 16 14:25:35.066165 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2592/5210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:34 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1218 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:35.089991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:35.096354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:35.134133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:35.135048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:35.143010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:35.144190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:35.144939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:35.152452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:35.809386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:25:35.810493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:25:35.811171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:25:35.811762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:25:35.812352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:25:35.828791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:35.829283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:35.843512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:35.844735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:35.845456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:35.846087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:35.881693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Getting quotas for project 31c31e5d3722447b8d6f49585a19144e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:25:35.906235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Getting quotas for user 000370dc2ad84f22940251ee1b08c0a8 and project 31c31e5d3722447b8d6f49585a19144e. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:25:35.952091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:25:35.957456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:25:36.157408 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9da05910-5bd3-4715-aa1f-6a75e22e08cd tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394342 Sep 16 14:25:36.171735 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2619/5211] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:25:36.187628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:36.189459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:36.233320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:36.236343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:36.242991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:36.249640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:36.256074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:36.275000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:36.449278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:36.459508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3892b568-ed3d-4513-bf76-02e25f4a690a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.391285 Sep 16 14:25:36.467287 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2593/5212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:35 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:36.496184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c233bed-d2fa-45b6-90dd-a32496f1f1d7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:36.497211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c233bed-d2fa-45b6-90dd-a32496f1f1d7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:36.892621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:36.949010 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-95c412d7-120f-4008-8f95-fc7bb8f9cc01 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1274 microversion: 2.1 time: 0.772216 Sep 16 14:25:36.988748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2620/5213] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:36 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1274 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:36.998806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c233bed-d2fa-45b6-90dd-a32496f1f1d7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:37.030462 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c233bed-d2fa-45b6-90dd-a32496f1f1d7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1218 microversion: 2.1 time: 0.558289 Sep 16 14:25:37.031738 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2594/5214] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:36 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1218 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:37.516260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:37.517192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:37.545529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:37.554025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:37.554818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:37.557954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:37.560309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:37.560896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:37.620589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a0cc9660-fe4c-44fe-b69e-722f4d697966 req-29bccb5b-ec3d-45e5-a4bc-8196ba735d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4619fe9-8701-4a1a-ae30-7d6d00d828d8", "name": "network-vif-unplugged", "status": "completed", "tag": "d56ec400-272e-4e25-ba6b-be7535a1a3c5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:37.697416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:37.717374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a0cc9660-fe4c-44fe-b69e-722f4d697966 req-29bccb5b-ec3d-45e5-a4bc-8196ba735d92 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:37.725688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a0cc9660-fe4c-44fe-b69e-722f4d697966 req-29bccb5b-ec3d-45e5-a4bc-8196ba735d92 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:37.733144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a0cc9660-fe4c-44fe-b69e-722f4d697966 req-29bccb5b-ec3d-45e5-a4bc-8196ba735d92 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:37.840409 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a0cc9660-fe4c-44fe-b69e-722f4d697966 req-29bccb5b-ec3d-45e5-a4bc-8196ba735d92 service nova] Creating event network-vif-unplugged:d56ec400-272e-4e25-ba6b-be7535a1a3c5 for instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 on n-h2-858129-2 Sep 16 14:25:37.854561 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a0cc9660-fe4c-44fe-b69e-722f4d697966 req-29bccb5b-ec3d-45e5-a4bc-8196ba735d92 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.242789 Sep 16 14:25:37.855928 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2595/5215] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:38.000762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:38.001228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:38.017959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:38.030653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:38.031335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:38.032995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:38.033676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:38.034325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:38.354759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:38.366782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:38.375228 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28bdbc7e-f7b7-4a05-958a-62bcfb85f8dc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 0.863905 Sep 16 14:25:38.381700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eff62563-d60c-4aa2-b253-c3e7380e8022 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1272 microversion: 2.1 time: 0.390729 Sep 16 14:25:38.395502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2621/5216] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:37 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:38.403319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2596/5217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:37 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1272 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:38.410326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:38.415052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:38.432188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:38.433061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:38.433682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:38.434715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:38.435377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:38.435974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:38.469921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:38.570141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:38.579349 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2eb5c990-9782-4b9e-86e8-6c8430d146f5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1270 microversion: 2.1 time: 0.181807 Sep 16 14:25:38.591289 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2622/5218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:38 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:39.023433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f05e5852-ec53-406f-b96f-adbd20ea41fd req-6ceffe7f-8fdf-4245-a1ce-6ee52430354d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4619fe9-8701-4a1a-ae30-7d6d00d828d8", "name": "network-vif-deleted", "tag": "d56ec400-272e-4e25-ba6b-be7535a1a3c5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:39.057277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f05e5852-ec53-406f-b96f-adbd20ea41fd req-6ceffe7f-8fdf-4245-a1ce-6ee52430354d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:39.059098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f05e5852-ec53-406f-b96f-adbd20ea41fd req-6ceffe7f-8fdf-4245-a1ce-6ee52430354d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:39.059890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f05e5852-ec53-406f-b96f-adbd20ea41fd req-6ceffe7f-8fdf-4245-a1ce-6ee52430354d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:39.090205 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f05e5852-ec53-406f-b96f-adbd20ea41fd req-6ceffe7f-8fdf-4245-a1ce-6ee52430354d service nova] Creating event network-vif-deleted:d56ec400-272e-4e25-ba6b-be7535a1a3c5 for instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 on n-h2-858129-2 Sep 16 14:25:39.112903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f05e5852-ec53-406f-b96f-adbd20ea41fd req-6ceffe7f-8fdf-4245-a1ce-6ee52430354d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097044 Sep 16 14:25:39.120313 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2597/5219] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:25:39.413628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:39.414292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:39.416933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:39.417824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:39.451062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:39.453351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:39.457029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:39.457888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:39.459483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:39.460820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:39.463522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:39.464062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:39.466269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:39.467357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:39.468767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:39.475199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:40.074064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:40.123248 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4cc0a678-40b6-4c89-98b1-0093e8cf3507 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1272 microversion: 2.1 time: 0.714262 Sep 16 14:25:40.143508 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2598/5220] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:39 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1272 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:40.189994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:40.191760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:40.241846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:40.248201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:40.248973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:40.253673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:40.257830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:40.260132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:40.666867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:40.679741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61005fb9-2461-4296-a37f-c92ccbd07736 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1276 microversion: 2.1 time: 0.534143 Sep 16 14:25:40.696815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2599/5221] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:40 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1276 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:41.222622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:41.225194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:41.258013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:41.268409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:41.269242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:41.270087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:41.271492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:41.272344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:41.273102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:41.323550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d1bfa5a-6d7b-4e83-ae1e-f0a9923d431f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.874585 Sep 16 14:25:41.338432 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2623/5222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:39 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:41.338712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:41.720125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:41.726145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:41.781045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:41.784020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:41.785209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:41.789903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:41.791368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:41.797174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:42.823053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:42.838036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd334b56-2b44-493b-8fd6-995667d02c8c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 1.626069 Sep 16 14:25:42.839862 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2600/5223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:41 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:42.870260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:42.875836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:42.882510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:42.907879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-58525507-7469-466e-b3dc-30c85ae2b234 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 1.195812 Sep 16 14:25:42.916331 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2624/5224] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:41 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:25:42.917349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:42.921781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:42.926585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:42.932263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:42.938386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:42.939281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:43.901155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:43.908665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:43.923611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:43.924103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:43.924762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:43.925840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:43.933811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:43.934811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:44.059434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:44.074645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-adf9bf73-5f23-4095-9f6a-2f1fc2bfe688 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.230135 Sep 16 14:25:44.075271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2601/5225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:42 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:44.105265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:44.114730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:44.136220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:44.137938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:44.139051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:44.140479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:44.141505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:44.146396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:44.512149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:44.529965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-964b1513-13bc-4a6b-8e67-64591af7419a tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 0.637949 Sep 16 14:25:44.530739 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2625/5226] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:43 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:44.797025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:44.814326 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1339fce2-1e22-4828-a13f-6f616d9b516f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 0.728376 Sep 16 14:25:44.827740 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2602/5227] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:44 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:45.102225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:45.103803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:45.120179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:45.121766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:45.123786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:45.124799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:45.127140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:45.128045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:45.528589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ac37f9ad-18bc-44be-861b-b43a2501246f req-7a65acde-7ace-4f05-a4f5-71b0728b120e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a3871d-ef3a-4b39-9e6f-f8446fd3347f", "tag": "d45e5a02-ae2d-4967-be2d-7932ed4ac976"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:45.558606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ac37f9ad-18bc-44be-861b-b43a2501246f req-7a65acde-7ace-4f05-a4f5-71b0728b120e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:45.564768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ac37f9ad-18bc-44be-861b-b43a2501246f req-7a65acde-7ace-4f05-a4f5-71b0728b120e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:45.567113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ac37f9ad-18bc-44be-861b-b43a2501246f req-7a65acde-7ace-4f05-a4f5-71b0728b120e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:45.597540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ac37f9ad-18bc-44be-861b-b43a2501246f req-7a65acde-7ace-4f05-a4f5-71b0728b120e service nova] Creating event network-changed:d45e5a02-ae2d-4967-be2d-7932ed4ac976 for instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f on n-h2-858129-2 Sep 16 14:25:45.607000 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ac37f9ad-18bc-44be-861b-b43a2501246f req-7a65acde-7ace-4f05-a4f5-71b0728b120e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082741 Sep 16 14:25:45.614894 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2603/5228] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:25:45.622874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:45.627094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:45.642998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:45.643499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:45.643954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:45.644706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:45.645176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:45.646199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:45.856514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:45.929773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=14 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:45.964056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:45.997144 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-248cbb58-6483-41c2-a3d8-62cbf9757980 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 0.899188 Sep 16 14:25:45.997790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2626/5229] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:45 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:46.008262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:46.009265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:46.026848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:46.028570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:46.029493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:46.030705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:46.031556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:46.033137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:46.201092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:46.214519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16a78b76-3e0b-4b74-b28a-83ffb56ef224 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 0.597902 Sep 16 14:25:46.223807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2604/5230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:45 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:46.976459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:46.991547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5821947e-bd51-41fd-88b6-5eefc0edb4b0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 0.991627 Sep 16 14:25:47.008513 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2627/5231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:45 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:47.027177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:47.029026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:47.043112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:47.048046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:47.050865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:47.052839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:47.055791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:47.058127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:47.061366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:47.274129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:47.275464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:47.314603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:47.315495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:47.319354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:47.320663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:47.321455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:47.322809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:48.263446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:48.276968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:48.289584 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3420f8ac-e37f-43ef-a4e3-beba2e6fe3ff tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 1.025653 Sep 16 14:25:48.289885 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d6f9fa1-ca49-4d7d-a993-382ee8d1fa85 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.267332 Sep 16 14:25:48.291329 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2605/5232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:47 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:48.299090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1eea323c-72c3-4200-8d01-1bf433a0b7a3 req-1ce3230a-f3fb-456b-b90a-864d621afdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893ffb64-04b3-40a6-8097-478208e750e8", "tag": "f394feef-5e7e-40d5-b884-0f7974377b42"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:48.299961 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2628/5233] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:47 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:48.310164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:48.311300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:48.322112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1eea323c-72c3-4200-8d01-1bf433a0b7a3 req-1ce3230a-f3fb-456b-b90a-864d621afdc2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:48.324360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1eea323c-72c3-4200-8d01-1bf433a0b7a3 req-1ce3230a-f3fb-456b-b90a-864d621afdc2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:48.324827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1eea323c-72c3-4200-8d01-1bf433a0b7a3 req-1ce3230a-f3fb-456b-b90a-864d621afdc2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:48.332973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:48.335140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:48.335917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:48.336925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:48.340954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:48.341775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:48.366828 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1eea323c-72c3-4200-8d01-1bf433a0b7a3 req-1ce3230a-f3fb-456b-b90a-864d621afdc2 service nova] Creating event network-changed:f394feef-5e7e-40d5-b884-0f7974377b42 for instance 893ffb64-04b3-40a6-8097-478208e750e8 on n-h1-858129-2 Sep 16 14:25:48.382635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1eea323c-72c3-4200-8d01-1bf433a0b7a3 req-1ce3230a-f3fb-456b-b90a-864d621afdc2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083191 Sep 16 14:25:48.383832 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2606/5234] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:48.701003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:48.712086 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ceff1621-7b76-41c6-a0f3-6ed9529234d9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 0.410681 Sep 16 14:25:48.717539 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2629/5235] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:48 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:49.352088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:49.352948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:49.354621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:49.358195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:49.381264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:49.383534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:49.384313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:49.385809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:49.387371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:49.390147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:49.391158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:49.393102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:49.394089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:49.400001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:49.403662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:49.404223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:49.798960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:49.836429 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed4c71ef-eda6-491c-9a82-f3a6354569ed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 0.494057 Sep 16 14:25:49.851811 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2630/5236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:49 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:49.868661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:49.870793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:49.895638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:49.903939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:49.908971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:49.915606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:49.916466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:49.919574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:50.049125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:50.061283 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4cff56e-cb39-4057-978e-95d9bbf6bc2b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 0.721042 Sep 16 14:25:50.072316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2607/5237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:49 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:50.300081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:50.313773 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b39d0d3a-272e-4e5b-a149-2da0c9a0b72c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 0.460386 Sep 16 14:25:50.314390 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2631/5238] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:49 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:50.865292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:50.866724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:50.875108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:50.876177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:50.876848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:50.878057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:50.879037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:50.879717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:51.099264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:51.100578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:51.125654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:51.128765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:51.131802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:51.135897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:51.137417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:51.143982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:51.782193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:51.798598 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5a1a7e6-4432-48a1-a3dc-bc3de5c9ea92 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 0.705595 Sep 16 14:25:51.811391 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2632/5239] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:51 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:51.823479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:51.824465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:51.831224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:51.833178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:51.834550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:51.835217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:51.836134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:51.836781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:51.837395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:51.945145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:51.962549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4f7a8e5-2edb-46bd-9bb8-f46ec2de8316 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.094208 Sep 16 14:25:51.967478 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2608/5240] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:50 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:52.468877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0164fcbd-e769-4d54-b48c-90a30cdafc63 req-f8da9362-14e1-4e95-be51-970e758d108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a3871d-ef3a-4b39-9e6f-f8446fd3347f", "name": "network-vif-plugged", "status": "completed", "tag": "d45e5a02-ae2d-4967-be2d-7932ed4ac976"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:52.483919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0164fcbd-e769-4d54-b48c-90a30cdafc63 req-f8da9362-14e1-4e95-be51-970e758d108c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:52.484170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0164fcbd-e769-4d54-b48c-90a30cdafc63 req-f8da9362-14e1-4e95-be51-970e758d108c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:52.484467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0164fcbd-e769-4d54-b48c-90a30cdafc63 req-f8da9362-14e1-4e95-be51-970e758d108c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:52.517855 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0164fcbd-e769-4d54-b48c-90a30cdafc63 req-f8da9362-14e1-4e95-be51-970e758d108c service nova] Creating event network-vif-plugged:d45e5a02-ae2d-4967-be2d-7932ed4ac976 for instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f on n-h2-858129-2 Sep 16 14:25:52.526281 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0164fcbd-e769-4d54-b48c-90a30cdafc63 req-f8da9362-14e1-4e95-be51-970e758d108c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061773 Sep 16 14:25:52.529638 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2609/5241] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:25:52.668420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:52.713283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71d21931-8e47-485f-8794-c38fed4f066f tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 0.900502 Sep 16 14:25:52.719313 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2633/5242] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:51 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:52.826845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:52.827597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:52.845527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:52.846049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:52.846535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:52.847308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:52.852536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:52.857034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:53.007071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:53.008231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:53.035346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:53.036938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:53.044894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:53.046129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:53.047379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:53.048001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:54.135159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:54.154308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:54.171695 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6211efc4-9126-42b9-b2cc-536cd000bd1d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.172183 Sep 16 14:25:54.177747 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14a5cae3-a820-4b3b-99e9-0965a4b31ed3 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1314 microversion: 2.1 time: 1.350460 Sep 16 14:25:54.183040 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2610/5243] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:52 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1314 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:54.199063 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2634/5244] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:52 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:54.202863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:54.204325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:54.237139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:54.238656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:54.240397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:54.242928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:54.245457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:54.246930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:55.207373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:55.209467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:55.241879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:55.256408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:55.256737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:55.261751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:55.267370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:55.275622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.276118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:56.292044 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a2933d3b-6948-4d3e-b826-971c4e41f1ed tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 2.102706 Sep 16 14:25:56.295625 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2611/5245] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:54 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:56.308727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:56.311489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:56.352965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:56.353567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:56.355226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.357510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:56.361386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:56.364412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.607785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:56.631927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7162b881-b53e-4503-bc11-db1b666231bb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1500 microversion: 2.1 time: 1.433969 Sep 16 14:25:56.652351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2635/5246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:55 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1500 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:56.670067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:56.674179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:56.697109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:56.698181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:56.698906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.703415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:56.704242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:56.705139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.785075 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a944c68a-5c09-4583-a969-670a01a5f176 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/ips" status: 200 len: 152 microversion: 2.20 time: 0.130395 Sep 16 14:25:56.789466 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2636/5247] 10.222.0.60 () {60 vars in 1289 bytes} [Fri Sep 16 14:25:56 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/ips => generated 152 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:25:56.797632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:56.806380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:56.814469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:56.815346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:56.816274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.817211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:56.818448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:56.819256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:56.896373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lazy-loading 'flavor' on Instance uuid 13a3871d-ef3a-4b39-9e6f-f8446fd3347f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:25:57.025016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:25:57.058828 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70056381-a5ee-4a85-b73b-29b47794281f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "POST /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f/action" status: 200 len: 32 microversion: 2.1 time: 0.267395 Sep 16 14:25:57.066777 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2637/5248] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:25:56 2022] POST /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:25:57.108490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:57.109669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:57.153220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:57.159080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:57.160216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:57.163092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:57.180555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:57.183233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:57.313730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:57.337777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25f56b5b-e48c-4c32-9835-06f38605f550 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.040283 Sep 16 14:25:57.347311 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2612/5249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:56 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:57.370021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:57.372972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:57.396891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:57.399841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:57.403452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:57.406446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:57.410021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:57.412674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:58.393481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:58.456916 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-183c07df-9247-4e82-bf09-d1a4ad2cb0e6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 1.378283 Sep 16 14:25:58.481537 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2638/5250] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:57 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:58.490967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:58.492412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:58.510568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:58.516270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:58.517333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:58.518384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:58.519196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:58.520414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:58.699696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:58.730493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dfd560be-d5dd-4f20-89ed-5b0499c3d9a1 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 1.378815 Sep 16 14:25:58.751343 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2613/5251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:57 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:59.047575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:25:59.074553 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e1c64b4-9d5c-4b0b-a42d-cf2eb1c49410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 0.602153 Sep 16 14:25:59.094379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2639/5252] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:58 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:25:59.506954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:59.511806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:59.569617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-978d765e-02bb-4dab-b926-23c5e1a4bce9 req-faf3eeb9-b012-459d-9c76-a9fd5a5cc78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893ffb64-04b3-40a6-8097-478208e750e8", "name": "network-vif-plugged", "status": "completed", "tag": "f394feef-5e7e-40d5-b884-0f7974377b42"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:25:59.570832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:59.571892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:59.572782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:59.576614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:59.582499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:59.586280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:59.606220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-978d765e-02bb-4dab-b926-23c5e1a4bce9 req-faf3eeb9-b012-459d-9c76-a9fd5a5cc78a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:59.608732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-978d765e-02bb-4dab-b926-23c5e1a4bce9 req-faf3eeb9-b012-459d-9c76-a9fd5a5cc78a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:59.609779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-978d765e-02bb-4dab-b926-23c5e1a4bce9 req-faf3eeb9-b012-459d-9c76-a9fd5a5cc78a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:59.648277 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-978d765e-02bb-4dab-b926-23c5e1a4bce9 req-faf3eeb9-b012-459d-9c76-a9fd5a5cc78a service nova] Creating event network-vif-plugged:f394feef-5e7e-40d5-b884-0f7974377b42 for instance 893ffb64-04b3-40a6-8097-478208e750e8 on n-h1-858129-2 Sep 16 14:25:59.654568 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-978d765e-02bb-4dab-b926-23c5e1a4bce9 req-faf3eeb9-b012-459d-9c76-a9fd5a5cc78a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089755 Sep 16 14:25:59.661570 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2640/5253] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:25:59.790377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:25:59.791498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:25:59.811283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:59.813303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:59.815301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:25:59.821868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:25:59.826165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:25:59.830210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:01.202944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:01.221381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b118759c-3990-4675-9e3b-cddc696449a9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 1.433443 Sep 16 14:26:01.226789 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2641/5254] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:59 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:01.232861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:01.237978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:01.261775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:01.262909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:01.263851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:01.264938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:01.265968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:01.266874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:01.317248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:01.384196 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-319a39c2-30d3-47b5-9114-d1133f3917c8 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 1.886508 Sep 16 14:26:01.389265 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2614/5255] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:25:59 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:01.901467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:01.902701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:01.932461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:01.936966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:01.941275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:01.946496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:01.947792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:01.953733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:02.099005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lazy-loading 'flavor' on Instance uuid a8abaf9c-8e3f-4a84-a560-ee024191b12d {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:26:02.288500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:02.319490 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f969039-6ddf-4dc3-81f2-4587e3dde6fc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 1.088021 Sep 16 14:26:02.337164 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2642/5256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:01 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:02.350826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:02.356567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:02.372420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:02.373365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:02.376999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:02.383225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:02.404991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:02.411997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:02.831311 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0a69714-d5a3-44ed-bb77-6666c522872d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/action" status: 202 len: 0 microversion: 2.20 time: 0.942011 Sep 16 14:26:02.838802 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2615/5257] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:26:01 2022] POST /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:26:02.888949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:02.892126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:02.952375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:02.952889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:02.953559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:02.957450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:02.959032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:02.965236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:03.113960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:03.134232 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0677d7ef-fa73-420b-8e96-c7e6bb587064 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1318 microversion: 2.1 time: 0.795675 Sep 16 14:26:03.150377 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2643/5258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:02 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:03.160301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:03.161891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:03.177993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:03.182593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:03.183368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:03.184365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:03.185016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:03.187812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:03.476524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:03.485022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:03.493311 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a84799b-6af4-4dc1-bb28-f56c96c80ebe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.647081 Sep 16 14:26:03.497938 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2616/5259] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:02 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:03.504127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:03.513301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:03.521385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:03.526817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:03.527575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:03.528638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:03.529316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:03.531997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:03.789099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:03.802627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:03.828932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:03.835455 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c25549ce-0fd7-4033-8c9c-ec26c7851858 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.683518 Sep 16 14:26:03.842456 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2644/5260] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:03 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:04.075346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:04.085763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4322fa3b-c4e2-460b-9972-95cd5ae611e3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 0.586253 Sep 16 14:26:04.099376 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2617/5261] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:03 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:04.160695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:04.161654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:04.180845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:04.181662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:04.182289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:04.183291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:04.183961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:04.184580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:04.535529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:04.547130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:04.597212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:04.600312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:04.607669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:04.616727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:04.619899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:04.623353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:05.357252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:05.372449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:05.374928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6859494a-342b-4882-859c-0ce6311edc9c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.859384 Sep 16 14:26:05.377127 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2618/5262] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:04 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:05.382870 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a7d75e6f-5416-4d51-b411-a414eeb83211 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1509 microversion: 2.1 time: 1.226379 Sep 16 14:26:05.383484 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2645/5263] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:04 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1509 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:05.388746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:05.394865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:05.406008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:05.412455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:05.413193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:05.414170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:05.416843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:05.417552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:05.426457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:05.428176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:05.446745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:05.448261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:05.449668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:05.451865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:05.453089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:05.454314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:05.899439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:05.912990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:05.914868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:05.919106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:05.920553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2c94558-6647-4dfd-a53e-abf65d2fa33c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.541322 Sep 16 14:26:05.921386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2619/5264] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:05 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:05.936122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:05.939477 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-18d05564-9db1-449c-9efe-d8592395d16c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1528 microversion: 2.1 time: 0.554310 Sep 16 14:26:05.940797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:05.947932 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2646/5265] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:05 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:05.959082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:05.959707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:05.960986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:05.962908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:05.963608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:05.967720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:06.406746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:06.407919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:06.428123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:06.430997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:06.432720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:06.435150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:06.437540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:06.439157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:06.865132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:06.879110 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f473f90b-be77-4676-88b1-c03c0990f04e tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1509 microversion: 2.1 time: 0.946957 Sep 16 14:26:06.880259 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2620/5266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:05 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1509 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:06.924703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:06.928213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:06.949832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:06.955250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:06.955975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:06.956962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:06.957627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:06.960938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:07.181726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:07.212438 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9899b034-885e-4312-8969-2ecd921b600b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.813259 Sep 16 14:26:07.248485 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2647/5267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:06 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:07.259260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:07.260371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:07.274549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:07.277118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:07.278469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:07.282778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:07.284111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:07.285512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:07.293065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a04fba5-3b3e-4141-b3c7-cf463c2a0662 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "PUT /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1081 microversion: 2.1 time: 0.371721 Sep 16 14:26:07.308964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2621/5268] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:26:06 2022] PUT /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1081 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:07.347231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:07.348421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:07.367406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:07.368823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:07.369897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:07.371907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:07.373206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:07.374372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:07.938738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:07.965937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9c57cb5-9380-45d9-84c7-38e765f03ce6 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1510 microversion: 2.1 time: 0.628745 Sep 16 14:26:07.984575 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2622/5269] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:07 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:08.013836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:08.016633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:08.028672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=56 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:08.031874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:08.035391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:08.062896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:08.070178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:08.071696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:08.072776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:08.486710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:08.528598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:08.536730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:08.543816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-72d4aa73-7904-42d3-bdbb-f4c6f75fc5ed tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 1.293273 Sep 16 14:26:08.550018 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2648/5270] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:07 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:08.575193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:08.576933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:08.597140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:08.598224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:08.599217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:08.604228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:08.606368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:08.609069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:08.974693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:08.995239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-852bbccc-505f-4a07-8996-18fae6a4fff5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1507 microversion: 2.1 time: 1.008235 Sep 16 14:26:08.997787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2623/5271] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:07 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1507 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:09.033645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:09.042988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:09.074637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:09.076274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:09.077692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:09.079984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:09.081416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:09.082703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:09.435069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:09.454264 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e04f18c-46d0-4cca-a432-cf70b2533935 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.901960 Sep 16 14:26:09.455709 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2649/5272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:08 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:09.463180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:09.467381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:09.490468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:09.492517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:09.492984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:09.493746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:09.494214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:09.499140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:09.914449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:09.923035 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7f6a4e41-3f9b-472c-830d-7b981638bdee tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1510 microversion: 2.1 time: 0.899321 Sep 16 14:26:09.930295 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2624/5273] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:09 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1510 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:09.935619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2f8f3feb-4455-4712-aa84-50ecb79f4fde req-be70fb2a-364a-4dd3-afd1-a143c3cceea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934b7a08-9fa8-431c-a6fa-6a255e516dbf", "name": "network-vif-unplugged", "status": "completed", "tag": "342f4453-24ce-4b24-b685-977cf8c2a703"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:09.961502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2f8f3feb-4455-4712-aa84-50ecb79f4fde req-be70fb2a-364a-4dd3-afd1-a143c3cceea4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:09.962342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2f8f3feb-4455-4712-aa84-50ecb79f4fde req-be70fb2a-364a-4dd3-afd1-a143c3cceea4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:09.962991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2f8f3feb-4455-4712-aa84-50ecb79f4fde req-be70fb2a-364a-4dd3-afd1-a143c3cceea4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:09.998254 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2f8f3feb-4455-4712-aa84-50ecb79f4fde req-be70fb2a-364a-4dd3-afd1-a143c3cceea4 service nova] Creating event network-vif-unplugged:342f4453-24ce-4b24-b685-977cf8c2a703 for instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf on n-h1-858129-2 Sep 16 14:26:10.008551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2f8f3feb-4455-4712-aa84-50ecb79f4fde req-be70fb2a-364a-4dd3-afd1-a143c3cceea4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076661 Sep 16 14:26:10.009497 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2625/5274] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:10.027701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:10.029042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:10.044627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.045490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.050661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.052401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.053087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.053725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.070765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:10.083447 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9891f70b-6baf-41d7-b4e6-7dde4ae8332d tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1507 microversion: 2.1 time: 0.625795 Sep 16 14:26:10.088334 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2650/5275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:09 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1507 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:10.149800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:10.163607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:10.178957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.181489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.182989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.184660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.185870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.187497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.400285 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-defd9d02-18c6-4eb2-b8a6-83a504ea6f6c tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "PUT /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1083 microversion: 2.1 time: 0.262027 Sep 16 14:26:10.422964 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2651/5276] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:26:10 2022] PUT /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1083 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:10.446740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:10.450937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:10.451820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:10.464554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:10.465570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.466080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:10.466342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.467399 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62ddbdb7-39f0-4c22-8baf-7d011baa5e8b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.455206 Sep 16 14:26:10.467825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.470547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2626/5277] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:10 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:10.480806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.481595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.482230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.505369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:10.506010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:10.516597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.517199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.517545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:10.518287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:10.518796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:10.519241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:11.115072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:11.135785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd3e1c64-2a64-4b3e-ab13-13759dc46bd9 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1509 microversion: 2.1 time: 0.708499 Sep 16 14:26:11.137448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2652/5278] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:10 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1509 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:11.152188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:11.154666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:11.165573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:11.187754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:11.190107 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e843fa2-3299-4c3c-a97b-89fef0e9c471 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.686162 Sep 16 14:26:11.191404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:11.192313 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2627/5279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:10 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:11.192981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:11.194522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:11.195328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:11.196040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:11.213676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:11.214328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:11.240757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:11.241007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:11.247263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:11.248948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:11.255834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:11.256577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.039119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:12.050874 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-863a73f9-abd3-4cd9-9300-8c3e2fa1c0ff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1510 microversion: 2.1 time: 0.911744 Sep 16 14:26:12.071895 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2653/5280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:11 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1510 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:12.077180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:12.081928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:12.100119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:12.100663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:12.101183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.105463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:12.106252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:12.106792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.110574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:12.128435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:12.137398 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a70e7b2-36b7-4758-bd3f-f513033a8eb2 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1509 microversion: 2.1 time: 0.939993 Sep 16 14:26:12.138019 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2628/5281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:11 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1509 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:12.172478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:12.173509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:12.190158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:12.190720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:12.191178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.193004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:12.193457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:12.193743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.271091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:26:12.514726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:12.526785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:12.528985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:12.530776 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab217a84-79f3-4153-a82e-a9413cf3ced3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.457647 Sep 16 14:26:12.532072 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2654/5282] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:12 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:12.536625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-927f0a5c-269a-4cc1-abda-7c07705912ea tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 204 len: 0 microversion: 2.1 time: 0.373189 Sep 16 14:26:12.538552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:12.539534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:12.540607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2629/5283] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:12 2022] DELETE /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:26:12.565809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:12.575819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:12.576941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.581480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:12.583160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:12.586211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:12.774104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-147317210", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "2629dcc7-43a8-4e47-b043-25fc848740ce"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:12.908118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] validate_networks() for [('2629dcc7-43a8-4e47-b043-25fc848740ce', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:26:13.571531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:13.600140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28328218-0b4e-458c-8892-b4f86b6350ef tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 1.064759 Sep 16 14:26:13.603040 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2655/5284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:12 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:13.620673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:13.621627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:13.633257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:13.634034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:13.634668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:13.636115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:13.636978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:13.637575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:13.713704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:26:13.850903 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.compute.api [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Instance is already in deleting state, ignoring this request Sep 16 14:26:13.872200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0cce0e0c-c04b-4dd4-8b92-38b08c1ecee5 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 204 len: 0 microversion: 2.1 time: 0.262162 Sep 16 14:26:13.877111 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2656/5285] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:13 2022] DELETE /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:26:13.887616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:13.889812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:13.915211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:13.919032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:13.923995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:13.929380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:13.931112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:13.933446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:14.332448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:14.347867 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36d33eb5-cff0-4d41-9fcf-587820b5c410 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1453 microversion: 2.1 time: 0.472984 Sep 16 14:26:14.349159 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2657/5286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:13 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1453 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:14.357530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:14.358164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:14.375639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:14.376486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:14.376929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:14.377732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:14.391269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:14.392079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:14.972809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:14.985404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:14.987073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:14.988332 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-356fbf5c-339e-4d5a-aa46-546d49683a4d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.637874 Sep 16 14:26:14.989245 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2658/5287] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:14 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:15.003116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:15.007912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:15.046809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.047734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.048369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.052575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.054143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.054854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.190364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:26:15.191697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:26:15.191697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:26:15.191697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:26:15.192430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:26:15.226668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.227748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.228381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.230149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.231067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.231731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.307800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Getting quotas for project ac964609a45b444db1419c07ce767173. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:26:15.320558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Getting quotas for user 2f3c6586414748c78809daff44d55938 and project ac964609a45b444db1419c07ce767173. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:26:15.363179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:26:15.369772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:26:15.461518 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b04ac58-f33c-4e99-a91c-33aaa0495f06 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.918983 Sep 16 14:26:15.462448 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2630/5288] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:26:15.468444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:15.469842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:15.479130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.480253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.481071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.482817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.483713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.484416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.555330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:15.564332 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d427e6f9-effb-494a-89f3-8518bebb82e7 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1515 microversion: 2.1 time: 0.573763 Sep 16 14:26:15.564947 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2659/5289] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:14 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1515 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:15.588298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:15.591335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:15.600550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.602496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.603503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.608896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:15.612627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:15.615938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:15.953222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:15.976123 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ca890c0-9093-4125-a2e2-e21cf1e04477 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1453 microversion: 2.1 time: 0.511690 Sep 16 14:26:15.980244 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2631/5290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:15 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1453 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:15.993040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4ebb815-3135-4a15-9e3a-91292d5512bd tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:15.994708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4ebb815-3135-4a15-9e3a-91292d5512bd tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:16.106266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:16.117112 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0355f61d-327a-4dcd-a0c7-f9db12728af9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.544965 Sep 16 14:26:16.117718 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2660/5291] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:15 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:16.125049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4ebb815-3135-4a15-9e3a-91292d5512bd tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:16.133952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:16.134565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:16.148075 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4ebb815-3135-4a15-9e3a-91292d5512bd tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1216 microversion: 2.1 time: 0.164511 Sep 16 14:26:16.153726 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2632/5292] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:15 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:16.166135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.166694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.167217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.167991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.170331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:16.171364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:16.179087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.179646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.191950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.193869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.194560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.195675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.196354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.197181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.271211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:16.352612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lazy-loading 'flavor' on Instance uuid 934b7a08-9fa8-431c-a6fa-6a255e516dbf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:26:16.395224 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'shelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state shelved_offloaded Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 14 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: {"shelve": {}} Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'shelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state shelved_offloaded Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'shelve': {}}} Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:26:16.397984 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state shelved_offloaded Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state shelved_offloaded Sep 16 14:26:16.404533 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:16.409518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'shelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state shelved_offloaded {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:16.411666 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-716f0036-a0d2-4d12-87d9-d88cd91c0644 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 155 microversion: 2.1 time: 0.256586 Sep 16 14:26:16.418110 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2633/5293] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:26:16 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 155 bytes in 262 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:26:16.429060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:16.435885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:16.449016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.453532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.454887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.457746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.459390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.460076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.565000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128642) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 14:26:16.735028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:16.760842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:16.770680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:16.771833 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab77a9a9-cf76-480f-b355-f7ca553bc677 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.349512 Sep 16 14:26:16.772510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2634/5294] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:26:16 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:26:16.778711 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ea3a9bf-80b1-43ed-8770-4e81e2cf0a48 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.658947 Sep 16 14:26:16.781385 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2661/5295] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:16 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:16.801194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-410481fd-175e-421c-ad12-6df97a8d1737 req-01002660-185c-408e-a9c1-76653a2284ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893ffb64-04b3-40a6-8097-478208e750e8", "name": "network-vif-deleted", "tag": "f394feef-5e7e-40d5-b884-0f7974377b42"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:16.809024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:16.811877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:16.843176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-410481fd-175e-421c-ad12-6df97a8d1737 req-01002660-185c-408e-a9c1-76653a2284ee service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.849023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-410481fd-175e-421c-ad12-6df97a8d1737 req-01002660-185c-408e-a9c1-76653a2284ee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.851452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.853217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-410481fd-175e-421c-ad12-6df97a8d1737 req-01002660-185c-408e-a9c1-76653a2284ee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.854658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.855263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.861949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.864898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.867834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.882487 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-410481fd-175e-421c-ad12-6df97a8d1737 req-01002660-185c-408e-a9c1-76653a2284ee service nova] Creating event network-vif-deleted:f394feef-5e7e-40d5-b884-0f7974377b42 for instance 893ffb64-04b3-40a6-8097-478208e750e8 on n-h1-858129-2 Sep 16 14:26:16.907570 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-410481fd-175e-421c-ad12-6df97a8d1737 req-01002660-185c-408e-a9c1-76653a2284ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123180 Sep 16 14:26:16.912653 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2635/5296] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:16.921880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:16.925992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:16.940342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.944598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.945583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.947320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.954047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.954937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.970320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:16.975197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:16.975197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:16.975771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lazy-loading 'fault' on Instance uuid 893ffb64-04b3-40a6-8097-478208e750e8 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:26:17.117542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000370dc2ad84f22940251ee1b08c0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c31e5d3722447b8d6f49585a19144e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:17.144126 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3aa88af0-8286-4be5-b957-76781d681b80 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 200 len: 1308 microversion: 2.1 time: 0.359156 Sep 16 14:26:17.159914 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2662/5297] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:16 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:17.191593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:17.195343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:17.213654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:17.217910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:17.218686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:17.219618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:17.220767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:17.223033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:17.807481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:17.819260 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a626924-f093-4154-9843-37ea5e95bcd8 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1461 microversion: 2.1 time: 0.904925 Sep 16 14:26:17.829426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:17.835548 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2636/5298] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:16 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1461 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:17.867677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:17.881562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:17.888303 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30a9ee63-8a62-42ef-8a09-cec12bb88b4f tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.726430 Sep 16 14:26:17.891702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2663/5299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:17 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:17.896533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:17.897084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:17.897538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:17.898392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:17.899048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:17.899372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:17.911665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:17.924015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:17.945102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:17.953975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:17.955366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:17.958498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:17.959306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:17.960260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.129335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:18.142714 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a10aa27-3745-458a-902a-028bf71f69f1 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1212 microversion: 2.1 time: 0.305114 Sep 16 14:26:18.160098 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2637/5300] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:17 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1212 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:18.173679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.174507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 893ffb64-04b3-40a6-8097-478208e750e8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.187691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.188939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.189632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.190882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.191652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.192907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.233624 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] HTTP exception thrown: Instance 893ffb64-04b3-40a6-8097-478208e750e8 could not be found. Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Request method failure captured: Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 HTTP/1.1 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIa2w8jUR4fBIMu_sCyu8UbLE_SS6IhVNa9LOnRKOUDS9PRKRW-fk9Nmq6WumwxaJ0Mqcv-Ug8GB1u0qvcKr6iXTcrK_0l7k8NfcEmW4PD821FWWHYU5N1yjCCywVb4XWKmpaPS6zhv-M602fQFho9SwmCzpxpiHkl6wFJmsa1A-VR4 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31c31e5d3722447b8d6f49585a19144e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}] Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 000370dc2ad84f22940251ee1b08c0a8 Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 893ffb64-04b3-40a6-8097-478208e750e8 could not be found. Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '893ffb64-04b3-40a6-8097-478208e750e8'} Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893ffb64-04b3-40a6-8097-478208e750e8 could not be found. Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893ffb64-04b3-40a6-8097-478208e750e8 could not be found. Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.241044 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893ffb64-04b3-40a6-8097-478208e750e8 could not be found. Sep 16 14:26:18.246159 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.252001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Returning 404 to user: Instance 893ffb64-04b3-40a6-8097-478208e750e8 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:18.253333 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fc573c43-1a1c-48dd-8cfc-9a1b78ef7d25 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8" status: 404 len: 111 microversion: 2.1 time: 0.084692 Sep 16 14:26:18.254562 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2638/5301] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:18 2022] GET /compute/v2.1/servers/893ffb64-04b3-40a6-8097-478208e750e8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:26:18.270124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.271554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.281425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.282257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.283016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.284218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.284914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.285452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.339230 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] HTTP exception thrown: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Request method failure captured: Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 HTTP/1.1 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIa2w8jUR4fBIMu_sCyu8UbLE_SS6IhVNa9LOnRKOUDS9PRKRW-fk9Nmq6WumwxaJ0Mqcv-Ug8GB1u0qvcKr6iXTcrK_0l7k8NfcEmW4PD821FWWHYU5N1yjCCywVb4XWKmpaPS6zhv-M602fQFho9SwmCzpxpiHkl6wFJmsa1A-VR4 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31c31e5d3722447b8d6f49585a19144e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}] Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 000370dc2ad84f22940251ee1b08c0a8 Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e4619fe9-8701-4a1a-ae30-7d6d00d828d8'} Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:18.341211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.346482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Returning 404 to user: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:18.348118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-949627ff-ca1e-48d4-b7c6-8723b61ace95 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 404 len: 111 microversion: 2.1 time: 0.087537 Sep 16 14:26:18.348959 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2639/5302] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:18 2022] DELETE /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:18.365042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.366536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: e4619fe9-8701-4a1a-ae30-7d6d00d828d8] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.380502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.381889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.382916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.384456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.388845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.389620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.414659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] HTTP exception thrown: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Request method failure captured: Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 HTTP/1.1 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIa2w8jUR4fBIMu_sCyu8UbLE_SS6IhVNa9LOnRKOUDS9PRKRW-fk9Nmq6WumwxaJ0Mqcv-Ug8GB1u0qvcKr6iXTcrK_0l7k8NfcEmW4PD821FWWHYU5N1yjCCywVb4XWKmpaPS6zhv-M602fQFho9SwmCzpxpiHkl6wFJmsa1A-VR4 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31c31e5d3722447b8d6f49585a19144e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}] Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 000370dc2ad84f22940251ee1b08c0a8 Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e4619fe9-8701-4a1a-ae30-7d6d00d828d8'} Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.416932 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. Sep 16 14:26:18.423866 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.428421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Returning 404 to user: Instance e4619fe9-8701-4a1a-ae30-7d6d00d828d8 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:18.430134 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a6e3928-2cb8-46ef-bd0e-0c6aca031210 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8" status: 404 len: 111 microversion: 2.1 time: 0.073274 Sep 16 14:26:18.434811 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2640/5303] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:18 2022] GET /compute/v2.1/servers/e4619fe9-8701-4a1a-ae30-7d6d00d828d8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:18.438875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:18.441265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.441829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.451946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.452550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.453196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.457109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.462135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.462135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.464510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:18.481640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:18.483063 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83b232c2-71cc-40bb-9f46-5c144a8c2ae0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.588218 Sep 16 14:26:18.487394 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2664/5304] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:17 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:18.496180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] HTTP exception thrown: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Request method failure captured: Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc HTTP/1.1 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIa2w8jUR4fBIMu_sCyu8UbLE_SS6IhVNa9LOnRKOUDS9PRKRW-fk9Nmq6WumwxaJ0Mqcv-Ug8GB1u0qvcKr6iXTcrK_0l7k8NfcEmW4PD821FWWHYU5N1yjCCywVb4XWKmpaPS6zhv-M602fQFho9SwmCzpxpiHkl6wFJmsa1A-VR4 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31c31e5d3722447b8d6f49585a19144e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}] Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 000370dc2ad84f22940251ee1b08c0a8 Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '808fa331-04a9-4998-987f-0dd30ba2bffc'} Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:18.497826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Returning 404 to user: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1587e25-7a30-4ccb-a489-780e971e72f0 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "DELETE /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 404 len: 111 microversion: 2.1 time: 0.063320 Sep 16 14:26:18.505429 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2641/5305] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:18 2022] DELETE /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:18.511353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.512043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] [instance: 808fa331-04a9-4998-987f-0dd30ba2bffc] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.524841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.526760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.527960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.529276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.530107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.530823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.559582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] HTTP exception thrown: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Request method failure captured: Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc HTTP/1.1 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIa2w8jUR4fBIMu_sCyu8UbLE_SS6IhVNa9LOnRKOUDS9PRKRW-fk9Nmq6WumwxaJ0Mqcv-Ug8GB1u0qvcKr6iXTcrK_0l7k8NfcEmW4PD821FWWHYU5N1yjCCywVb4XWKmpaPS6zhv-M602fQFho9SwmCzpxpiHkl6wFJmsa1A-VR4 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_31c31e5d3722447b8d6f49585a19144e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/31c31e5d3722447b8d6f49585a19144e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/31c31e5d3722447b8d6f49585a19144e"}]}] Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 31c31e5d3722447b8d6f49585a19144e Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1231892566 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 000370dc2ad84f22940251ee1b08c0a8 Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerDiskConfigTestJSON-1231892566-project Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '808fa331-04a9-4998-987f-0dd30ba2bffc'} Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:18.563295 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] Returning 404 to user: Instance 808fa331-04a9-4998-987f-0dd30ba2bffc could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:18.579184 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a25fd14c-0b21-41bc-8703-b1db21ceb193 tempest-ServerDiskConfigTestJSON-1231892566 tempest-ServerDiskConfigTestJSON-1231892566-project] 10.222.0.60 "GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc" status: 404 len: 111 microversion: 2.1 time: 0.069467 Sep 16 14:26:18.581556 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2665/5306] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:18 2022] GET /compute/v2.1/servers/808fa331-04a9-4998-987f-0dd30ba2bffc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:18.861722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.862664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.870138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.870681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.873868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.876805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.883095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.884643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.924956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:18.931797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:18.964151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.965014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.965771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:18.971373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:18.975084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:18.979193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:19.633868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:19.643679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bddbfa3b-ed19-4593-972e-3efefd26ef8b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1461 microversion: 2.1 time: 0.786258 Sep 16 14:26:19.644289 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2642/5307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:18 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1461 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:19.664070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:19.668611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:19.669252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:19.674813 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c6eae68c-b560-45f3-8273-e9e6e88f3410 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.758896 Sep 16 14:26:19.676064 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2666/5308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:18 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:19.682310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:19.683395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:19.684461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:19.684979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:19.688563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:19.689799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:19.692354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:19.693146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:19.693783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:19.694284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:19.694789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:19.695321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:19.695972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:19.696579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:19.977856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:19.995420 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72ecb745-7a30-4402-91ba-b61b2da770ad tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1274 microversion: 2.1 time: 0.336587 Sep 16 14:26:19.996752 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2643/5309] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:19 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1274 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:20.672514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:20.673636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:20.692500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:20.694815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:20.695784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:20.697554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:20.698837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:20.700040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:20.702989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:20.717897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:20.722114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:20.724936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bc4b1be-4189-4bad-ae6e-d53d3a0ef1a0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1743 microversion: 2.20 time: 1.047008 Sep 16 14:26:20.733623 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2667/5310] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:19 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1743 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:20.759775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:20.761360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:20.771296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:20.782777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:20.783987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:20.785057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:20.785532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:20.786578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:21.426467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:21.441048 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c3efc453-15bd-4427-9eaa-96708832b8c5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.705902 Sep 16 14:26:21.441664 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2668/5311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:20 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:21.459217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:21.460277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:21.471067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:21.471911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:21.472730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:21.475358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:21.476301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:21.476920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:21.485774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:21.519182 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71828b16-2e75-499a-9eb6-3cb15f87b2ac tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.851288 Sep 16 14:26:21.520832 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2644/5312] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:20 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:21.656708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:21.661476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:21.681453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be68c1f3-954e-4679-a18e-a847c58b80bf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1274 microversion: 2.1 time: 0.238548 Sep 16 14:26:21.684186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2669/5313] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:21 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:21.785476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:21.789653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:21.822824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:21.824288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:21.825522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:21.827324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:21.828626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:21.829832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:22.051085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5bbc2c34-c95c-4d35-bdb8-2d0d0974a9be req-6dfdf91b-e2ae-431d-9ed6-f2da5ec3732b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "name": "network-vif-plugged", "status": "completed", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:22.097432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=76 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:22.112474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5bbc2c34-c95c-4d35-bdb8-2d0d0974a9be req-6dfdf91b-e2ae-431d-9ed6-f2da5ec3732b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:22.114695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5bbc2c34-c95c-4d35-bdb8-2d0d0974a9be req-6dfdf91b-e2ae-431d-9ed6-f2da5ec3732b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:22.120818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5bbc2c34-c95c-4d35-bdb8-2d0d0974a9be req-6dfdf91b-e2ae-431d-9ed6-f2da5ec3732b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:22.162376 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5bbc2c34-c95c-4d35-bdb8-2d0d0974a9be req-6dfdf91b-e2ae-431d-9ed6-f2da5ec3732b service nova] Creating event network-vif-plugged:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:26:22.181982 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5bbc2c34-c95c-4d35-bdb8-2d0d0974a9be req-6dfdf91b-e2ae-431d-9ed6-f2da5ec3732b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132314 Sep 16 14:26:22.184234 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2670/5314] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:26:22.370796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:22.387990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:22.390279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:22.392046 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0582a997-84fe-4c9d-b3a8-a6b519cf9484 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1743 microversion: 2.20 time: 0.614155 Sep 16 14:26:22.393006 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2645/5315] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:21 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1743 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:22.478608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:22.480052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:22.494555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:22.496027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:22.497222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:22.498240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:22.499626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:22.500368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:22.550164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:22.557628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:22.590679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:22.600870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:22.602894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:22.604529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:22.613732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:22.623365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:23.471404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:23.490358 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4406f3f7-34c7-4620-9c69-3e490b04545b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 1.021307 Sep 16 14:26:23.498941 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2671/5316] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:22 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:23.514600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:23.522033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:23.542965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:23.546137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:23.547457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:23.548514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:23.549172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:23.549807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:23.576904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:23.606494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb5878f8-0159-41e3-8eb0-9b230b4d33eb tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.064349 Sep 16 14:26:23.608221 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2646/5317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:22 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:23.620539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:23.622330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:23.635128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:23.636915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:23.638158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:23.640599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:23.641806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:23.642963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:23.985962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:24.002130 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69c517cd-3fcd-469c-8d36-f20ea35a0872 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.509073 Sep 16 14:26:24.005466 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2672/5318] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:23 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:24.412795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:24.448940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:24.453520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:24.461664 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d87b810-2126-4737-b13d-850d68504f25 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1743 microversion: 2.20 time: 0.850416 Sep 16 14:26:24.465937 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2647/5319] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:23 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1743 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:24.538264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:24.539327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:24.568191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:24.576484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:24.578448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:24.581485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:24.583425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:24.585698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:24.639861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:24.641877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:24.665384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:24.670936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:24.671421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:24.672163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:24.672659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:24.680952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:25.266360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:25.968783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:25.980932 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c072368-8c79-4206-a4d6-8f0ccacc0e0d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 1.449849 Sep 16 14:26:25.984613 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2673/5320] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:24 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:25.991308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:25.992044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:26.003806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:26.007338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:26.008318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:26.009267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:26.009957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:26.016195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:26.145067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:26.159884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:26.228436 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-032bb309-62e6-42fb-b8a5-b2a6d054e7c7 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.589331 Sep 16 14:26:26.244062 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2648/5321] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:24 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:26.263703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:26.265986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:26.297141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:26.297872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:26.298327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:26.299156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:26.319507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:26.320556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:26.841204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:26.855369 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b708f3fa-b8ad-4cd4-841a-134443b634da tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.869412 Sep 16 14:26:26.856489 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2674/5322] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:25 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:27.030019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:27.030830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:27.042440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:27.045382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:27.049791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:27.051049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:27.052535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:27.058713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:27.064114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:27.074376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:27.078976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:27.091555 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9442aa3-2516-4024-9379-a8b292e8c243 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1743 microversion: 2.20 time: 0.842922 Sep 16 14:26:27.092734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2649/5323] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:26 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1743 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:27.285030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:27.289974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:27.347713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:27.362069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:27.365822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:27.371454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:27.403808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:27.406611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:27.630559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:27.665170 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca342b9a-6a9a-4054-929d-e2f3e45af8dd tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.639672 Sep 16 14:26:27.668148 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2675/5324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:27 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:27.882655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:27.883209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:27.901643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:27.911504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:27.914491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:27.916790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:27.924066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:27.930224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:28.470637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:28.504489 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da2c52b1-10ee-4812-9511-eab7ac596589 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.227540 Sep 16 14:26:28.505817 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2650/5325] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:27 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:28.559915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-753e1c4e-de5e-41e6-b92b-aaad1dde1827 req-0d7ffcaa-8ecd-404c-95a5-4bb822a9bf41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ba42f9-42b4-4e12-ae22-55b802707528", "tag": "41fd532a-4396-4ca9-83ce-1be50ffea773"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:28.597868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-753e1c4e-de5e-41e6-b92b-aaad1dde1827 req-0d7ffcaa-8ecd-404c-95a5-4bb822a9bf41 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:28.600369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-753e1c4e-de5e-41e6-b92b-aaad1dde1827 req-0d7ffcaa-8ecd-404c-95a5-4bb822a9bf41 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:28.608648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-753e1c4e-de5e-41e6-b92b-aaad1dde1827 req-0d7ffcaa-8ecd-404c-95a5-4bb822a9bf41 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:28.659385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-753e1c4e-de5e-41e6-b92b-aaad1dde1827 req-0d7ffcaa-8ecd-404c-95a5-4bb822a9bf41 service nova] Creating event network-changed:41fd532a-4396-4ca9-83ce-1be50ffea773 for instance 71ba42f9-42b4-4e12-ae22-55b802707528 on n-h2-858129-2 Sep 16 14:26:28.686263 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-753e1c4e-de5e-41e6-b92b-aaad1dde1827 req-0d7ffcaa-8ecd-404c-95a5-4bb822a9bf41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146064 Sep 16 14:26:28.688323 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2651/5326] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:28.718915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:28.720879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:28.749540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:28.750055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:28.750543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:28.756862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:28.757374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:28.757836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:29.764844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:29.777705 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-213dc3ff-9abc-44dc-9ab5-9fbd365d9e08 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 1.899880 Sep 16 14:26:29.780178 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2676/5327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:27 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:29.790429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:29.793465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:29.804587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:29.813874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:29.814484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:29.815276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:29.815916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:29.826838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:29.902049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:29.989179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:30.023299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:30.065476 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77954fd6-f588-49ac-bcf6-12f80037da86 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.339227 Sep 16 14:26:30.066880 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2652/5328] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:28 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:30.072884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:30.073794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:30.110170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:30.115258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:30.116014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:30.116994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:30.117679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:30.118492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:30.130815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:30.935320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:30.998966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e78c2b6b-9f29-40cf-b9b5-016bb56b61db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.929520 Sep 16 14:26:31.006995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2653/5329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:30 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:31.044707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:31.045897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:31.076716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.077629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.078796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.080608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.084115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.087104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.326715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:31.372868 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a98e1ac9-5872-4a13-85da-3c799f19a6d5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1486 microversion: 2.1 time: 1.590884 Sep 16 14:26:31.382945 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2677/5330] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:29 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1486 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:31.406192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:31.418488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:31.448477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:31.466889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.468503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.469964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.472138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.475439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.477794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-70054896-b6d5-40f0-90aa-b2d845decd8f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.468928 Sep 16 14:26:31.478638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.479861 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2654/5331] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:31 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:31.500482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:31.503641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:31.533256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.534918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.539571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.541351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.542597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.547446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.775742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-03b45906-e6b7-4cb2-86b3-71f7e4815497 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "POST /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f/action" status: 202 len: 0 microversion: 2.1 time: 0.291236 Sep 16 14:26:31.776489 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2655/5332] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:26:31 2022] POST /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:26:31.811008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:31.812399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:31.846027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.849471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.851463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:31.853299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:31.854161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:31.855168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:32.255680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:32.318662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:32.326034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:32.328832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c47117fb-8598-4c55-bb3d-0e6f866c7984 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.943920 Sep 16 14:26:32.331942 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2678/5333] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:31 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:32.343170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:32.348964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:32.372615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:32.373172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:32.373623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:32.377363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:32.379100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:32.381099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:32.909483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:32.928671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e96823d-3f88-4bb1-a9a6-2b243056344b tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1494 microversion: 2.1 time: 1.141010 Sep 16 14:26:32.940714 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2656/5334] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:31 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1494 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:32.959130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:32.961743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:32.982921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:32.985497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:32.994816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:33.004381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:33.005894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:33.006610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:33.109058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:33.141714 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-84f45d50-0258-4e7e-9fbc-55c1d2e21992 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.805706 Sep 16 14:26:33.148333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2679/5335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:32 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:33.383457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:33.387311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:33.418707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:33.420406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:33.423675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:33.430789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:33.433483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:33.440877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:33.910969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:33.939618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2affbe29-a06d-4881-913c-c2cfaf9183df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.996332 Sep 16 14:26:33.943033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2657/5336] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:32 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:33.965220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:33.968454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:33.996750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:34.001050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:34.004302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:34.006713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:34.010261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:34.011147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:35.172545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:35.187479 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5d3b9e64-fd0f-47a0-b2fd-33bfbca279f9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1494 microversion: 2.1 time: 1.228227 Sep 16 14:26:35.187479 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2658/5337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:33 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1494 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:35.206145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:35.235255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:35.254542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:35.256257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:35.269761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:35.279173 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ebfd399-939e-4680-9616-1071f9763c23 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.917716 Sep 16 14:26:35.285520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:35.306438 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2680/5338] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:33 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:35.306677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:35.311214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:35.314173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:35.315158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:35.315661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:35.316113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:35.339753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:35.341895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:35.377857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:35.377857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:35.377857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:35.377857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:35.377857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:35.385550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:36.129711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:36.155676 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e384e254-e804-41f0-b983-77ae7e99a80d tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.846893 Sep 16 14:26:36.166576 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2681/5339] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:35 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:36.215311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:36.240109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:36.241709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:36.245271 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-10499bcd-d072-46c6-9cec-a63bb20db522 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.047791 Sep 16 14:26:36.247412 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2659/5340] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:35 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:36.259368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:36.261217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:36.262227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:36.263368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:36.264007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:36.264799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:36.323544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:36.326335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:36.353945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:36.354585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:36.355116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:36.355951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:36.356482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:36.365038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:36.685189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:36.718459 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-511a2c82-00b4-4603-9f12-6e0b0adf49b5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1494 microversion: 2.1 time: 0.483922 Sep 16 14:26:36.736993 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2682/5341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:36 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1494 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:36.789139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:36.802749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:36.807805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:36.809443 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34d8f889-4059-458e-b816-e7d736f2c535 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.500150 Sep 16 14:26:36.813471 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2660/5342] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:36 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:37.201260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:37.208214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:37.236581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:37.239988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:37.244411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:37.250163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:37.253289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:37.254168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:37.276016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:37.276947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:37.291803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:37.292654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:37.294471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:37.297071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:37.298180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:37.300525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:38.053866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:38.082970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d10cde0-166b-426f-9631-42c1823ede6a tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.882058 Sep 16 14:26:38.086054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2683/5343] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:37 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:38.110071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:38.121384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:38.148338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:38.154889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:38.155534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:38.156542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:38.157557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:38.160087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:38.231348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:38.243743 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0cd5a2cc-a66d-4723-b7c4-26cd6630e4aa tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.974688 Sep 16 14:26:38.244984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2661/5344] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:37 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:38.268368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:38.273958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:38.308867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:38.319783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:38.320266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:38.321069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:38.321571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:38.322012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:38.657729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:38.680275 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6263b64b-a153-4edf-809b-f5a74fe0158e tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1494 microversion: 2.1 time: 0.592650 Sep 16 14:26:38.681234 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2684/5345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:38 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1494 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:38.697251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9135e76b-b841-434d-8c3f-fe05f5f57966 req-c9dbd7f2-83a0-4627-8152-17d7d88b1b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ba42f9-42b4-4e12-ae22-55b802707528", "name": "network-vif-plugged", "status": "completed", "tag": "41fd532a-4396-4ca9-83ce-1be50ffea773"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:38.746138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9135e76b-b841-434d-8c3f-fe05f5f57966 req-c9dbd7f2-83a0-4627-8152-17d7d88b1b62 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:38.746691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9135e76b-b841-434d-8c3f-fe05f5f57966 req-c9dbd7f2-83a0-4627-8152-17d7d88b1b62 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:38.747139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9135e76b-b841-434d-8c3f-fe05f5f57966 req-c9dbd7f2-83a0-4627-8152-17d7d88b1b62 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:38.801918 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9135e76b-b841-434d-8c3f-fe05f5f57966 req-c9dbd7f2-83a0-4627-8152-17d7d88b1b62 service nova] Creating event network-vif-plugged:41fd532a-4396-4ca9-83ce-1be50ffea773 for instance 71ba42f9-42b4-4e12-ae22-55b802707528 on n-h2-858129-2 Sep 16 14:26:38.815607 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9135e76b-b841-434d-8c3f-fe05f5f57966 req-c9dbd7f2-83a0-4627-8152-17d7d88b1b62 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131448 Sep 16 14:26:38.827444 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2685/5346] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:38.892353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:38.915053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:38.917070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:38.918428 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-295d52d5-4def-491d-96b0-ed90c1285bcb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.664321 Sep 16 14:26:38.919191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2662/5347] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:38 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:39.116707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:39.117485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:39.153523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:39.158565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:39.162889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:39.167429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:39.174476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:39.174997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:39.276731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:39.277520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:39.321778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:39.322512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:39.326466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:39.328149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:39.336515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:39.338233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.200888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:40.231041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6dddec9d-299b-4d3a-9568-e24ebe2752cc tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 1.120819 Sep 16 14:26:40.235130 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2686/5348] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:39 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:40.257727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:40.261648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:40.273027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:40.285394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:40.287843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:40.288684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.291675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:40.292624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:40.293427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.294979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f698161-fbe4-43db-bfd2-20c0d3f0b6db tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.027117 Sep 16 14:26:40.301719 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2663/5349] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:39 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:40.321126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:40.321978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:40.332930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:40.333204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:40.333491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.334229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:40.334726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:40.340616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.636978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:40.657190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:40.683823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:40.687479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:40.687859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:40.691118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-32c74527-10c4-4e01-b203-59376378a20c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.386692 Sep 16 14:26:40.694539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2664/5350] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:40 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:40.697807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f905b7d0-f9f1-410c-ac93-7af69f37a64c tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1500 microversion: 2.1 time: 0.460612 Sep 16 14:26:40.698470 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2687/5351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:40 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1500 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:40.774639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:40.776141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:40.809241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:40.810055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:40.810733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.815781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:40.816696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:40.817374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:40.881044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:26:41.110870 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e43f26a-e42a-459d-9548-b77ea2a8915d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 204 len: 0 microversion: 2.1 time: 0.356971 Sep 16 14:26:41.114682 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2665/5352] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:40 2022] DELETE /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:26:41.123154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:41.123983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:41.134512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.135703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.136343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.137368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.137828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.138456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.273405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:41.275447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:41.341362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.352354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.352966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.354267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.355355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.356342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.583751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:41.602825 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ddd10ff6-149e-4e20-995f-8142a59019d9 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.485128 Sep 16 14:26:41.608693 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2688/5353] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:41 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:41.638234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:41.639534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:41.671321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.672749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.673912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.676117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.677980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.679988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.747458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:41.769627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85189e72-e77f-485a-a055-27f2c37fcd43 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.503746 Sep 16 14:26:41.771708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2666/5354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:41 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:41.782460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:41.783933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:41.797593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.798943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.800033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.802225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:41.803181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:41.803953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:41.809443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:41.906190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:41.930457 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3678b1c9-bc0f-4631-b75f-a17a82f4042d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.307456 Sep 16 14:26:41.946438 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2689/5355] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:41 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:42.037271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:42.047286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:42.050332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:42.051668 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb54163a-daa6-42c0-8324-d1da426a9f6f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.278355 Sep 16 14:26:42.052248 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2667/5356] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:41 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:42.651556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:42.653116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:42.670309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:42.671245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:42.671887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:42.672851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:42.673503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:42.674167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:42.804998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:42.805905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:42.830747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:42.836048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:42.838912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:42.840158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:42.843009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:42.846615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:42.988301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:43.005354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1440de9-04d8-4581-9ebf-f7e4d696cc21 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 0.360419 Sep 16 14:26:43.021136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2690/5357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:42 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:43.036731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:43.037839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:43.053963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:43.056306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:43.057529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:43.059328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:43.060568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:43.061905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:43.357175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:43.373024 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1610b23-07f9-497c-aba0-0327c06abaaf tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1316 microversion: 2.1 time: 0.579064 Sep 16 14:26:43.385070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2668/5358] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:42 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:43.398917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:43.399551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:43.415686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:43.436201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:43.441142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:43.442933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:43.443870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:43.444645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:43.490296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:43.534203 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8cb9906-4dcf-47bc-8999-35e787fdd5d3 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.501889 Sep 16 14:26:43.534826 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2691/5359] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:43 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:44.037265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:44.038180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:44.047568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:44.048718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:44.049481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:44.050639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:44.052006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:44.053060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:44.528051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:44.563972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:44.567340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:44.576459 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf663501-3358-407c-97b4-35e2f2434d1d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.183159 Sep 16 14:26:44.611248 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2669/5360] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:43 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:44.651775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:44.660203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:44.699215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:44.700214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:44.701300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:44.702804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:44.709745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:44.716435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:45.757331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:45.768909 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0aac75ed-2162-46cb-aaea-8d582f4c98ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1506 microversion: 2.1 time: 1.738679 Sep 16 14:26:45.772457 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2692/5361] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:44 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1506 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:45.799203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:45.809714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:45.838185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:45.844551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:45.848632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:45.852198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:45.855944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:45.860379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:46.110906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:46.155765 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58a487eb-05d8-41bb-8bc9-4c3311eb549e tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1504 microversion: 2.1 time: 1.542417 Sep 16 14:26:46.188683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2670/5362] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:44 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1504 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:46.197544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:46.198547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:46.206063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:46.206899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:46.207611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:46.208853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:46.209789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:46.210431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:46.880680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:46.898690 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4329b85b-33e7-446d-987e-748c027b42c0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.123836 Sep 16 14:26:46.902672 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2693/5363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:45 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:46.912417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:46.913210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:46.923609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:46.924432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:46.925063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:46.925961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:46.926682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:46.927275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:46.989971 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41acffaf-60d7-44f8-9541-5f283540062f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528/ips" status: 200 len: 108 microversion: 2.1 time: 0.085038 Sep 16 14:26:46.991634 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2694/5364] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:26:46 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528/ips => generated 108 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:46.997840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-401ed58c-2759-40d5-b5d2-dd323e895db6 req-5da4a8ee-0b3e-489b-9d15-6cbca1eedcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a3871d-ef3a-4b39-9e6f-f8446fd3347f", "name": "network-vif-deleted", "tag": "d45e5a02-ae2d-4967-be2d-7932ed4ac976"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:47.033044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-401ed58c-2759-40d5-b5d2-dd323e895db6 req-5da4a8ee-0b3e-489b-9d15-6cbca1eedcee service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.033864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-401ed58c-2759-40d5-b5d2-dd323e895db6 req-5da4a8ee-0b3e-489b-9d15-6cbca1eedcee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.034799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-401ed58c-2759-40d5-b5d2-dd323e895db6 req-5da4a8ee-0b3e-489b-9d15-6cbca1eedcee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.051054 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-401ed58c-2759-40d5-b5d2-dd323e895db6 req-5da4a8ee-0b3e-489b-9d15-6cbca1eedcee service nova] Creating event network-vif-deleted:d45e5a02-ae2d-4967-be2d-7932ed4ac976 for instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f on n-h2-858129-2 Sep 16 14:26:47.078921 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-401ed58c-2759-40d5-b5d2-dd323e895db6 req-5da4a8ee-0b3e-489b-9d15-6cbca1eedcee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084449 Sep 16 14:26:47.080040 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2695/5365] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:47.099272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:47.102057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:47.128276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:47.128908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.129193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.130311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.131096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.131706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.133332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.179793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:47.184538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:47.203855 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-393ce0c8-bfaf-4e24-af94-4edb77fab4f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.002596 Sep 16 14:26:47.205061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2671/5366] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:46 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:47.243910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:47.245420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:47.248087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.252108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.256260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.259516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lazy-loading 'fault' on Instance uuid 13a3871d-ef3a-4b39-9e6f-f8446fd3347f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:26:47.281094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.282899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.284259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.296771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.301791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.303135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.398022 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7aede234-df04-43d1-9700-548c2f5da352 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528/ips" status: 200 len: 108 microversion: 2.1 time: 0.179781 Sep 16 14:26:47.400990 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2672/5367] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:26:47 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528/ips => generated 108 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:47.419218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:47.421045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:47.466529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.467632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.468196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.474517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.478429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.479272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.503791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:47.519203 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ce80271c-982e-48a2-a2e4-47e8be4f8bf6 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 200 len: 1304 microversion: 2.1 time: 0.437269 Sep 16 14:26:47.549336 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2696/5368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:47 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 1304 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:47.593839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01414b95-4bc8-4211-a975-87dbcd24e61f tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528/ips/tempest-ServerAddressesTestJSON-819442887-network" status: 200 len: 93 microversion: 2.1 time: 0.185404 Sep 16 14:26:47.597884 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2673/5369] 10.222.0.60 () {58 vars in 1398 bytes} [Fri Sep 16 14:26:47 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528/ips/tempest-ServerAddressesTestJSON-819442887-network => generated 93 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:26:47.607762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:47.608176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:47.627946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.628451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.628903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.637272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.638120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.638700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.695919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:26:47.938144 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67c16fc4-5677-4560-8fc5-b0beb56ddbba tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 204 len: 0 microversion: 2.1 time: 0.334668 Sep 16 14:26:47.939934 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2697/5370] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:47 2022] DELETE /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:26:47.951721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:47.952671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:47.977587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:47.978322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:47.990437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.990437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.990437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:47.990437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:47.990437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:47.990437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:48.000600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:48.005884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:48.006462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:48.010232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:48.017293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:48.022419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:48.968505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:49.004039 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e539532-879d-4870-8829-66e6950fa12b tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1510 microversion: 2.1 time: 1.051096 Sep 16 14:26:49.006488 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2674/5371] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:47 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1510 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:49.049389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:49.060297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:49.117229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:49.118289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.120417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.128712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.131532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.137389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.139994 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-716b516a-3923-4775-90c8-44be442caf59 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 1.185752 Sep 16 14:26:49.141049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.163311 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2698/5372] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:47 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:49.170026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:49.171872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 13a3871d-ef3a-4b39-9e6f-f8446fd3347f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:49.251394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.252865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.254139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.258531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.262700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.263575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.366519 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] HTTP exception thrown: Instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f could not be found. Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Request method failure captured: Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f HTTP/1.1 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIcU9cNCpcxtHWbpkrWV206FbUB3DQSSODBblQA-IZj7KO9smvMXaZErpdRp2T-DCemrC_H86TIeG8aBvv8QXKRvuosY02wSjcLDx9i4nWIp22d2zPyCE4Msi_XXWEjtNADq5LVS6IsuAsK9qgiZL3bEUV_5AQB56yUOiCxgfYWEzYw Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ae06c4ada55746289de65e12379de8d7 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueTestJSON-275429893 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ae06c4ada55746289de65e12379de8d7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae06c4ada55746289de65e12379de8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ae06c4ada55746289de65e12379de8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae06c4ada55746289de65e12379de8d7"}]}] Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueTestJSON-275429893 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ae06c4ada55746289de65e12379de8d7 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueTestJSON-275429893 Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueTestJSON-275429893-project Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 9e66569ee5124501a096d4201eabbd1a Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueTestJSON-275429893-project Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f could not be found. Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '13a3871d-ef3a-4b39-9e6f-f8446fd3347f'} Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f could not be found. Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f could not be found. Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:49.381879 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f could not be found. Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Returning 404 to user: Instance 13a3871d-ef3a-4b39-9e6f-f8446fd3347f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-275d1e47-2be5-4606-beb7-acacb02509a5 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f" status: 404 len: 111 microversion: 2.1 time: 0.219680 Sep 16 14:26:49.398048 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2699/5373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:49 2022] GET /compute/v2.1/servers/13a3871d-ef3a-4b39-9e6f-f8446fd3347f => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:49.417365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:49.418264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:49.445616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.459211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.460221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.461590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.472879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.474250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.688958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:26:49.821637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:49.833535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:49.835442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:49.837039 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98065465-ad27-4535-99b4-118ad99127f9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.805218 Sep 16 14:26:49.838516 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2675/5374] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:49 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:49.936453 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-51eaf38d-9599-4ae5-9776-6b55ff2f3bbe tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "DELETE /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 204 len: 0 microversion: 2.1 time: 0.534375 Sep 16 14:26:49.946008 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2700/5375] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:26:49 2022] DELETE /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:26:49.949301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:49.949945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:49.962025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.962576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.963014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:49.969159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:49.972473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:49.979527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:50.041824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:50.047370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:50.115982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:50.118808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:50.128255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:50.129984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:50.136451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:50.138942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:51.169691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:51.183423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3afe706-48f5-4887-9be3-f969c4a671ec tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1491 microversion: 2.1 time: 1.238014 Sep 16 14:26:51.208779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2676/5376] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:49 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1491 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:51.220127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:51.231271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:51.262687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:51.264187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:51.264969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:51.266040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:51.267166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:51.272219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:51.414675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:51.445340 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f73f1c2a-e2e7-48ea-b10e-77e53ab4b265 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1510 microversion: 2.1 time: 1.417890 Sep 16 14:26:51.450696 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2701/5377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:50 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1510 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:51.483076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:51.483834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:51.518648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:51.519183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:51.519639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:51.523083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:51.523600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:51.524045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:51.608280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:51.977521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:51.988939 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6184b05-3b32-424d-be69-5bc5ceba4d31 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.778592 Sep 16 14:26:51.989560 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2677/5378] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:51 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:52.003899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9c7748e1-5ab1-4129-ad56-edf00654d9c3 req-4662b602-b955-4071-967d-cb7c89a7de8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934b7a08-9fa8-431c-a6fa-6a255e516dbf", "name": "network-vif-plugged", "status": "completed", "tag": "342f4453-24ce-4b24-b685-977cf8c2a703"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:52.033284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c7748e1-5ab1-4129-ad56-edf00654d9c3 req-4662b602-b955-4071-967d-cb7c89a7de8e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.034357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c7748e1-5ab1-4129-ad56-edf00654d9c3 req-4662b602-b955-4071-967d-cb7c89a7de8e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.035083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c7748e1-5ab1-4129-ad56-edf00654d9c3 req-4662b602-b955-4071-967d-cb7c89a7de8e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.061065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9c7748e1-5ab1-4129-ad56-edf00654d9c3 req-4662b602-b955-4071-967d-cb7c89a7de8e service nova] Creating event network-vif-plugged:342f4453-24ce-4b24-b685-977cf8c2a703 for instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf on n-h1-858129-2 Sep 16 14:26:52.070113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9c7748e1-5ab1-4129-ad56-edf00654d9c3 req-4662b602-b955-4071-967d-cb7c89a7de8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069281 Sep 16 14:26:52.072404 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2678/5379] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:52.080324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0f962d23-da38-4378-890f-f98a49b7ccb9 req-c23a3c88-87de-414c-b177-06bcdaaa7268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ba42f9-42b4-4e12-ae22-55b802707528", "name": "network-vif-deleted", "tag": "41fd532a-4396-4ca9-83ce-1be50ffea773"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:52.093050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0f962d23-da38-4378-890f-f98a49b7ccb9 req-c23a3c88-87de-414c-b177-06bcdaaa7268 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.093929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0f962d23-da38-4378-890f-f98a49b7ccb9 req-c23a3c88-87de-414c-b177-06bcdaaa7268 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.094634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0f962d23-da38-4378-890f-f98a49b7ccb9 req-c23a3c88-87de-414c-b177-06bcdaaa7268 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.108106 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0f962d23-da38-4378-890f-f98a49b7ccb9 req-c23a3c88-87de-414c-b177-06bcdaaa7268 service nova] Creating event network-vif-deleted:41fd532a-4396-4ca9-83ce-1be50ffea773 for instance 71ba42f9-42b4-4e12-ae22-55b802707528 on n-h2-858129-2 Sep 16 14:26:52.115632 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0f962d23-da38-4378-890f-f98a49b7ccb9 req-c23a3c88-87de-414c-b177-06bcdaaa7268 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039526 Sep 16 14:26:52.116784 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2679/5380] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:52.216349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:52.217271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:52.232268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.232861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.233326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.238020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.239104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.239573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.342711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:52.358560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:52.362470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:52.364595 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7cb3672f-9699-4265-8f19-a85a0636ccac tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.911636 Sep 16 14:26:52.378603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2702/5381] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:51 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:52.515402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:52.527632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:52.532712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:26:52.545825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.546379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.548316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.549980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.550549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.552936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.674790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:52.678039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:52.679008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:52.682005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lazy-loading 'fault' on Instance uuid 71ba42f9-42b4-4e12-ae22-55b802707528 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:26:52.836103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:52.881284 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f56495b3-0cef-4e3e-98a6-ebef3605e9eb tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1491 microversion: 2.1 time: 0.667325 Sep 16 14:26:52.883286 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2680/5382] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:52 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1491 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:53.033932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:53.037316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:53.054930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:53.061402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:53.080121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f3c6586414748c78809daff44d55938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac964609a45b444db1419c07ce767173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:53.087019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:53.090269 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7786d5dc-7a32-4a32-9f84-45b8dadb89df tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 200 len: 1306 microversion: 2.1 time: 0.596509 Sep 16 14:26:53.092150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:53.094705 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2703/5383] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:52 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 1306 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:26:53.098782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:53.103043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:53.432025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:53.461888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:53.471780 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87947a27-4f58-4774-8806-1134cca71236 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.441821 Sep 16 14:26:53.478679 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2681/5384] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:53 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:53.783546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:53.802960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:53.804941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:53.806229 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-70030822-41cf-4b42-8cd8-53a5d58cb1a9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.417867 Sep 16 14:26:53.821471 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2704/5385] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:53 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:26:53.910909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:53.911548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:53.939878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:53.940590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:53.941047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:53.942365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:53.955289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:53.956248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:54.081641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1967719188", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "f2d70059-8c3e-4607-801a-3ea6501bbd67"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:54.273686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] validate_networks() for [('f2d70059-8c3e-4607-801a-3ea6501bbd67', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:26:54.694260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e66569ee5124501a096d4201eabbd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae06c4ada55746289de65e12379de8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:54.712486 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-700752f5-d236-4f31-9920-881b01e1a517 tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 200 len: 1491 microversion: 2.1 time: 0.808251 Sep 16 14:26:54.732626 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2705/5386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:53 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 1491 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:54.756402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:54.757388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] [instance: 71ba42f9-42b4-4e12-ae22-55b802707528] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:54.773217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:54.774024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:54.774731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:54.776000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:54.777142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:54.781727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:54.820917 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] HTTP exception thrown: Instance 71ba42f9-42b4-4e12-ae22-55b802707528 could not be found. Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Request method failure captured: Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 HTTP/1.1 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIeEI4strlTSJx1yYDCKsFE-sdYt4QxUt7lPXV8XKeoKa2KRZI8mZh-aJSSZ3icYK5ZGKu4U996ws9eohhEKGL5Q2vEPHhl9txBF2RqrAKW0ORYZfkC2rCJ89XTOnHYjWJ3dDXnaVIV3K6IJYPlolJBvfDzUEILsJNbndrTqzk1boLM Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ac964609a45b444db1419c07ce767173 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerAddressesTestJSON-621135959 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ac964609a45b444db1419c07ce767173", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac964609a45b444db1419c07ce767173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ac964609a45b444db1419c07ce767173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ac964609a45b444db1419c07ce767173"}]}] Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerAddressesTestJSON-621135959 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ac964609a45b444db1419c07ce767173 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerAddressesTestJSON-621135959 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerAddressesTestJSON-621135959-project Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2f3c6586414748c78809daff44d55938 Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerAddressesTestJSON-621135959-project Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 71ba42f9-42b4-4e12-ae22-55b802707528 could not be found. Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '71ba42f9-42b4-4e12-ae22-55b802707528'} Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ba42f9-42b4-4e12-ae22-55b802707528 could not be found. Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ba42f9-42b4-4e12-ae22-55b802707528 could not be found. Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:54.826958 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ba42f9-42b4-4e12-ae22-55b802707528 could not be found. Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] Returning 404 to user: Instance 71ba42f9-42b4-4e12-ae22-55b802707528 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:54.835417 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39f0d984-36e3-4d69-8c64-5509b614f6c0 tempest-ServerAddressesTestJSON-621135959 tempest-ServerAddressesTestJSON-621135959-project] 10.222.0.60 "GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528" status: 404 len: 111 microversion: 2.1 time: 0.087054 Sep 16 14:26:54.854787 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2706/5387] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:54 2022] GET /compute/v2.1/servers/71ba42f9-42b4-4e12-ae22-55b802707528 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:54.876289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:54.879795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:54.905972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:54.906985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:54.907800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:54.911629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:54.920730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:54.924095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:55.694145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:55.737322 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1e9d739-85bb-4f94-9b13-8267cdd20a67 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1519 microversion: 2.1 time: 0.880781 Sep 16 14:26:55.756500 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2707/5388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:54 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1519 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:55.781555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5dd17c66-7487-4d7f-8e97-23060add92eb req-c9c53be7-86be-4646-b1d9-506372472991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658b4840-76eb-42e7-b222-c10b0b84ec47", "name": "network-vif-deleted", "tag": "fa099d62-300c-40a6-9878-20983fd70326"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:26:55.847253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5dd17c66-7487-4d7f-8e97-23060add92eb req-c9c53be7-86be-4646-b1d9-506372472991 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:55.848631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5dd17c66-7487-4d7f-8e97-23060add92eb req-c9c53be7-86be-4646-b1d9-506372472991 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:55.849424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5dd17c66-7487-4d7f-8e97-23060add92eb req-c9c53be7-86be-4646-b1d9-506372472991 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:55.910327 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5dd17c66-7487-4d7f-8e97-23060add92eb req-c9c53be7-86be-4646-b1d9-506372472991 service nova] Creating event network-vif-deleted:fa099d62-300c-40a6-9878-20983fd70326 for instance 658b4840-76eb-42e7-b222-c10b0b84ec47 on n-h1-858129-2 Sep 16 14:26:55.940761 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5dd17c66-7487-4d7f-8e97-23060add92eb req-c9c53be7-86be-4646-b1d9-506372472991 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177778 Sep 16 14:26:55.943468 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2708/5389] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:26:56.003718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:56.009023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:56.037125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:26:56.038274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:26:56.039146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.039334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:26:56.039948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:26:56.040666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:26:56.041181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.041824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.043034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.043737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.045192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.083474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.083825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.084400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.088262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.088900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.091651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.196172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Getting quotas for project 760c0e2cb8ab4c958dd9fa01781aa78c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:26:56.218861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Getting quotas for user 3d2a93bc688942abaded9edc4bef242c and project 760c0e2cb8ab4c958dd9fa01781aa78c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:26:56.264869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:26:56.274754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:26:56.526282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:56.550969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:56.561990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:56.563363 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-420bc750-4bb3-46da-88d3-259af3d6463f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.606559 Sep 16 14:26:56.563996 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2709/5390] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:55 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:26:56.577054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:56.578927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] [instance: 658b4840-76eb-42e7-b222-c10b0b84ec47] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:56.600511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.609247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.615174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.616525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.617533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.618395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.654006 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] HTTP exception thrown: Instance 658b4840-76eb-42e7-b222-c10b0b84ec47 could not be found. Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Request method failure captured: Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 HTTP/1.1 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIcU9cNCpcxtHWbpkrWV206FbUB3DQSSODBblQA-IZj7KO9smvMXaZErpdRp2T-DCemrC_H86TIeG8aBvv8QXKRvuosY02wSjcLDx9i4nWIp22d2zPyCE4Msi_XXWEjtNADq5LVS6IsuAsK9qgiZL3bEUV_5AQB56yUOiCxgfYWEzYw Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ae06c4ada55746289de65e12379de8d7 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueTestJSON-275429893 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ae06c4ada55746289de65e12379de8d7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae06c4ada55746289de65e12379de8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ae06c4ada55746289de65e12379de8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae06c4ada55746289de65e12379de8d7"}]}] Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueTestJSON-275429893 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ae06c4ada55746289de65e12379de8d7 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueTestJSON-275429893 Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueTestJSON-275429893-project Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 9e66569ee5124501a096d4201eabbd1a Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueTestJSON-275429893-project Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 658b4840-76eb-42e7-b222-c10b0b84ec47 could not be found. Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '658b4840-76eb-42e7-b222-c10b0b84ec47'} Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 658b4840-76eb-42e7-b222-c10b0b84ec47 could not be found. Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 658b4840-76eb-42e7-b222-c10b0b84ec47 could not be found. Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:26:56.657277 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 658b4840-76eb-42e7-b222-c10b0b84ec47 could not be found. Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] Returning 404 to user: Instance 658b4840-76eb-42e7-b222-c10b0b84ec47 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:26:56.664848 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0ea7290-73b9-47be-a350-55fb994a694d tempest-ServerRescueTestJSON-275429893 tempest-ServerRescueTestJSON-275429893-project] 10.222.0.60 "GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47" status: 404 len: 111 microversion: 2.1 time: 0.097043 Sep 16 14:26:56.665606 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2710/5391] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:56 2022] GET /compute/v2.1/servers/658b4840-76eb-42e7-b222-c10b0b84ec47 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:26:56.697041 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9f5f632-22ab-42ce-93a1-70344e2b9faa tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.950858 Sep 16 14:26:56.698368 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2682/5392] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:26:56.715150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c032f1bb-f024-4d50-914e-0560b2b8f686 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:56.716944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c032f1bb-f024-4d50-914e-0560b2b8f686 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:56.789881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:56.791469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:56.836151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.855973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.861898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:56.865427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:56.872925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:56.876180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:57.073341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c032f1bb-f024-4d50-914e-0560b2b8f686 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:57.092406 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c032f1bb-f024-4d50-914e-0560b2b8f686 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1216 microversion: 2.1 time: 0.386574 Sep 16 14:26:57.123688 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2711/5393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:56 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1216 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:57.427973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:26:57.440645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5cc4aa3-b051-4e9d-8075-e7dbb9bca70f tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.659232 Sep 16 14:26:57.460666 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2683/5394] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:56 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:26:57.469259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:57.470093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:57.493111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:57.495614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:57.500240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:57.501120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:57.511173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:57.512194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:57.611148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:26:57.611825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:26:57.646062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:57.647062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:57.647793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:57.648818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:26:57.661793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:26:57.662838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:26:59.986524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:00.030709 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-07b97e2c-c743-47b7-a27e-937b2b497e52 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 2.563420 Sep 16 14:27:00.034639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2712/5395] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:26:57 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 2570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:00.058348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:00.064805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:00.119209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:00.124940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:00.126780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:00.132814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:00.135353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:00.137297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:00.323801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:00.358297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:00.360060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:00.361351 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a5f7dc06-2af1-4a5d-bca7-6da53ff71d6b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 2.754367 Sep 16 14:27:00.369008 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2684/5396] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:26:57 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 2761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:00.399308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:00.405946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:00.436497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:00.439002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:00.440512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:00.442843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:00.444249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:00.449452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:00.520453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:00.563138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-64c64986-6caf-4b30-b8ae-90be1dc526cf tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1268 microversion: 2.1 time: 0.521060 Sep 16 14:27:00.568671 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2713/5397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:00 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1268 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:01.284281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:01.297006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca19d8bc-138b-4ab9-8bd3-2e383dd5692d tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.926240 Sep 16 14:27:01.300777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2685/5398] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:00 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:01.361987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-14b346b4-79de-4db6-8963-8c1b5f49ceff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:01.385630 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-14b346b4-79de-4db6-8963-8c1b5f49ceff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 2ec096f4-8e7d-453c-922c-d5c1fe28cb1e has no mapping to a cell. Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-14b346b4-79de-4db6-8963-8c1b5f49ceff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/2ec096f4-8e7d-453c-922c-d5c1fe28cb1e/action HTTP/1.1 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 15 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: {"os-stop": {}} Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 2ec096f4-8e7d-453c-922c-d5c1fe28cb1e has no mapping to a cell. Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '2ec096f4-8e7d-453c-922c-d5c1fe28cb1e', 'body': {'os-stop': {}}} Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2ec096f4-8e7d-453c-922c-d5c1fe28cb1e has no mapping to a cell. Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:01.401213 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec096f4-8e7d-453c-922c-d5c1fe28cb1e has no mapping to a cell. Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec096f4-8e7d-453c-922c-d5c1fe28cb1e has no mapping to a cell. Sep 16 14:27:01.407108 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:01.420946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:01.422428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:01.423412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-14b346b4-79de-4db6-8963-8c1b5f49ceff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 2ec096f4-8e7d-453c-922c-d5c1fe28cb1e has no mapping to a cell. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:01.426653 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-14b346b4-79de-4db6-8963-8c1b5f49ceff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/2ec096f4-8e7d-453c-922c-d5c1fe28cb1e/action" status: 404 len: 117 microversion: 2.1 time: 0.081767 Sep 16 14:27:01.430986 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2714/5399] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:01 2022] POST /compute/v2.1/servers/2ec096f4-8e7d-453c-922c-d5c1fe28cb1e/action => generated 117 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:01.451425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:01.454133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:01.454581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:01.455553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:01.456581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:01.461349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:01.464230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:01.466747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:01.484180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:01.489911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:01.490584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:01.491477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:01.492079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:01.492658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:01.492794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:02.397420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:02.412514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:02.415407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:02.419988 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8943d704-d5fa-4d95-9fe6-6dd6135d1e0e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.007686 Sep 16 14:27:02.423613 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2686/5400] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:01 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:02.430307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:02.437337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:02.453682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:02.455839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:02.456576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:02.459439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:02.463145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:02.464027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:03.261170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:03.278132 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08926ccd-31b6-4d1e-a482-9e16a7ed9e3c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1274 microversion: 2.1 time: 0.852571 Sep 16 14:27:03.298237 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2687/5401] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:02 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1274 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:03.460561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:03.462089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:03.481988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:03.486562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:03.488311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:03.490066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:03.492200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:03.493654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:03.531883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:03.548061 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e471613c-0e2a-4333-bd6a-a933103f3295 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 2.112654 Sep 16 14:27:03.550768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2715/5402] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:01 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:03.579837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:03.581275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:03.594560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:03.595384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:03.598990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:03.600205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:03.600907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:03.601547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:04.758794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:04.778343 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-392e81ff-bfa3-48b1-8230-721c188feffc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 1.202210 Sep 16 14:27:04.779415 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2716/5403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:03 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:27:04.789316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:04.790241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:04.792484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:04.807146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:04.807850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:04.810066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:04.814963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:04.816032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:04.817567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:04.818298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:04.823033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:04.829138 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d51e6167-384f-4f40-87e1-7d0b4e9845a6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.373236 Sep 16 14:27:04.829816 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2688/5404] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:03 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:04.857471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0205e9d4-7080-40af-b50e-5841749e0a92 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:04.864100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0205e9d4-7080-40af-b50e-5841749e0a92 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 2614dde0-17d7-4290-8617-477173479573] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:04.903228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0205e9d4-7080-40af-b50e-5841749e0a92 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 2614dde0-17d7-4290-8617-477173479573 could not be found. Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0205e9d4-7080-40af-b50e-5841749e0a92 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/2614dde0-17d7-4290-8617-477173479573/action HTTP/1.1 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 15 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: {"suspend": {}} Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 2614dde0-17d7-4290-8617-477173479573 could not be found. Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '2614dde0-17d7-4290-8617-477173479573', 'body': {'suspend': {}}} Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2614dde0-17d7-4290-8617-477173479573 could not be found. Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2614dde0-17d7-4290-8617-477173479573 could not be found. Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:04.915350 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:04.920945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:04.920945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:04.920945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2614dde0-17d7-4290-8617-477173479573 could not be found. Sep 16 14:27:04.920945 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:04.925295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0205e9d4-7080-40af-b50e-5841749e0a92 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 2614dde0-17d7-4290-8617-477173479573 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:04.928169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0205e9d4-7080-40af-b50e-5841749e0a92 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/2614dde0-17d7-4290-8617-477173479573/action" status: 404 len: 111 microversion: 2.1 time: 0.091270 Sep 16 14:27:04.935431 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2689/5405] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:04 2022] POST /compute/v2.1/servers/2614dde0-17d7-4290-8617-477173479573/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:04.963055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:04.964431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:04.976886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:04.981477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:04.986233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:04.991486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:04.992219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:04.996252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:05.352125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:05.365802 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69436526-eb52-402e-b85c-a3ba975756be tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 0.584888 Sep 16 14:27:05.368967 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2717/5406] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:04 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:05.579607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:05.590899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-84cf077d-1f71-4f2e-839b-ab1f9bfa3f68 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.653962 Sep 16 14:27:05.596144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2690/5407] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:04 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:05.623647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:05.624663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:05.639925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:05.640801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:05.641454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:05.642483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:05.646204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:05.646798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:05.862872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:05.864976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:05.874484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:05.880615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:05.882113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:05.887527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:05.888766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:05.889855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:05.890635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:06.152244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:06.245723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:06.542169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:06.551286 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01739bf6-d6ba-41e8-a3ac-12399e8bbdff tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.931453 Sep 16 14:27:06.551925 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2718/5408] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:05 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:06.576979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e8084f1e-e90e-4c72-b48b-70b56aeb2b93 req-b5b841a2-cfd5-496b-8fba-af193446c05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf1e547-193b-4884-be59-a63475b68019", "tag": "26b8b0fe-02ee-4d70-bf4e-dc351cff5d75"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:06.616517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e8084f1e-e90e-4c72-b48b-70b56aeb2b93 req-b5b841a2-cfd5-496b-8fba-af193446c05c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:06.617415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e8084f1e-e90e-4c72-b48b-70b56aeb2b93 req-b5b841a2-cfd5-496b-8fba-af193446c05c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:06.618543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e8084f1e-e90e-4c72-b48b-70b56aeb2b93 req-b5b841a2-cfd5-496b-8fba-af193446c05c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:06.679613 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e8084f1e-e90e-4c72-b48b-70b56aeb2b93 req-b5b841a2-cfd5-496b-8fba-af193446c05c service nova] Creating event network-changed:26b8b0fe-02ee-4d70-bf4e-dc351cff5d75 for instance 3bf1e547-193b-4884-be59-a63475b68019 on n-h2-858129-2 Sep 16 14:27:06.695088 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e8084f1e-e90e-4c72-b48b-70b56aeb2b93 req-b5b841a2-cfd5-496b-8fba-af193446c05c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128665 Sep 16 14:27:06.699223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2719/5409] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:27:06.713077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:06.725456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:06.750864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:06.755425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:06.763316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:06.764856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:06.765903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:06.766972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:06.827664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:06.933414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:06.936181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:06.937852 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0cd0418-1df7-43f5-8df1-e21c03739af7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.079578 Sep 16 14:27:06.938896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2691/5410] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:05 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:06.955667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:06.956363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:06.988303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:06.997831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:07.003580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:07.016078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:07.016078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:07.016078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:07.092480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:07.119000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lazy-loading 'flavor' on Instance uuid 934b7a08-9fa8-431c-a6fa-6a255e516dbf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:27:07.381608 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0eab2679-8de1-42f8-ab58-b5e26230feaf tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.441098 Sep 16 14:27:07.384510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2692/5411] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:06 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:27:07.392167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:07.392888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:07.437144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:07.438287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:07.447361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:07.448497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:07.449225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:07.450883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:07.923290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:07.977958 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc15b640-ae04-4c3c-b089-d39c0036f990 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 1.276989 Sep 16 14:27:07.985048 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2720/5412] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:06 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:08.032807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:08.034272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:08.060366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:08.064123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:08.067177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:08.072147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:08.075737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:08.077806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:08.432342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:08.462191 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7bf05d8c-b513-462f-88e8-c9532da5b486 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1514 microversion: 2.1 time: 1.074424 Sep 16 14:27:08.474463 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2693/5413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:07 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1514 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:09.017098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:09.017737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:09.057861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:09.058384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:09.058875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:09.072882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:09.073605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:09.074072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:09.453876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:09.476642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:09.480947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:09.491112 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-04dd568d-ff4e-47c8-bbba-c4a78ea05e9e tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.489020 Sep 16 14:27:09.508288 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2721/5414] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:07 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:09.525724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:09.534070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:09.559297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:09.560302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:09.565231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:09.567160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:09.575965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:09.581474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:09.679529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:09.694223 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af14f5bf-03ea-4f4a-9e28-08bfca3f42ec tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 0.681309 Sep 16 14:27:09.721769 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2694/5415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:09 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:27:10.093880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:10.109429 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d789ecf-bd4a-46a9-87fb-0495c94b212a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1497 microversion: 2.1 time: 0.599015 Sep 16 14:27:10.114459 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2722/5416] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:09 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1497 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:10.139383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:10.140049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:10.162913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.168786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.178158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.190732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.192262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.196183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.425126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lazy-loading 'flavor' on Instance uuid 934b7a08-9fa8-431c-a6fa-6a255e516dbf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:27:10.481708 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'suspend' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state suspended Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 15 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: {"suspend": {}} Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'suspend' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state suspended Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'suspend': {}}} Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state suspended. Cannot suspend while the instance is in this state. Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 16 14:27:10.488442 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state suspended Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state suspended Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'suspend' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state suspended {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7823e394-0d00-4783-887d-d55236d38bed tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 148 microversion: 2.1 time: 0.356214 Sep 16 14:27:10.507647 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2695/5417] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:10 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 148 bytes in 361 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:27:10.513059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:10.513059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:10.526728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.529171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.529780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.530612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.531110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.536403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.536892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:10.537540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:10.548096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.548644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.549091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.549844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.582227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:10.590969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.601781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.789874 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f184fc74-98bf-4d62-802f-f598d42c7c70 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.284977 Sep 16 14:27:10.792589 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2723/5418] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:10 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:27:10.809662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:10.813558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:10.845476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.850541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.853381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:10.861579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:10.868861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:10.871144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:11.758649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:11.783206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:11.786027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:11.788196 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-807d8d1f-073f-4a40-bb8b-b46ff1e3c744 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.255080 Sep 16 14:27:11.803492 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2696/5419] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:10 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:11.824608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:11.825774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:11.846627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:11.849637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:11.851220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:11.852089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:11.852587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:11.853041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:12.203518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:12.213571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2015709a-80eb-4e4e-a118-9c4b9ff34626 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 1.418116 Sep 16 14:27:12.214186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2724/5420] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:10 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:12.712399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:12.726392 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-157a2c3f-4fe5-452f-a354-0ca4f0a15524 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1503 microversion: 2.1 time: 0.920845 Sep 16 14:27:12.734221 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2697/5421] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:11 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1503 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:12.832740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:12.833843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:12.846041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:12.851821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:12.852711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:12.853836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:12.856266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:12.857076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:13.239923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:13.240556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:13.258386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:13.259249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:13.259918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:13.260880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:13.261533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:13.262154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:14.140143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:14.153823 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31e89855-be64-49d0-b73d-c5d5c72d5b92 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 0.918312 Sep 16 14:27:14.162083 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2698/5422] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:13 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:14.324255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:14.337832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:14.345866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:14.351868 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4c82d06e-28b4-47a6-9d66-16003c4b1240 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.523215 Sep 16 14:27:14.355764 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2725/5423] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:12 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:14.895579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:14.897194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:14.911878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:14.913136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:14.917971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:14.919975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:14.923928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:14.924800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:15.183998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:15.185153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:15.233878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:15.239866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:15.245843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:15.249805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:15.256165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:15.261930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:15.323678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:15.334906 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44e392cb-56fd-4397-a3e6-04a34b7d1e82 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1503 microversion: 2.1 time: 1.171731 Sep 16 14:27:15.370578 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2699/5424] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:14 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1503 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:15.397954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:15.402324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:15.437644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:15.442003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:15.443644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:15.446899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:15.449111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:15.451132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:16.445344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:16.511142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:16.518922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:16.522169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28686e75-46e1-48b3-b111-97eb24f339c3 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 1.140022 Sep 16 14:27:16.539117 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2700/5425] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:15 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:16.556338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:16.557514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:16.595102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:16.598522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:16.599428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:16.611088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:16.612127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:16.612971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:16.913737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:16.934645 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9b6af6b4-2899-4153-9f3b-9de660595efb tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 1.756206 Sep 16 14:27:16.940038 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2726/5426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:15 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:16.994931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a7f1200b-fd21-49f6-a56e-f72bb56707d2 req-c73e539d-a934-4ea2-a52a-5b63e40937cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf1e547-193b-4884-be59-a63475b68019", "name": "network-vif-plugged", "status": "completed", "tag": "26b8b0fe-02ee-4d70-bf4e-dc351cff5d75"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:17.049775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a7f1200b-fd21-49f6-a56e-f72bb56707d2 req-c73e539d-a934-4ea2-a52a-5b63e40937cb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.052322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a7f1200b-fd21-49f6-a56e-f72bb56707d2 req-c73e539d-a934-4ea2-a52a-5b63e40937cb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.053131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a7f1200b-fd21-49f6-a56e-f72bb56707d2 req-c73e539d-a934-4ea2-a52a-5b63e40937cb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:17.110928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a7f1200b-fd21-49f6-a56e-f72bb56707d2 req-c73e539d-a934-4ea2-a52a-5b63e40937cb service nova] Creating event network-vif-plugged:26b8b0fe-02ee-4d70-bf4e-dc351cff5d75 for instance 3bf1e547-193b-4884-be59-a63475b68019 on n-h2-858129-2 Sep 16 14:27:17.126087 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a7f1200b-fd21-49f6-a56e-f72bb56707d2 req-c73e539d-a934-4ea2-a52a-5b63e40937cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138964 Sep 16 14:27:17.133211 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2727/5427] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:27:17.138004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:17.157426 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1d5940f-09d0-4a5e-b5d6-d8e0a838a00c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.616288 Sep 16 14:27:17.159334 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2701/5428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:16 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:17.189326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:17.196074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:17.250337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.251648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.252193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:17.255070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.256342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.270998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:17.563944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:17.566577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:17.606975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:17.621761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.624042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.626390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:17.632058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.633590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.637239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f144e4d-e3b8-4b47-9748-2ecfe12f8144 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.449121 Sep 16 14:27:17.649534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:17.651728 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2728/5429] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:17 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:17.680519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b23ecea0-b186-431e-8ccf-bef122b91e1c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:17.682435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b23ecea0-b186-431e-8ccf-bef122b91e1c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: e950c5ac-d066-4340-9cb1-13d5dd171d5a] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:17.711459 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b23ecea0-b186-431e-8ccf-bef122b91e1c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance e950c5ac-d066-4340-9cb1-13d5dd171d5a could not be found. Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b23ecea0-b186-431e-8ccf-bef122b91e1c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/e950c5ac-d066-4340-9cb1-13d5dd171d5a/action HTTP/1.1 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 15 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: {"unpause": {}} Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e950c5ac-d066-4340-9cb1-13d5dd171d5a could not be found. Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e950c5ac-d066-4340-9cb1-13d5dd171d5a', 'body': {'unpause': {}}} Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e950c5ac-d066-4340-9cb1-13d5dd171d5a could not be found. Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e950c5ac-d066-4340-9cb1-13d5dd171d5a could not be found. Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:17.714773 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:17.721340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:17.721340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:17.721340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e950c5ac-d066-4340-9cb1-13d5dd171d5a could not be found. Sep 16 14:27:17.721340 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:17.733814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b23ecea0-b186-431e-8ccf-bef122b91e1c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance e950c5ac-d066-4340-9cb1-13d5dd171d5a could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:17.735518 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b23ecea0-b186-431e-8ccf-bef122b91e1c tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/e950c5ac-d066-4340-9cb1-13d5dd171d5a/action" status: 404 len: 111 microversion: 2.1 time: 0.060813 Sep 16 14:27:17.736617 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2729/5430] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:17 2022] POST /compute/v2.1/servers/e950c5ac-d066-4340-9cb1-13d5dd171d5a/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:27:17.748645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:17.767909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:17.769082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:17.820647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.837849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.839269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:17.845554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:17.862892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:17.864773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.095334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:18.109761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:18.114965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:18.120802 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1410e6ea-4ae2-4e0a-937c-99fc98721060 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.562934 Sep 16 14:27:18.126209 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2702/5431] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:17 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:18.143797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:18.145448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:18.164001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.165111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.167602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.168736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.169217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.169656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.444433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:18.465911 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bbbfda48-dffb-4c15-83d7-583f458401d0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.707278 Sep 16 14:27:18.468897 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2730/5432] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:17 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:18.494823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:18.495424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:18.503663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.530252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.545962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.547381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.548067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.553592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:18.554046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.565607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-731d8ae2-5870-4033-b755-e558628a9129 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1316 microversion: 2.1 time: 0.437704 Sep 16 14:27:18.576927 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2703/5433] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:18 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:18.798272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:18.818159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f2b5ffd7-bbe6-4c10-9f3b-d6fdde84d48b tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.327204 Sep 16 14:27:18.835125 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2731/5434] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:18 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:18.860642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:18.862009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:18.878576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.880490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.881499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.883045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.884628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.885837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.953808 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'unpause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 15 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: {"unpause": {}} Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'unpause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'unpause': {}}} Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state active. Cannot unpause while the instance is in this state. Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:18.958368 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'unpause' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5cb480b0-fe58-4107-bd94-11f2d784e197 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 145 microversion: 2.1 time: 0.108220 Sep 16 14:27:18.972734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2704/5435] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:18 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 145 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:27:18.984122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:18.985517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:18.996551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:18.997067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:18.997720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:18.998884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.000628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.001534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.181203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:19.195383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:19.222418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.223271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.225960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.231603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.232467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.233203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.386262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:19.398656 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d4e7934-124b-497e-ba45-20da4a553533 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.422776 Sep 16 14:27:19.409056 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2732/5436] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:18 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:19.445807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:19.445807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:19.453911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.454437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.455098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.456035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.456698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.457529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.649215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:19.680071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:19.691061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:19.702839 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d113be3-9740-4cc8-b784-762329c6fcad tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.528950 Sep 16 14:27:19.703833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2705/5437] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:19 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:19.710216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:19.710863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:19.733428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.738325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.743133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.746486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.747840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.753478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.806273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:19.821637 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0efe7a2c-1c0d-4e94-ae7f-4ce80f721af0 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.378087 Sep 16 14:27:19.823679 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2733/5438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:19 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:27:19.853736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0f16debe-6220-439f-9999-e60626f30f3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:19.855949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0f16debe-6220-439f-9999-e60626f30f3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 75746882-e63e-493b-9d60-daf9f9c95a82] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:19.870867 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-0f16debe-6220-439f-9999-e60626f30f3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 75746882-e63e-493b-9d60-daf9f9c95a82 could not be found. Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0f16debe-6220-439f-9999-e60626f30f3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/75746882-e63e-493b-9d60-daf9f9c95a82/action HTTP/1.1 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 18 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: {"unshelve": null} Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 75746882-e63e-493b-9d60-daf9f9c95a82 could not be found. Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '75746882-e63e-493b-9d60-daf9f9c95a82', 'body': {'unshelve': None}} Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75746882-e63e-493b-9d60-daf9f9c95a82 could not be found. Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75746882-e63e-493b-9d60-daf9f9c95a82 could not be found. Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:19.880170 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75746882-e63e-493b-9d60-daf9f9c95a82 could not be found. Sep 16 14:27:19.886494 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:19.888791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0f16debe-6220-439f-9999-e60626f30f3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 75746882-e63e-493b-9d60-daf9f9c95a82 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:19.889953 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0f16debe-6220-439f-9999-e60626f30f3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/75746882-e63e-493b-9d60-daf9f9c95a82/action" status: 404 len: 111 microversion: 2.1 time: 0.043683 Sep 16 14:27:19.892513 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2734/5439] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:19 2022] POST /compute/v2.1/servers/75746882-e63e-493b-9d60-daf9f9c95a82/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:19.904256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:19.907223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:19.916613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.917581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.918291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:19.919365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:19.920108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:19.920809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:20.225062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:20.277469 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7885d8dc-7ba3-4804-a28c-ededbcfede46 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1504 microversion: 2.1 time: 0.569982 Sep 16 14:27:20.278160 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2706/5440] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:19 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:20.288078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:20.335138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-486712b1-7de4-43ef-a609-bb99907744f4 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.436047 Sep 16 14:27:20.337484 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2735/5441] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:19 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:20.352732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:20.354209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:20.374696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:20.379427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:20.380579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:20.381780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:20.382257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:20.383025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:20.545481 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de2b469f-07bb-4c63-b706-1956f71b07c9 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.204209 Sep 16 14:27:20.546619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2736/5442] 10.222.0.60 () {58 vars in 1296 bytes} [Fri Sep 16 14:27:20 2022] DELETE /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019/os-server-password => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:27:20.564688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:20.565464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:20.574913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:20.575757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:20.576920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:20.577947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:20.579080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:20.579896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:20.918472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:20.933891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e88723fa-7ce8-4865-85eb-e21b1d1c4eca tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.377970 Sep 16 14:27:20.950540 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2737/5443] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:20 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:20.959335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-408222796", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:20.963186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:20.963985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:20.972089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:20.972517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:20.974006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:20.975288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:20.976339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:20.977323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.012192 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c61d892b-9ab0-4a1c-a575-1275bdfdb32f tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.060525 Sep 16 14:27:21.014981 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2738/5444] 10.222.0.60 () {58 vars in 1293 bytes} [Fri Sep 16 14:27:20 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019/os-server-password => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:27:21.024819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:21.026793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:21.036776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.038782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.039539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.040578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.041570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.042220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.129803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:27:21.131130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:27:21.131661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:27:21.134803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:27:21.136729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:27:21.151847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.153341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.153916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.161674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.163580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.164931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.240447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Getting quotas for project 99e927b8b69441e4b9a73d33dabf629e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:27:21.247569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Getting quotas for user cd77e3e30e0243b69e8fee2438af9403 and project 99e927b8b69441e4b9a73d33dabf629e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:27:21.314519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:27:21.321431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:27:21.328836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:21.353331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:21.359775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:21.366467 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-346a1c78-399a-4f8e-9b0c-cd85f5af6cff tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1738 microversion: 2.20 time: 0.349603 Sep 16 14:27:21.370008 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2739/5445] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:21 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:21.390891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:21.391630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:21.415150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.415980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.416833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.418049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.420195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.422053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.471444 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14327292-640c-4386-9a2d-7ea16dcafeae tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.161499 Sep 16 14:27:21.474965 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2707/5446] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:27:21.489529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:21.491797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:21.527302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.529790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.531068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.532859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.534026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.535026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.569480 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Cannot 'unshelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action HTTP/1.1 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 18 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: {"unshelve": null} Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot 'unshelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'unshelve': None}} Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf in vm_state active. Cannot unshelve while the instance is in this state. Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:27:21.578678 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 409 to user: Cannot 'unshelve' instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf while it is in vm_state active {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:21.587836 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3ba229da-220b-4b24-877a-47efacb8d55a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action" status: 409 len: 146 microversion: 2.1 time: 0.211115 Sep 16 14:27:21.590506 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2740/5447] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:27:21 2022] POST /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf/action => generated 146 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:27:21.605563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f1fb123a-21bc-4418-a926-0ae2ba46af38 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:21.605874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:27:21.607760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f1fb123a-21bc-4418-a926-0ae2ba46af38 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:21.771117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f1fb123a-21bc-4418-a926-0ae2ba46af38 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:21.791626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f1fb123a-21bc-4418-a926-0ae2ba46af38 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:21.795004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f1fb123a-21bc-4418-a926-0ae2ba46af38 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:21.798573 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f1fb123a-21bc-4418-a926-0ae2ba46af38 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 200 len: 1277 microversion: 2.47 time: 0.205981 Sep 16 14:27:21.800542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2741/5448] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:21 2022] GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:21.803184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-60d880e2-45a2-46cc-bba5-1b4871882b5e tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 204 len: 0 microversion: 2.1 time: 0.326087 Sep 16 14:27:21.804935 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2708/5449] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:27:21 2022] DELETE /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:27:21.811037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:21.812311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:21.825785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:21.827460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:21.833276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.835291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.836414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.838973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.841385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.842135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.849089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:21.873120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.874547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.875722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:21.878023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:21.880877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:21.882635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.438258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:22.452942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97c9f3ae-6b2e-46b4-9147-f3f2f5a090d7 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1510 microversion: 2.1 time: 0.643051 Sep 16 14:27:22.458032 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2709/5450] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:21 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1510 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:22.469353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1380276861", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": "none"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:22.482151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:22.498111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8684e2b5-660a-4769-9ce6-3a326a640d77 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.695356 Sep 16 14:27:22.499201 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2742/5451] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:21 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:22.510531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:22.516411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:22.533547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:22.534706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:22.536126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.537927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:22.538712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:22.539332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.611361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:27:22.615155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:27:22.617051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:27:22.618290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:27:22.619636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:27:22.633263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:22.634082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:22.634743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.636034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:22.636694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:22.637325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.663495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Getting quotas for project 99e927b8b69441e4b9a73d33dabf629e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:27:22.670225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Getting quotas for user cd77e3e30e0243b69e8fee2438af9403 and project 99e927b8b69441e4b9a73d33dabf629e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:27:22.699960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:27:22.702865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:27:22.852111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:22.864297 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-90f14b81-08c4-4a2a-9f63-2f15a50fb28d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.403736 Sep 16 14:27:22.865513 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2710/5452] 10.222.0.60 () {62 vars in 1188 bytes} [Fri Sep 16 14:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 14:27:22.888575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:22.896064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:22.899439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:22.915305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:22.926019 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30dfcd46-a048-4d92-a912-ecc21b6be45d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1720 microversion: 2.20 time: 0.416437 Sep 16 14:27:22.947276 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2743/5453] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:22 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1720 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:22.977675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:22.978218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:22.983299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.984114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:22.984620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:22.985061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:22.989911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-734ba0d8-547b-447c-a6c4-8b43226194c5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:23.003173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-734ba0d8-547b-447c-a6c4-8b43226194c5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:23.024175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=88 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:23.144293 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-734ba0d8-547b-447c-a6c4-8b43226194c5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "PUT /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 992 microversion: 2.47 time: 0.194964 Sep 16 14:27:23.149751 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2744/5454] 10.222.0.60 () {62 vars in 1297 bytes} [Fri Sep 16 14:27:22 2022] PUT /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 992 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:27:23.167906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dab3b054-2d00-469f-a1da-ed907c5596e0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:23.171438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dab3b054-2d00-469f-a1da-ed907c5596e0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:23.375993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dab3b054-2d00-469f-a1da-ed907c5596e0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:23.392779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dab3b054-2d00-469f-a1da-ed907c5596e0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:23.399750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dab3b054-2d00-469f-a1da-ed907c5596e0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:23.403747 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dab3b054-2d00-469f-a1da-ed907c5596e0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1278 microversion: 2.47 time: 0.240018 Sep 16 14:27:23.415701 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2745/5455] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:23 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:23.496504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:23.510196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:23.511209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:23.528115 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4beab296-88f1-40e1-9abe-9f91e3ae10b2 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.656249 Sep 16 14:27:23.537220 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2711/5456] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:22 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:23.553315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:23.554194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:23.573542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:23.580884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:23.581504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:23.582521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed24cba1-20ec-460d-8905-f013b3210141 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2097169499_updated"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:23.584983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:23.588748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed24cba1-20ec-460d-8905-f013b3210141 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: a5c25829-97dd-40c6-9e36-a6839205ee1b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:23.614864 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ed24cba1-20ec-460d-8905-f013b3210141 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance a5c25829-97dd-40c6-9e36-a6839205ee1b could not be found. Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed24cba1-20ec-460d-8905-f013b3210141 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: request: PUT /compute/v2.1/servers/a5c25829-97dd-40c6-9e36-a6839205ee1b HTTP/1.1 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 81 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2097169499_updated"}} Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a5c25829-97dd-40c6-9e36-a6839205ee1b could not be found. Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a5c25829-97dd-40c6-9e36-a6839205ee1b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2097169499_updated'}}} Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c25829-97dd-40c6-9e36-a6839205ee1b could not be found. Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 16 14:27:23.635405 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c25829-97dd-40c6-9e36-a6839205ee1b could not be found. Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c25829-97dd-40c6-9e36-a6839205ee1b could not be found. Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed24cba1-20ec-460d-8905-f013b3210141 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance a5c25829-97dd-40c6-9e36-a6839205ee1b could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed24cba1-20ec-460d-8905-f013b3210141 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "PUT /compute/v2.1/servers/a5c25829-97dd-40c6-9e36-a6839205ee1b" status: 404 len: 111 microversion: 2.1 time: 0.063347 Sep 16 14:27:23.652215 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2712/5457] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:27:23 2022] PUT /compute/v2.1/servers/a5c25829-97dd-40c6-9e36-a6839205ee1b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:23.659253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:23.659253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:23.681440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:23.682993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:23.684907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:23.688048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:23.688894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:23.697827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:24.353714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:24.368691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:24.390862 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1581011-405d-4002-8673-8dfb7a3c391c tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1510 microversion: 2.1 time: 0.881919 Sep 16 14:27:24.414527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2746/5458] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:23 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1510 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:27:24.418639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-10997aff-1adc-4135-8fe5-e9909fe4c475 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.766286 Sep 16 14:27:24.419602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2713/5459] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:23 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:24.424903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:24.425873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:24.433711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:24.434452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:24.435093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:24.436026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:24.436707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:24.437298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:24.455918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:24.456888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:24.477089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:24.480342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:24.481834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:24.484738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:24.486521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:24.487326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:24.777528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:24.831239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:24.833088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:24.839609 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05e6d01b-ac96-41c3-957d-7e56405e5067 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1330 microversion: 2.47 time: 0.397920 Sep 16 14:27:24.840281 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2714/5460] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:24 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1330 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:24.853720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:24.854900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:24.874850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:24.876192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:24.881108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:24.885520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:24.886948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:24.888706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.020709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:25.039966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:25.041497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:25.050544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a32a281-c405-4b2f-990b-724a4be4e695 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1720 microversion: 2.20 time: 0.632282 Sep 16 14:27:25.051440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2747/5461] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:24 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1720 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:25.091782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-80fd35cc-bfe4-4f94-a2f5-01a3229678c3 req-0170e044-682d-4095-8570-c16d9ab3d2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "name": "network-vif-unplugged", "status": "completed", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:25.154375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80fd35cc-bfe4-4f94-a2f5-01a3229678c3 req-0170e044-682d-4095-8570-c16d9ab3d2ff service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.161346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80fd35cc-bfe4-4f94-a2f5-01a3229678c3 req-0170e044-682d-4095-8570-c16d9ab3d2ff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.162189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80fd35cc-bfe4-4f94-a2f5-01a3229678c3 req-0170e044-682d-4095-8570-c16d9ab3d2ff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.236597 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-80fd35cc-bfe4-4f94-a2f5-01a3229678c3 req-0170e044-682d-4095-8570-c16d9ab3d2ff service nova] Creating event network-vif-unplugged:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:27:25.256449 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-80fd35cc-bfe4-4f94-a2f5-01a3229678c3 req-0170e044-682d-4095-8570-c16d9ab3d2ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.195518 Sep 16 14:27:25.257824 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2748/5462] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:27:25.301518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:25.333574 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4609ca0a-8f36-45ed-903b-037a7e7168cc tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.488379 Sep 16 14:27:25.334935 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2715/5463] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:24 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:25.414123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-578147ee-9d7b-4cb2-bbe1-dc37b2edaad1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-578147ee-9d7b-4cb2-bbe1-dc37b2edaad1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: request: PUT /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf HTTP/1.1 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 280 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.454957 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 16 14:27:25.461833 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:27:25.466987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:25.466987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:25.467248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-578147ee-9d7b-4cb2-bbe1-dc37b2edaad1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:25.473136 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-578147ee-9d7b-4cb2-bbe1-dc37b2edaad1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "PUT /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 400 len: 619 microversion: 2.1 time: 0.076063 Sep 16 14:27:25.479940 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2749/5464] 10.222.0.60 () {60 vars in 1257 bytes} [Fri Sep 16 14:27:25 2022] PUT /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 619 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:27:25.505709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b9ed7bfe-d295-4524-a730-b5def0ab502e req-79098f82-ce4c-4c93-a519-1b6906559a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf1e547-193b-4884-be59-a63475b68019", "name": "network-vif-deleted", "tag": "26b8b0fe-02ee-4d70-bf4e-dc351cff5d75"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:25.513451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.524255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.530048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.532522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.540851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.543398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.585573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b9ed7bfe-d295-4524-a730-b5def0ab502e req-79098f82-ce4c-4c93-a519-1b6906559a5f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.591351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b9ed7bfe-d295-4524-a730-b5def0ab502e req-79098f82-ce4c-4c93-a519-1b6906559a5f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.593616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b9ed7bfe-d295-4524-a730-b5def0ab502e req-79098f82-ce4c-4c93-a519-1b6906559a5f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.636997 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b9ed7bfe-d295-4524-a730-b5def0ab502e req-79098f82-ce4c-4c93-a519-1b6906559a5f service nova] Creating event network-vif-deleted:26b8b0fe-02ee-4d70-bf4e-dc351cff5d75 for instance 3bf1e547-193b-4884-be59-a63475b68019 on n-h2-858129-2 Sep 16 14:27:25.649794 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b9ed7bfe-d295-4524-a730-b5def0ab502e req-79098f82-ce4c-4c93-a519-1b6906559a5f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163259 Sep 16 14:27:25.651103 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2750/5465] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:27:25.667611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:25.669640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:25.685661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.688274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.689958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.694237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.700741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.707891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.813661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:25.840163 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e5e7483c-c3c0-424e-9dba-f05a4b027311 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1468 microversion: 2.1 time: 0.403379 Sep 16 14:27:25.842080 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2716/5466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:25 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1468 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:25.878929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:25.883275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:25.950922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.951810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.966503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:25.969177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:25.970053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:25.970897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:26.304112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:26.315447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:26.322769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:26.326253 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f605412c-164f-49c0-8c25-13f69a8d82c8 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1338 microversion: 2.47 time: 0.460444 Sep 16 14:27:26.342731 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2717/5467] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:25 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1338 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:26.364371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:26.371717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:26.375685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:26.394815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:26.397294 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eaefa456-bed2-4a09-b475-73ad7ab5ea3a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.743603 Sep 16 14:27:26.399437 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2751/5468] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:25 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:26.402903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:26.404146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:26.406480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:26.407986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:26.409035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:26.447416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:26.449412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:26.462689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:26.464093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:26.465363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:26.466965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:26.468274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:26.469515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.370281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.380115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.392182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.393589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.395261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6c38f4f-9990-4767-a22d-979d14c50c65 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1720 microversion: 2.20 time: 1.048883 Sep 16 14:27:27.396425 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2718/5469] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:26 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1720 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:27.402975 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f08bd3e5-b2f7-43f4-b33c-220faa819fab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.962687 Sep 16 14:27:27.411909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:27.420017 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2752/5470] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:26 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:27:27.421200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:27.440900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.443496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.444733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.445660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.457160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.457693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.462390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:27.464906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:27.494065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.495521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.496796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.498865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.500069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.501291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.537831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.543736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.546508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.547218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lazy-loading 'fault' on Instance uuid 3bf1e547-193b-4884-be59-a63475b68019 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:27:27.622279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.626049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:27.684291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-778495f5-eb39-4f29-ab96-ec87055c31cc tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1306 microversion: 2.1 time: 0.281509 Sep 16 14:27:27.713760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2719/5471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:27 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1306 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:27.728148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.749297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1e5efab-39e9-4fc5-8c5f-9c8726530403 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:27.761006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1e5efab-39e9-4fc5-8c5f-9c8726530403 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: request: PUT /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf HTTP/1.1 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 24 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: {"server": {"name": ""}} Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf', 'body': {'server': {'name': ''}}} Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '' Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 14:27:27.766083 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1e5efab-39e9-4fc5-8c5f-9c8726530403 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1e5efab-39e9-4fc5-8c5f-9c8726530403 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "PUT /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 400 len: 108 microversion: 2.1 time: 0.052522 Sep 16 14:27:27.774991 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2720/5472] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:27:27 2022] PUT /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 108 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:27:27.776495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:27.781233 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-321f1332-f8c4-47e6-9b10-bf49e00e1c02 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1336 microversion: 2.47 time: 0.358427 Sep 16 14:27:27.783666 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2753/5473] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:27 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1336 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:27.826674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:27.827532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:27.851548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.852079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.852525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:27.853312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:27.867260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:27.869228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:28.210694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:28.229432 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e6738cb-27e6-48ce-980d-8c3f175376ef tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1506 microversion: 2.1 time: 0.449022 Sep 16 14:27:28.253385 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2721/5474] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:27 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:28.447629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:28.449270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:28.464694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:28.467255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:28.468293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:28.469794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:28.470878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:28.471870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:28.739894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:28.744062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:28.784924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:28.788521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:28.792118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:28.796812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:28.799179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:28.804457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:28.897757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:28.898730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:28.899926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:28.900988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lazy-loading 'fault' on Instance uuid 3bf1e547-193b-4884-be59-a63475b68019 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:27:29.032516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.077487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.087221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.088858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2645ce9c-7854-491c-92ec-ed3377e47f11 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1723 microversion: 2.20 time: 0.650511 Sep 16 14:27:29.091464 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2754/5475] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:28 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1723 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:29.096676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:29.104754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:29.124271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:29.128175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:29.133278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:29.134611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:29.138200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:29.139006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:29.148494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.166080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a2f41701-5551-4fc7-8029-3059b92bf488 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1306 microversion: 2.1 time: 0.439949 Sep 16 14:27:29.167168 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2722/5476] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:28 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1306 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:29.174887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "903b74de-9382-4c89-b418-206a4c0a01fb"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:29.179528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:29.186334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:29.188122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:29.188811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:29.190222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:29.191278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:29.191998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:29.192681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:29.278250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.295711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.297934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:29.299409 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35ebca50-1339-45ed-b08e-1f8760b26b3f tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1336 microversion: 2.47 time: 0.206674 Sep 16 14:27:29.306454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2755/5477] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:29 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1336 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:30.086268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02d7e1dd-8a85-4f34-a31d-f0f715132f43 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.913780 Sep 16 14:27:30.091862 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2723/5478] 10.222.0.60 () {62 vars in 1364 bytes} [Fri Sep 16 14:27:29 2022] POST /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-volume_attachments => generated 188 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:27:30.218062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:30.218871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:30.230706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.231209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.231655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:30.248133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.248791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.249250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:30.333201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:30.334327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:30.356016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.356016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.356441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:30.357041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.357513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.358469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:30.494532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.495633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.507015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:30.508129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lazy-loading 'fault' on Instance uuid 3bf1e547-193b-4884-be59-a63475b68019 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:27:30.674226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:30.723159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-893c2a2a-90a3-4c5e-ace9-dc823bb05a35 tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1306 microversion: 2.1 time: 0.508316 Sep 16 14:27:30.730491 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2756/5479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:30 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1306 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:30.751568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:30.753263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:30.775452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.780174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.783575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:30.785894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:30.788604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:30.792092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:31.222569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:31.237807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:31.244559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:31.246153 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d2a4995-c87c-4cd8-afa6-70efbb5aef01 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1336 microversion: 2.47 time: 0.917192 Sep 16 14:27:31.250645 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2724/5480] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:30 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1336 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:31.682428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-734d96cf-e9ab-40d9-a8a4-2c18bd30c079 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-volume_attachments/903b74de-9382-4c89-b418-206a4c0a01fb" status: 202 len: 0 microversion: 2.20 time: 0.949800 Sep 16 14:27:31.708919 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2757/5481] 10.222.0.60 () {60 vars in 1457 bytes} [Fri Sep 16 14:27:30 2022] DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-volume_attachments/903b74de-9382-4c89-b418-206a4c0a01fb => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:27:31.775124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:31.775856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:31.807119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:31.810621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:31.812220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:31.819309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:31.823741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:31.830289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:31.848316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:31.849269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:31.864504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:31.866539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:31.867684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:31.872759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:31.873484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:31.879136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:32.007563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 14:27:32.019146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:32.020190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:32.020677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:32.021161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lazy-loading 'fault' on Instance uuid 3bf1e547-193b-4884-be59-a63475b68019 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:27:32.198171 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-99d317a7-873c-4583-9a95-d17105b800d8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "POST /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/action" status: 202 len: 0 microversion: 2.20 time: 0.352803 Sep 16 14:27:32.200304 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2758/5482] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:27:31 2022] POST /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:27:32.212689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:32.213324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:32.232342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2a93bc688942abaded9edc4bef242c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760c0e2cb8ab4c958dd9fa01781aa78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.251113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:32.251724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:32.252184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:32.253297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:32.262383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:32.262984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:32.300504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:32.332862 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-edbaf724-10c5-4945-b642-6a4770b0683b tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 200 len: 1306 microversion: 2.1 time: 0.541837 Sep 16 14:27:32.341338 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2725/5483] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:31 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 1306 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:32.393861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:32.400009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:32.437654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:32.439169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:32.445011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:32.448275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:32.448939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:32.449564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:32.653068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:32.682614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:32.685903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.773736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.791944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.813527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c5d96ca6-48bf-4c74-bd5a-5abb980628f2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1671 microversion: 2.20 time: 0.605149 Sep 16 14:27:32.818366 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2759/5484] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:32 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1671 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:32.889763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.944052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.946089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:32.948050 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-218d1c1c-1f29-4344-ac2c-b007b377e84c tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1357 microversion: 2.47 time: 0.604735 Sep 16 14:27:32.949240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2726/5485] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:32 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1357 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:33.009934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:33.014057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:33.038216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.038819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.039275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.040025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.040495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.040936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.324331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:27:33.328808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:27:33.329549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:27:33.330446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:27:33.331024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:27:33.362969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:33.363732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] [instance: 3bf1e547-193b-4884-be59-a63475b68019] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:33.375560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.383306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.384177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.385428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.389873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.390577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.426680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] HTTP exception thrown: Instance 3bf1e547-193b-4884-be59-a63475b68019 could not be found. Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Request method failure captured: Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 HTTP/1.1 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIetCbeGD1WOjOm7vpOcpGgibM53DqnUSff7K1At-L7Ij2cEyVtGZmomJUEDwWRGEHrkFZ-7-R2z8G1tMBoFLZeSwidyXi9FGRSN_j8LdDAou_IKdjiFyZ3QFOy0Bzom8SMf9u54cDC0igDx_gvwrDXb-vBrSQqiUQ_3YKef3e092nM Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 760c0e2cb8ab4c958dd9fa01781aa78c Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerPasswordTestJSON-1960207061 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_760c0e2cb8ab4c958dd9fa01781aa78c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/760c0e2cb8ab4c958dd9fa01781aa78c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/760c0e2cb8ab4c958dd9fa01781aa78c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/760c0e2cb8ab4c958dd9fa01781aa78c"}]}] Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerPasswordTestJSON-1960207061 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 760c0e2cb8ab4c958dd9fa01781aa78c Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1960207061 Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerPasswordTestJSON-1960207061-project Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3d2a93bc688942abaded9edc4bef242c Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerPasswordTestJSON-1960207061-project Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 3bf1e547-193b-4884-be59-a63475b68019 could not be found. Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3bf1e547-193b-4884-be59-a63475b68019'} Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf1e547-193b-4884-be59-a63475b68019 could not be found. Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf1e547-193b-4884-be59-a63475b68019 could not be found. Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:33.428550 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf1e547-193b-4884-be59-a63475b68019 could not be found. Sep 16 14:27:33.431763 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:33.433212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] Returning 404 to user: Instance 3bf1e547-193b-4884-be59-a63475b68019 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:33.434265 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-091f68e5-02c3-4a42-9397-7b364582d10d tempest-ServerPasswordTestJSON-1960207061 tempest-ServerPasswordTestJSON-1960207061-project] 10.222.0.60 "GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019" status: 404 len: 111 microversion: 2.1 time: 0.076777 Sep 16 14:27:33.436161 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2727/5486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:33 2022] GET /compute/v2.1/servers/3bf1e547-193b-4884-be59-a63475b68019 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:27:33.468748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:33.546116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:33.559497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.561610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.565829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.567945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.569240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.571219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.658761 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a7ced174-2cfa-42d7-9d3b-67bcd76b8e03 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "POST /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977/action" status: 202 len: 1079 microversion: 2.47 time: 0.653039 Sep 16 14:27:33.664081 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2760/5487] 10.222.0.60 () {62 vars in 1319 bytes} [Fri Sep 16 14:27:33 2022] POST /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977/action => generated 1079 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 16 14:27:33.711995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:33.712921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:33.721485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.721993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.722512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.723292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.723775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.724220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.865560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:33.866498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:33.883971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.886141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.890155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:33.898725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:33.899772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:33.900382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:35.600897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:35.615113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:35.636286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:35.637720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43d0edec-15b1-4435-9d02-d631cfcec778 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 1.932959 Sep 16 14:27:35.638339 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2728/5488] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:33 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:36.090185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366933223", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:36.225084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] validate_networks() for [('9de475fd-2eba-43da-ba4e-a6068fb30e9c', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:27:36.866440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:36.898863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:36.904193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:36.915537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c85b9325-2020-444a-96d8-dbc291f714e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1671 microversion: 2.20 time: 3.054368 Sep 16 14:27:36.920171 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2761/5489] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:33 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1671 bytes in 3061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:36.939480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:36.940333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:37.001993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:37.005593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:37.009639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:37.014948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:37.016240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:37.023234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:37.403183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:37.429744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:37.445608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:37.448317 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21b9dc1f-264b-48bf-8ea8-b80c85f11776 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.518189 Sep 16 14:27:37.462436 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2762/5490] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:36 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:37.971046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:37.972664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:37.987027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:37.991973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:37.992788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:37.993761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:37.996550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:37.997281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:39.023379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:39.073118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:39.077401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:39.079951 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a6801dc-1b02-4e49-9998-9436ba9e10cb tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 1.112775 Sep 16 14:27:39.086973 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2763/5491] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:37 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:39.105832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:39.107420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:39.138093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:39.139528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:39.140449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:39.143925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:39.150308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:39.151352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:39.348044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:39.369837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:27:39.371027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:27:39.372283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:27:39.373402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:27:39.374551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:27:39.387858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:39.392254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:39.400164 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d69b89cf-630a-45f4-97c1-bb13b4868da2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.310663 Sep 16 14:27:39.402138 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2764/5492] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:39 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:39.429355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:39.430070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:39.430870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:39.432275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:39.433142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:39.433929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:39.521528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for project e04d4359a23549d587d9bf8ea9638abd. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:27:39.554290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for user b4ffd42c93ac48329b0e1a8b3baf0a36 and project e04d4359a23549d587d9bf8ea9638abd. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:27:39.615718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:27:39.627292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:27:39.841978 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-32760516-b14c-40e2-b554-c1c1a84d4a91 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.999499 Sep 16 14:27:39.858907 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2729/5493] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:27:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 4018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:27:39.866367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ffb39c5d-5c61-49c4-aa8a-710ac314af49 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:39.867595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ffb39c5d-5c61-49c4-aa8a-710ac314af49 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:40.127721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ffb39c5d-5c61-49c4-aa8a-710ac314af49 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:40.152636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:40.154463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:40.189360 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ffb39c5d-5c61-49c4-aa8a-710ac314af49 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1221 microversion: 2.1 time: 0.330673 Sep 16 14:27:40.226792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:40.226792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:40.226792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:40.226792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:40.226792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:40.227527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2765/5494] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:39 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1221 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:40.248649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:40.417569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-475888347", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:41.181792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:41.250286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:41.255603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:41.257762 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-afa22b5e-c4ea-4a1c-b4b9-cf109399dffd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 1.125036 Sep 16 14:27:41.272736 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2730/5495] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:40 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:41.287791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:41.300670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:41.340128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:41.344892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:41.350282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:41.359598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:41.372420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:41.373420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:41.790140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:41.818855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:41.837821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:41.850751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1f380b8-bb4f-421e-a27c-d2e89a63771a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.576148 Sep 16 14:27:41.856153 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2731/5496] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:41 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:41.920374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:41.921010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:42.006393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:42.010473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:42.011403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:42.025249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:42.026093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:42.026913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:42.130803 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 HTTP/1.1 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '448f58d2-be6a-4483-a06c-89e5c5e22868'} Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:42.137495 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.144153 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.161587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:42.172480 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d3ad003-2fc1-4ea2-b5cf-af2993735118 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "DELETE /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 404 len: 111 microversion: 2.1 time: 0.310838 Sep 16 14:27:42.184938 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2732/5497] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:27:41 2022] DELETE /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 111 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:42.232267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:42.234057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 448f58d2-be6a-4483-a06c-89e5c5e22868] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:42.276488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:42.278674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:42.279747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:42.281288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:42.286357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:42.287544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:42.427551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 HTTP/1.1 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '448f58d2-be6a-4483-a06c-89e5c5e22868'} Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:42.452205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. Sep 16 14:27:42.458845 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:42.464188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 448f58d2-be6a-4483-a06c-89e5c5e22868 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:42.466937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9db7dad-7ef6-4628-9155-8eaa8e3c1b2a tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868" status: 404 len: 111 microversion: 2.1 time: 0.273304 Sep 16 14:27:42.472931 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2733/5498] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:42 2022] GET /compute/v2.1/servers/448f58d2-be6a-4483-a06c-89e5c5e22868 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:42.519228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:42.520976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:42.595888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:42.607124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:42.608018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:42.612063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:42.613566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:42.614442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:43.258807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:43.287935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:43.295519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:43.296847 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc9ab4e8-a75a-41ea-90e1-23d0ec01969f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.819823 Sep 16 14:27:43.304984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2734/5499] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:42 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:43.322528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:43.327797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:43.364107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:43.365022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:43.365502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:43.366283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:43.384034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:43.390800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:43.498768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:27:43.662855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:43.849445 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2308b39-00da-4338-afc6-7d54cd2afaab tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "DELETE /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 204 len: 0 microversion: 2.1 time: 0.541395 Sep 16 14:27:43.861755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2735/5500] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:27:43 2022] DELETE /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:27:43.908635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:43.913921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:43.960919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:43.961840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:43.974972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:43.980198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:43.981059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:43.981866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:44.285144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:44.297179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:44.298915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:44.300343 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1ac9ed6-b056-4e50-a478-7123509ab3f4 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.432838 Sep 16 14:27:44.301510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2736/5501] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:43 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:44.307656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:44.308740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:44.325061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:44.326297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:44.329957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:44.342631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:44.344156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:44.344776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:44.675042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:44.685021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-72641e0f-d28e-4588-8b40-e753999895a5 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.381523 Sep 16 14:27:44.693872 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2737/5502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:44 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:44.714079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:44.719905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:44.748872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:44.749571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:44.750192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:44.751292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:44.766715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:44.770304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:45.213797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:45.245956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:45.252524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:45.255721 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b937ff5b-4389-4514-9b38-80faa9b98ea5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.560504 Sep 16 14:27:45.259444 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2738/5503] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:44 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:45.340876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:45.343594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:45.402865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:45.405274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:45.411103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:45.414954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:45.416677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:45.421935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:45.717934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:45.749274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:45.767467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:45.787848 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe3e2d95-161e-4038-aaef-83a8a39904a9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.450892 Sep 16 14:27:45.788952 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2739/5504] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:45 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:45.889516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:45.890680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:45.964725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:45.965818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:45.987783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:45.995862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:45.997080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:45.997848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:46.783789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:46.811038 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d85f1db-53bf-4b0d-ac83-1f081a525fa1 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 0.998469 Sep 16 14:27:46.815144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2740/5505] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:45 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:46.834299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:46.834972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:46.859656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:46.860194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:46.867171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:46.870977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:46.871470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:46.871984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:47.593341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:47.607728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:47.614256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:47.616687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bedc8676-4c1e-42d9-a662-4f1ee51106da tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.799345 Sep 16 14:27:47.619989 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2741/5506] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:46 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:47.634259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:47.636300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:47.654620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:47.661674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:47.662677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:47.664428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:47.665491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:47.666437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:47.872500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:47.891692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:47.899259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:47.902476 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cc5ed99b-b0d7-4afd-bd99-cabdd3444c77 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.277339 Sep 16 14:27:47.920006 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2742/5507] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:47 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:47.941170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:47.944823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:47.962571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:47.965353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:47.967287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:47.969562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:47.971354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:47.976513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:49.377562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:49.477459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:49.595359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:50.177043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:50.523671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:50.604743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d093d019a504159871c04a88352f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4c0f62449a419594af6e73b821cc31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:50.631895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19fbb57b-4a6c-486f-951a-071e7d001725 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 200 len: 1512 microversion: 2.1 time: 2.710090 Sep 16 14:27:50.639405 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2743/5508] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:47 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 1512 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:50.663363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:50.664331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:50.718357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:50.719315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:50.721993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:50.725241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:50.733049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:50.739192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:51.609651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:51.689008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:51.716164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:51.720969 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d6c3ae15-28aa-415f-aa6e-7a9b9ffd53f8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 1.077662 Sep 16 14:27:51.722080 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2744/5509] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:50 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:51.754055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:51.760868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:51.789104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:51.795402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:51.796544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:51.797569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:51.798262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:51.798936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:52.237593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:52.277310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:52.306991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:52.318447 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f62af11f-33ae-4cb2-80c4-a66e4307f1f7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.574777 Sep 16 14:27:52.320644 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2745/5510] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:51 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:52.356975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-12b8f88d-344e-495d-9f55-9130edbbcf84 req-955cf3ea-cb0a-4330-adac-d86a0cbf9877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934b7a08-9fa8-431c-a6fa-6a255e516dbf", "name": "network-vif-deleted", "tag": "342f4453-24ce-4b24-b685-977cf8c2a703"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:52.412541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-12b8f88d-344e-495d-9f55-9130edbbcf84 req-955cf3ea-cb0a-4330-adac-d86a0cbf9877 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:52.415649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-12b8f88d-344e-495d-9f55-9130edbbcf84 req-955cf3ea-cb0a-4330-adac-d86a0cbf9877 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:52.419213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-12b8f88d-344e-495d-9f55-9130edbbcf84 req-955cf3ea-cb0a-4330-adac-d86a0cbf9877 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:52.453179 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-12b8f88d-344e-495d-9f55-9130edbbcf84 req-955cf3ea-cb0a-4330-adac-d86a0cbf9877 service nova] Creating event network-vif-deleted:342f4453-24ce-4b24-b685-977cf8c2a703 for instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf on n-h1-858129-2 Sep 16 14:27:52.469442 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-12b8f88d-344e-495d-9f55-9130edbbcf84 req-955cf3ea-cb0a-4330-adac-d86a0cbf9877 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143421 Sep 16 14:27:52.484465 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2746/5511] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:27:52.491341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:52.498082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] [instance: 934b7a08-9fa8-431c-a6fa-6a255e516dbf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:52.510145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:52.514476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:52.515278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:52.516353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:52.517137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:52.527223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:52.544469 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] HTTP exception thrown: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf could not be found. Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Request method failure captured: Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf HTTP/1.1 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaVaTP991kwSf52tdN_jWTckL7wtzKZHBBCO6WlcElksf89sUd-K8WKeqUPR-8hI6BN69fytI4IihGtS4Rl-i8cYGQU24VkcTHwvw6QaxthepP9vY2Yc4NwzKleBet7KGGKujXyB3OM7VEPKBZJDLKWlqJPaGPRTFecbwKfplUKJtk Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6a4c0f62449a419594af6e73b821cc31", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6a4c0f62449a419594af6e73b821cc31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6a4c0f62449a419594af6e73b821cc31"}]}] Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6a4c0f62449a419594af6e73b821cc31 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-842960286 Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 2d093d019a504159871c04a88352f43f Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-842960286-project Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf could not be found. Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '934b7a08-9fa8-431c-a6fa-6a255e516dbf'} Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf could not be found. Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf could not be found. Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:27:52.555211 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf could not be found. Sep 16 14:27:52.558919 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:27:52.573335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] Returning 404 to user: Instance 934b7a08-9fa8-431c-a6fa-6a255e516dbf could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:27:52.574698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d17bed50-9596-4bbc-8559-a5c508c4b626 tempest-ServersNegativeTestJSON-842960286 tempest-ServersNegativeTestJSON-842960286-project] 10.222.0.60 "GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf" status: 404 len: 111 microversion: 2.1 time: 0.088583 Sep 16 14:27:52.575905 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2747/5512] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:52 2022] GET /compute/v2.1/servers/934b7a08-9fa8-431c-a6fa-6a255e516dbf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:27:52.772823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:52.774966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:52.788178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:52.789503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:52.791587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:52.792631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:52.795357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:52.796177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:53.396301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:53.428541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:53.430893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:53.432368 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fd0eefd1-edcd-46fc-b053-195582cd0459 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.664109 Sep 16 14:27:53.433289 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2748/5513] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:52 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:27:53.440106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:53.440744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:53.448158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:53.449104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:53.449503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:53.450625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:53.451285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:53.451896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:53.681565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:53.692042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:53.700449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:53.701868 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a88df410-7954-495d-aeb0-f3ec27133daa tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.267438 Sep 16 14:27:53.717458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2749/5514] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:53 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:54.386082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-30c5ebf2-4f5a-459e-8cfc-7170b0921dc4 req-b7f84d8b-af78-411c-a3d7-23426c05e9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec860017-4a48-4dde-8f14-3a4187a16ab6", "tag": "23ec2f4b-9e38-48c8-9817-dbe6a2e97f45"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:27:54.413285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-30c5ebf2-4f5a-459e-8cfc-7170b0921dc4 req-b7f84d8b-af78-411c-a3d7-23426c05e9a2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:54.415225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-30c5ebf2-4f5a-459e-8cfc-7170b0921dc4 req-b7f84d8b-af78-411c-a3d7-23426c05e9a2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:54.415933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-30c5ebf2-4f5a-459e-8cfc-7170b0921dc4 req-b7f84d8b-af78-411c-a3d7-23426c05e9a2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:54.442955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-30c5ebf2-4f5a-459e-8cfc-7170b0921dc4 req-b7f84d8b-af78-411c-a3d7-23426c05e9a2 service nova] Creating event network-changed:23ec2f4b-9e38-48c8-9817-dbe6a2e97f45 for instance ec860017-4a48-4dde-8f14-3a4187a16ab6 on n-h1-858129-2 Sep 16 14:27:54.459449 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-30c5ebf2-4f5a-459e-8cfc-7170b0921dc4 req-b7f84d8b-af78-411c-a3d7-23426c05e9a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075964 Sep 16 14:27:54.460918 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2750/5515] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:27:54.474443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:54.475184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:54.489161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:54.489909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:54.490580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:54.491496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:54.492121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:54.492716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:55.113037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:55.139423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:55.141790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:55.148121 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40c888d0-c279-48ad-a7ea-1a0ee66a32e4 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.685914 Sep 16 14:27:55.149001 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2751/5516] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:54 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:55.181539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:55.183960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:55.207694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:55.219451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:55.224424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:55.226956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:55.229325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:55.230717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:55.458570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:55.478370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:55.480797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:55.484261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e16b382-b76a-4e04-b3df-8eb3a62ed12d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.332648 Sep 16 14:27:55.506912 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2752/5517] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:55 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:56.184576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:56.185084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:56.226163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] validate_networks() for [('9de475fd-2eba-43da-ba4e-a6068fb30e9c', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:27:56.280448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:56.286156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:56.288159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:56.295686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:56.297614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:56.303349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:56.883229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:56.886829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:27:56.901612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:56.917449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:56.918788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9947a33-0357-416a-923f-c1d475c113f5 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.745466 Sep 16 14:27:56.919401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2753/5518] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:56 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:56.924475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:56.955307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:56.982207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:56.998151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:57.000140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:57.001270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:57.012232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:57.013203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:57.205516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:57.226221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:57.243767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:57.245456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ec41ae4-dcdf-42b2-a4dd-6301a9e9f5c7 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.324859 Sep 16 14:27:57.246657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2754/5519] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:56 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:57.949947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:57.951037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:57.961566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:57.973813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:57.974715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:57.975672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:57.976455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:57.981808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:58.622248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:27:58.623108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:27:58.624099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:27:58.624889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:27:58.625665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:27:58.716935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:58.717747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:58.718529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:58.719846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:58.720601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:58.738632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:58.783844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for project e04d4359a23549d587d9bf8ea9638abd. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:27:58.805984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for user b4ffd42c93ac48329b0e1a8b3baf0a36 and project e04d4359a23549d587d9bf8ea9638abd. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:27:58.844150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:27:58.847235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:27:58.987866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.010693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.012610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.016200 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0d95af6e-c2ea-449d-833f-bbb4fa97cd01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 18.612105 Sep 16 14:27:59.021697 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c343fb1-8172-4295-9f42-d1baf342b19f tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 1.076057 Sep 16 14:27:59.024699 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2766/5520] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:27:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 18622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:27:59.046494 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2755/5521] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:57 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:27:59.054992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:59.055698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:59.070708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ef20faf-2ab5-408c-a828-9caaba1d152a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:27:59.071348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ef20faf-2ab5-408c-a828-9caaba1d152a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:27:59.109090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:59.118416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:59.120535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:59.122217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:27:59.126560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:27:59.130719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:27:59.418160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ef20faf-2ab5-408c-a828-9caaba1d152a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.429065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ef20faf-2ab5-408c-a828-9caaba1d152a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1221 microversion: 2.1 time: 0.380910 Sep 16 14:27:59.441693 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2756/5522] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:27:59 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1221 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:27:59.697992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.725620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.727366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:27:59.729034 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0fbbe93-2d21-4d8e-a6d0-c9aae7e984b2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.703048 Sep 16 14:27:59.746908 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2767/5523] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:27:59 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:00.058205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:00.074249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:00.111168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:00.120060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:00.121531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:00.123754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:00.127926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:00.130668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:00.134209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:00.479879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5f183e4-ae5c-44df-8ce1-6d5539c27fa1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:00.480556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5f183e4-ae5c-44df-8ce1-6d5539c27fa1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:00.690277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5f183e4-ae5c-44df-8ce1-6d5539c27fa1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:00.703718 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5f183e4-ae5c-44df-8ce1-6d5539c27fa1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1221 microversion: 2.1 time: 0.227747 Sep 16 14:28:00.704790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2768/5524] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:00 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1221 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:00.762428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:00.763701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:00.782465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:00.785549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:00.787624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:00.793778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:00.795005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:00.796815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:01.221821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.236759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.238906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.240158 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5db6ef6-c3fb-4c3a-bdb5-0fed7a8e8522 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.482304 Sep 16 14:28:01.264041 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2769/5525] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:00 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:01.466569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.494839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.497138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.498674 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0e90704-ccdb-4971-a813-2ac81a4ac7d2 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 1.448104 Sep 16 14:28:01.499905 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2757/5526] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:00 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:01.746941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:01.747572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:01.763208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:01.765661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:01.766655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:01.780211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:01.782879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:01.783852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:01.965074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:01.999979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-76c4cdfd-17c9-44e9-ab73-79a3b3fdb1dd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1273 microversion: 2.1 time: 0.256311 Sep 16 14:28:02.005857 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2770/5527] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:01 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:02.288950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:02.295503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:02.338368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:02.339617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:02.345714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:02.351352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:02.352618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:02.357557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:02.534501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:02.542568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:02.545591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:02.562182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:02.569620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:02.571120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:02.573214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:02.576156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:02.577764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:02.579738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:02.580832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:02.584720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75b35548-c272-40bb-a5b3-8e8c84d9160a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.304039 Sep 16 14:28:02.602808 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2758/5528] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:02 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:03.074313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:03.095471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:03.136474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:03.139364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:03.145238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:03.150264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:03.151927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:03.152999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:03.405747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.416262 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8220d75e-2887-4e8d-90da-f4a7c4d47f9f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1281 microversion: 2.1 time: 0.360445 Sep 16 14:28:03.418277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.419182 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2759/5529] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:03 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:03.480765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.488476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.490748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a1e403c8-0a41-4595-84ce-06c0b7659ef9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.960165 Sep 16 14:28:03.491762 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2771/5530] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:02 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:03.653599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:03.656403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:03.699958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:03.706221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:03.707607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:03.708994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:03.709768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:03.710525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:03.960132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.971709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.973264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:03.997437 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79fb8d62-8c5f-4c5c-8628-4e1f616dc0e5 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.361606 Sep 16 14:28:03.999205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2760/5531] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:03 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:04.457072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:04.458454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:04.466530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:04.467375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:04.468026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:04.469113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:04.469939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:04.473541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:04.540650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:04.541800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:04.561465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:04.562435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:04.572762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:04.573988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:04.582629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:04.583518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:04.852176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:04.892159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-315a131b-5d99-401d-9f05-60fcc1ebe92e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1291 microversion: 2.1 time: 0.436557 Sep 16 14:28:04.894923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2772/5532] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:04 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1291 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:05.033943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-80781577-3783-4ef8-b5a4-6f4d9612ed65 req-6fc61921-13da-479d-80e9-fd6464fa7c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec860017-4a48-4dde-8f14-3a4187a16ab6", "name": "network-vif-plugged", "status": "completed", "tag": "23ec2f4b-9e38-48c8-9817-dbe6a2e97f45"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:05.106055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80781577-3783-4ef8-b5a4-6f4d9612ed65 req-6fc61921-13da-479d-80e9-fd6464fa7c29 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:05.108623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80781577-3783-4ef8-b5a4-6f4d9612ed65 req-6fc61921-13da-479d-80e9-fd6464fa7c29 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:05.111034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-80781577-3783-4ef8-b5a4-6f4d9612ed65 req-6fc61921-13da-479d-80e9-fd6464fa7c29 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:05.165455 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-80781577-3783-4ef8-b5a4-6f4d9612ed65 req-6fc61921-13da-479d-80e9-fd6464fa7c29 service nova] Creating event network-vif-plugged:23ec2f4b-9e38-48c8-9817-dbe6a2e97f45 for instance ec860017-4a48-4dde-8f14-3a4187a16ab6 on n-h1-858129-2 Sep 16 14:28:05.195547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-80781577-3783-4ef8-b5a4-6f4d9612ed65 req-6fc61921-13da-479d-80e9-fd6464fa7c29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168760 Sep 16 14:28:05.208130 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2773/5533] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:28:05.226114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:05.233308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:05.257605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:05.258279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:05.265964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:05.267914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:05.268512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:05.269077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:05.391710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:05.436227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:05.443666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:05.447962 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ffa71f4-0daf-4081-90e7-533c931870e7 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.912802 Sep 16 14:28:05.449012 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2761/5534] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:04 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:28:05.625290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:05.643010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:05.644993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:05.646639 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-752d3f93-7482-42e6-bcae-c55a21ea83c2 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.436146 Sep 16 14:28:05.647543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2774/5535] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:05 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:05.916922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:05.917448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:05.936409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:05.936409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:05.936409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:05.936409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:05.936870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:05.936966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:06.077501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:06.105840 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09cc6dcc-3be0-4266-9318-06a39df92cb5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1279 microversion: 2.1 time: 0.192576 Sep 16 14:28:06.106789 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2762/5536] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:05 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:06.484039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:06.485534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:06.515637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:06.524738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:06.526136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:06.527813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:06.534181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:06.535698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:06.703315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:06.708433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:06.734917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:06.736230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:06.737878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:06.743453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:06.744603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:06.745722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:06.972567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.016918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.026993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.032379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-80680fed-da11-44ed-b460-8b9c3464e656 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1366 microversion: 2.47 time: 0.337779 Sep 16 14:28:07.038584 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2763/5537] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:06 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:07.136494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.152265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:07.160313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:07.194345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:07.195473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.196057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:07.197271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.198595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:07.200406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:07.201650 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc81e621-f602-4194-b1d6-03817671b8d0 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.727008 Sep 16 14:28:07.201866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:07.202835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:07.211979 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2775/5538] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:06 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:07.633844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:07.679259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a605b7e6-e180-408f-9e2f-e7580a0e074e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.514455 Sep 16 14:28:07.683126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2764/5539] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:07 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:08.079936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:08.081505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:08.129440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:08.142292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:08.147026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:08.148532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:08.155333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:08.159443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:08.235712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:08.239387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:08.255668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:08.256993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:08.258556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:08.260271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:08.262110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:08.263235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:08.763900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:09.108169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:09.153470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:09.159865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:09.178461 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-258c1ed4-3077-4f26-9998-e5e88b1b3e2d tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1372 microversion: 2.47 time: 1.110236 Sep 16 14:28:09.180875 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2776/5540] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:08 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1372 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:28:09.190073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:09.192282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:09.225239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:09.227546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:09.228727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:09.230442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:09.231897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:09.232991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:09.426790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:09.878055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:09.897842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:09.901788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:09.909495 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6570af51-bc27-40d9-8c0b-3eaf5debbafd tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 1.683357 Sep 16 14:28:09.912907 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2765/5541] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:08 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:09.947735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b79cdf90-83dd-49b0-bead-4457faa578bd req-b42ff52c-b62f-4701-a5d2-195c71d8d43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "name": "network-vif-plugged", "status": "completed", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:09.986349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b79cdf90-83dd-49b0-bead-4457faa578bd req-b42ff52c-b62f-4701-a5d2-195c71d8d43d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:09.988086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b79cdf90-83dd-49b0-bead-4457faa578bd req-b42ff52c-b62f-4701-a5d2-195c71d8d43d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:09.992043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b79cdf90-83dd-49b0-bead-4457faa578bd req-b42ff52c-b62f-4701-a5d2-195c71d8d43d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:10.042392 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b79cdf90-83dd-49b0-bead-4457faa578bd req-b42ff52c-b62f-4701-a5d2-195c71d8d43d service nova] Creating event network-vif-plugged:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:28:10.056038 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b79cdf90-83dd-49b0-bead-4457faa578bd req-b42ff52c-b62f-4701-a5d2-195c71d8d43d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141422 Sep 16 14:28:10.059034 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2766/5542] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:10.105417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:10.165246 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21e1ede2-1d43-43c7-8145-e3b88e487849 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.977396 Sep 16 14:28:10.177712 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2777/5543] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:09 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:10.218517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:10.219478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:10.235436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:10.236066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:10.236898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:10.238726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:10.239425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:10.239982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:10.387030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:10.404223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:10.412411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:10.415373 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-38f81255-5e9b-48a8-8845-672773c03ed0 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1372 microversion: 2.47 time: 0.204073 Sep 16 14:28:10.416201 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2767/5544] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:10 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:28:10.730527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-84d66c9e-0bc2-4b2e-aa59-8dd7355c684c req-f46af4a2-cfae-4ad8-8aba-929ea0113556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a6cb496-a555-4b1e-8e86-62a96b13ea78", "tag": "45707517-0a6f-4f40-84cf-30cbefc81e7e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:10.742850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:10.745956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-84d66c9e-0bc2-4b2e-aa59-8dd7355c684c req-f46af4a2-cfae-4ad8-8aba-929ea0113556 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:10.746811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-84d66c9e-0bc2-4b2e-aa59-8dd7355c684c req-f46af4a2-cfae-4ad8-8aba-929ea0113556 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:10.747698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-84d66c9e-0bc2-4b2e-aa59-8dd7355c684c req-f46af4a2-cfae-4ad8-8aba-929ea0113556 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:10.771616 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-84d66c9e-0bc2-4b2e-aa59-8dd7355c684c req-f46af4a2-cfae-4ad8-8aba-929ea0113556 service nova] Creating event network-changed:45707517-0a6f-4f40-84cf-30cbefc81e7e for instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 on n-h2-858129-2 Sep 16 14:28:10.778541 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-84d66c9e-0bc2-4b2e-aa59-8dd7355c684c req-f46af4a2-cfae-4ad8-8aba-929ea0113556 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051603 Sep 16 14:28:10.779768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2778/5545] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:10.962786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:10.967765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:10.986701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:10.987207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:10.987682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:10.988428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:10.988915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:10.989334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:11.218023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:11.219827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:11.247227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:11.251430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:11.254968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:11.260324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:11.262028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:11.263144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:11.335726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.352753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.356213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.360904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c717a680-0ae4-40bd-8a9b-cb631513cb9b tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.419925 Sep 16 14:28:11.363332 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2768/5546] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:10 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:11.587034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.595101 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b70e2d2-1413-49da-b22b-46885dd0ee8e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.385354 Sep 16 14:28:11.595965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2779/5547] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:11 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:11.600299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:11.600917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:11.630821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:11.631228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:11.631665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:11.632385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:11.632840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:11.633267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:11.756178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.768318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dae95d29-e5b5-46d9-8a2d-7a36a35a19d7 tempest-ComputeTenantNetworksTest-1727036710 tempest-ComputeTenantNetworksTest-1727036710-project] Calling method '.version_select at 0x7f724c3b5af0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:11.779692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.781167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:11.782660 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be6e96d8-1317-4f7c-9125-b31e565847c9 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1372 microversion: 2.47 time: 0.185993 Sep 16 14:28:11.787535 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2780/5548] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:11 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:12.158249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dae95d29-e5b5-46d9-8a2d-7a36a35a19d7 tempest-ComputeTenantNetworksTest-1727036710 tempest-ComputeTenantNetworksTest-1727036710-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.789526 Sep 16 14:28:12.159335 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2769/5549] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 14:28:11 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:12.170297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c3cd3fbd-0977-4bc1-8d2c-20b5f7408851 tempest-ComputeTenantNetworksTest-1727036710 tempest-ComputeTenantNetworksTest-1727036710-project] Calling method '.version_select at 0x7f724c250940>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:12.328524 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c3cd3fbd-0977-4bc1-8d2c-20b5f7408851 tempest-ComputeTenantNetworksTest-1727036710 tempest-ComputeTenantNetworksTest-1727036710-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks/a2ec5372-3061-47ef-93d7-77693ee58196" status: 200 len: 140 microversion: 2.1 time: 0.161681 Sep 16 14:28:12.331343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2781/5550] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:28:12 2022] GET /compute/v2.1/os-tenant-networks/a2ec5372-3061-47ef-93d7-77693ee58196 => generated 140 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:12.415344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:12.416412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:12.431610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:12.431978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:12.432428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:12.433184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:12.433651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:12.434074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:12.625919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:12.627052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:12.680243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:12.681543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:12.682550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:12.691976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:12.692852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:12.693636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:12.962964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:12.974432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:12.983015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:12.988109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6e11d7e-cc63-4437-83af-1bcceaa21247 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.577140 Sep 16 14:28:12.988807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2770/5551] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:12 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:28:13.001233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:13.002492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:13.012879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:13.014485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:13.015246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:13.016570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:13.017476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:13.018283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:13.078987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.090513 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6f3de35e-d881-4b4a-83dc-9b898a1ae636 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.471768 Sep 16 14:28:13.105410 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2782/5552] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:12 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:13.142337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.157390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.160208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.167849 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5a50953d-d22e-485f-b984-714e6fdbe769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1357 microversion: 2.47 time: 0.171940 Sep 16 14:28:13.194849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2771/5553] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:12 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:13.220569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:13.228727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.235973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Searching by: {'deleted': False, 'project_id': '99e927b8b69441e4b9a73d33dabf629e'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 14:28:13.257521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:13.258300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:13.264415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:13.269919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:13.272696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:13.275782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:13.541541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 14:28:13.633311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-510296797", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:13.756984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:28:13.802575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.820877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:13.821385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:13.823045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:13.888165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:13.893535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:14.002066 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5cf3ee7-ce2f-41c5-a012-6fdf6090d590 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.803250 Sep 16 14:28:14.003382 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2783/5554] 10.222.0.60 () {60 vars in 1187 bytes} [Fri Sep 16 14:28:13 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:14.033250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:14.035038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:14.085641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.091861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.094772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.101480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.104989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.105816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.225907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:28:14.225907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:28:14.227808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:28:14.228375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:28:14.228996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:28:14.248250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.251064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.252722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.254960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.256237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.257567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.323853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Getting quotas for project 3ccd1509d8a042c5bda6094612f608e1. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:28:14.341618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Getting quotas for user 1e005a0321254a168e34c69d650dbc7a and project 3ccd1509d8a042c5bda6094612f608e1. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:28:14.387696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:28:14.396474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:28:14.550601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:14.588340 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e9d0029e-996e-4a92-8600-ba7088eb48b2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958604 Sep 16 14:28:14.592291 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2772/5555] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:28:14.599157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:14.600918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:14.601459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:14.620221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.620830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.621564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.622306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.622901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.623583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.630805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:14.633067 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-24bfbbe0-9d2c-4508-bbd7-4995e1b9c74c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.616918 Sep 16 14:28:14.649361 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2784/5556] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:14 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:28:14.696291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:14.698254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:14.735061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.738650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.740514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.745119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:14.750561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:14.750966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:14.756299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:28:14.761020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:14.959011 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75894ef3-2612-4333-a557-2ee79873be29 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 204 len: 0 microversion: 2.47 time: 0.364884 Sep 16 14:28:14.959883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2773/5557] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:28:14 2022] DELETE /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:28:14.983833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c947c3b-2aa2-407c-b625-58ca17a29d01 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:14.985241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c947c3b-2aa2-407c-b625-58ca17a29d01 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:15.256784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c947c3b-2aa2-407c-b625-58ca17a29d01 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:15.293230 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c947c3b-2aa2-407c-b625-58ca17a29d01 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1213 microversion: 2.1 time: 0.319747 Sep 16 14:28:15.293230 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2774/5558] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:14 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1213 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:15.310743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:15.311823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:15.356748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:15.371379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:15.375330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:15.378128 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa0a716e-4838-42e2-a996-82c56d7706b0 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.726951 Sep 16 14:28:15.379439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2785/5559] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:14 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:15.382568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:15.386440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:15.391618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:15.400459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:15.400459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:15.579366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:15.602756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:15.607071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:15.611313 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69263cb2-4b97-4fd8-a97a-df356f68e254 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1363 microversion: 2.47 time: 0.318425 Sep 16 14:28:15.613272 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2775/5560] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:15 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:15.717450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:15.718438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:15.741506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:15.742509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:15.743086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:15.750730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:15.751576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:15.752338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:16.108842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:16.132263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:16.137828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:16.142079 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-47f36639-0e7e-4f04-966b-251288483f57 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1729 microversion: 2.20 time: 0.431476 Sep 16 14:28:16.171643 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2786/5561] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:15 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1729 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:16.323797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:16.325956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:16.364489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:16.367924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:16.370206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:16.374368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:16.384315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:16.388224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:16.421144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:16.427750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:16.459463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:16.460146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:16.460614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:16.473208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:16.474292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:16.475331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:16.733610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:16.777265 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da206119-79b5-4d78-8ea1-654537d791a5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1265 microversion: 2.1 time: 0.461548 Sep 16 14:28:16.782861 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2776/5562] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:16 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1265 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:16.794650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:16.809782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:16.850143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:16.853491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:16.855332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:16.860579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:16.862103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:16.866626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:17.075578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.098096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.102561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.106661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2dd32e5-65e6-445e-a5a6-c12d75be2769 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1363 microversion: 2.47 time: 0.320654 Sep 16 14:28:17.108393 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2777/5563] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:16 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:17.185844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.199070 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eccd2b2e-c38b-4ecd-863c-e1f0ef4b6e90 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.787925 Sep 16 14:28:17.199883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2787/5564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:16 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:17.205666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:17.210542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:17.241346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:17.242123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:17.249141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:17.252381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:17.253495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:17.254732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:17.856525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ed762bb-bad0-447e-b6ef-7a44d0649bb6 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Action: 'create', calling method: .version_select at 0x7f724c3084c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1149855440", "metadata": {"Type": "work"}}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:17.928061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.939033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.940581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:17.943106 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ade92306-506e-41eb-984e-6d2e75164575 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1716 microversion: 2.20 time: 0.741400 Sep 16 14:28:17.943797 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2788/5565] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:17 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1716 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:17.959624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:17.960589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:17.966952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:17.967530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:17.968076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:17.968984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:17.969508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:17.969997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:18.157885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:18.172476 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c432dd4b-478b-46b4-817e-6a855df95d91 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1271 microversion: 2.1 time: 0.226748 Sep 16 14:28:18.174732 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2789/5566] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:17 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:18.187513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:18.190352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:18.207577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:18.208540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:18.208999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:18.211869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:18.212820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:18.214285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:18.348201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:18.365708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:18.369015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:18.371805 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6623c3be-8f62-4494-8119-11b22489b060 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1363 microversion: 2.47 time: 0.195122 Sep 16 14:28:18.374028 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2790/5567] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:18 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:18.382265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:18.383284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:18.390596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:18.391256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:18.391841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:18.392707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:18.393540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:18.394297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:18.451829 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ed762bb-bad0-447e-b6ef-7a44d0649bb6 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.341547 Sep 16 14:28:18.454226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2778/5568] 10.222.0.60 () {60 vars in 1156 bytes} [Fri Sep 16 14:28:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1345 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 14:28:18.478352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31eae5ee-3689-4557-ab35-b86bf84e3908 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c2520d0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:18.560973 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31eae5ee-3689-4557-ab35-b86bf84e3908 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 353 microversion: 2.1 time: 0.086822 Sep 16 14:28:18.562678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2779/5569] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:18 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:18.918757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:18.946753 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b853c0e-17cf-4e2b-a9d5-e8b01f3b0179 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.566720 Sep 16 14:28:18.948959 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2791/5570] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:18 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:19.199194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:19.200880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:19.215934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.220812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.221504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:19.222665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.225903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.227381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:19.408187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:19.416228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:19.416958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:19.429896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.430982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.431714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:19.433702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.434470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.435283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:19.454390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b3f8bef-902c-4c98-b002-0a861f5df70f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1271 microversion: 2.1 time: 0.260350 Sep 16 14:28:19.455718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2780/5571] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:19 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:19.515357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.516300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.518100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:19.518979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lazy-loading 'fault' on Instance uuid c816a3c1-3a87-4085-88cc-fb015e239977 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:28:19.577129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-260a73c4-f1c0-44cb-b732-1dce973724e8 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c4dc700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:19.763639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:19.778188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:19.785496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:19.787154 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54dd6d85-a320-4956-91b9-f5420c5e8f60 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 200 len: 1368 microversion: 2.47 time: 0.390424 Sep 16 14:28:19.789081 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2792/5572] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:19 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:19.846613 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-260a73c4-f1c0-44cb-b732-1dce973724e8 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 353 microversion: 2.1 time: 0.273929 Sep 16 14:28:19.848785 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2781/5573] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:19 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 353 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:19.971520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:19.972489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:19.989565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.990343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.990979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:19.991714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:19.992173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:19.992600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.433232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:20.452424 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98475c36-1715-4768-be76-eb9319877dc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.482948 Sep 16 14:28:20.453380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2793/5574] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:19 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:20.480808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:20.482287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:20.495435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e7660001-d11b-43e7-8794-a22b7f8be522 req-105457ed-a55c-427e-afe2-7e0598689a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6cb496-a555-4b1e-8e86-62a96b13ea78", "name": "network-vif-plugged", "status": "completed", "tag": "45707517-0a6f-4f40-84cf-30cbefc81e7e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:20.522710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e7660001-d11b-43e7-8794-a22b7f8be522 req-105457ed-a55c-427e-afe2-7e0598689a1d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.528615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.529321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.529913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.531093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.532896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.533720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e7660001-d11b-43e7-8794-a22b7f8be522 req-105457ed-a55c-427e-afe2-7e0598689a1d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.534348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.538003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e7660001-d11b-43e7-8794-a22b7f8be522 req-105457ed-a55c-427e-afe2-7e0598689a1d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.569968 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e7660001-d11b-43e7-8794-a22b7f8be522 req-105457ed-a55c-427e-afe2-7e0598689a1d service nova] Creating event network-vif-plugged:45707517-0a6f-4f40-84cf-30cbefc81e7e for instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 on n-h2-858129-2 Sep 16 14:28:20.579901 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e7660001-d11b-43e7-8794-a22b7f8be522 req-105457ed-a55c-427e-afe2-7e0598689a1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087834 Sep 16 14:28:20.584417 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2794/5575] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:20.818643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:20.819948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: c816a3c1-3a87-4085-88cc-fb015e239977] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:20.822145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:20.838861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.840989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.841690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.842612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.843229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.843802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.875549 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] HTTP exception thrown: Instance c816a3c1-3a87-4085-88cc-fb015e239977 could not be found. Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Request method failure captured: Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 HTTP/1.1 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIfH_0bCMbH87djU5eE4ilXJJdJKWe057rVbfJeLOazaua1H3wcvYrTdIocWgvFGpIWCt0eT-95YxLcqAcgc71RPRA4_eg-6h2ou6K0Mh4iU50p1TnBnjP1dale10OygWzbgvD1qUo4K7YwuPNcoGP96u3gK1Y3KhBIxwXzE4XObAq0 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.47 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 99e927b8b69441e4b9a73d33dabf629e Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerShowV247Test-1886018146 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99e927b8b69441e4b9a73d33dabf629e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e927b8b69441e4b9a73d33dabf629e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99e927b8b69441e4b9a73d33dabf629e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e927b8b69441e4b9a73d33dabf629e"}]}] Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerShowV247Test-1886018146 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 99e927b8b69441e4b9a73d33dabf629e Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerShowV247Test-1886018146 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerShowV247Test-1886018146-project Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: cd77e3e30e0243b69e8fee2438af9403 Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerShowV247Test-1886018146-project Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance c816a3c1-3a87-4085-88cc-fb015e239977 could not be found. Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'c816a3c1-3a87-4085-88cc-fb015e239977'} Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c816a3c1-3a87-4085-88cc-fb015e239977 could not be found. Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c816a3c1-3a87-4085-88cc-fb015e239977 could not be found. Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:20.880534 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c816a3c1-3a87-4085-88cc-fb015e239977 could not be found. Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Returning 404 to user: Instance c816a3c1-3a87-4085-88cc-fb015e239977 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1877f49e-58cf-4942-8e68-83d2486161b1 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977" status: 404 len: 111 microversion: 2.47 time: 0.071023 Sep 16 14:28:20.888865 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2795/5576] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:20 2022] GET /compute/v2.1/servers/c816a3c1-3a87-4085-88cc-fb015e239977 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:28:20.894881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:20.897263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-547a59ad-989d-4251-a7cc-8f184fe4742f tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c4f2e50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:20.905334 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7196f1f8-91a3-4826-b9a6-6bd1889b306c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.429172 Sep 16 14:28:20.908564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2782/5577] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:20 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:20.920182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:20.920816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:20.937434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.940436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.941093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.941845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:20.944400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:20.945128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:20.984040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:28:21.054166 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-547a59ad-989d-4251-a7cc-8f184fe4742f tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 354 microversion: 2.1 time: 0.161028 Sep 16 14:28:21.055550 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2796/5578] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:20 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:21.073167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45263416-07e3-437f-9c68-8703169f2362 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c13e700>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:21.094508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62f0e49c-eab7-4a97-8fcc-54caa55bf598 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "DELETE /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 204 len: 0 microversion: 2.47 time: 0.179377 Sep 16 14:28:21.096290 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2783/5579] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:28:20 2022] DELETE /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:28:21.117876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:21.133230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:21.140087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:21.140597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:21.141044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:21.141789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:21.149361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:21.149930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:21.196036 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45263416-07e3-437f-9c68-8703169f2362 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 354 microversion: 2.1 time: 0.130489 Sep 16 14:28:21.196632 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2797/5580] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:21 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:21.215686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b37226c5-6f3e-43e0-acc8-10449dc40acb tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c4f2e50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:21.319043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b37226c5-6f3e-43e0-acc8-10449dc40acb tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 202 len: 0 microversion: 2.1 time: 0.111511 Sep 16 14:28:21.320063 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2798/5581] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:28:21 2022] DELETE /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:28:21.328753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4b7fbed-f249-4c1b-974d-3dc1c8953826 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c568ee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:21.461090 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4b7fbed-f249-4c1b-974d-3dc1c8953826 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 353 microversion: 2.1 time: 0.136806 Sep 16 14:28:21.462475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2799/5582] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:21 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:21.476894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:21.479109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:21.492469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:21.500300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:21.509115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:21.510370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:21.511371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:21.512039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:21.742510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:21.764195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:21.771681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:21.774414 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f8407503-27ba-4fd1-810c-d5af673a60be tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 200 len: 1362 microversion: 2.47 time: 0.661749 Sep 16 14:28:21.791921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2784/5583] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:21 2022] GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 1362 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:21.889561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:21.899978 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2fded289-bf90-4741-b516-512753d22cc6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.426597 Sep 16 14:28:21.911090 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2800/5584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:21 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:21.938723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:21.939471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:21.952257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:21.953775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:21.954854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:21.959568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:21.961950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:21.963209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:22.280701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:22.295122 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5398803d-dec4-4450-a4ab-3c08fc023715 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.362915 Sep 16 14:28:22.304230 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2785/5585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:21 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:22.482650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-990e8722-3812-41b5-a610-d1276b7f3e6b tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c3e9310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:22.614603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-069a18f4-9765-4506-93c4-2200245d4212 req-c2a9c26f-2215-4d7f-b089-5be2c548d1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468dcba3-7b9f-4a31-908a-cf771a0b4423", "tag": "ca50f224-7f39-4ced-a4ed-cb62c61580db"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:22.668726 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-990e8722-3812-41b5-a610-d1276b7f3e6b tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 353 microversion: 2.1 time: 0.194401 Sep 16 14:28:22.669436 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2801/5586] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:22 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:22.684738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-069a18f4-9765-4506-93c4-2200245d4212 req-c2a9c26f-2215-4d7f-b089-5be2c548d1e1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:22.685282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-069a18f4-9765-4506-93c4-2200245d4212 req-c2a9c26f-2215-4d7f-b089-5be2c548d1e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:22.688432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-069a18f4-9765-4506-93c4-2200245d4212 req-c2a9c26f-2215-4d7f-b089-5be2c548d1e1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:22.712623 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-069a18f4-9765-4506-93c4-2200245d4212 req-c2a9c26f-2215-4d7f-b089-5be2c548d1e1 service nova] Creating event network-changed:ca50f224-7f39-4ced-a4ed-cb62c61580db for instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 on n-h1-858129-2 Sep 16 14:28:22.719547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-069a18f4-9765-4506-93c4-2200245d4212 req-c2a9c26f-2215-4d7f-b089-5be2c548d1e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111887 Sep 16 14:28:22.720499 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2786/5587] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:28:22.806128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:22.806787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:22.818963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:22.822320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:22.822820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:22.825802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:22.826296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:22.826844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:22.932129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:22.933750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:22.951193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:22.954073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:22.954886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:22.956003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:22.960645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:22.961824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:22.989748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:23.039765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:23.043141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:23.045614 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-282cf54c-fed0-45dc-85d4-53917ef761ff tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 200 len: 1362 microversion: 2.47 time: 0.243565 Sep 16 14:28:23.064353 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2802/5588] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:22 2022] GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:23.326906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:23.329013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:23.361025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:23.364180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:23.364180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:23.365315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:23.368696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:23.370089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:23.418729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:23.519814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:23.533023 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c8839bf8-a2aa-46c4-95bc-401f047c0303 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1321 microversion: 2.1 time: 0.610057 Sep 16 14:28:23.539886 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2787/5589] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:22 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:23.690065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55c23411-9d45-438d-8d44-71d8761eae8c tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f724c4063a0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:23.797935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:23.822156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:23.861077 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55c23411-9d45-438d-8d44-71d8761eae8c tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 200 len: 353 microversion: 2.1 time: 0.179835 Sep 16 14:28:23.862228 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2788/5590] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:23 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:23.874063 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45c3e737-b58e-487c-be40-832984423db8 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.554833 Sep 16 14:28:23.877682 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2803/5591] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:23 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:24.099961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:24.101140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:24.118944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.123977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.125110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.127501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.130589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.133629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.265934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.267276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.272593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.273744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lazy-loading 'fault' on Instance uuid 72e346f9-6bde-4dcf-bf69-b774dfdb3edb {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:28:24.280441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:24.369460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:24.386028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:24.391048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:24.393271 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df4834ef-892e-4936-bb56-3e3c572dc986 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 200 len: 1367 microversion: 2.47 time: 0.301711 Sep 16 14:28:24.398464 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2789/5592] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:24 2022] GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:24.577921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:24.579207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:24.594003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.596042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.597951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.599660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.600825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.601667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.879159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:24.887584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a89d529c-0efd-4dbc-aa07-453ecc4ed044 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Calling method '.version_select at 0x7f7251782b80>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:24.888625 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f4481294-362f-4ab7-bee2-0637d62109b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1514 microversion: 2.1 time: 0.318793 Sep 16 14:28:24.889904 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2804/5593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:24 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:24.920052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:24.932236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:24.955069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.955561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.956132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.956962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:24.957415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:24.959639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:24.976746 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-a89d529c-0efd-4dbc-aa07-453ecc4ed044 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] HTTP exception thrown: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a89d529c-0efd-4dbc-aa07-453ecc4ed044 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Request method failure captured: Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 HTTP/1.1 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIgAACmYS4pAA71tNgCkf5Ofix7NSsIodkR4-heHWg-LR_kXdHyvMdY9D0WtoXe1_3VgNHeoxSNPQbb79Qa8RAz7h-6DwBtIhDizRTkoWLlyAQ9bMn6bVIStwBZLlYzq57pGbZQQpRcLOu1_akilA1HH2ee8ZXNW7VBlSalu_I1rC8s Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 190d1839f19648dfaafe5f9d8a228333 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesGetTestJSON-256776502 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_190d1839f19648dfaafe5f9d8a228333", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/190d1839f19648dfaafe5f9d8a228333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/190d1839f19648dfaafe5f9d8a228333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/190d1839f19648dfaafe5f9d8a228333"}]}] Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesGetTestJSON-256776502 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 190d1839f19648dfaafe5f9d8a228333 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesGetTestJSON-256776502 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesGetTestJSON-256776502-project Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 30b030a9e4f142c9a002ed18aad84416 Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesGetTestJSON-256776502-project Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: method: Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: exception: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c13c5955-647e-434d-97f4-816ebd40b683'} Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. (HTTP 404) (Request-ID: req-7dd1bf12-fbe9-472e-9d66-db544baf681b) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 14:28:24.992310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a89d529c-0efd-4dbc-aa07-453ecc4ed044 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] Returning 404 to user: Volume c13c5955-647e-434d-97f4-816ebd40b683 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:28:25.000786 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a89d529c-0efd-4dbc-aa07-453ecc4ed044 tempest-VolumesGetTestJSON-256776502 tempest-VolumesGetTestJSON-256776502-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683" status: 404 len: 109 microversion: 2.1 time: 0.119400 Sep 16 14:28:25.035029 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2790/5594] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:24 2022] GET /compute/v2.1/os-volumes/c13c5955-647e-434d-97f4-816ebd40b683 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:28:25.055565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:25.073948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:25.101402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.102505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.103114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.104041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.108880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.111509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.183169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'flavor' on Instance uuid 0a6cb496-a555-4b1e-8e86-62a96b13ea78 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:28:25.235318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:25.254890 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-abee939b-e402-4ed8-84a5-3e917b4a98c5 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.353587 Sep 16 14:28:25.271439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:25.274742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2805/5595] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:24 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:25.390584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:25.448701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:25.450992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:25.451788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e9641bb9-0a8b-480a-bc3e-c747c7e8b480 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action" status: 200 len: 32 microversion: 2.1 time: 0.438153 Sep 16 14:28:25.453579 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2791/5596] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:28:25 2022] POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:28:25.478028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:25.480018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:25.482609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.483889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.484809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.489357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.491910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.492888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.517110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.519494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.521484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.523369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.526549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.527273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.612341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:25.613668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:25.614776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:25.615944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lazy-loading 'fault' on Instance uuid 72e346f9-6bde-4dcf-bf69-b774dfdb3edb {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:28:25.825876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:25.837797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:25.843641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd77e3e30e0243b69e8fee2438af9403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e927b8b69441e4b9a73d33dabf629e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:25.847259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37fd2c19-a357-4d01-9b16-660ca9055b69 tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 200 len: 1367 microversion: 2.47 time: 0.415936 Sep 16 14:28:25.852567 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2806/5597] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:25 2022] GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:28:26.035887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:26.060291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d1d1428-3c5b-4a0f-9b35-3f66dbf2edb6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.599304 Sep 16 14:28:26.070542 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2792/5598] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:25 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:26.319233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:26.322585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:26.356277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:26.356834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:26.357237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:26.370458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:26.372108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:26.381461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:26.888810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:26.890186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] [instance: 72e346f9-6bde-4dcf-bf69-b774dfdb3edb] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:26.901896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:26.905281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:26.906020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:26.907072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:26.910836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:26.911637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:26.949120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] HTTP exception thrown: Instance 72e346f9-6bde-4dcf-bf69-b774dfdb3edb could not be found. Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Request method failure captured: Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb HTTP/1.1 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIfH_0bCMbH87djU5eE4ilXJJdJKWe057rVbfJeLOazaua1H3wcvYrTdIocWgvFGpIWCt0eT-95YxLcqAcgc71RPRA4_eg-6h2ou6K0Mh4iU50p1TnBnjP1dale10OygWzbgvD1qUo4K7YwuPNcoGP96u3gK1Y3KhBIxwXzE4XObAq0 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.47 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 99e927b8b69441e4b9a73d33dabf629e Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerShowV247Test-1886018146 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99e927b8b69441e4b9a73d33dabf629e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e927b8b69441e4b9a73d33dabf629e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99e927b8b69441e4b9a73d33dabf629e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e927b8b69441e4b9a73d33dabf629e"}]}] Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerShowV247Test-1886018146 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 99e927b8b69441e4b9a73d33dabf629e Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerShowV247Test-1886018146 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerShowV247Test-1886018146-project Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: cd77e3e30e0243b69e8fee2438af9403 Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerShowV247Test-1886018146-project Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 72e346f9-6bde-4dcf-bf69-b774dfdb3edb could not be found. Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '72e346f9-6bde-4dcf-bf69-b774dfdb3edb'} Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e346f9-6bde-4dcf-bf69-b774dfdb3edb could not be found. Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e346f9-6bde-4dcf-bf69-b774dfdb3edb could not be found. Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:26.952409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e346f9-6bde-4dcf-bf69-b774dfdb3edb could not be found. Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] Returning 404 to user: Instance 72e346f9-6bde-4dcf-bf69-b774dfdb3edb could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:28:26.956853 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f8b6be97-bac0-4407-8300-9914ee81900a tempest-ServerShowV247Test-1886018146 tempest-ServerShowV247Test-1886018146-project] 10.222.0.60 "GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb" status: 404 len: 111 microversion: 2.47 time: 0.069260 Sep 16 14:28:26.958832 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2793/5599] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:28:26 2022] GET /compute/v2.1/servers/72e346f9-6bde-4dcf-bf69-b774dfdb3edb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:28:27.116243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:27.119807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:27.147349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:27.153780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:27.163312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:27.167886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:27.188675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:27.190069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:27.191273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:27.198955 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36e6ff8c-5bbc-49c9-a60a-657f09bf2d9c tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.894551 Sep 16 14:28:27.200117 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2807/5600] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:26 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:27.870972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:27.907407 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0418787f-b7b0-4485-be98-631a9d646fdf tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.797867 Sep 16 14:28:27.918854 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2794/5601] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:27 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:28.227738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:28.228726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:28.237981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:28.237981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:28.238798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:28.238968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:28.239309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:28.239739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:28.334521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:28.811664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:28.835023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e2b50878-a770-448e-bbaf-3eead1ced186 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.611773 Sep 16 14:28:28.864173 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2808/5602] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:28 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:28.960956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:28.961832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:28.998005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:29.000405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:29.000961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:29.003447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:29.006176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:29.006908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:29.264991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1566c63c-946d-4a36-a868-7eb833c95828 req-b688b732-d49e-4755-9033-cd3f9c4e1b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468dcba3-7b9f-4a31-908a-cf771a0b4423", "name": "network-vif-plugged", "status": "completed", "tag": "ca50f224-7f39-4ced-a4ed-cb62c61580db"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:29.285391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1566c63c-946d-4a36-a868-7eb833c95828 req-b688b732-d49e-4755-9033-cd3f9c4e1b07 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:29.286272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1566c63c-946d-4a36-a868-7eb833c95828 req-b688b732-d49e-4755-9033-cd3f9c4e1b07 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:29.287399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1566c63c-946d-4a36-a868-7eb833c95828 req-b688b732-d49e-4755-9033-cd3f9c4e1b07 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:29.305635 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1566c63c-946d-4a36-a868-7eb833c95828 req-b688b732-d49e-4755-9033-cd3f9c4e1b07 service nova] Creating event network-vif-plugged:ca50f224-7f39-4ced-a4ed-cb62c61580db for instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 on n-h1-858129-2 Sep 16 14:28:29.316747 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1566c63c-946d-4a36-a868-7eb833c95828 req-b688b732-d49e-4755-9033-cd3f9c4e1b07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062788 Sep 16 14:28:29.318574 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2809/5603] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:29.495419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:29.573751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec6414a4-2934-4183-8427-c6704aa8e9cb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.614977 Sep 16 14:28:29.579733 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2795/5604] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:28 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:29.883056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:29.886176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:29.897137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:29.901835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:29.902645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:29.903755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:29.904251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:29.904783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:30.173930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:30.185015 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e811f7a4-c689-42c9-bf6e-d31b8c4ef675 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1313 microversion: 2.1 time: 0.309056 Sep 16 14:28:30.186475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2810/5605] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:29 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:30.616106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:30.617003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:30.620332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:30.638599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:30.639591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:30.640257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:30.641763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:30.643027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:30.644056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:30.938492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:30.954756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae0af3e0-e1ea-47ab-9f49-a9d73b629253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.344129 Sep 16 14:28:30.967449 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2796/5606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:30 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:31.242568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:31.243486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:31.280151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:31.281416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:31.282439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:31.283830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:31.284901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:31.286114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:31.764905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:31.789252 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2a826fc8-6084-482e-8eeb-0f05e884fac1 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1462 microversion: 2.1 time: 0.556521 Sep 16 14:28:31.797614 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2811/5607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:31 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1462 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:31.855866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "976d89e0-15d5-4c47-96ec-749cd57acb1d", "device": "/dev/sdb"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:31.865345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:31.888530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:31.890179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:31.891168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:31.893017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:31.894903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:31.895924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:32.099919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23ab2dbd-4961-4db4-b3a7-db2cea421dc6 tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] Calling method '.version_select at 0x7f724c2eec10>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:32.363011 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-23ab2dbd-4961-4db4-b3a7-db2cea421dc6 tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502/defaults" status: 200 len: 371 microversion: 2.1 time: 0.873492 Sep 16 14:28:32.364755 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2797/5608] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:28:31 2022] GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502/defaults => generated 371 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:32.370562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:32.371502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:32.381184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:32.382122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:32.383295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:32.384634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:32.385588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:32.386379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:32.638185 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0d6bc96d-e07f-49ff-ad90-2a58a69c9931 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "POST /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810120 Sep 16 14:28:32.651035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2812/5609] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:28:31 2022] POST /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:32.658076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c266236-1763-4485-aceb-b2e053775e59 tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] Calling method '.version_select at 0x7f724d0cb8b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:32.751882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:32.764345 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43ebf757-675a-423a-a115-1174ce3ce90c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.398122 Sep 16 14:28:32.767019 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2798/5610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:32 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:33.178542 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c266236-1763-4485-aceb-b2e053775e59 tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502" status: 200 len: 371 microversion: 2.1 time: 0.525646 Sep 16 14:28:33.179538 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2813/5611] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 14:28:32 2022] GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502 => generated 371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:33.197258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ecfe0a51-660a-4261-a48a-c7b9b0555faf tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] Calling method '.version_select at 0x7f7251769e50>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:33.321007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ecfe0a51-660a-4261-a48a-c7b9b0555faf tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502/defaults" status: 200 len: 371 microversion: 2.1 time: 0.127568 Sep 16 14:28:33.321852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2799/5612] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 14:28:33 2022] GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502/defaults => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:28:33.343715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c71d965-6fca-4386-ae3b-e918ef28423e tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] Calling method '.version_select at 0x7f724c15b700>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:33.679883 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c71d965-6fca-4386-ae3b-e918ef28423e tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502" status: 200 len: 371 microversion: 2.1 time: 0.338499 Sep 16 14:28:33.685995 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2814/5613] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 14:28:33 2022] GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502 => generated 371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:33.711618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ccd1a1f2-f4e5-47c2-b3b5-0f7e258fcf8d tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] Calling method '.version_select at 0x7f724c2ee940>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:33.801885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:33.802752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:33.819860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:33.820960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:33.825902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:33.828842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:33.829647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:33.833032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:34.131061 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ccd1a1f2-f4e5-47c2-b3b5-0f7e258fcf8d tempest-QuotasTestJSON-2029865596 tempest-QuotasTestJSON-2029865596-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502?user_id=e40af07105f341928470ebaf9f9c851b" status: 200 len: 371 microversion: 2.1 time: 0.428187 Sep 16 14:28:34.132323 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2800/5614] 10.222.0.60 () {58 vars in 1323 bytes} [Fri Sep 16 14:28:33 2022] GET /compute/v2.1/os-quota-sets/44d2e99123cf48ddb01154049015a502?user_id=e40af07105f341928470ebaf9f9c851b => generated 371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:34.218286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:34.263388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0662e56-8be3-4d2a-8a0e-12b405db149a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.461658 Sep 16 14:28:34.265576 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2815/5615] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:33 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:34.502949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5a820016-de73-42c4-a8ce-b2a31d8f8e5a tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c4dc700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:34.592684 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5a820016-de73-42c4-a8ce-b2a31d8f8e5a tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b5488336-0522-43dc-bd5a-6d4ece23cee1" status: 200 len: 350 microversion: 2.1 time: 0.094866 Sep 16 14:28:34.594007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2801/5616] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:34 2022] GET /compute/v2.1/os-volumes/b5488336-0522-43dc-bd5a-6d4ece23cee1 => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:35.303404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:35.304530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:35.366127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:35.372279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:35.373149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:35.374533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:35.375349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:35.376056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:35.714811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:35.732591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fff9809-86d8-429d-833a-6f6cd50c838b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.440019 Sep 16 14:28:35.733652 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2816/5617] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:35 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:36.760078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:36.761020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:36.777761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:36.778267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:36.778744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:36.779462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:36.779924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:36.780354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:37.059413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:37.073077 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7d06220-26d8-4504-96fd-fc28c79e8b63 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.319497 Sep 16 14:28:37.074558 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2802/5618] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:36 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:37.778800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05df8431-2809-465e-9520-554face9f7e3 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c1521f0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:37.854739 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05df8431-2809-465e-9520-554face9f7e3 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/32ded0f5-3915-4e47-be36-599482bdcce4" status: 200 len: 350 microversion: 2.1 time: 0.080270 Sep 16 14:28:37.870236 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2817/5619] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:37 2022] GET /compute/v2.1/os-volumes/32ded0f5-3915-4e47-be36-599482bdcce4 => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:38.100060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:38.101634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:38.117843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:38.118695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:38.119592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:38.120547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:38.123201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:38.123997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:38.523149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:38.537185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e62e7123-566c-4952-bdaf-1f5fa05c949b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.442097 Sep 16 14:28:38.539350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2803/5620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:38 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:39.074227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:39.078396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:39.091740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:39.092636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:39.093236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:39.094144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:39.094794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:39.095756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:39.143081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:28:39.290367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83824c29-71c2-4555-907f-348567ce5feb tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 204 len: 0 microversion: 2.1 time: 0.895011 Sep 16 14:28:39.290367 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2818/5621] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:28:38 2022] DELETE /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:28:39.299852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:39.301460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:39.310732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:39.311524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:39.312147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:39.313277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:39.314074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:39.314811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:39.508576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:39.520875 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b22a9ea1-8ce1-405e-ab3f-b4d2675293a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1732 microversion: 2.1 time: 0.226029 Sep 16 14:28:39.540326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2804/5622] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:39 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1732 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:39.572422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:39.583214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:39.590052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:39.590680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:39.591346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:39.592268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:39.592928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:39.593539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:39.821846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:39.834151 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41b194b3-40eb-4954-9288-6db43b9f1c61 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.270714 Sep 16 14:28:39.835743 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2819/5623] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:39 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:40.549022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:40.550304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:40.589034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:40.595229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:40.595807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:40.596651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:40.597773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:40.598219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:40.667916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee9b624c-3676-4f59-880d-5475467fbb9a tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c16a940>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:40.811256 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee9b624c-3676-4f59-880d-5475467fbb9a tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/055c9ed3-31a6-4eff-b482-c79535883772" status: 200 len: 351 microversion: 2.1 time: 0.147678 Sep 16 14:28:40.811837 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2820/5624] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 14:28:40 2022] GET /compute/v2.1/os-volumes/055c9ed3-31a6-4eff-b482-c79535883772 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:28:40.826513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1b0fa8a-e8c8-4c63-8af1-bf41b78a8350 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c25e3a0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:40.986293 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1b0fa8a-e8c8-4c63-8af1-bf41b78a8350 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.163505 Sep 16 14:28:40.991247 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2821/5625] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Sep 16 14:28:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:40.997357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:40.998272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:41.008697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:41.009895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:41.010614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:41.011646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:41.012499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:41.013278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:41.658506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:41.682187 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79355df0-78c6-4a0d-a51d-9d867e91016f tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1732 microversion: 2.1 time: 1.136782 Sep 16 14:28:41.683674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2805/5626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:40 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1732 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:41.695732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a58ef64-09f8-47f3-90ed-feb4864d3cd5 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f7251691700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:41.825725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a58ef64-09f8-47f3-90ed-feb4864d3cd5 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.140218 Sep 16 14:28:41.826048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:41.827540 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2806/5627] 10.222.0.60 () {58 vars in 1149 bytes} [Fri Sep 16 14:28:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:41.835259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c0e76bf-ab1d-4105-bc5a-139dd546af29 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.842508 Sep 16 14:28:41.839997 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2822/5628] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:40 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:41.845948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13fc75ca-01a6-47b2-9ed2-d30d2f9cad3d tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c1b0430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:41.990930 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13fc75ca-01a6-47b2-9ed2-d30d2f9cad3d tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.149435 Sep 16 14:28:42.000604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2807/5629] 10.222.0.60 () {58 vars in 1134 bytes} [Fri Sep 16 14:28:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:42.011534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bfeaf303-3fac-4791-bfa6-c0625a97ca7e tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c16a4c0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:42.204429 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bfeaf303-3fac-4791-bfa6-c0625a97ca7e tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.201681 Sep 16 14:28:42.205543 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2823/5630] 10.222.0.60 () {58 vars in 1167 bytes} [Fri Sep 16 14:28:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:42.227525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-994424ba-834d-4c92-9685-c182c9009dc4 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c1b0040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:42.413145 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-994424ba-834d-4c92-9685-c182c9009dc4 tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194470 Sep 16 14:28:42.416371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2808/5631] 10.222.0.60 () {58 vars in 1170 bytes} [Fri Sep 16 14:28:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:42.432761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-286284a1-9b30-4a86-9508-4564d141027d tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c152a60>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:42.574570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b4883492-2ec3-4749-ae41-9cffbcc05b24 req-7ef3443c-70ec-450c-a1c5-39735221e9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e159bca0-0aa7-49e7-8786-e45f6ab9c955", "name": "network-vif-deleted", "tag": "958ce341-a491-4067-98bc-32737a0751ab"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:28:42.622775 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-286284a1-9b30-4a86-9508-4564d141027d tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.196181 Sep 16 14:28:42.623925 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2824/5632] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 14:28:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:42.626464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4883492-2ec3-4749-ae41-9cffbcc05b24 req-7ef3443c-70ec-450c-a1c5-39735221e9a6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:42.627593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4883492-2ec3-4749-ae41-9cffbcc05b24 req-7ef3443c-70ec-450c-a1c5-39735221e9a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:42.629327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b4883492-2ec3-4749-ae41-9cffbcc05b24 req-7ef3443c-70ec-450c-a1c5-39735221e9a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:42.645621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d052b84-0dcc-4e71-8e62-7837b47a05ea tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c1ad8b0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:42.684573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b4883492-2ec3-4749-ae41-9cffbcc05b24 req-7ef3443c-70ec-450c-a1c5-39735221e9a6 service nova] Creating event network-vif-deleted:958ce341-a491-4067-98bc-32737a0751ab for instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 on n-h1-858129-2 Sep 16 14:28:42.702085 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b4883492-2ec3-4749-ae41-9cffbcc05b24 req-7ef3443c-70ec-450c-a1c5-39735221e9a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143109 Sep 16 14:28:42.708457 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2809/5633] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:42.732477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:42.738983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:42.759040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:42.759825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:42.761225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:42.765172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:42.766030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:42.767117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:42.856159 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d052b84-0dcc-4e71-8e62-7837b47a05ea tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.215006 Sep 16 14:28:42.866762 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2825/5634] 10.222.0.60 () {58 vars in 1188 bytes} [Fri Sep 16 14:28:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:28:42.876218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:42.876401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:42.876742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:42.879847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:42.882156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:42.883109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lazy-loading 'fault' on Instance uuid e159bca0-0aa7-49e7-8786-e45f6ab9c955 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:28:42.899546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:42.900734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:42.903486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:42.904328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:42.906160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:42.907442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:43.039290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a43d12320824d39bb777e43f226e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaad41e9f2141e3af895994b0f722ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:43.060281 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01cc20ee-00a7-45ff-80f3-19374f13c6a1 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 200 len: 1387 microversion: 2.1 time: 0.346604 Sep 16 14:28:43.065949 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2810/5635] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:42 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 1387 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:43.084993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0dd6a80-2045-4166-9c86-850abb581fbb tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] Calling method '.version_select at 0x7f724c294430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:43.215969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:43.227541 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c6575ca-3bc4-4728-8963-a642cc097b46 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.359138 Sep 16 14:28:43.241049 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2826/5636] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:42 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:43.264524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0dd6a80-2045-4166-9c86-850abb581fbb tempest-VolumesTestJSON-973975206 tempest-VolumesTestJSON-973975206-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197146 Sep 16 14:28:43.279203 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2811/5637] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 14:28:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:44.107962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:44.113309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:44.120650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:44.123550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:44.124283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:44.124906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:44.126592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:44.127654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:44.129926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:44.147977 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] HTTP exception thrown: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Request method failure captured: Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 HTTP/1.1 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaM0-h_pLQHao7mGJ_TlV_k88TEQ6oKbTNXiXwSVUCBEHq0pTwof5mURd44MtC0s8vXtmd3W7x9XiRjA7aaETyDPm5EoI4fDGaeZ-hdmCe-1BizbP7ATZLU4pFtnf3vayFMZEm1t6hJ3nTrjLWuN4vI0kabeKLMXd4s1uawnU_4hGo Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: eaaad41e9f2141e3af895994b0f722ef Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestServerBasicOps-444645803 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eaaad41e9f2141e3af895994b0f722ef", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaaad41e9f2141e3af895994b0f722ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eaaad41e9f2141e3af895994b0f722ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaaad41e9f2141e3af895994b0f722ef"}]}] Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestServerBasicOps-444645803 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: eaaad41e9f2141e3af895994b0f722ef Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestServerBasicOps-444645803 Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestServerBasicOps-444645803-project Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8a43d12320824d39bb777e43f226e98c Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestServerBasicOps-444645803-project Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e159bca0-0aa7-49e7-8786-e45f6ab9c955'} Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:44.149887 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:44.154445 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:44.156678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Returning 404 to user: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:28:44.157976 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37e05628-8910-4f88-991b-922a6d7b35a9 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 404 len: 111 microversion: 2.1 time: 0.054133 Sep 16 14:28:44.158957 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2827/5638] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:44 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:28:44.251768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:44.258059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:44.258731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:44.291798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:44.294474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:44.295016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:44.297228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:44.297933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:44.299320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:44.522119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:44.532074 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b605c36c-4816-48e1-b1d1-e73a67c65d0e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.282654 Sep 16 14:28:44.533407 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2812/5639] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:44 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:45.057405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:45.058235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:45.064899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:45.066454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:45.067113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:45.068105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:45.068687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:45.069371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:45.086435 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] HTTP exception thrown: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Request method failure captured: Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 HTTP/1.1 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIaM0-h_pLQHao7mGJ_TlV_k88TEQ6oKbTNXiXwSVUCBEHq0pTwof5mURd44MtC0s8vXtmd3W7x9XiRjA7aaETyDPm5EoI4fDGaeZ-hdmCe-1BizbP7ATZLU4pFtnf3vayFMZEm1t6hJ3nTrjLWuN4vI0kabeKLMXd4s1uawnU_4hGo Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: eaaad41e9f2141e3af895994b0f722ef Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestServerBasicOps-444645803 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eaaad41e9f2141e3af895994b0f722ef", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaaad41e9f2141e3af895994b0f722ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eaaad41e9f2141e3af895994b0f722ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaaad41e9f2141e3af895994b0f722ef"}]}] Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestServerBasicOps-444645803 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: eaaad41e9f2141e3af895994b0f722ef Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestServerBasicOps-444645803 Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestServerBasicOps-444645803-project Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 8a43d12320824d39bb777e43f226e98c Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestServerBasicOps-444645803-project Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e159bca0-0aa7-49e7-8786-e45f6ab9c955'} Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:28:45.088521 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.091897 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.094075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Returning 404 to user: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:28:45.095202 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-745740c8-0ca2-4901-a08d-6d217c0cd85a tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 404 len: 111 microversion: 2.1 time: 0.041899 Sep 16 14:28:45.100121 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2828/5640] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:28:45 2022] DELETE /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:28:45.106523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:45.107320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] [instance: e159bca0-0aa7-49e7-8786-e45f6ab9c955] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:45.117166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:45.118294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:45.119152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:45.120657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:45.121751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:45.123075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:45.139385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] HTTP exception thrown: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Request method failure captured: Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 HTTP/1.1 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIaM0-h_pLQHao7mGJ_TlV_k88TEQ6oKbTNXiXwSVUCBEHq0pTwof5mURd44MtC0s8vXtmd3W7x9XiRjA7aaETyDPm5EoI4fDGaeZ-hdmCe-1BizbP7ATZLU4pFtnf3vayFMZEm1t6hJ3nTrjLWuN4vI0kabeKLMXd4s1uawnU_4hGo Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: eaaad41e9f2141e3af895994b0f722ef Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestServerBasicOps-444645803 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eaaad41e9f2141e3af895994b0f722ef", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaaad41e9f2141e3af895994b0f722ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eaaad41e9f2141e3af895994b0f722ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaaad41e9f2141e3af895994b0f722ef"}]}] Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestServerBasicOps-444645803 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: eaaad41e9f2141e3af895994b0f722ef Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestServerBasicOps-444645803 Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestServerBasicOps-444645803-project Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 8a43d12320824d39bb777e43f226e98c Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestServerBasicOps-444645803-project Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e159bca0-0aa7-49e7-8786-e45f6ab9c955'} Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:28:45.141297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. Sep 16 14:28:45.145451 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:28:45.146720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Returning 404 to user: Instance e159bca0-0aa7-49e7-8786-e45f6ab9c955 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:28:45.147742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67825462-224a-4eab-8451-58e74e68eb3b tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955" status: 404 len: 111 microversion: 2.1 time: 0.046680 Sep 16 14:28:45.148801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2813/5641] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:45 2022] GET /compute/v2.1/servers/e159bca0-0aa7-49e7-8786-e45f6ab9c955 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:28:45.406506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2bb78cf2-ff8a-48fb-800e-029d517a81f8 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] Calling method '.version_select at 0x7f724d421ee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:45.445371 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2bb78cf2-ff8a-48fb-800e-029d517a81f8 tempest-TestServerBasicOps-444645803 tempest-TestServerBasicOps-444645803-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-757546372" status: 202 len: 0 microversion: 2.1 time: 0.043269 Sep 16 14:28:45.449839 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2829/5642] 10.222.0.60 () {58 vars in 1251 bytes} [Fri Sep 16 14:28:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-757546372 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:28:45.559063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:45.559900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:45.571121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:45.571950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:45.572666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:45.573666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:45.574326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:45.574998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:45.823611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:45.834036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-084d0357-a6e3-4e56-8e3d-76b1f89d5239 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.278956 Sep 16 14:28:45.842913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2814/5643] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:45 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:46.860533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:46.862015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:46.892908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:46.896558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:46.898040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:46.900523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:46.902373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:46.904063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:47.542341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:47.559344 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3dd44b0d-3458-47df-8d0d-8405da69f632 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.702796 Sep 16 14:28:47.574888 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2830/5644] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:46 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:48.603736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:48.606454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:48.650676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:48.651384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:48.651950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:48.654330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:48.655316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:48.658285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:49.107064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:49.118619 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-913c5410-eab9-444b-a86b-09cb983e010e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.534815 Sep 16 14:28:49.137621 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2815/5645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:48 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:50.153024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:50.155819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:50.178058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:50.179098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:50.185047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:50.194854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:50.200131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:50.203413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:50.579500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:50.590904 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fcfcc3b-0035-42a5-826b-3a1dd31a588c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.449327 Sep 16 14:28:50.591619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2831/5646] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:50 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:51.621923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:51.623306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:51.633638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:51.635576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:51.636457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:51.637582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:51.638293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:51.639612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:52.183609 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:28:52.184030 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 14:28:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 (ip 10.222.0.60) !!! Sep 16 14:28:52.348399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:52.357985 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ae3399f5-ea5a-4840-beeb-6515c9879bdc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.741688 Sep 16 14:28:52.363097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2816/5647] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:51 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:53.389125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:53.390336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:53.402023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:53.408075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:53.410644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:53.411679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:53.426520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:53.431480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:53.437310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:54.161933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:54.186117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:54.200148 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36982c15-4ef9-4496-ac49-678e3a74b528 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.815275 Sep 16 14:28:54.201651 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2832/5648] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:53 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:55.235265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:55.239065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:55.257806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:55.258746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:55.259541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:55.260847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:55.261929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:55.263267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:55.834195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:55.854857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:28:55.866506 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8bed996f-f3c4-4423-982b-6d9ae78e04aa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.642889 Sep 16 14:28:55.867574 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2817/5649] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:55 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:56.921879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:56.929611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:56.978938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:56.979851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:56.982695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:56.990962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:56.994978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:56.995976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:57.829497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:57.844970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc8182ef-f425-4c34-a414-d4d7a5c68b39 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1520 microversion: 2.1 time: 0.936586 Sep 16 14:28:57.847946 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2833/5650] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:56 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1520 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:58.894809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:58.895450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:58.912523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:58.913128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:58.913589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:58.914357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:58.914862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:58.915301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:59.479086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:59.508788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79095ec8-4d64-420d-8702-2527cbf81343 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1500 microversion: 2.1 time: 0.616906 Sep 16 14:28:59.525774 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2818/5651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:58 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1500 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:28:59.541828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:28:59.543106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:28:59.569272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:59.571208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:59.571883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:59.575824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:28:59.576480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:28:59.577071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:28:59.958710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:28:59.968806 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-50bbf055-3333-425e-a1ba-f5abe30de955 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1514 microversion: 2.1 time: 0.430853 Sep 16 14:28:59.972542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2834/5652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:28:59 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1514 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:28:59.999829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0eeaa784-be1d-499d-89c4-0a84d0369c96 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:00.004127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0eeaa784-be1d-499d-89c4-0a84d0369c96 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 679ba933-31a2-4f03-93fe-7e21b7307b46] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:00.032291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0eeaa784-be1d-499d-89c4-0a84d0369c96 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Instance 679ba933-31a2-4f03-93fe-7e21b7307b46 could not be found. Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0eeaa784-be1d-499d-89c4-0a84d0369c96 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/679ba933-31a2-4f03-93fe-7e21b7307b46/action HTTP/1.1 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 14 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: {"rescue": {}} Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 679ba933-31a2-4f03-93fe-7e21b7307b46 could not be found. Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '679ba933-31a2-4f03-93fe-7e21b7307b46', 'body': {'rescue': {}}} Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679ba933-31a2-4f03-93fe-7e21b7307b46 could not be found. Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679ba933-31a2-4f03-93fe-7e21b7307b46 could not be found. Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:00.044281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679ba933-31a2-4f03-93fe-7e21b7307b46 could not be found. Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:00.050113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0eeaa784-be1d-499d-89c4-0a84d0369c96 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 404 to user: Instance 679ba933-31a2-4f03-93fe-7e21b7307b46 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:00.061808 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0eeaa784-be1d-499d-89c4-0a84d0369c96 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/679ba933-31a2-4f03-93fe-7e21b7307b46/action" status: 404 len: 111 microversion: 2.1 time: 0.055095 Sep 16 14:29:00.077434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:00.081506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:00.085928 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2819/5653] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:28:59 2022] POST /compute/v2.1/servers/679ba933-31a2-4f03-93fe-7e21b7307b46/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:29:00.097159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:00.102228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:00.102742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:00.103928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:00.104398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:00.105404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:00.305919 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c542bb5-d423-4e61-9c0f-31c0aa51aef4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.231650 Sep 16 14:29:00.310595 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2835/5654] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:29:00 2022] POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:29:00.316513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:00.317421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:00.332031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:00.333825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:00.335545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:00.337149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:00.337800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:00.338684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:00.908397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:00.945614 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f8a7ba3-6927-451c-9a2d-af3057b88f7a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1519 microversion: 2.1 time: 0.626813 Sep 16 14:29:00.950788 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2820/5655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:00 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1519 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:29:02.003519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:02.008655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:02.029092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:02.029986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:02.030819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:02.032159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:02.033021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:02.033804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:02.425286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:02.438041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ccab20ee-73e3-4e4c-871e-e18a530ee802 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1499 microversion: 2.1 time: 0.445783 Sep 16 14:29:02.439376 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2836/5656] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:01 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1499 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:02.514105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:02.525354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:02.532903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=46 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:02.560219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:02.560731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:02.563233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:02.564072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:02.567688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:02.569897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:02.666611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'flavor' on Instance uuid ec860017-4a48-4dde-8f14-3a4187a16ab6 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:29:02.721537 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Cannot 'rescue' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state paused Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action HTTP/1.1 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 14 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: {"rescue": {}} Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: exception: Cannot 'rescue' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state paused Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ec860017-4a48-4dde-8f14-3a4187a16ab6', 'body': {'rescue': {}}} Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 in vm_state paused. Cannot rescue while the instance is in this state. Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state paused Sep 16 14:29:02.722890 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state paused Sep 16 14:29:02.727095 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:02.736632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 409 to user: Cannot 'rescue' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state paused {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:02.738841 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6920f4b3-abf4-4b44-94fb-799f248f4212 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action" status: 409 len: 144 microversion: 2.1 time: 0.228852 Sep 16 14:29:02.750523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2821/5657] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:29:02 2022] POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action => generated 144 bytes in 241 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:29:02.757249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:02.758031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:02.768384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:02.771644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:02.772316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:02.773081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:02.773531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:02.777548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:03.031384 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1aded4ba-daf2-4961-895d-52c6bf2e0872 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.278789 Sep 16 14:29:03.033645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2837/5658] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:29:02 2022] POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:29:03.043427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:03.044047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:03.055845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:03.056354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:03.057034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:03.057862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:03.058350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:03.058798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:04.095466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:04.123152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2257b2cc-1373-4ef2-8728-9f245b688dc5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1506 microversion: 2.1 time: 1.082317 Sep 16 14:29:04.125657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2822/5659] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:03 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1506 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:05.165224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:05.166025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:05.180935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:05.183840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:05.185248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:05.186460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:05.188276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:05.190677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:05.632601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:05.665718 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8f45e5ad-ebd3-4cd7-b80a-357e97ee8d36 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1514 microversion: 2.1 time: 0.504051 Sep 16 14:29:05.678668 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2838/5660] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:05 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1514 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:09.347313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:09.350937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:09.364323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:09.365063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:09.365727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:09.366843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:09.367892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:09.368549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:09.449497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'flavor' on Instance uuid ec860017-4a48-4dde-8f14-3a4187a16ab6 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:29:09.819270 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e85e68c7-f7ed-4460-9647-3a9b3c4c6fcb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action" status: 200 len: 32 microversion: 2.1 time: 0.477912 Sep 16 14:29:09.822806 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2823/5661] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:29:09 2022] POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action => generated 32 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:29:09.839803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:09.841097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:09.864984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:09.865930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:09.867891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:09.870674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:09.873235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:09.874030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:11.081822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:11.107248 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a8021346-190b-4b38-8c4b-dd7e47ed8259 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 1.276203 Sep 16 14:29:11.114637 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2839/5662] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:09 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:12.143731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:12.145862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:12.167810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:12.168339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:12.168779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:12.169522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:12.169982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:12.170502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:12.439451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:12.466805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-373039d6-818e-4e03-ae5f-46ee84966c01 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.324903 Sep 16 14:29:12.486392 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2824/5663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:12 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:13.496237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:13.497351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:13.535823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:13.536700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:13.537498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:13.545041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:13.548453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:13.549286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:13.879600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:13.914103 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0492d21-f88b-4b7b-8ac2-ef0bfc1688a7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.424777 Sep 16 14:29:13.914945 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2840/5664] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:13 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:14.943172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:14.943799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:14.954071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:14.954604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:14.959135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:14.960149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:14.960791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:14.967144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:15.408772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:15.426192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a79999c-64d4-49cf-bb50-c55d70fdf653 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.486635 Sep 16 14:29:15.455130 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2825/5665] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:14 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:29:16.451791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:16.452678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:16.469817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:16.470722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:16.471808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:16.474840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:16.476014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:16.477065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:16.746628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:16.758634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe719714-9bc0-4e76-b0bf-9a4495818680 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.312128 Sep 16 14:29:16.759780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2841/5666] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:16 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:17.790076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:17.793805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:17.822469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:17.823334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:17.824146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:17.825464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:17.826352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:17.827190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:18.222974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:18.255595 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7e8fb69-4b59-46fd-96a4-f7b616f2e8c8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.470242 Sep 16 14:29:18.257463 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2826/5667] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:17 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:29:19.304335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:19.306255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:19.351046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:19.354492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:19.356633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:19.360552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:19.363313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:19.366712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:19.769025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:19.782474 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-820f2c94-50eb-42eb-a1be-d59c18c0d6e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.486578 Sep 16 14:29:19.783921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2842/5668] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:19 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:20.826722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:20.829988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:20.849302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:20.851453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:20.853181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:20.855091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:20.856374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:20.857435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:21.283469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:21.323530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2dc1fa3a-329d-44a8-9d8e-43a9eb99b5ea tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.507116 Sep 16 14:29:21.327681 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2827/5669] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:20 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:22.355511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:22.359058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:22.367784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.368459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.368792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.369778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.370133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.370584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.375787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:22.379341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:22.397957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.404544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.405743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.407213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.408567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.409816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.414386 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1c48cfc-dfe3-46ab-82ba-1221aceefdc8 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064172 Sep 16 14:29:22.415029 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2843/5670] 10.222.0.60 () {60 vars in 1343 bytes} [Fri Sep 16 14:29:22 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:29:22.578243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:22.578992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:22.589175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.590037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.590782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.591951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.592561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.593266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.634264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:29:22.716733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:22.748354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e93df293-6e31-4a9f-a060-08d0840a5521 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.384439 Sep 16 14:29:22.762447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2828/5671] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:22 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:22.798333 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d09b610-30c7-40e3-8b46-4eed302ecee9 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 204 len: 0 microversion: 2.20 time: 0.225016 Sep 16 14:29:22.800258 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2844/5672] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:29:22 2022] DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 14:29:22.810588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:22.811223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:22.818803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.819313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.819839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:22.820735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:22.821206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:22.821638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:23.089767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:23.100048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:23.101529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:23.102803 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-944187ba-de44-4e7d-8c3a-46dd5844d114 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.298112 Sep 16 14:29:23.103596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2829/5673] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:22 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:29:23.814597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:23.815985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:23.818841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:23.835405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:23.835989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:23.837009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:23.838110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:23.838879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:23.839554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:24.114637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:24.121268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:24.125402 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41e6537c-9f2e-4394-9592-43d247bb4154 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.321243 Sep 16 14:29:24.130698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:24.131400 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2845/5674] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:23 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:24.132198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:24.140408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:24.141012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:24.141576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:24.142302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:24.142806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:24.143295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:24.427806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:24.447081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:24.455585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:24.458458 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a10e1fd-b39c-430f-82bd-485acdeb6115 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.332710 Sep 16 14:29:24.459926 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2830/5675] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:24 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:29:25.155562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:25.157658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:25.174235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:25.176113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:25.176799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:25.178171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:25.179117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:25.179966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:25.516510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:25.517616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:25.544622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:25.545464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:25.546241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:25.547490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:25.548289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:25.555929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:25.736200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:25.767312 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5a84675b-40f2-4709-9577-a5a2f6214f56 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.619721 Sep 16 14:29:25.775912 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2846/5676] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:25 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:26.031471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:26.061457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:26.064668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:26.067807 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-448c0ca9-c343-4315-97e8-c256d941d039 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1722 microversion: 2.20 time: 0.556798 Sep 16 14:29:26.078938 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2831/5677] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:25 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1722 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 14:29:26.812530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:26.815495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:26.862752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e26b2ace-de8e-4c9f-ae49-6efc3b8cdfaf req-7dffb1ac-f3a6-4866-a51d-248ac6bd1966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8abaf9c-8e3f-4a84-a560-ee024191b12d", "name": "network-vif-deleted", "tag": "ab40a508-df53-4ad5-b01c-a27cc2675719"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:26.882910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:26.883508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:26.884259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:26.885518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:26.886240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:26.915403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:26.943151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e26b2ace-de8e-4c9f-ae49-6efc3b8cdfaf req-7dffb1ac-f3a6-4866-a51d-248ac6bd1966 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:26.943973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e26b2ace-de8e-4c9f-ae49-6efc3b8cdfaf req-7dffb1ac-f3a6-4866-a51d-248ac6bd1966 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:26.944684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e26b2ace-de8e-4c9f-ae49-6efc3b8cdfaf req-7dffb1ac-f3a6-4866-a51d-248ac6bd1966 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:27.037819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e26b2ace-de8e-4c9f-ae49-6efc3b8cdfaf req-7dffb1ac-f3a6-4866-a51d-248ac6bd1966 service nova] Creating event network-vif-deleted:ab40a508-df53-4ad5-b01c-a27cc2675719 for instance a8abaf9c-8e3f-4a84-a560-ee024191b12d on n-h2-858129-2 Sep 16 14:29:27.085921 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e26b2ace-de8e-4c9f-ae49-6efc3b8cdfaf req-7dffb1ac-f3a6-4866-a51d-248ac6bd1966 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236089 Sep 16 14:29:27.092944 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2832/5678] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:29:27.128416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:27.134526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:27.166580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:27.167485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:27.168311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:27.169560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:27.170383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:27.171446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:27.340090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:27.341848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:27.347021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:27.348717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lazy-loading 'fault' on Instance uuid a8abaf9c-8e3f-4a84-a560-ee024191b12d {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:29:27.638854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:27.684169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:27.691722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:27.692883 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ebce6d42-4a1d-4f17-a658-516cf4e80b44 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1500 microversion: 2.1 time: 0.888251 Sep 16 14:29:27.694336 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2847/5679] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:26 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1500 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:27.741973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b923f93c-c914-480d-8ece-8c9e7bcf8001"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:27.758450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:27.758450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6830539834e941eaa36dcb955b57194d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057a5157844b15bb19ece760a72ce5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:27.765127 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-714b15cf-d96f-4073-bd82-cc3782af0f91 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 200 len: 1371 microversion: 2.20 time: 0.652120 Sep 16 14:29:27.771403 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2833/5680] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:27 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 1371 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 14:29:27.775012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:27.851354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:27.851354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:27.857659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:27.859229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:27.860154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:27.862932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:27.920781 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Cannot 'attach_volume' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state rescued Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/os-volume_attachments HTTP/1.1 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 74 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: {"volumeAttachment": {"volumeId": "b923f93c-c914-480d-8ece-8c9e7bcf8001"}} Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot 'attach_volume' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state rescued Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': 'ec860017-4a48-4dde-8f14-3a4187a16ab6', 'body': {'volumeAttachment': {'volumeId': 'b923f93c-c914-480d-8ece-8c9e7bcf8001'}}} Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 16 14:29:27.926026 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state rescued Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state rescued Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:27.931780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 409 to user: Cannot 'attach_volume' instance ec860017-4a48-4dde-8f14-3a4187a16ab6 while it is in vm_state rescued {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:27.933912 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bef5eb1a-b653-4fcf-879a-a51a8b62d40a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.201383 Sep 16 14:29:27.935186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2848/5681] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:29:27 2022] POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/os-volume_attachments => generated 152 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:29:27.951574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:27.952630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:28.004512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:28.005677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:28.006471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:28.013931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:28.015186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:28.018982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:28.277348 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-089195f1-90b7-405a-af70-10f973186c26 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.334963 Sep 16 14:29:28.281731 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2834/5682] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:29:27 2022] POST /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:29:28.301263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:28.303085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:28.355104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:28.356916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:28.358098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:28.358935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:28.362938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:28.371172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:28.825562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:28.833691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:28.873594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:28.874362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:28.875103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:28.882093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:28.883854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:28.884930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:28.952305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] HTTP exception thrown: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Request method failure captured: Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d HTTP/1.1 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIWa4-Y0Ua5K-hQb4nN5FixexB-iaA9GvS1t_xrHBX45UZvCBAqbUZzEtJpd59lsMyep16GxVXlcZmet68hjFLa8FskpzNmQFXaWZusm0__sTWCQpJ7qSSXOU950wBm0VgqJZOhkvXkpsoSOoS0babnF7zPB9CwifT59FxOiHXxAYSw Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d8057a5157844b15bb19ece760a72ce5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}] Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6830539834e941eaa36dcb955b57194d Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a8abaf9c-8e3f-4a84-a560-ee024191b12d'} Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:28.958613 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:28.966459 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:28.972265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Returning 404 to user: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:28.984062 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0ba7691-1605-48e4-9d2d-30448d459062 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 404 len: 111 microversion: 2.20 time: 0.179412 Sep 16 14:29:28.987777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2835/5683] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:28 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:29:29.005700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-33dc395f-7a36-44a9-a84f-95ea3c0c011d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '.version_select at 0x7f72516c35e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:29.153013 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-33dc395f-7a36-44a9-a84f-95ea3c0c011d tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385613269" status: 204 len: 0 microversion: 2.20 time: 0.157157 Sep 16 14:29:29.158162 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2836/5684] 10.222.0.60 () {60 vars in 1262 bytes} [Fri Sep 16 14:29:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385613269 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 14:29:29.235799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:29.273551 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-84adebab-0d02-4b7e-9932-0bae0e52310b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1508 microversion: 2.1 time: 0.985941 Sep 16 14:29:29.280874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2849/5685] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:28 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1508 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:30.328184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:30.328941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:30.352601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:30.354579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:30.357006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:30.359235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:30.360986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:30.364414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:30.760715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:30.773102 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6904b542-8ad0-440d-8df8-bc6ef23d8263 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1508 microversion: 2.1 time: 0.449192 Sep 16 14:29:30.790945 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2837/5686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:30 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1508 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:29:31.813000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:31.814080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:31.851675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:31.852708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:31.863736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:31.865683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:31.866994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:31.868015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:32.382958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:32.406014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-25120f16-d356-4166-9e03-a3486bd911db tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1508 microversion: 2.1 time: 0.602887 Sep 16 14:29:32.408143 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2850/5687] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:31 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1508 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:33.456985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:33.458119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:33.510870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:33.513710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:33.521841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:33.526915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:33.532192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:33.533620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:33.535197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:34.240057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:34.272249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-748b90d6-2397-43a7-845c-c70d241f168f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1514 microversion: 2.1 time: 0.823724 Sep 16 14:29:34.273249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2838/5688] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:33 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1514 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:37.795479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:37.807621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:37.849723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:37.852895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:37.853677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:37.857284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:37.858855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:37.861537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:37.932214 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] HTTP exception thrown: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Request method failure captured: Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d HTTP/1.1 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIWa4-Y0Ua5K-hQb4nN5FixexB-iaA9GvS1t_xrHBX45UZvCBAqbUZzEtJpd59lsMyep16GxVXlcZmet68hjFLa8FskpzNmQFXaWZusm0__sTWCQpJ7qSSXOU950wBm0VgqJZOhkvXkpsoSOoS0babnF7zPB9CwifT59FxOiHXxAYSw Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d8057a5157844b15bb19ece760a72ce5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}] Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 6830539834e941eaa36dcb955b57194d Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'a8abaf9c-8e3f-4a84-a560-ee024191b12d'} Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:29:37.935881 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:37.946939 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:37.951683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Returning 404 to user: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:37.953719 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-927ca4f8-3bab-4851-8bc1-f42505e66991 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 404 len: 111 microversion: 2.20 time: 0.166549 Sep 16 14:29:37.955458 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2851/5689] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:29:37 2022] DELETE /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 14:29:37.968851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:37.969327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: a8abaf9c-8e3f-4a84-a560-ee024191b12d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:38.009009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:38.009837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:38.010626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:38.024917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:38.026112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:38.028634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:38.108693 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] HTTP exception thrown: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Request method failure captured: Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d HTTP/1.1 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIWa4-Y0Ua5K-hQb4nN5FixexB-iaA9GvS1t_xrHBX45UZvCBAqbUZzEtJpd59lsMyep16GxVXlcZmet68hjFLa8FskpzNmQFXaWZusm0__sTWCQpJ7qSSXOU950wBm0VgqJZOhkvXkpsoSOoS0babnF7zPB9CwifT59FxOiHXxAYSw Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d8057a5157844b15bb19ece760a72ce5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}] Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6830539834e941eaa36dcb955b57194d Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a8abaf9c-8e3f-4a84-a560-ee024191b12d'} Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:38.118517 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. Sep 16 14:29:38.126050 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:38.133562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Returning 404 to user: Instance a8abaf9c-8e3f-4a84-a560-ee024191b12d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:38.135359 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b8c4736-d45f-4495-933b-822a597d6ff1 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d" status: 404 len: 111 microversion: 2.20 time: 0.174191 Sep 16 14:29:38.144437 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2839/5690] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:37 2022] GET /compute/v2.1/servers/a8abaf9c-8e3f-4a84-a560-ee024191b12d => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:29:38.718540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6919c36-beed-4394-8133-d1d4c822f764 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'create', calling method: .version_select at 0x7f724c1ad310>, body: {"keypair": {"name": "tempest-keypair-639512528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7WmlZB7IgXB/pi9bS09Bv0eLfZU8rYe02aSWbXCXJ7HCy/7ic3frJVyoYaCbafIFJWxTBocTq6hSGDzq8YHahyxmVbuVjGVnyupUruX+vQUccJT6JvP6zwdhEItvw17A=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:38.802969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b6919c36-beed-4394-8133-d1d4c822f764 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for project e04d4359a23549d587d9bf8ea9638abd. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:29:38.814676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b6919c36-beed-4394-8133-d1d4c822f764 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for user b4ffd42c93ac48329b0e1a8b3baf0a36 and project e04d4359a23549d587d9bf8ea9638abd. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:29:38.854957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6919c36-beed-4394-8133-d1d4c822f764 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156942 Sep 16 14:29:38.858392 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2852/5691] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:29:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:29:44.302628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1525098274", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9de475fd-2eba-43da-ba4e-a6068fb30e9c"}], "security_groups": [{"name": "tempest-securitygroup--1111029931"}], "key_name": "tempest-keypair-639512528", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:44.695826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] validate_networks() for [('9de475fd-2eba-43da-ba4e-a6068fb30e9c', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:29:45.664052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:29:45.665303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:29:45.666199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:29:45.667474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:29:45.668111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:29:45.685642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:45.686463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:45.687091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:45.688236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:45.688894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:45.689529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:45.759773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for project e04d4359a23549d587d9bf8ea9638abd. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:29:45.786630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Getting quotas for user b4ffd42c93ac48329b0e1a8b3baf0a36 and project e04d4359a23549d587d9bf8ea9638abd. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:29:45.869420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:29:45.887983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:29:45.981404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-894396fe-d59b-43a1-bfc7-adef97abf0fa tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.684580 Sep 16 14:29:45.989629 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2840/5692] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:29:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:29:46.011338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be3bb1b4-b927-4890-ac40-9d1f969dc1d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:46.020438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be3bb1b4-b927-4890-ac40-9d1f969dc1d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:46.251866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be3bb1b4-b927-4890-ac40-9d1f969dc1d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:46.277182 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be3bb1b4-b927-4890-ac40-9d1f969dc1d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1245 microversion: 2.1 time: 0.281631 Sep 16 14:29:46.278907 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2853/5693] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:45 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1245 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:46.810519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:46.811191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:46.823794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:46.825206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:46.831481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:46.832991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:46.835220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:46.836589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:46.887939 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] HTTP exception thrown: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Request method failure captured: Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba HTTP/1.1 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIWa4-Y0Ua5K-hQb4nN5FixexB-iaA9GvS1t_xrHBX45UZvCBAqbUZzEtJpd59lsMyep16GxVXlcZmet68hjFLa8FskpzNmQFXaWZusm0__sTWCQpJ7qSSXOU950wBm0VgqJZOhkvXkpsoSOoS0babnF7zPB9CwifT59FxOiHXxAYSw Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d8057a5157844b15bb19ece760a72ce5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}] Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6830539834e941eaa36dcb955b57194d Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '71ac39ea-a915-4f5b-991a-f086e509d8ba'} Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:29:46.895595 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Returning 404 to user: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3e79e15-bba2-46c4-8fe9-a5f95207af9c tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 404 len: 111 microversion: 2.20 time: 0.095962 Sep 16 14:29:46.901426 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2841/5694] 10.222.0.60 () {60 vars in 1280 bytes} [Fri Sep 16 14:29:46 2022] DELETE /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:29:46.915850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:46.917803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] [instance: 71ac39ea-a915-4f5b-991a-f086e509d8ba] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:46.934772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:46.936099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:46.937135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:46.938729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:46.940402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:46.941403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:47.002133 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] HTTP exception thrown: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Request method failure captured: Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba HTTP/1.1 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIWa4-Y0Ua5K-hQb4nN5FixexB-iaA9GvS1t_xrHBX45UZvCBAqbUZzEtJpd59lsMyep16GxVXlcZmet68hjFLa8FskpzNmQFXaWZusm0__sTWCQpJ7qSSXOU950wBm0VgqJZOhkvXkpsoSOoS0babnF7zPB9CwifT59FxOiHXxAYSw Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d8057a5157844b15bb19ece760a72ce5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d8057a5157844b15bb19ece760a72ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d8057a5157844b15bb19ece760a72ce5"}]}] Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: d8057a5157844b15bb19ece760a72ce5 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82677386 Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 6830539834e941eaa36dcb955b57194d Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82677386-project Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '71ac39ea-a915-4f5b-991a-f086e509d8ba'} Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:47.025083 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. Sep 16 14:29:47.033690 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:29:47.036839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] Returning 404 to user: Instance 71ac39ea-a915-4f5b-991a-f086e509d8ba could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:29:47.042987 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26cb7c2d-1c28-4078-abae-7f9276d578c6 tempest-AttachVolumeShelveTestJSON-82677386 tempest-AttachVolumeShelveTestJSON-82677386-project] 10.222.0.60 "GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba" status: 404 len: 111 microversion: 2.20 time: 0.136389 Sep 16 14:29:47.047067 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2854/5695] 10.222.0.60 () {60 vars in 1277 bytes} [Fri Sep 16 14:29:46 2022] GET /compute/v2.1/servers/71ac39ea-a915-4f5b-991a-f086e509d8ba => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:29:47.302433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9faacd8d-d3eb-4af4-b43d-cb855abb0363 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:47.304176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9faacd8d-d3eb-4af4-b43d-cb855abb0363 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:47.397956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9faacd8d-d3eb-4af4-b43d-cb855abb0363 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:47.414591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9faacd8d-d3eb-4af4-b43d-cb855abb0363 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1245 microversion: 2.1 time: 0.115654 Sep 16 14:29:47.416148 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2842/5696] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:47 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:48.464118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:48.466680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:48.503465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:48.504513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:48.505662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:48.507537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:48.508996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:48.509784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:48.713590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:48.741937 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2641448-f368-486a-a5e7-49da1c5ab587 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1297 microversion: 2.1 time: 0.279892 Sep 16 14:29:48.743119 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2855/5697] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:48 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1297 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:49.796552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:49.803673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:49.859932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:49.867753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:49.869122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:49.877270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:49.882367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:49.885599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:50.149387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:50.186854 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d167431-e99d-4ce9-a03f-64843bab1661 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1303 microversion: 2.1 time: 0.392475 Sep 16 14:29:50.206824 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2843/5698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:49 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1303 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:51.281695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:51.295300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:51.370322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:51.379655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:51.382125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:51.383397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:51.384201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:51.391392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:52.642678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:52.676087 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-527276cc-d28b-4853-8fc5-8b483b443253 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 1.405806 Sep 16 14:29:52.683096 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2856/5699] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:51 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:53.729020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:53.731782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:53.764152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:53.767431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:53.769848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:53.772702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:53.773310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:53.775111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:54.458713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:54.479796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94e20340-d0c1-4c26-8f47-32c4c25ec262 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.765798 Sep 16 14:29:54.481833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2844/5700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:53 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:55.529968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:55.530870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:55.562709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:55.584753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:55.591712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:55.593969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:55.599641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:55.603565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:55.609591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:55.667791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=45 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:55.700133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:56.274604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:56.314008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-38bc1632-041e-452c-b0ca-6224d97cc7a6 req-2d203231-d90d-4875-acd0-e708e34014fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:29:56.318837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:56.340278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c99504f0-e948-4ccd-849c-d29ff3259cef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.812622 Sep 16 14:29:56.341080 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2857/5701] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:55 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:29:56.354472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38bc1632-041e-452c-b0ca-6224d97cc7a6 req-2d203231-d90d-4875-acd0-e708e34014fb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:56.356764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38bc1632-041e-452c-b0ca-6224d97cc7a6 req-2d203231-d90d-4875-acd0-e708e34014fb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:56.362765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38bc1632-041e-452c-b0ca-6224d97cc7a6 req-2d203231-d90d-4875-acd0-e708e34014fb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:56.407761 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-38bc1632-041e-452c-b0ca-6224d97cc7a6 req-2d203231-d90d-4875-acd0-e708e34014fb service nova] Creating event network-changed:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:29:56.440717 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-38bc1632-041e-452c-b0ca-6224d97cc7a6 req-2d203231-d90d-4875-acd0-e708e34014fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.781623 Sep 16 14:29:56.441883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2845/5702] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:29:57.377295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:57.377917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:57.400296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:57.401123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:57.401595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:57.402542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:57.403170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:57.403773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:57.752421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:57.786561 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dcdd154a-d7a2-4aa8-bff0-4ac0df03d5e7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.412207 Sep 16 14:29:57.804384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2858/5703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:57 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:29:58.869521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:29:58.870293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:29:58.892251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:58.905583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:58.906101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:58.906611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:58.907330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:29:58.907794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:29:58.908324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:29:58.916333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:29:59.653017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:29:59.670540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0b8387c-aa5c-4631-8977-3b88984a5731 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.832234 Sep 16 14:29:59.671975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2846/5704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:29:58 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:00.704759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:00.708200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:00.751963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:00.758143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:00.761613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:00.765204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:00.766325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:00.767167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:01.811092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:01.821923 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-804d062a-477c-4794-88d3-c78fd2b72ffe tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 1.125247 Sep 16 14:30:01.839493 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2859/5705] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:00 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:02.854524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:02.855736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:02.910461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:02.911250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:02.911707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:02.912494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:02.912970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:02.913390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:03.286850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:03.302838 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a75e92a-8498-40d6-b627-9c608dff4518 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.453232 Sep 16 14:30:03.303466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2847/5706] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:02 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:30:04.345504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:04.349333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:04.369902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:04.373679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:04.375056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:04.377655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:04.382234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:04.388696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:04.880580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:04.895499 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb8bcb1f-cd33-431e-a5a6-7343c100c2d7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.559330 Sep 16 14:30:04.901047 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2860/5707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:04 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:05.390823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cea2f1fa-c1a8-40ca-91cc-16530f273ca7 req-c17198e8-2a73-4699-ad10-6386ed115cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "name": "network-vif-plugged", "status": "completed", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:30:05.399059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:05.411792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cea2f1fa-c1a8-40ca-91cc-16530f273ca7 req-c17198e8-2a73-4699-ad10-6386ed115cd2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:05.412724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cea2f1fa-c1a8-40ca-91cc-16530f273ca7 req-c17198e8-2a73-4699-ad10-6386ed115cd2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:05.413507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cea2f1fa-c1a8-40ca-91cc-16530f273ca7 req-c17198e8-2a73-4699-ad10-6386ed115cd2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:05.431566 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cea2f1fa-c1a8-40ca-91cc-16530f273ca7 req-c17198e8-2a73-4699-ad10-6386ed115cd2 service nova] Creating event network-vif-plugged:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:30:05.438957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cea2f1fa-c1a8-40ca-91cc-16530f273ca7 req-c17198e8-2a73-4699-ad10-6386ed115cd2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.625014 Sep 16 14:30:05.441523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2848/5708] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:30:05.932312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:05.932892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:05.966304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:05.967707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:05.971489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:05.974739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:05.975359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:05.980209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:06.311112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:06.325363 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9ca1722e-73d5-4b80-a721-c0215756e062 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1371 microversion: 2.1 time: 0.402683 Sep 16 14:30:06.342882 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2861/5709] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:05 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:07.359690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:07.363866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:07.462520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:07.464892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:07.466653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:07.468913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:07.470272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:07.471288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:07.933313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:07.978862 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9ca548e-0b8f-4585-9453-1440ef0eb5f2 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1564 microversion: 2.1 time: 0.620184 Sep 16 14:30:07.982550 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2849/5710] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:07 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1564 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:08.011675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:08.012565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:08.034206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:08.035012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:08.035542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:08.036443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:08.038492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:08.039028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:08.300654 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f193312b-0e0d-4c32-b408-de57c7901d2e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299674 Sep 16 14:30:08.301560 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2862/5711] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:30:07 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:30:12.985379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-63685d9b-0225-4aa5-97a8-7f3ea4ddb55b req-18a3d4e8-b0a7-41aa-91ec-a42e5a82e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:30:13.063797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-63685d9b-0225-4aa5-97a8-7f3ea4ddb55b req-18a3d4e8-b0a7-41aa-91ec-a42e5a82e5b0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:13.065675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-63685d9b-0225-4aa5-97a8-7f3ea4ddb55b req-18a3d4e8-b0a7-41aa-91ec-a42e5a82e5b0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:13.071283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-63685d9b-0225-4aa5-97a8-7f3ea4ddb55b req-18a3d4e8-b0a7-41aa-91ec-a42e5a82e5b0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:13.152294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-63685d9b-0225-4aa5-97a8-7f3ea4ddb55b req-18a3d4e8-b0a7-41aa-91ec-a42e5a82e5b0 service nova] Creating event network-changed:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:30:13.206705 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-63685d9b-0225-4aa5-97a8-7f3ea4ddb55b req-18a3d4e8-b0a7-41aa-91ec-a42e5a82e5b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.242555 Sep 16 14:30:13.230309 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2850/5712] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:30:24.913925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=11 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:24.918078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=33 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:25.754724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d577f11e-628e-459c-b840-9b14b40e6a94 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: .version_select at 0x7f724c16a280>, body: {"keypair": {"name": "tempest-keypair-1786787350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs4ox2BmYLanL8NWIKPfPjJFKgJ8qSaMmPlQqKwdiz/9FCzSO8esY0/s0Ue1Dkyjz89GLv8MzCk0rD9Ohe2Y0q/sUcY59/ployBYlG1q5B5TiefmFExzZv9uGhxzkwF5A=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:30:25.877996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d577f11e-628e-459c-b840-9b14b40e6a94 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:30:25.901031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d577f11e-628e-459c-b840-9b14b40e6a94 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for user 67181b6dea474d52af92f466ac92d055 and project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:30:26.020496 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d577f11e-628e-459c-b840-9b14b40e6a94 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.138312 Sep 16 14:30:26.030486 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2863/5713] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:30:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:30:30.719721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1870235558", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58ab957a-8d04-4758-873b-dcacdf3fe82b"}], "security_groups": [{"name": "tempest-securitygroup--634197045"}], "key_name": "tempest-keypair-1786787350", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:30:30.740719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=5 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:30.741460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=21 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:30.931786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] validate_networks() for [('58ab957a-8d04-4758-873b-dcacdf3fe82b', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:30:32.365774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:30:32.366660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:30:32.366912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:30:32.367692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:30:32.368307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:30:32.395565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:32.396107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:32.396660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:32.397459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:32.397932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:32.402353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:32.468029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:30:32.476008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for user 67181b6dea474d52af92f466ac92d055 and project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:30:32.518275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:30:32.521370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:30:32.698603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57a7be45-25c0-4c4e-a880-3f620964c5e2 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.983983 Sep 16 14:30:32.705746 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2851/5714] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:30:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:30:32.725276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62d121ed-d458-4e55-b887-a477923db0bb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:32.725894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62d121ed-d458-4e55-b887-a477923db0bb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:32.989661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62d121ed-d458-4e55-b887-a477923db0bb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:32.998214 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62d121ed-d458-4e55-b887-a477923db0bb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1238 microversion: 2.1 time: 0.277857 Sep 16 14:30:33.003378 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2864/5715] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:32 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1238 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:30:34.056029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c99b5021-5ad5-42d8-ba7c-4654954948b9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:34.066903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c99b5021-5ad5-42d8-ba7c-4654954948b9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:34.480955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c99b5021-5ad5-42d8-ba7c-4654954948b9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:34.500706 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c99b5021-5ad5-42d8-ba7c-4654954948b9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1238 microversion: 2.1 time: 0.475027 Sep 16 14:30:34.501644 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2852/5716] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:34 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1238 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:35.535365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5ed6c13-d047-4f5e-8a15-8d34a0b9708b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:35.536087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5ed6c13-d047-4f5e-8a15-8d34a0b9708b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:35.538260 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:30:35.538797 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f (ip 10.222.0.60) !!! Sep 16 14:30:35.831639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d5ed6c13-d047-4f5e-8a15-8d34a0b9708b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:35.866077 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5ed6c13-d047-4f5e-8a15-8d34a0b9708b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1238 microversion: 2.1 time: 0.333150 Sep 16 14:30:35.870670 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2865/5717] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:35 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1238 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:30:36.896555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:36.897769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:36.927464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:36.938636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:36.942750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:36.947744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:36.948634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:36.951549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:37.280707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:37.301779 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5d23894b-4f1d-41a6-a98c-0464d89c37a7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1234 microversion: 2.1 time: 0.404351 Sep 16 14:30:37.307082 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2853/5718] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:36 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1234 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:38.334317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:38.335785 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:38.371745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:38.374830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:38.377008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:38.382511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:38.383715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:38.384705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:38.790918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:38.810112 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb0f2c84-da79-45cd-8b0c-adcc7110ede1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1296 microversion: 2.1 time: 0.481341 Sep 16 14:30:38.810777 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2866/5719] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:38 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1296 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:39.837381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:39.838355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:39.851720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:39.854060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:39.857454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:39.858699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:39.859577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:39.863029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:40.270886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:40.294388 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f18e97c5-cc4b-45e4-864f-f3f7f69dc611 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1296 microversion: 2.1 time: 0.462759 Sep 16 14:30:40.299015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2854/5720] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:39 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1296 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:41.327185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:41.335579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:41.363759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:41.384998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:41.393964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:41.399163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:41.402485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:41.410982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:43.022441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:43.037184 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-794da408-34ad-4619-8816-f0cc87facb87 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 1.723182 Sep 16 14:30:43.037795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2867/5721] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:41 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:44.068499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:44.069973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:44.078450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:44.088047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:44.089032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:44.089655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:44.090965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:44.091785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:44.092645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:44.129073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-64b71dcb-e5ad-48aa-9fd4-850ca72ad7da req-a169d7ad-7532-41aa-b9f7-fbeff62f5146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5210058-ed7d-44e7-82d4-a0636df6787f", "tag": "4ca4c4a6-62df-4215-8630-eece9e8a78a3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:30:44.203425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-64b71dcb-e5ad-48aa-9fd4-850ca72ad7da req-a169d7ad-7532-41aa-b9f7-fbeff62f5146 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:44.207598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-64b71dcb-e5ad-48aa-9fd4-850ca72ad7da req-a169d7ad-7532-41aa-b9f7-fbeff62f5146 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:44.212681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-64b71dcb-e5ad-48aa-9fd4-850ca72ad7da req-a169d7ad-7532-41aa-b9f7-fbeff62f5146 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:44.243353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-64b71dcb-e5ad-48aa-9fd4-850ca72ad7da req-a169d7ad-7532-41aa-b9f7-fbeff62f5146 service nova] Creating event network-changed:4ca4c4a6-62df-4215-8630-eece9e8a78a3 for instance f5210058-ed7d-44e7-82d4-a0636df6787f on n-h1-858129-2 Sep 16 14:30:44.268474 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-64b71dcb-e5ad-48aa-9fd4-850ca72ad7da req-a169d7ad-7532-41aa-b9f7-fbeff62f5146 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154453 Sep 16 14:30:44.271119 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2868/5722] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:30:44.487205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:44.776563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:44.786659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-549d94a6-c0b9-44a5-a267-cabbe2e0d4cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 0.723717 Sep 16 14:30:44.808333 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2855/5723] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:44 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:45.836781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:45.840878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:45.860547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:45.869396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:45.873531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:45.877129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:45.880985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:45.882289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:45.883099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:46.461887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:46.493346 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5f785f5-c205-471a-a31c-7c691919d9cd tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 0.681057 Sep 16 14:30:46.494112 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2869/5724] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:45 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:47.521928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:47.523113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:47.571748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:47.572687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:47.573524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:47.587952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:47.589156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:47.597188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:48.236492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:48.254066 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e311104f-9bc1-4994-8a10-5e93ae6af8e5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 0.738010 Sep 16 14:30:48.271952 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2856/5725] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:47 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:49.297041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:49.299589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:49.344540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:49.345534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:49.348956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:49.349780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:49.352609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:49.353092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:50.683654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:50.731903 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dcb4015c-f8a2-4b95-9efe-71f6559e5907 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 1.441631 Sep 16 14:30:50.737117 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2870/5726] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:49 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:51.762846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:51.764843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:51.796280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:51.802268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:51.807997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:51.813776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:51.817418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:51.828455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:52.283374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:52.297382 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fbe07bab-6db6-4a42-af3d-13e265e9d02b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 0.539676 Sep 16 14:30:52.302178 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2857/5727] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:51 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:52.474951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c8f7da21-4036-4043-b779-485095055cf1 req-807fd2a0-b4fd-4cf8-af1f-14cc1daa44ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5210058-ed7d-44e7-82d4-a0636df6787f", "name": "network-vif-plugged", "status": "completed", "tag": "4ca4c4a6-62df-4215-8630-eece9e8a78a3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:30:52.551488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8f7da21-4036-4043-b779-485095055cf1 req-807fd2a0-b4fd-4cf8-af1f-14cc1daa44ae service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:52.552381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8f7da21-4036-4043-b779-485095055cf1 req-807fd2a0-b4fd-4cf8-af1f-14cc1daa44ae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:52.553180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c8f7da21-4036-4043-b779-485095055cf1 req-807fd2a0-b4fd-4cf8-af1f-14cc1daa44ae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:52.664327 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c8f7da21-4036-4043-b779-485095055cf1 req-807fd2a0-b4fd-4cf8-af1f-14cc1daa44ae service nova] Creating event network-vif-plugged:4ca4c4a6-62df-4215-8630-eece9e8a78a3 for instance f5210058-ed7d-44e7-82d4-a0636df6787f on n-h1-858129-2 Sep 16 14:30:52.683930 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c8f7da21-4036-4043-b779-485095055cf1 req-807fd2a0-b4fd-4cf8-af1f-14cc1daa44ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217069 Sep 16 14:30:52.686259 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2871/5728] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:30:53.356278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:53.357300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:53.405489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:53.406378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:53.413320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:53.425438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:53.426535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:53.429287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:54.054418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:54.086761 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55a9a2bb-b2e0-4a72-a9a3-686341cb075d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 0.747144 Sep 16 14:30:54.104998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2858/5729] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:53 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:30:55.148355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:55.149542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:55.166270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:30:55.219184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:55.223801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:55.224871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:55.226550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:55.231910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:55.239898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:56.214343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:56.245685 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-afd134e7-ea0b-4184-8a15-8c06c3297781 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1363 microversion: 2.1 time: 1.103289 Sep 16 14:30:56.251984 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2872/5730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:55 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1363 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:56.791066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:56.792359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:56.811792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:56.818290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:56.825533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:56.831571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:56.832364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:56.832979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:57.073056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lazy-loading 'services' on Instance uuid 468dcba3-7b9f-4a31-908a-cf771a0b4423 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:30:57.303093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:57.307666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:57.354795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:57.356378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:57.361537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:57.363434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:57.365225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:57.366447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:57.372627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4870eb79-a1eb-448c-9dfe-ea9295575ffa tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423/os-volume_attachments/976d89e0-15d5-4c47-96ec-749cd57acb1d" status: 202 len: 0 microversion: 2.1 time: 0.585004 Sep 16 14:30:57.378500 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2859/5731] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:30:56 2022] DELETE /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423/os-volume_attachments/976d89e0-15d5-4c47-96ec-749cd57acb1d => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:30:58.319271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:30:58.337606 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3bb1fe6a-a701-4b71-89ab-38e1be544386 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1548 microversion: 2.1 time: 1.041977 Sep 16 14:30:58.338749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2873/5732] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:30:57 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1548 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:30:58.390246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:30:58.396318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:30:58.435943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:58.438450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:58.445618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:58.453775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:30:58.456244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:30:58.457488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:30:58.788860 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a36a3ca0-f999-4f9a-acf3-afc4442aec29 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.410552 Sep 16 14:30:58.809990 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2860/5733] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:30:58 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-interface => generated 284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:31:03.220523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f3f9a94e-498b-4b75-bb84-23ae5c2d1297 req-47b73f99-e88b-4ddc-a7ab-12aa4e478d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5210058-ed7d-44e7-82d4-a0636df6787f", "tag": "4ca4c4a6-62df-4215-8630-eece9e8a78a3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:31:03.279401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f3f9a94e-498b-4b75-bb84-23ae5c2d1297 req-47b73f99-e88b-4ddc-a7ab-12aa4e478d11 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:03.279897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f3f9a94e-498b-4b75-bb84-23ae5c2d1297 req-47b73f99-e88b-4ddc-a7ab-12aa4e478d11 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:03.280345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f3f9a94e-498b-4b75-bb84-23ae5c2d1297 req-47b73f99-e88b-4ddc-a7ab-12aa4e478d11 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:03.323832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f3f9a94e-498b-4b75-bb84-23ae5c2d1297 req-47b73f99-e88b-4ddc-a7ab-12aa4e478d11 service nova] Creating event network-changed:4ca4c4a6-62df-4215-8630-eece9e8a78a3 for instance f5210058-ed7d-44e7-82d4-a0636df6787f on n-h1-858129-2 Sep 16 14:31:03.331191 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f3f9a94e-498b-4b75-bb84-23ae5c2d1297 req-47b73f99-e88b-4ddc-a7ab-12aa4e478d11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120206 Sep 16 14:31:03.332538 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2874/5734] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:31:06.700058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:06.700562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:06.714282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:06.716885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:06.717867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:06.718779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:06.721603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:06.722953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:06.723584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:06.739885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:06.792437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:31:06.934724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-35591550-b8bc-40c8-a9d2-c76009c466e2 tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "DELETE /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 204 len: 0 microversion: 2.1 time: 0.243294 Sep 16 14:31:06.937835 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2861/5735] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:31:06 2022] DELETE /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:31:06.948917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:06.950431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:06.964928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:06.967414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:06.968113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:06.971479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:06.972145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:06.973592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:06.979767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=43 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:07.327064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:07.355672 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-44371540-e0e0-4d2e-8b57-2d77409f081f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1468 microversion: 2.1 time: 0.408654 Sep 16 14:31:07.360386 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2875/5736] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:06 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1468 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:31:08.386614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:08.387756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:08.397102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:08.398048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:08.398609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:08.399636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:08.400259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:08.400841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:08.685590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:08.700487 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7f0fee16-5e19-4e05-84e0-5f5f3a1c007e tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1468 microversion: 2.1 time: 0.319688 Sep 16 14:31:08.701108 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2862/5737] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:08 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1468 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:31:09.748435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:09.749601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:09.768265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8cf4a59c-a9e8-4e42-b487-44d345e1e299 req-f7299650-fe5c-4af6-8ba6-ebfefe0a807c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468dcba3-7b9f-4a31-908a-cf771a0b4423", "name": "network-vif-deleted", "tag": "ca50f224-7f39-4ced-a4ed-cb62c61580db"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:31:09.820663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:09.826674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:09.830499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:09.836272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:09.842903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:09.844291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:09.850296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8cf4a59c-a9e8-4e42-b487-44d345e1e299 req-f7299650-fe5c-4af6-8ba6-ebfefe0a807c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:09.855403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8cf4a59c-a9e8-4e42-b487-44d345e1e299 req-f7299650-fe5c-4af6-8ba6-ebfefe0a807c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:09.856469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8cf4a59c-a9e8-4e42-b487-44d345e1e299 req-f7299650-fe5c-4af6-8ba6-ebfefe0a807c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:09.912241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8cf4a59c-a9e8-4e42-b487-44d345e1e299 req-f7299650-fe5c-4af6-8ba6-ebfefe0a807c service nova] Creating event network-vif-deleted:ca50f224-7f39-4ced-a4ed-cb62c61580db for instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 on n-h1-858129-2 Sep 16 14:31:09.934498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8cf4a59c-a9e8-4e42-b487-44d345e1e299 req-f7299650-fe5c-4af6-8ba6-ebfefe0a807c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175147 Sep 16 14:31:09.936413 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2863/5738] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:31:10.064154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e005a0321254a168e34c69d650dbc7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ccd1509d8a042c5bda6094612f608e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:10.099174 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1129acb9-1944-4c29-8c31-aeb725ca6e8f tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 200 len: 1298 microversion: 2.1 time: 0.359357 Sep 16 14:31:10.116133 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2876/5739] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:09 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 1298 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:31:11.141317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:11.142774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] [instance: 468dcba3-7b9f-4a31-908a-cf771a0b4423] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:11.156367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:11.157356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:11.158986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:11.160809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:11.161874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:11.162661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:11.189975 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] HTTP exception thrown: Instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 could not be found. Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Request method failure captured: Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 HTTP/1.1 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIf5ZndVXhCAJVTOFor-8psrzwCfs5FWDLTSnxIL9KqcxKWEugpF6x2-JRO_moTmKUcyOP1JpWOATLi_9iPWeJ8mOOkNQFTzOrWTzGUDZ4vXzVOKFwmLpn7-LiAZlrdBNt-DJFETA7uty0cqqgsJVE3atbf63aKEQKJg-G9n-HK6khE Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3ccd1509d8a042c5bda6094612f608e1 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesBackupsTest-1955983254 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ccd1509d8a042c5bda6094612f608e1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ccd1509d8a042c5bda6094612f608e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ccd1509d8a042c5bda6094612f608e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ccd1509d8a042c5bda6094612f608e1"}]}] Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesBackupsTest-1955983254 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3ccd1509d8a042c5bda6094612f608e1 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesBackupsTest-1955983254 Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesBackupsTest-1955983254-project Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1e005a0321254a168e34c69d650dbc7a Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesBackupsTest-1955983254-project Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 could not be found. Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '468dcba3-7b9f-4a31-908a-cf771a0b4423'} Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 could not be found. Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 could not be found. Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:31:11.193058 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 could not be found. Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] Returning 404 to user: Instance 468dcba3-7b9f-4a31-908a-cf771a0b4423 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3dab034b-c937-472c-b29b-c7378041db4a tempest-VolumesBackupsTest-1955983254 tempest-VolumesBackupsTest-1955983254-project] 10.222.0.60 "GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423" status: 404 len: 111 microversion: 2.1 time: 0.059315 Sep 16 14:31:11.203391 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2864/5740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:11 2022] GET /compute/v2.1/servers/468dcba3-7b9f-4a31-908a-cf771a0b4423 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:31:24.895492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:24.897390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=11 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:24.902459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2474db50-ff74-40ca-8cf1-bcbe32798e65"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:31:24.909379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:24.926821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:24.927705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:24.928161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:24.928910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:24.929475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:24.932892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:25.627840 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-edd637fb-7cb9-445a-9c7d-970a1c5bb1b3 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732012 Sep 16 14:31:25.629613 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2877/5741] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:31:24 2022] POST /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:31:48.144698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:31:48.154358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:48.170992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:48.178194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:48.182507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:48.184540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:48.185876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:48.187877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:48.190783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:48.191878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:48.267580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'flavor' on Instance uuid 8b0772fb-1194-4f5c-b916-a249bdb68edf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:31:48.761280 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-147f8601-ab13-4de4-9e83-c4873df2d17c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/action" status: 200 len: 32 microversion: 2.1 time: 0.637847 Sep 16 14:31:48.766136 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2865/5742] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:31:48 2022] POST /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/action => generated 32 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:31:48.778663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:48.783440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:31:48.788823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:48.807082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:48.835023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:48.835755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:48.835936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:48.860803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:48.861295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:48.861923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:50.041549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:50.068252 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf1959d9-d6e3-4041-b70b-f83013961e23 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 1.296113 Sep 16 14:31:50.077449 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2878/5743] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:48 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:31:51.119659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:51.128193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:51.156578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:51.158013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:51.158837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:51.162504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:51.163323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:51.175577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:52.539833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:52.559246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1feaf5ed-afbf-4b56-9a58-757c2651e933 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 1.452782 Sep 16 14:31:52.575044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2866/5744] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:51 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:31:53.600132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:53.601423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:53.613462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:53.617800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:53.618787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:53.621532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:53.622269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:53.622926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:54.378473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:54.403675 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b45f5b3e-2f3a-475e-b612-7cf6352470b1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.807325 Sep 16 14:31:54.407783 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2879/5745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:53 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:31:55.448970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:55.451967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:55.475963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:55.478364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:55.483258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:55.484350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:55.485097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:55.485894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:55.987360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:55.996955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1ed61e59-1652-42f6-9c74-539da666461b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.553169 Sep 16 14:31:55.998602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2867/5746] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:55 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:31:57.101108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:57.104161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:57.119001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:57.120457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:57.121454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:57.123058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:57.125040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:57.126187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:57.477601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:57.498792 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f593ff7-cfd1-4144-b7fc-3f11c5e9122e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.439139 Sep 16 14:31:57.499503 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2880/5747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:57 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:31:58.537677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:31:58.540333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:31:58.572757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:58.574198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:58.575393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:58.578003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:31:58.579992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:31:58.584089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:31:59.014477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:31:59.039332 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab0e72d2-ce58-4551-95bb-9983634e68dc tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.510688 Sep 16 14:31:59.051095 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2868/5748] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:31:58 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:00.088265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:00.095557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:00.185323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:00.190988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:00.191736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:00.207390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:00.208153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:00.208841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:00.964236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:00.980554 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f89c089f-f803-43db-a806-2f43aeef40ae tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.902746 Sep 16 14:32:00.983196 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2881/5749] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:00 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:02.019198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:02.030850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:02.083935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:02.089881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:02.091258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:02.095492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:02.097881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:02.100834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:02.453327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:02.465610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2358233-fb67-49c3-b4f4-aefacc79c404 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.457587 Sep 16 14:32:02.472221 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2869/5750] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:02 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:03.497880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:03.499287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:03.515035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:03.519381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:03.520233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:03.521028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:03.521524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:03.521967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:03.964367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:03.992876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af9e84cd-920b-4c76-a3d4-341df1da442f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.495455 Sep 16 14:32:03.996358 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2882/5751] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:03 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:32:04.950002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:04.950709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:04.966915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:04.969016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:04.969585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:04.970383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:04.970896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:04.971713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:05.041358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:05.047023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:05.062195 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4862b33d-883d-4ff0-b59a-29bdfa9eba9a tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/ips" status: 200 len: 144 microversion: 2.1 time: 0.117372 Sep 16 14:32:05.063774 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2870/5752] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:32:04 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/ips => generated 144 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:32:05.067806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:05.075536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:05.076744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:05.078353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:05.083417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:05.084576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:05.880782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:05.893344 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc5746f6-565e-4033-a842-d8fe65ab0146 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1735 microversion: 2.1 time: 0.869890 Sep 16 14:32:05.908783 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2883/5753] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:05 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1735 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:32:06.957765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:06.965221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:06.995291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:06.999415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:07.006881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:07.042741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:07.047678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:07.067756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:07.817910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:07.845854 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aba84867-6d23-426f-b973-2c81aa23fc7f tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1715 microversion: 2.1 time: 0.906617 Sep 16 14:32:07.846498 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2871/5754] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:06 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1715 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:08.522918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:08.523670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:08.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:08.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:08.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:08.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:08.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:08.557242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:08.783829 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Cannot 'detach_volume' instance 8b0772fb-1194-4f5c-b916-a249bdb68edf while it is in vm_state rescued Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments/2474db50-ff74-40ca-8cf1-bcbe32798e65 HTTP/1.1 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot 'detach_volume' instance 8b0772fb-1194-4f5c-b916-a249bdb68edf while it is in vm_state rescued Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': '8b0772fb-1194-4f5c-b916-a249bdb68edf', 'id': '2474db50-ff74-40ca-8cf1-bcbe32798e65'} Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8b0772fb-1194-4f5c-b916-a249bdb68edf while it is in vm_state rescued Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:32:08.786375 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:32:08.790947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:32:08.790947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:32:08.790947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:32:08.790947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:32:08.790947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8b0772fb-1194-4f5c-b916-a249bdb68edf while it is in vm_state rescued Sep 16 14:32:08.790947 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:32:08.793561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 409 to user: Cannot 'detach_volume' instance 8b0772fb-1194-4f5c-b916-a249bdb68edf while it is in vm_state rescued {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:32:08.831927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b80f2138-0f4c-4638-8244-875753b6fc2d tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments/2474db50-ff74-40ca-8cf1-bcbe32798e65" status: 409 len: 152 microversion: 2.1 time: 0.278159 Sep 16 14:32:08.836759 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2884/5755] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:32:08 2022] DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments/2474db50-ff74-40ca-8cf1-bcbe32798e65 => generated 152 bytes in 321 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:32:08.866215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:32:08.866805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:08.887936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:08.888454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:08.888917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:08.889687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:08.904979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:08.906561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:09.207336 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d27d3f6-08bf-4d6a-b083-a1c2539dbcc8 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/action" status: 202 len: 0 microversion: 2.1 time: 0.352442 Sep 16 14:32:09.208665 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2872/5756] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:32:08 2022] POST /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:32:09.228023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:09.228023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:09.270904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:09.279090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:09.284715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:09.287155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:09.291236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:09.291692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:10.082590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:10.093491 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bdc149e-addf-4152-9844-9049e57130b5 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1723 microversion: 2.1 time: 0.880013 Sep 16 14:32:10.094309 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2885/5757] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:09 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1723 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:11.066894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6be569b3-b2fb-4b2c-ab11-9f72f42712f9"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:32:11.083551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:11.124551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:11.126290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:11.148493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:11.149581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:11.150487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:11.168277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:11.175398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:11.176566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:11.194108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:11.195728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:11.203803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:11.207166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:11.208361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:11.209401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:12.013743 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd9dfeab-719d-4ff9-8352-cf8f1baf5609 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.997606 Sep 16 14:32:12.020725 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2873/5758] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:32:11 2022] POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-volume_attachments => generated 194 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:32:12.933235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:12.947465 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1507ee4a-59bb-4120-9102-4d331b0f166b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1723 microversion: 2.1 time: 1.830258 Sep 16 14:32:12.959807 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2886/5759] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:11 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1723 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:13.993722 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:32:13.994556 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 14:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf (ip 10.222.0.60) !!! Sep 16 14:32:14.012962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:14.018580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:14.052352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:14.053279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:14.060905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:14.061990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:14.065321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:14.066367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:14.862562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:14.900632 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85649e57-51d9-4193-8bfa-13ba4469c0e1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1723 microversion: 2.1 time: 0.908133 Sep 16 14:32:14.903799 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2874/5760] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:13 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1723 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:15.932521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:15.933284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:15.973392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:15.977542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:15.978689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:15.984105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:15.987015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:15.988222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:17.251943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:17.295609 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9706c72d-caa6-46a6-9330-a03479ff66bd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1729 microversion: 2.1 time: 1.367922 Sep 16 14:32:17.296928 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2887/5761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:15 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1729 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:32:17.344178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:17.345115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:17.393425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:17.395663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:17.396575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:17.397832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:17.398642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:17.399338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:17.765569 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f939485-4f04-420b-87ea-188b5acfe3d4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.429851 Sep 16 14:32:17.766542 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2875/5762] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:32:17 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-interface => generated 284 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:32:24.985761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a308829f-30e4-4d30-8bde-e270e2a1820e req-b5d2e4d4-c12b-4751-a4fb-636e855057a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:32:25.027517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=21 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:32:25.043429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a308829f-30e4-4d30-8bde-e270e2a1820e req-b5d2e4d4-c12b-4751-a4fb-636e855057a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:25.046349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a308829f-30e4-4d30-8bde-e270e2a1820e req-b5d2e4d4-c12b-4751-a4fb-636e855057a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:25.047228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a308829f-30e4-4d30-8bde-e270e2a1820e req-b5d2e4d4-c12b-4751-a4fb-636e855057a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:25.083459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=61 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:32:25.121836 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a308829f-30e4-4d30-8bde-e270e2a1820e req-b5d2e4d4-c12b-4751-a4fb-636e855057a4 service nova] Creating event network-changed:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:32:25.178736 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a308829f-30e4-4d30-8bde-e270e2a1820e req-b5d2e4d4-c12b-4751-a4fb-636e855057a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196624 Sep 16 14:32:25.190136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2888/5763] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:32:27.275409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-24922e6d-9a96-4d49-9bc6-434f7da35569 req-296243ce-97e8-4ae3-8371-c109b0940bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:32:27.301322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=23 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:32:27.305514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24922e6d-9a96-4d49-9bc6-434f7da35569 req-296243ce-97e8-4ae3-8371-c109b0940bbf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:27.308860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24922e6d-9a96-4d49-9bc6-434f7da35569 req-296243ce-97e8-4ae3-8371-c109b0940bbf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:27.311076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24922e6d-9a96-4d49-9bc6-434f7da35569 req-296243ce-97e8-4ae3-8371-c109b0940bbf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:27.343339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:32:27.350887 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-24922e6d-9a96-4d49-9bc6-434f7da35569 req-296243ce-97e8-4ae3-8371-c109b0940bbf service nova] Creating event network-changed:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:32:27.363801 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-24922e6d-9a96-4d49-9bc6-434f7da35569 req-296243ce-97e8-4ae3-8371-c109b0940bbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093096 Sep 16 14:32:27.367710 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2876/5764] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:32:33.379157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e88c9751-9da3-4111-a7d5-eb08ab43cc16 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:32:33.401194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88c9751-9da3-4111-a7d5-eb08ab43cc16 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:33.402339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88c9751-9da3-4111-a7d5-eb08ab43cc16 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:33.403173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e88c9751-9da3-4111-a7d5-eb08ab43cc16 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:33.511578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e88c9751-9da3-4111-a7d5-eb08ab43cc16 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Going to try to stop instance {{(pid=128643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:32:33.593816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e88c9751-9da3-4111-a7d5-eb08ab43cc16 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action" status: 202 len: 0 microversion: 2.1 time: 0.227256 Sep 16 14:32:33.600623 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2889/5765] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:32:33 2022] POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:32:33.609635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:33.611800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:33.624310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:33.626789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:33.628145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:33.630193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:33.631551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:33.632673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:34.690881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:34.719386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ece8e2a8-cab4-44ef-83f9-3004116fdefb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 1.114066 Sep 16 14:32:34.730736 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2877/5766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:33 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:35.794327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:35.802281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:35.850892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:35.854474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:35.855758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:35.858116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:35.871148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:35.872084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:36.343108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:36.359731 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ffc3c0e8-24c3-47d3-8a31-7a7a3941abdc tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 0.584604 Sep 16 14:32:36.360902 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2890/5767] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:35 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:37.410531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:37.414146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:37.430311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:37.431130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:37.432060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:37.434833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:37.435658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:37.436439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:38.484694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:38.527663 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dea795e8-8f65-4f22-901f-3d9fc883f9d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 1.122346 Sep 16 14:32:38.536480 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2878/5768] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:37 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:32:39.569551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:39.570671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:39.583805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:39.585487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:39.586617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:39.588365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:39.589630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:39.590810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:39.985924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:40.008420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b5bd24a9-544a-46cf-9fa3-34afcf2cb5f6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 0.446738 Sep 16 14:32:40.009316 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2891/5769] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:39 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:41.038275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:41.041634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:41.087268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:41.088161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:41.088909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:41.104307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:41.115222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:41.116144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:41.893898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:41.906130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4dd0b0f-d151-41d0-a103-604dd7e1f527 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 0.875240 Sep 16 14:32:41.914818 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2879/5770] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:41 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:42.943331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:42.948375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:42.971049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:42.972562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:42.973968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:42.976804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:42.981009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:42.989475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:43.872229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:43.893237 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b482d080-8e04-4b33-875b-f2bbce05d37d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 0.961527 Sep 16 14:32:43.894729 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2892/5771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:42 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:44.920564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:44.922739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:44.961019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:44.961839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:44.962599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:44.963712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:44.964510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:44.965248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:45.390535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:45.407028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9fba3abd-62e6-457e-abbe-f71e199994d9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 0.493132 Sep 16 14:32:45.407630 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2880/5772] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:44 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:46.434086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:46.434934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:46.459514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:46.460215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:46.460931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:46.461843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:46.465635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:46.466153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:47.631377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:47.664760 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f2cb020c-3c2e-433b-a515-b33fd75c8b68 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 1.234480 Sep 16 14:32:47.674334 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2893/5773] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:46 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:48.696126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:48.697855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:48.710464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:48.715946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:48.716808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:48.718544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:48.719879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:48.723071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:49.749423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:49.796570 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-84f3b3a0-6f5c-465d-bbf6-2eb4ff154bca tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 1.102665 Sep 16 14:32:49.798488 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2881/5774] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:48 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:32:50.824737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:50.825645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:50.841681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:50.842185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:50.842668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:50.843413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:50.843873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:50.844842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:51.708049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:51.725635 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6eca6c71-5fa8-46f0-83cf-0d808157e144 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1699 microversion: 2.1 time: 0.901648 Sep 16 14:32:51.728731 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2894/5775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:50 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1699 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:51.754534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f69d337-f814-4391-af90-e23613875ee7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:32:51.769200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f69d337-f814-4391-af90-e23613875ee7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:51.785605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f69d337-f814-4391-af90-e23613875ee7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:51.786167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f69d337-f814-4391-af90-e23613875ee7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:51.867944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f69d337-f814-4391-af90-e23613875ee7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Going to try to start instance {{(pid=128642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 14:32:51.984731 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f69d337-f814-4391-af90-e23613875ee7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action" status: 202 len: 0 microversion: 2.1 time: 0.233053 Sep 16 14:32:51.986803 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2882/5776] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:32:51 2022] POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:32:51.994923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:51.995635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:52.010356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:52.013643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:52.028248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:52.035941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:52.035941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:52.040039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:52.568214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:52.583585 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3be9d3a6-3fd0-4043-b57b-fce1a5f94dfb tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1708 microversion: 2.1 time: 0.588866 Sep 16 14:32:52.584684 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2895/5777] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:51 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1708 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:53.614387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:53.616670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:53.644729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:53.646149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:53.647715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:53.649253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:53.658683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:53.659819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:54.730642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:54.744455 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f783e0f1-ebf5-44a5-b0f7-a691f43da203 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1708 microversion: 2.1 time: 1.138125 Sep 16 14:32:54.745083 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2883/5778] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:53 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1708 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:32:55.773828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:32:55.775200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:32:55.779307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:32:55.793807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:55.794631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:55.795275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:55.796186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:32:55.796825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:32:55.797483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:32:56.184843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:32:56.194920 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ed2b250-2fcd-4729-97e5-4396fe826d35 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1712 microversion: 2.1 time: 0.425168 Sep 16 14:32:56.206963 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2896/5779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:32:55 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1712 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:10.648091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:10.650088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:10.707560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=15 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:10.712468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:10.741443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:10.742155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:10.743036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:10.744140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:10.744639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:10.745096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:10.946976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'services' on Instance uuid 8b0772fb-1194-4f5c-b916-a249bdb68edf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:33:11.134909 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bb528f1a-175d-404e-8e0b-ca8a0516e300 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments/2474db50-ff74-40ca-8cf1-bcbe32798e65" status: 202 len: 0 microversion: 2.1 time: 0.492905 Sep 16 14:33:11.137111 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2884/5780] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:33:10 2022] DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments/2474db50-ff74-40ca-8cf1-bcbe32798e65 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:33:11.147969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:11.155340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:11.173729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:11.198185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:11.209814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:11.210375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:11.211020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:11.216524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:11.217117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:11.218040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:11.347784 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-00aaac2f-6b58-435e-a39d-09e4c78b9468 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205569 Sep 16 14:33:11.348797 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2897/5781] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:11 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:12.391308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:12.393911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:12.423292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:12.423917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:12.424418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:12.424956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:12.425429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:12.425870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:12.497127 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1580115d-ec75-462c-8ec1-3391d21e4f9c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137111 Sep 16 14:33:12.497659 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2885/5782] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:12 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:13.511020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:13.524338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:13.562315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:13.568138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:13.569076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:13.575618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:13.587779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:13.596160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:13.775655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b96a61f0-5406-4a95-bfab-5c0df89c2088 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.269614 Sep 16 14:33:13.784814 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2898/5783] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:13 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:14.793827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:14.796956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:14.821764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:14.821764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:14.822222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:14.823009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:14.823481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:14.823927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:14.951490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31b21de6-6810-483d-b0a3-1d2885ee0482 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161596 Sep 16 14:33:14.964483 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2886/5784] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:14 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:15.965823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:15.969342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:15.995634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:15.999746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:16.001517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:16.002672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:16.005436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:16.009345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:16.114973 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ffc60f2-0d0e-41b1-9b6c-a350b14569af tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154236 Sep 16 14:33:16.123344 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2899/5785] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:15 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:33:16.805910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1681048393", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "0fc0ae2a-5dd3-4fe1-a067-1a7da4959464"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:17.042890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] validate_networks() for [('0fc0ae2a-5dd3-4fe1-a067-1a7da4959464', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:33:17.147405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:17.167935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:17.181801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:17.182874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:17.183642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:17.184690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:17.186051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:17.186845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:17.227978 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab96b095-ae72-49cc-96a8-0c37ebc92749 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091541 Sep 16 14:33:17.229251 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2900/5786] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:17 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:18.243908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:18.255039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:18.271662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:18.272969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:18.276372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:18.280069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:18.280834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:18.281491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:18.474878 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-77b2fe1b-1f88-4fd6-b293-8fe71103b0be tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233444 Sep 16 14:33:18.483896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2901/5787] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:18 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:33:19.389083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:33:19.390391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:33:19.391251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:33:19.396858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:33:19.397654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:33:19.449044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:19.462180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:19.465203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:19.470060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:19.472451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:19.474009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:19.491774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:19.494230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:19.512048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:19.512561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:19.513543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:19.514303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:19.523675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:19.525177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:19.543440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Getting quotas for project 42e9b8aa0ca94d2da7320d250be583bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:33:19.558428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Getting quotas for user 6bf6ac99d7584a5faefbce2a4fae7d92 and project 42e9b8aa0ca94d2da7320d250be583bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:33:19.604556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:33:19.607618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:33:19.633871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7881dda7-de3c-4e8d-8d0e-84a41d79b931 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147208 Sep 16 14:33:19.648115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2902/5788] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:19 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:33:19.773578 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [f72a35bf-7819-446a-8f38-347e0b130acd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 14:33:20.650908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:20.667269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:20.689247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:20.690001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:20.690749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:20.691921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:20.692923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:20.694123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:20.790293 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [f72a35bf-7819-446a-8f38-347e0b130acd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48748. Sep 16 14:33:20.797012 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-589d95ba-3a90-45d5-9fc3-e93f7f1c4541 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.998833 Sep 16 14:33:20.797700 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2887/5789] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:33:20.814944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b314efab-af63-4196-929d-d958e1daa8cd tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170102 Sep 16 14:33:20.816612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2903/5790] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:20 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:33:20.817032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fd9e8eb5-bf8b-4e69-b3ef-3048a368a02a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:20.821169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fd9e8eb5-bf8b-4e69-b3ef-3048a368a02a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:20.996647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd9e8eb5-bf8b-4e69-b3ef-3048a368a02a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:21.028139 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fd9e8eb5-bf8b-4e69-b3ef-3048a368a02a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1219 microversion: 2.1 time: 0.218740 Sep 16 14:33:21.047551 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2888/5791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:20 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1219 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:21.837041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:21.858459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:21.910915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:21.912297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:21.916553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:21.920236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:21.923029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:21.924932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:22.037241 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-366b2adf-a643-47ff-9acc-4f64f1b4ecf7 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207459 Sep 16 14:33:22.038572 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2904/5792] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:21 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:22.068083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b89a61a-def4-4490-85e7-99533cada9e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:22.068876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b89a61a-def4-4490-85e7-99533cada9e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:22.245625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b89a61a-def4-4490-85e7-99533cada9e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:22.282931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b89a61a-def4-4490-85e7-99533cada9e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1219 microversion: 2.1 time: 0.218696 Sep 16 14:33:22.298618 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2889/5793] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:22 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:23.057128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:23.066569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:23.114840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:23.115747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:23.116317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:23.120814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:23.121558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:23.122755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:23.261059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46e2f6a1-f4ee-430a-aeb9-45776ea0cd1a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211258 Sep 16 14:33:23.268484 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2905/5794] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:23 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:23.313757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:23.315012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:23.334027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:23.334932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:23.335594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:23.336604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:23.337319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:23.337975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:23.463796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:23.483272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce86629b-a1cf-4313-b4df-71d0f96335ab tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1271 microversion: 2.1 time: 0.176186 Sep 16 14:33:23.484518 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2890/5795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:23 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:24.275774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:24.278163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:24.296122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.302023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.306915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.308061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.316746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.317609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.415409 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11acc7a5-e40b-4f6b-ad1d-e459e4778bdb tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144650 Sep 16 14:33:24.416061 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2906/5796] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:33:24 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:33:24.511201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:24.514019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:24.548921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.549761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.553960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.555242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.555957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.556580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.636312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:24.639056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:24.657585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.667157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.667899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.670352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.676139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.687227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.742335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Cannot 'reboot' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action HTTP/1.1 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 28 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: {"reboot": {"type": "HARD"}} Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot 'reboot' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0a6cb496-a555-4b1e-8e86-62a96b13ea78', 'body': {'reboot': {'type': 'HARD'}}} Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:33:24.762092 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.767127 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.783481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 409 to user: Cannot 'reboot' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:33:24.784798 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5bd9e2ec-ff2e-4640-a525-e15234970098 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action" status: 409 len: 145 microversion: 2.1 time: 0.154813 Sep 16 14:33:24.785942 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2907/5797] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:33:24 2022] POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action => generated 145 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 16 14:33:24.802954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:24.807537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:24.832714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.833227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.833679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.834441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.834906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.835340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.909016 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Cannot 'rebuild' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: request: POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action HTTP/1.1 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 65 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: exception: Cannot 'rebuild' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0a6cb496-a555-4b1e-8e86-62a96b13ea78', 'body': {'rebuild': {'imageRef': 'b0b65f17-d770-469f-9ae4-7c7011730f1b'}}} Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:33:24.922898 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 409 to user: Cannot 'rebuild' instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 while it is in vm_state rescued {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fbb30837-c0fc-4980-9b5a-05ff182e6fef tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action" status: 409 len: 146 microversion: 2.1 time: 0.131363 Sep 16 14:33:24.927702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2908/5798] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:33:24 2022] POST /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78/action => generated 146 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 14:33:24.935912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:24.936418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:24.948932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.949445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.949989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:24.963641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:24.964121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:24.964571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:25.009337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:33:25.257138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:25.269333 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a499b995-fbd6-4ac2-b295-40d10c56a666 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1277 microversion: 2.1 time: 0.763617 Sep 16 14:33:25.270319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2891/5799] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:24 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1277 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:25.289313 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb7324d7-906a-4672-8b47-f823c70ed1ff tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 204 len: 0 microversion: 2.1 time: 0.358028 Sep 16 14:33:25.313619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2909/5800] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:33:24 2022] DELETE /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:33:25.331213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:25.333573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:25.355474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:25.359530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:25.360082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:25.360808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:25.361279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:25.361707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:26.316008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:26.319341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:26.327782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:26.328530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:26.329122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:26.330027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:26.330687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:26.331276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:26.560311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:26.596014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7cacab08-c4c2-493c-a146-208b72b34f98 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1277 microversion: 2.1 time: 0.294228 Sep 16 14:33:26.600282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2910/5801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:26 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:27.022120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:27.035955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9a9a555-c57a-4cb3-8635-f5a8fef2580b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1689 microversion: 2.1 time: 1.719872 Sep 16 14:33:27.046915 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2892/5802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:25 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1689 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:27.632283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:27.634877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:27.676305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:27.676862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:27.679075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:27.688993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:27.691073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:27.694590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:28.067538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:28.068643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:28.089661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:28.090278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:28.090963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:28.099146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:28.099814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:28.100346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:28.104316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:28.125355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-259b5ef8-ba9a-4c34-b9a6-ff526318286f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1277 microversion: 2.1 time: 0.501280 Sep 16 14:33:28.125981 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2911/5803] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:27 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1277 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:29.171858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:29.172523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:29.182676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:29.183428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:29.184108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:29.185129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:29.185853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:29.186941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:29.222084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:29.495213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:29.751234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:29.768797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-070820f2-b32f-414f-8872-3bdb0b77410a tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1689 microversion: 2.1 time: 1.706999 Sep 16 14:33:29.788944 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2893/5804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:28 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1689 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:30.803829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:30.803829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:30.818422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:30.820552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:30.821018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:30.821778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:30.822298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:30.826852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:30.988889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:31.004043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-568ff632-6f12-4b3f-a6fc-f3120ea597fd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 1.836762 Sep 16 14:33:31.005393 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2912/5805] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:29 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:31.559684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:31.587763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-049314e1-3c6c-4666-94d5-d2d4e1b19663 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1689 microversion: 2.1 time: 0.794011 Sep 16 14:33:31.598476 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2894/5806] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:30 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1689 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:32.055767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:32.061426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:32.087862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:32.088919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:32.095743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:32.097233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:32.098227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:32.099196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:32.291825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:32.307849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d88254aa-2985-45dd-9e31-1485da28951d req-db537213-5867-4c41-b15b-fe343b4c02ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "name": "network-vif-unplugged", "status": "completed", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:32.373999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d88254aa-2985-45dd-9e31-1485da28951d req-db537213-5867-4c41-b15b-fe343b4c02ed service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:32.377459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d88254aa-2985-45dd-9e31-1485da28951d req-db537213-5867-4c41-b15b-fe343b4c02ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:32.379071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d88254aa-2985-45dd-9e31-1485da28951d req-db537213-5867-4c41-b15b-fe343b4c02ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:32.483468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d88254aa-2985-45dd-9e31-1485da28951d req-db537213-5867-4c41-b15b-fe343b4c02ed service nova] Creating event network-vif-unplugged:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:33:32.533740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d88254aa-2985-45dd-9e31-1485da28951d req-db537213-5867-4c41-b15b-fe343b4c02ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.244861 Sep 16 14:33:32.541098 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2895/5807] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:33:32.625737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:32.627942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:32.677635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:32.679854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:32.685480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:32.689751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:32.691043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:32.695499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:33.827462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:33.926593 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dea9e71e-13af-4bea-8fa5-c1903a283e56 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 1.867164 Sep 16 14:33:33.934052 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2913/5808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:32 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:34.304098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:34.334822 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee5d44fd-7d2d-44ad-971d-a9a391ce1ec6 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1689 microversion: 2.1 time: 1.721945 Sep 16 14:33:34.345448 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2896/5809] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:32 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1689 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:34.984037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:34.985028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:35.020848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:35.027938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:35.028535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:35.033663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:35.034484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:35.035289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:35.363203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:35.366578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:35.396996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:35.403172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:35.409151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:35.411672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:35.414581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:35.415370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:35.947384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:35.970821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2946927-7c19-45c9-96a7-dde13c20ae4b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1621 microversion: 2.1 time: 0.611814 Sep 16 14:33:35.984056 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2897/5810] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:35 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1621 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:36.355563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:36.371675 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fda46c0-12ed-4de3-88e4-d8af14c91c54 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 1.393191 Sep 16 14:33:36.375210 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2914/5811] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:34 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:37.008038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:37.015691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:37.038679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:37.039629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:37.040387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:37.041615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:37.048785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:37.050162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:37.400504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:37.402025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:37.424407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:37.429301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:37.430435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:37.431486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:37.432209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:37.435469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:37.698000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:37.727133 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81518bec-3154-4e4b-bb89-9f5236c6562c tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1621 microversion: 2.1 time: 0.727204 Sep 16 14:33:37.730276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2898/5812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:36 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1621 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:37.736087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-deebcfc0-4d20-4e06-ba68-0cbefd7eb846 req-c15c048f-1ca4-4fc5-b976-de8842a35b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48e3e7f-6700-477e-88cb-6bb28f8a1493", "tag": "4d61e994-57a1-40c3-9edc-a5dd5e4e1cef"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:37.765077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-deebcfc0-4d20-4e06-ba68-0cbefd7eb846 req-c15c048f-1ca4-4fc5-b976-de8842a35b5b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:37.772237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-deebcfc0-4d20-4e06-ba68-0cbefd7eb846 req-c15c048f-1ca4-4fc5-b976-de8842a35b5b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:37.773023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-deebcfc0-4d20-4e06-ba68-0cbefd7eb846 req-c15c048f-1ca4-4fc5-b976-de8842a35b5b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:37.847338 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-deebcfc0-4d20-4e06-ba68-0cbefd7eb846 req-c15c048f-1ca4-4fc5-b976-de8842a35b5b service nova] Creating event network-changed:4d61e994-57a1-40c3-9edc-a5dd5e4e1cef for instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 on n-h1-858129-2 Sep 16 14:33:37.869769 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-deebcfc0-4d20-4e06-ba68-0cbefd7eb846 req-c15c048f-1ca4-4fc5-b976-de8842a35b5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133167 Sep 16 14:33:37.875263 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2899/5813] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:38.192095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:38.215304 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28ab5a3d-8e25-49dc-a67e-bc992bbe45e7 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 0.818431 Sep 16 14:33:38.249961 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2915/5814] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:37 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:38.772449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:38.773219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:38.806093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:38.807165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:38.808507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:38.809725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:38.810485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:38.811208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:38.861753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:38.862732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:38.863416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:38.864739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'fault' on Instance uuid 8b0772fb-1194-4f5c-b916-a249bdb68edf {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:33:38.992836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:39.017735 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cc573c96-8189-486e-b760-0854f6657f6e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 200 len: 1335 microversion: 2.1 time: 0.251288 Sep 16 14:33:39.023377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2900/5815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:38 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 1335 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:39.253868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:39.254711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:39.271425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:39.272208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:39.272824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:39.273890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:39.275159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:39.275803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:39.523164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:39.540829 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9fe90f26-20a2-4306-8c73-10a76bae04f6 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 0.292934 Sep 16 14:33:39.542730 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2916/5816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:39 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:39.926463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-db2b2ad6-ce92-4cf6-9975-640fe2cbffad req-495204d1-7c25-43f9-9e6b-1b9a2985718a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0772fb-1194-4f5c-b916-a249bdb68edf", "name": "network-vif-deleted", "tag": "4344ca0c-8b22-4da7-9fbb-d2c94c71204f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:39.959663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-db2b2ad6-ce92-4cf6-9975-640fe2cbffad req-495204d1-7c25-43f9-9e6b-1b9a2985718a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:39.960140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-db2b2ad6-ce92-4cf6-9975-640fe2cbffad req-495204d1-7c25-43f9-9e6b-1b9a2985718a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:39.960587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-db2b2ad6-ce92-4cf6-9975-640fe2cbffad req-495204d1-7c25-43f9-9e6b-1b9a2985718a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:40.029509 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-db2b2ad6-ce92-4cf6-9975-640fe2cbffad req-495204d1-7c25-43f9-9e6b-1b9a2985718a service nova] Creating event network-vif-deleted:4344ca0c-8b22-4da7-9fbb-d2c94c71204f for instance 8b0772fb-1194-4f5c-b916-a249bdb68edf on n-h2-858129-2 Sep 16 14:33:40.052150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:40.052511 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-db2b2ad6-ce92-4cf6-9975-640fe2cbffad req-495204d1-7c25-43f9-9e6b-1b9a2985718a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128953 Sep 16 14:33:40.053278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 8b0772fb-1194-4f5c-b916-a249bdb68edf] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:40.060960 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2901/5817] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:40.069375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:40.072298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:40.073044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:40.077124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:40.077968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:40.079368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:40.124290 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf could not be found. Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf HTTP/1.1 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf could not be found. Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8b0772fb-1194-4f5c-b916-a249bdb68edf'} Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf could not be found. Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf could not be found. Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:40.128546 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf could not be found. Sep 16 14:33:40.134234 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:33:40.139238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 404 to user: Instance 8b0772fb-1194-4f5c-b916-a249bdb68edf could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:33:40.140633 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-36f86124-e8cd-494b-a937-c61d98d51a9e tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf" status: 404 len: 111 microversion: 2.1 time: 0.094418 Sep 16 14:33:40.143270 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2917/5818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:40 2022] GET /compute/v2.1/servers/8b0772fb-1194-4f5c-b916-a249bdb68edf => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:33:40.157682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4baf0149-d4f7-44a3-a864-68d54e30f913 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '.version_select at 0x7f724c09c040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:40.265704 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4baf0149-d4f7-44a3-a864-68d54e30f913 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639512528" status: 202 len: 0 microversion: 2.1 time: 0.116343 Sep 16 14:33:40.271986 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2902/5819] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639512528 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:33:40.568636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:40.569743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:40.584777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:40.590569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:40.591569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:40.592757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:40.593772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:40.594504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:41.431188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:41.451317 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e5795610-a63d-4f7e-8c68-f3d1ec90a47f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 0.887043 Sep 16 14:33:41.452475 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2918/5820] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:40 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:42.485765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:42.490914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:42.506810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:42.536427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:42.539231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:42.544414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:42.547262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:42.549011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:42.552255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:42.650613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:44.577537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:44.616364 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63fdb4a1-21ef-42f8-9c2d-7b55b9548b05 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 2.138918 Sep 16 14:33:44.622519 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2903/5821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:42 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:45.657891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:45.662786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:45.685494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:33:45.731037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:45.732041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:45.732801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:45.744105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:45.744965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:45.745749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:46.258448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:46.298002 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d7e407b-c051-4599-b04f-6825cf56c205 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 0.640673 Sep 16 14:33:46.322978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2919/5822] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:45 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:47.353938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:47.360993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:47.418192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0eee7a34-45a2-4aa8-861d-dddc9d4433de req-7db5df4d-6143-47c7-b3b9-78b8c027f8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48e3e7f-6700-477e-88cb-6bb28f8a1493", "name": "network-vif-plugged", "status": "completed", "tag": "4d61e994-57a1-40c3-9edc-a5dd5e4e1cef"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:33:47.423019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:47.428075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:47.430793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:47.439320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:47.442969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:47.444290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:47.453285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0eee7a34-45a2-4aa8-861d-dddc9d4433de req-7db5df4d-6143-47c7-b3b9-78b8c027f8de service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:47.453777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0eee7a34-45a2-4aa8-861d-dddc9d4433de req-7db5df4d-6143-47c7-b3b9-78b8c027f8de service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:47.468720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0eee7a34-45a2-4aa8-861d-dddc9d4433de req-7db5df4d-6143-47c7-b3b9-78b8c027f8de service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:47.517879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0eee7a34-45a2-4aa8-861d-dddc9d4433de req-7db5df4d-6143-47c7-b3b9-78b8c027f8de service nova] Creating event network-vif-plugged:4d61e994-57a1-40c3-9edc-a5dd5e4e1cef for instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 on n-h1-858129-2 Sep 16 14:33:47.538250 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0eee7a34-45a2-4aa8-861d-dddc9d4433de req-7db5df4d-6143-47c7-b3b9-78b8c027f8de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125731 Sep 16 14:33:47.540633 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2920/5823] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:33:48.405547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:48.431789 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-05253a06-e97e-485c-8bd6-c9fc6a9b1269 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 1.086971 Sep 16 14:33:48.438740 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2904/5824] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:47 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:49.466062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:49.468723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:49.491088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:49.499475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:49.500504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:49.501545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:49.502293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:49.503035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:50.532884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:50.543146 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e61aa4f-84b7-47ef-bc56-a705abc53247 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1319 microversion: 2.1 time: 1.084045 Sep 16 14:33:50.543803 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2921/5825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:49 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1319 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:33:51.580282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:51.580884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:51.593864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:51.594354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:51.600847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:51.601628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:51.602107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:51.602573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:51.767692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:51.768242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:51.794430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:51.795226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:51.797931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:51.801359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:51.805229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:51.809992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:52.082695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lazy-loading 'services' on Instance uuid f5210058-ed7d-44e7-82d4-a0636df6787f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:33:52.310767 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31d028fa-ad1e-4f2f-bda6-85a2e10d625e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-volume_attachments/6be569b3-b2fb-4b2c-ab11-9f72f42712f9" status: 202 len: 0 microversion: 2.1 time: 0.545533 Sep 16 14:33:52.311113 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2922/5826] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:33:51 2022] DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-volume_attachments/6be569b3-b2fb-4b2c-ab11-9f72f42712f9 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:33:52.785409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:33:52.828997 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e699de7e-e5c7-47ec-84e1-51a577f1395d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1509 microversion: 2.1 time: 1.252851 Sep 16 14:33:52.831454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2905/5827] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:51 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1509 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:33:58.362760 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:33:58.363762 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:33:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 (ip 10.222.0.60) !!! Sep 16 14:33:58.385996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:58.387694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:58.437481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:58.444564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:58.445820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:58.448309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:58.449385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:58.450331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:58.580951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:33:58.957101 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-76956f84-5eec-4c4d-adc8-c78b033709a4 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 204 len: 0 microversion: 2.1 time: 0.599101 Sep 16 14:33:58.957997 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2923/5828] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:33:58 2022] DELETE /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:33:58.970539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:33:58.971442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:33:58.994307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:58.996248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:59.000934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:33:59.001982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:33:59.005073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:33:59.009446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:01.262082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:01.281274 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-860db788-09b9-4324-9865-3fc961d27a00 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1506 microversion: 2.1 time: 2.315406 Sep 16 14:34:01.308694 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2906/5829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:33:58 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1506 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:02.313894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:02.315319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:02.356007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:02.356564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:02.357747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:02.358772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:02.366310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:02.376195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:02.484606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:02.583351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:02.591965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-770616f2-212d-4f99-9631-9ab80d840c50 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1464 microversion: 2.1 time: 0.282605 Sep 16 14:34:02.592597 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2924/5830] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:02 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1464 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:02.678760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f3b038b4-002d-40fc-b6b2-0d27e955d934 req-c931c54d-a12b-441a-a2d3-d897bd415241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6cb496-a555-4b1e-8e86-62a96b13ea78", "name": "network-vif-deleted", "tag": "45707517-0a6f-4f40-84cf-30cbefc81e7e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:02.714815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f3b038b4-002d-40fc-b6b2-0d27e955d934 req-c931c54d-a12b-441a-a2d3-d897bd415241 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:02.715314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f3b038b4-002d-40fc-b6b2-0d27e955d934 req-c931c54d-a12b-441a-a2d3-d897bd415241 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:02.715761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f3b038b4-002d-40fc-b6b2-0d27e955d934 req-c931c54d-a12b-441a-a2d3-d897bd415241 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:02.760616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f3b038b4-002d-40fc-b6b2-0d27e955d934 req-c931c54d-a12b-441a-a2d3-d897bd415241 service nova] Creating event network-vif-deleted:45707517-0a6f-4f40-84cf-30cbefc81e7e for instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 on n-h2-858129-2 Sep 16 14:34:02.809291 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f3b038b4-002d-40fc-b6b2-0d27e955d934 req-c931c54d-a12b-441a-a2d3-d897bd415241 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136195 Sep 16 14:34:02.827217 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2907/5831] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:34:03.619813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:03.622557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:03.641795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:03.644458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:03.652917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:03.655046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:03.655759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:03.658809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:03.778121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:03.778696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:03.779153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:03.779635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lazy-loading 'fault' on Instance uuid 0a6cb496-a555-4b1e-8e86-62a96b13ea78 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:34:04.756596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:04.777848 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9175ad9c-5b2c-4241-a781-03fe9609d92b tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 200 len: 1311 microversion: 2.1 time: 1.162441 Sep 16 14:34:04.790440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2925/5832] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:03 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 1311 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:05.833195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:05.851952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: 0a6cb496-a555-4b1e-8e86-62a96b13ea78] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:05.887160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:05.888040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:05.888857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:05.890154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:05.905088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:05.906000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:05.942459 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 could not be found. Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 HTTP/1.1 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 could not be found. Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0a6cb496-a555-4b1e-8e86-62a96b13ea78'} Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 could not be found. Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 could not be found. Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:05.948141 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 could not be found. Sep 16 14:34:05.956631 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:05.959444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 404 to user: Instance 0a6cb496-a555-4b1e-8e86-62a96b13ea78 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:34:05.961365 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efd7f14f-d2a7-42c8-bdef-d6e4709ea1a1 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78" status: 404 len: 111 microversion: 2.1 time: 0.140695 Sep 16 14:34:05.968690 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2908/5833] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:05 2022] GET /compute/v2.1/servers/0a6cb496-a555-4b1e-8e86-62a96b13ea78 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:34:05.975206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:05.975765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:05.991493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:06.000403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:06.001727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:06.002605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:06.009518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:06.010003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:06.115740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:34:06.448647 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e92b8311-1620-4aab-b6eb-885c5a20c060 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 204 len: 0 microversion: 2.1 time: 0.479928 Sep 16 14:34:06.455454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2926/5834] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:34:05 2022] DELETE /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:34:06.460645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:06.461387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:06.478238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:06.479098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:06.483590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:06.488953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:06.489478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:06.495686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:07.150003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:07.193007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0c06bdec-42d7-4d4d-96cd-fda8ea77c670 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.736322 Sep 16 14:34:07.194139 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2909/5835] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:06 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:07.459555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23737764-ea5e-4d52-93b9-2e722bac093b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:07.512182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23737764-ea5e-4d52-93b9-2e722bac093b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:07.515159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23737764-ea5e-4d52-93b9-2e722bac093b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:07.515903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23737764-ea5e-4d52-93b9-2e722bac093b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:07.582871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23737764-ea5e-4d52-93b9-2e722bac093b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Going to try to stop instance {{(pid=128643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 14:34:07.682913 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23737764-ea5e-4d52-93b9-2e722bac093b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action" status: 202 len: 0 microversion: 2.1 time: 0.232060 Sep 16 14:34:07.686384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2927/5836] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:34:07 2022] POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:34:07.696891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:07.697809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:07.719358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:07.729757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:07.731039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:07.739101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:07.741464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:07.742637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:08.017062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:08.053354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb8b4c8d-ed26-4b1b-b44b-c96afbd57b53 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1722 microversion: 2.1 time: 0.362419 Sep 16 14:34:08.053961 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2910/5837] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:07 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:08.248986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:08.250788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:08.266105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:08.266242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:08.267105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:08.268895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:08.270242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:08.271323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:08.648195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:08.700394 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1b917636-d6dd-406b-b6ba-062e3abb74ac tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.460960 Sep 16 14:34:08.702480 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2928/5838] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:08 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:09.100862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:09.102481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:09.126283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:09.127203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:09.128252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:09.135099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:09.136057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:09.136646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:09.773138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:09.785712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:09.808854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:09.809375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:09.809832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:09.810604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:09.811073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:09.811504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:10.111128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:10.125373 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e54930f9-9f11-49b8-a20d-e10aa311607d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 1.030870 Sep 16 14:34:10.147220 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2911/5839] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:09 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:10.543942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:10.560142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e0ae35b2-70fb-43ef-a0a3-ac04a96e3f94 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1520 microversion: 2.1 time: 0.810575 Sep 16 14:34:10.561447 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2929/5840] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:09 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1520 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:11.153716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:11.154492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:11.171300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:11.172956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:11.173458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:11.175750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:11.176245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:11.178565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:11.610992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:11.619933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:11.651263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:11.655645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:11.656186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:11.656954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:11.657421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:11.657847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:11.926063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:11.943397 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5880586-a43d-4a33-aa3d-24a96e8c60b7 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 0.797099 Sep 16 14:34:11.946819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2912/5841] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:11 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:11.951397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ffd42c93ac48329b0e1a8b3baf0a36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04d4359a23549d587d9bf8ea9638abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:11.993755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ee7e86b8-9dbd-4bdd-acb1-bc9c23ce7a92 req-e5b30bc2-a737-4abd-b8d2-9548c1cf649d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec860017-4a48-4dde-8f14-3a4187a16ab6", "name": "network-vif-deleted", "tag": "23ec2f4b-9e38-48c8-9817-dbe6a2e97f45"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:12.006089 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-938aecd4-10a9-4c48-8d0d-f35b31324280 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 200 len: 1478 microversion: 2.1 time: 0.412407 Sep 16 14:34:12.016276 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2930/5842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:11 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 1478 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:34:12.085982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ee7e86b8-9dbd-4bdd-acb1-bc9c23ce7a92 req-e5b30bc2-a737-4abd-b8d2-9548c1cf649d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:12.095591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ee7e86b8-9dbd-4bdd-acb1-bc9c23ce7a92 req-e5b30bc2-a737-4abd-b8d2-9548c1cf649d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:12.096913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ee7e86b8-9dbd-4bdd-acb1-bc9c23ce7a92 req-e5b30bc2-a737-4abd-b8d2-9548c1cf649d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:12.164274 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ee7e86b8-9dbd-4bdd-acb1-bc9c23ce7a92 req-e5b30bc2-a737-4abd-b8d2-9548c1cf649d service nova] Creating event network-vif-deleted:23ec2f4b-9e38-48c8-9817-dbe6a2e97f45 for instance ec860017-4a48-4dde-8f14-3a4187a16ab6 on n-h1-858129-2 Sep 16 14:34:12.201405 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ee7e86b8-9dbd-4bdd-acb1-bc9c23ce7a92 req-e5b30bc2-a737-4abd-b8d2-9548c1cf649d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252866 Sep 16 14:34:12.202913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2913/5843] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:34:12.996540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:12.997176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:13.024464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:13.024974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:13.025418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:13.026152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:13.026648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:13.027083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:13.049417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:13.050140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] [instance: ec860017-4a48-4dde-8f14-3a4187a16ab6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:13.065346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=22 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:13.106773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:13.107282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:13.107728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:13.108448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:13.108910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:13.109339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:13.191250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=54 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:13.202337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] HTTP exception thrown: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 could not be found. Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Request method failure captured: Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 HTTP/1.1 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIfX1_ff6u8i4v8c1lKa0nkhZ0tgzdrXemtBfkAQl2jSBddS_VWDoSoyuG-kJ-xRXiy67Gne7Si7wVjzOmytuEaXMNac65mgsSoryB1RHh2xKxL8xuUp80P4y_oxUWrnUBXMPfw3i18q0rTWaGwr7H_7Fu7oz3anejfKMLdtEtZVTkk Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e04d4359a23549d587d9bf8ea9638abd", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e04d4359a23549d587d9bf8ea9638abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e04d4359a23549d587d9bf8ea9638abd"}]}] Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e04d4359a23549d587d9bf8ea9638abd Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-503758930 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: b4ffd42c93ac48329b0e1a8b3baf0a36 Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-503758930-project Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 could not be found. Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ec860017-4a48-4dde-8f14-3a4187a16ab6'} Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 could not be found. Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 could not be found. Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:13.208093 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 could not be found. Sep 16 14:34:13.214067 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:34:13.218143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] Returning 404 to user: Instance ec860017-4a48-4dde-8f14-3a4187a16ab6 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:34:13.220051 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e979107-afc2-446f-82f3-46bfe19aa512 tempest-ServerRescueNegativeTestJSON-503758930 tempest-ServerRescueNegativeTestJSON-503758930-project] 10.222.0.60 "GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6" status: 404 len: 111 microversion: 2.1 time: 0.175870 Sep 16 14:34:13.227926 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2914/5844] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:13 2022] GET /compute/v2.1/servers/ec860017-4a48-4dde-8f14-3a4187a16ab6 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:34:13.752512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:13.800582 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b18878b-578b-4230-860f-a4e4d6c67c72 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 0.815896 Sep 16 14:34:13.802343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2931/5845] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:12 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:14.830844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:14.831723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:14.848071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:14.848577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:14.849021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:14.849750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:14.850208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:14.851239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:16.173450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:16.198615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc63d232-e0d4-4cfd-9e53-3222bea1b592 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 1.368901 Sep 16 14:34:16.200675 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2915/5846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:14 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:34:17.232191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:17.233359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:17.262337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:17.270054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:17.281338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:17.282585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:17.289689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:17.299436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:17.302842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:18.558765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:18.574740 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7ee216cd-355e-44a3-abbd-110a07908a64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 1.344099 Sep 16 14:34:18.575549 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2932/5847] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:17 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:19.604621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:19.605435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:19.612183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:19.621241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:19.621963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:19.623039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:19.623669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:19.624269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:19.968341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:20.000686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d880b4e5-0978-4ef2-b835-ec7db0b65b51 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 0.401213 Sep 16 14:34:20.005031 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2916/5848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:19 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:21.041690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:21.047029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:21.082995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:21.083405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:21.084098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:21.084885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:21.089364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:21.089364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:21.558348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:21.596576 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c780fb39-59fc-41ec-8d25-088378d0714b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 0.568900 Sep 16 14:34:21.599073 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2933/5849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:21 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:22.648125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:22.648125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:22.674922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:22.678575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:22.680649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:22.683349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:22.685004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:22.686789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:23.273305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:23.289822 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-84be59fb-a877-45ca-8fcf-ab803f511256 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1676 microversion: 2.1 time: 0.654099 Sep 16 14:34:23.306594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2917/5850] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:22 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1676 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:24.313858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:24.315146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:24.329725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:24.330512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:24.333349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:24.334350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:24.335005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:24.336548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:24.707440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:24.727835 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-49706b07-d9a2-4a64-9fd2-caaeb260df02 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1653 microversion: 2.1 time: 0.418350 Sep 16 14:34:24.736148 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2934/5851] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:24 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1653 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:24.771328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b5e619b-3b90-43a6-97b6-3808d5300b75 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:24.787930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b5e619b-3b90-43a6-97b6-3808d5300b75 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:24.790148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b5e619b-3b90-43a6-97b6-3808d5300b75 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:24.792698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b5e619b-3b90-43a6-97b6-3808d5300b75 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:24.870333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b5e619b-3b90-43a6-97b6-3808d5300b75 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Going to try to start instance {{(pid=128642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 14:34:25.020801 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2b5e619b-3b90-43a6-97b6-3808d5300b75 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action" status: 202 len: 0 microversion: 2.1 time: 0.251680 Sep 16 14:34:25.025716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2918/5852] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:34:24 2022] POST /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:34:25.035100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:25.036216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:25.047191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:25.048121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:25.048827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:25.049981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:25.050823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:25.051543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:26.716844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:26.733446 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b833baca-a7cb-4a16-99a1-61e006b138f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1662 microversion: 2.1 time: 1.703641 Sep 16 14:34:26.736476 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2935/5853] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:25 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1662 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:27.768245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:27.769098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:27.797227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:27.799351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:27.800610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:27.802880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:27.804063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:27.808096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:28.424626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:28.437987 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dac18c0a-2fc9-43ee-abd4-e9380cb380f5 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1662 microversion: 2.1 time: 0.676204 Sep 16 14:34:28.442081 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2919/5854] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:27 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1662 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:29.468000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:29.470970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:29.494325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:29.495341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:29.497662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:29.499337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:29.502073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:29.505955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:30.164861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:30.200396 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5ee72434-df8b-4941-9443-dd07820d962c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1666 microversion: 2.1 time: 0.731979 Sep 16 14:34:30.233795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2936/5855] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:29 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1666 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:34:35.549648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9581309e-40b3-4522-996c-f12d40397635", "device": "/dev/sdb"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:35.553095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:35.569693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:35.570212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:35.570692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:35.571481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:35.583547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:35.585730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:36.210563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f8b6e89-7900-4a67-938a-6f2e186c0f5b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "POST /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665198 Sep 16 14:34:36.217317 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2920/5856] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:34:35 2022] POST /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:34:45.747388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:45.748740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:46.032818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f017ef04-f2a8-4298-aba4-18403e6b7950 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: .version_select at 0x7f724d308d30>, body: {"keypair": {"name": "tempest-keypair-1029246519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXU/l2OvXVkuJTh5xm1X2DIzsivnhHl6tDtCPf73VKBt0enLqHMvk1yENq+h2lrYFli+RHIsPxA68PJrsBPItMoYIgbUjIUJvgB37d0bv0fCI3/2T5fCalFAPS3tuRfA=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:46.076168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f017ef04-f2a8-4298-aba4-18403e6b7950 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:34:46.093019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-f017ef04-f2a8-4298-aba4-18403e6b7950 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:34:46.156684 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f017ef04-f2a8-4298-aba4-18403e6b7950 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.423963 Sep 16 14:34:46.157318 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2937/5857] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:34:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:34:53.990455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=13 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:53.991981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:54.005673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1482925120", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c17062a-3bb6-45ab-8062-5725ef0d7c64"}], "security_groups": [{"name": "tempest-securitygroup--146433947"}], "key_name": "tempest-keypair-1029246519", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:34:54.630972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] validate_networks() for [('1c17062a-3bb6-45ab-8062-5725ef0d7c64', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:34:56.015204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:34:56.015840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:34:56.016606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:34:56.017222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:34:56.017829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:34:56.053370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:56.054173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:56.054927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:56.058942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:34:56.060319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:34:56.062130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:34:56.142540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:34:56.176819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:34:56.220946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:34:56.229646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:34:56.420625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88a8caa9-8603-4547-82c0-e1e19551003f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.437208 Sep 16 14:34:56.439802 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2921/5858] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:34:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:34:56.441201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:56.442379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:34:56.446881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5ca20e6-8676-411d-8ab0-455e20b006fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:56.447520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5ca20e6-8676-411d-8ab0-455e20b006fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:56.614273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f5ca20e6-8676-411d-8ab0-455e20b006fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:56.639258 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5ca20e6-8676-411d-8ab0-455e20b006fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1242 microversion: 2.1 time: 0.199428 Sep 16 14:34:56.641922 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2938/5859] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:56 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:57.672111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c700014f-265f-45b4-a279-17677e4d8d6c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:57.672986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c700014f-265f-45b4-a279-17677e4d8d6c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:58.369876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c700014f-265f-45b4-a279-17677e4d8d6c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:58.381819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c700014f-265f-45b4-a279-17677e4d8d6c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1242 microversion: 2.1 time: 0.715887 Sep 16 14:34:58.385023 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2922/5860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:57 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1242 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:34:59.412202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a2cab37-4c2c-4d42-92b8-e5bc130f6580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:34:59.414268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1a2cab37-4c2c-4d42-92b8-e5bc130f6580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:34:59.580808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a2cab37-4c2c-4d42-92b8-e5bc130f6580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:34:59.629988 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a2cab37-4c2c-4d42-92b8-e5bc130f6580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1242 microversion: 2.1 time: 0.222464 Sep 16 14:34:59.646024 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2939/5861] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:34:59 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1242 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:00.660387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:00.662775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:00.677373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:00.678706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:00.680097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:00.681943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:00.683306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:00.684447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:00.958678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:00.972172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5fa604ad-b754-4ea6-b3db-37ad462eb9fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1294 microversion: 2.1 time: 0.320254 Sep 16 14:35:01.023234 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2923/5862] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:00 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1294 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:02.006874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:02.007982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:02.021567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:02.022572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:02.023996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:02.025311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:02.026065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:02.026800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:02.244948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:02.285260 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-537c519c-8d71-46b1-9016-5c863ceb1ec6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1300 microversion: 2.1 time: 0.277618 Sep 16 14:35:02.313888 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2940/5863] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:01 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:03.336957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:03.343637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:03.388136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:03.393810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:03.397393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:03.406122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:03.408768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:03.411790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:04.400642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:04.400642 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b6de6347-23b1-4d28-a996-508096007679 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 1.071283 Sep 16 14:35:04.420596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2924/5864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:03 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:05.416424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:05.417835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:05.437711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:05.454000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:05.460411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:05.461643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:05.466927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:05.469289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:05.733843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:05.757643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-801c2f23-34bf-46fe-bf77-7a63851871ae tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 0.343228 Sep 16 14:35:05.759965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2941/5865] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:05 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:35:06.798765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:06.807253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:06.832460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:06.920387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:06.932845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:06.940985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:06.942306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:06.943161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:06.943899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:08.374707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:08.855906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:08.887798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9223c00d-3359-4405-9724-a822b342c9da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 2.094629 Sep 16 14:35:08.906852 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2925/5866] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:06 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:09.688877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:09.871011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4e53579f-a211-4028-96ea-9c2683648995 req-ee824b25-9aec-4ceb-8fd8-eca5f6b6cac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e2a4b1-5232-4366-9496-53a98f1e80b2", "tag": "e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:09.896831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4e53579f-a211-4028-96ea-9c2683648995 req-ee824b25-9aec-4ceb-8fd8-eca5f6b6cac6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:09.897743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4e53579f-a211-4028-96ea-9c2683648995 req-ee824b25-9aec-4ceb-8fd8-eca5f6b6cac6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:09.898489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4e53579f-a211-4028-96ea-9c2683648995 req-ee824b25-9aec-4ceb-8fd8-eca5f6b6cac6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:09.900391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:09.901631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:09.919721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:09.925896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:09.926824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:09.927935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:09.942116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:09.943866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:09.944936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4e53579f-a211-4028-96ea-9c2683648995 req-ee824b25-9aec-4ceb-8fd8-eca5f6b6cac6 service nova] Creating event network-changed:e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f for instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 on n-h2-858129-2 Sep 16 14:35:09.964517 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4e53579f-a211-4028-96ea-9c2683648995 req-ee824b25-9aec-4ceb-8fd8-eca5f6b6cac6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282295 Sep 16 14:35:09.967932 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2942/5867] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:35:10.685551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:10.696044 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-73a90b08-d134-42b1-acd3-184ba2172ac9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 0.799635 Sep 16 14:35:10.711704 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2926/5868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:09 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:11.774741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:11.786043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:11.809673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:11.810962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:11.818344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:11.819647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:11.820352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:11.826221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:12.168383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:12.180421 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0932a732-be30-4dbf-b7b2-02d83135b30e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 0.443068 Sep 16 14:35:12.181139 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2943/5869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:11 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:13.205020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:13.205654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:13.231013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:13.236634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:13.237473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:13.238261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:13.238850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:13.239273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:14.644389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:14.671974 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ac73b89-6078-4462-98b6-a40d58afecb0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 1.471306 Sep 16 14:35:14.690914 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2927/5870] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:13 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:35:15.700375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:15.701057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:15.726622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:15.727132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:15.727583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:15.728318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:15.728795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:15.729226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:16.855304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:16.874537 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a9668b31-83d0-4671-83c3-df04597947c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 1.178087 Sep 16 14:35:16.878526 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2944/5871] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:15 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:17.901759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:17.902376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:17.913394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:17.916131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:17.916757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:17.917675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:17.926300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:17.927026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:18.384827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:18.395828 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fb40359e-f362-4286-bf88-df63e3a7fa44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 0.495832 Sep 16 14:35:18.411946 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2928/5872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:17 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:19.207505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8ff69a76-1463-468b-b149-47d262d497fe req-1b5ebae9-0158-432a-b0d7-ead58ace3105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e2a4b1-5232-4366-9496-53a98f1e80b2", "name": "network-vif-plugged", "status": "completed", "tag": "e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:19.256354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8ff69a76-1463-468b-b149-47d262d497fe req-1b5ebae9-0158-432a-b0d7-ead58ace3105 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:19.260180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8ff69a76-1463-468b-b149-47d262d497fe req-1b5ebae9-0158-432a-b0d7-ead58ace3105 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:19.263401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8ff69a76-1463-468b-b149-47d262d497fe req-1b5ebae9-0158-432a-b0d7-ead58ace3105 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:19.279956 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8ff69a76-1463-468b-b149-47d262d497fe req-1b5ebae9-0158-432a-b0d7-ead58ace3105 service nova] Creating event network-vif-plugged:e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f for instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 on n-h2-858129-2 Sep 16 14:35:19.289172 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8ff69a76-1463-468b-b149-47d262d497fe req-1b5ebae9-0158-432a-b0d7-ead58ace3105 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267037 Sep 16 14:35:19.290570 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2945/5873] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:35:19.432247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:19.432998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:19.449339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:19.458655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:19.468934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:19.473499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:19.477328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:19.478064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:20.263295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:20.276117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-280d82f5-903b-4355-ba23-fc144e089b37 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 0.855864 Sep 16 14:35:20.292890 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2929/5874] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:19 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:21.304679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:21.305571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:21.326354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:21.326879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:21.327344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:21.328091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:21.340735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:21.341266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:21.632085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:21.641203 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-24bc6b58-2f3a-46d6-8f03-bdcc9412522a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1367 microversion: 2.1 time: 0.342276 Sep 16 14:35:21.656850 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2946/5875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:21 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:22.664408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:22.665031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:22.679682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:22.680300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:22.681283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:22.682052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:22.688429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:22.689175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:22.988819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:23.002974 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3b0d4062-a080-49d5-af85-f93f970fee9b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1555 microversion: 2.1 time: 0.341425 Sep 16 14:35:23.005828 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2930/5876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:22 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:23.031971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:23.032485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:23.050865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:23.051363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:23.051800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:23.052513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:23.052964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:23.053385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:23.335624 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4814c635-349c-4de7-abf5-3edc670dff23 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.308940 Sep 16 14:35:23.336478 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2947/5877] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:35:23 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:35:25.609449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6e9deee1-ce84-421f-8f1e-dabf7acf3559 req-17e9b05c-4b9c-4ed2-bf8d-00d0b910e78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e2a4b1-5232-4366-9496-53a98f1e80b2", "tag": "e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:25.631715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:25.644336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6e9deee1-ce84-421f-8f1e-dabf7acf3559 req-17e9b05c-4b9c-4ed2-bf8d-00d0b910e78a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:25.651225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6e9deee1-ce84-421f-8f1e-dabf7acf3559 req-17e9b05c-4b9c-4ed2-bf8d-00d0b910e78a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:25.653562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6e9deee1-ce84-421f-8f1e-dabf7acf3559 req-17e9b05c-4b9c-4ed2-bf8d-00d0b910e78a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:25.681407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=51 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:25.723791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6e9deee1-ce84-421f-8f1e-dabf7acf3559 req-17e9b05c-4b9c-4ed2-bf8d-00d0b910e78a service nova] Creating event network-changed:e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f for instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 on n-h2-858129-2 Sep 16 14:35:25.740136 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6e9deee1-ce84-421f-8f1e-dabf7acf3559 req-17e9b05c-4b9c-4ed2-bf8d-00d0b910e78a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132970 Sep 16 14:35:25.742390 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2931/5878] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:35:25.948133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:25.950578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:25.978615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:25.981867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:25.982632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:25.983457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:25.997688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:25.999040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:26.101744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe975e5c-f1a5-4e03-a21d-07b44fcfa257 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.159336 Sep 16 14:35:26.116083 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2948/5879] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:35:25 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:35:26.234300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:26.237372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:26.281864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:26.284323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:26.285849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:26.288166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:26.293347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:26.294307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:26.444451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:35:26.792242 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58e15c5a-c47d-4cd5-abc1-ae7faf750006 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 204 len: 0 microversion: 2.1 time: 0.565897 Sep 16 14:35:26.801060 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2932/5880] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:35:26 2022] DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:35:26.808859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:26.811367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:26.813954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=27 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:26.834829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:26.837384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:26.837384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:26.845207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:26.848140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:26.848998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:26.862274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=45 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:27.680598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:27.704898 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21204a34-a3ef-4747-a637-101f6bf4a659 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1672 microversion: 2.1 time: 0.902432 Sep 16 14:35:27.708576 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2949/5881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:26 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1672 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:28.730950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:28.731828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:28.750397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:28.750938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:28.751617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:28.752658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:28.753319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:28.754090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:29.177812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:29.205323 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a641c43-c93f-4ee9-ae94-8fc6f38bb604 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1672 microversion: 2.1 time: 0.479084 Sep 16 14:35:29.224983 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2933/5882] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:28 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1672 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:29.862279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:29.864127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:29.877184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:29.880266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:29.880932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:29.884974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:29.885660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:29.886279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:30.054594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lazy-loading 'services' on Instance uuid a48e3e7f-6700-477e-88cb-6bb28f8a1493 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:35:30.238497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:30.239236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:30.262729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:30.264021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:30.266933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:30.270582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:30.271782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:30.274668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:30.285263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02b047e8-2ea0-4a09-afc1-ac8595f5cb88 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493/os-volume_attachments/9581309e-40b3-4522-996c-f12d40397635" status: 202 len: 0 microversion: 2.1 time: 0.427809 Sep 16 14:35:30.308274 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2950/5883] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:35:29 2022] DELETE /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493/os-volume_attachments/9581309e-40b3-4522-996c-f12d40397635 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:35:30.873233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:30.891082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bb9f817c-3b20-4c94-87b4-7a685de10015 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1672 microversion: 2.1 time: 0.656796 Sep 16 14:35:30.895112 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2934/5884] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:30 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1672 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:35:31.923469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:31.924454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:31.948778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:31.949266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:31.952699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:31.957380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:31.957380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:31.957380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:32.518363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:32.535442 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c2e80fad-b652-4d94-a9d1-cb56f2020247 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1605 microversion: 2.1 time: 0.617578 Sep 16 14:35:32.536612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2951/5885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:31 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1605 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:33.409746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a361d756-0efe-41d3-a99b-d68bd8f7e714 req-c50f9613-943c-49f1-a659-7b6f9930150a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5210058-ed7d-44e7-82d4-a0636df6787f", "name": "network-vif-deleted", "tag": "4ca4c4a6-62df-4215-8630-eece9e8a78a3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:33.470059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a361d756-0efe-41d3-a99b-d68bd8f7e714 req-c50f9613-943c-49f1-a659-7b6f9930150a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:33.472148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a361d756-0efe-41d3-a99b-d68bd8f7e714 req-c50f9613-943c-49f1-a659-7b6f9930150a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:33.473223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a361d756-0efe-41d3-a99b-d68bd8f7e714 req-c50f9613-943c-49f1-a659-7b6f9930150a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:33.522509 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a361d756-0efe-41d3-a99b-d68bd8f7e714 req-c50f9613-943c-49f1-a659-7b6f9930150a service nova] Creating event network-vif-deleted:4ca4c4a6-62df-4215-8630-eece9e8a78a3 for instance f5210058-ed7d-44e7-82d4-a0636df6787f on n-h1-858129-2 Sep 16 14:35:33.564907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:33.565535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:33.570515 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a361d756-0efe-41d3-a99b-d68bd8f7e714 req-c50f9613-943c-49f1-a659-7b6f9930150a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147868 Sep 16 14:35:33.575747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:33.576218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:33.577191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:33.577912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:33.578364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:33.578517 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2935/5886] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:35:33.587159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:33.726090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:33.726626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:33.727071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:33.727538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lazy-loading 'fault' on Instance uuid f5210058-ed7d-44e7-82d4-a0636df6787f {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:35:34.118535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:34.131264 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc1d00a3-432d-4eda-af06-3446fe962944 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 200 len: 1328 microversion: 2.1 time: 0.569038 Sep 16 14:35:34.151678 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2952/5887] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:33 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 1328 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:35.161463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:35.162333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:35.187174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:35.187687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:35.188130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:35.188860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:35.195037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:35.196665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:35.227009 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] HTTP exception thrown: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Request method failure captured: Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f HTTP/1.1 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIiAS0nr6gn8XgciYSFaZ1I9-Zxk79uvRNlqFzEMSwTCH7CjMDUd-HDUx1p7ueoNTjrC8oMvpmCQjWro5tDt9rbLkTDl8ZA3pOvTu60fn13_2TWpQjAQuq8OQ7kibW3wnhmNCyLUtS6ny0wWl1ukocT4skgJxyUcC5ZAtCDIpyK2ICI Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86ad0ff4a2bb4402bae5c96d46cd528e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}] Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 67181b6dea474d52af92f466ac92d055 Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f5210058-ed7d-44e7-82d4-a0636df6787f'} Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:35:35.231449 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Returning 404 to user: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:35:35.237525 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79b31e03-21ba-4905-b306-51cfab5bb489 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 404 len: 111 microversion: 2.1 time: 0.077045 Sep 16 14:35:35.243476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b958a35-737f-4e05-acb6-b37a1c4c7b64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '.version_select at 0x7f724c3a8ca0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:35.256447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2936/5888] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:35 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:35:35.282865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b958a35-737f-4e05-acb6-b37a1c4c7b64 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786787350" status: 202 len: 0 microversion: 2.1 time: 0.043889 Sep 16 14:35:35.283536 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2953/5889] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:35:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1786787350 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:35:37.885543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2bdcaf03-471d-4c6e-abe7-3ee55f4a6ad3 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: .version_select at 0x7f7247ef3820>, body: {"keypair": {"name": "tempest-keypair-1064536850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRkHZ6p4HMJRuSRXDgiZ0jkR4j2UlVysmc17Z3AsWUfnvADy4IRM7acCUWnvD7dONvoB6TdAkxFqjY66yy6WYnOZuCa8hRXyKvwLR52XZehXbp9Z994ofSDT6SQfcCuXA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:37.927530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-2bdcaf03-471d-4c6e-abe7-3ee55f4a6ad3 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:35:37.942009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-2bdcaf03-471d-4c6e-abe7-3ee55f4a6ad3 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for user 67181b6dea474d52af92f466ac92d055 and project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:35:37.981400 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2bdcaf03-471d-4c6e-abe7-3ee55f4a6ad3 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096350 Sep 16 14:35:37.984271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2937/5890] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:35:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:35:40.999552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:41.002760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:41.026870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:41.038217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:41.038779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:41.040240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:41.040240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:41.043536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:41.091144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:35:41.250391 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b75486d8-d647-43a3-ab72-096c384fa077 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 204 len: 0 microversion: 2.1 time: 0.257138 Sep 16 14:35:41.251436 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2954/5891] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:35:40 2022] DELETE /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:35:41.264070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:41.265267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:41.282948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:41.283582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:41.283911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:41.284658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:41.285131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:41.285570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:41.790934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:41.801057 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a1c5faa1-6ec8-49f7-a2ef-582ba6c0ad6a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1515 microversion: 2.1 time: 0.545061 Sep 16 14:35:41.802021 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2938/5892] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:41 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1515 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:42.830768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:42.832531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:42.852913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:42.856173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:42.856847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:42.860740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:42.862569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:42.881332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:43.552239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:43.575045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cfd8d7dc-796b-4e4a-9632-465335a5a4a8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1515 microversion: 2.1 time: 0.750865 Sep 16 14:35:43.575368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-176236605", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58ab957a-8d04-4758-873b-dcacdf3fe82b"}], "security_groups": [{"name": "tempest-securitygroup--983782932"}], "key_name": "tempest-keypair-1064536850", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:43.592184 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2955/5893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:42 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1515 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:44.124531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] validate_networks() for [('58ab957a-8d04-4758-873b-dcacdf3fe82b', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:35:44.604280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:44.605302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:44.627629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:44.629099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:44.632799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:44.635400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:44.636243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:44.639767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:45.264820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:45.281544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca206449-5c73-4d66-bfe5-b27e5c84a76c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1515 microversion: 2.1 time: 0.682701 Sep 16 14:35:45.283489 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2956/5894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:44 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1515 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:46.318764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:46.320236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:46.329710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:46.330652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:46.331612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:46.332610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:46.333316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:46.334024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:47.040143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:35:47.041614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:35:47.042655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:35:47.045466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:35:47.046373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:35:47.059404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:47.060349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:47.061105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:47.064500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:47.065769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:47.066493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:47.100634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:35:47.120904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Getting quotas for user 67181b6dea474d52af92f466ac92d055 and project 86ad0ff4a2bb4402bae5c96d46cd528e. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:35:47.149271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:35:47.152395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:35:47.254858 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12a77c91-bf0c-489f-a984-e2fc49800138 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.684033 Sep 16 14:35:47.262651 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2939/5895] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:35:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 3691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:35:47.287037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39a4fe31-fd3b-4007-aa42-2cc14d986151 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:47.291279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-39a4fe31-fd3b-4007-aa42-2cc14d986151 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:47.613362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-39a4fe31-fd3b-4007-aa42-2cc14d986151 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:47.655978 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39a4fe31-fd3b-4007-aa42-2cc14d986151 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1237 microversion: 2.1 time: 0.380116 Sep 16 14:35:47.658061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2940/5896] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:47 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1237 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:47.720506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:47.781942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb79ac5b-c965-4b58-84aa-9a1e027bc446 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1515 microversion: 2.1 time: 1.466267 Sep 16 14:35:47.792182 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2957/5897] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:46 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1515 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:48.130042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-eaf4fed6-901d-45b5-9b9a-4340dae16557 req-85a6ee0a-7e4d-4b5d-9cbe-181d572f2a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48e3e7f-6700-477e-88cb-6bb28f8a1493", "name": "network-vif-deleted", "tag": "4d61e994-57a1-40c3-9edc-a5dd5e4e1cef"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:48.183362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eaf4fed6-901d-45b5-9b9a-4340dae16557 req-85a6ee0a-7e4d-4b5d-9cbe-181d572f2a14 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:48.186818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eaf4fed6-901d-45b5-9b9a-4340dae16557 req-85a6ee0a-7e4d-4b5d-9cbe-181d572f2a14 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:48.187682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-eaf4fed6-901d-45b5-9b9a-4340dae16557 req-85a6ee0a-7e4d-4b5d-9cbe-181d572f2a14 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:48.239947 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-eaf4fed6-901d-45b5-9b9a-4340dae16557 req-85a6ee0a-7e4d-4b5d-9cbe-181d572f2a14 service nova] Creating event network-vif-deleted:4d61e994-57a1-40c3-9edc-a5dd5e4e1cef for instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 on n-h1-858129-2 Sep 16 14:35:48.261463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-eaf4fed6-901d-45b5-9b9a-4340dae16557 req-85a6ee0a-7e4d-4b5d-9cbe-181d572f2a14 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139720 Sep 16 14:35:48.263930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2941/5898] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:35:48.688866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:48.689789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:48.705632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:48.706646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:48.707279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:48.708179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:48.708851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:48.710099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:48.813059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:48.814199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:48.838777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:48.844273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:48.846699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:48.851850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:48.859150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:48.859900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:48.935926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:48.954470 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3b7421c-b634-4e2c-82b3-c99c94b5fcb9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1241 microversion: 2.1 time: 0.270283 Sep 16 14:35:48.959282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2958/5899] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:48 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1241 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:48.998263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:49.002000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:49.004385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:49.005277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lazy-loading 'fault' on Instance uuid a48e3e7f-6700-477e-88cb-6bb28f8a1493 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:35:49.084084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:49.098079 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4299f97-2754-4417-816a-5dae9eae707f tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 200 len: 1309 microversion: 2.1 time: 0.292314 Sep 16 14:35:49.111674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2942/5900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:48 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:49.984986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:49.986318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:50.004874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:50.005646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:50.006283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:50.007205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:50.007962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:50.008646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:50.141511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:50.142239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: a48e3e7f-6700-477e-88cb-6bb28f8a1493] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:50.157046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:50.159272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:50.160684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:50.162352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:50.163714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:50.164179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:50.201327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:50.211138 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] HTTP exception thrown: Instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 could not be found. Sep 16 14:35:50.214017 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0368503c-669a-4570-b101-a0ee4c36a7a6 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1297 microversion: 2.1 time: 0.233409 Sep 16 14:35:50.218356 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2959/5901] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:49 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1297 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Request method failure captured: Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 HTTP/1.1 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIip-Jw_71mLP3_o3kGQ0fdjtcC8hemiS0pW_g8LOZCTeeypKZDfMwRIxkAb_e63gTyl6IrDE3sWxnos5j2VkTqlYOtJA3pXLVmuh5HCx9DzGnoclNn2YthQaisr-iDFWPMForNQXkpGAnzvTYQ4qkULwuwNKYf-nNbfsxYMCp7XE-g Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 42e9b8aa0ca94d2da7320d250be583bb Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1490310063 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_42e9b8aa0ca94d2da7320d250be583bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42e9b8aa0ca94d2da7320d250be583bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/42e9b8aa0ca94d2da7320d250be583bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42e9b8aa0ca94d2da7320d250be583bb"}]}] Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesSnapshotTestJSON-1490310063 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 42e9b8aa0ca94d2da7320d250be583bb Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1490310063 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesSnapshotTestJSON-1490310063-project Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6bf6ac99d7584a5faefbce2a4fae7d92 Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesSnapshotTestJSON-1490310063-project Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 could not be found. Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a48e3e7f-6700-477e-88cb-6bb28f8a1493'} Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 could not be found. Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 could not be found. Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:35:50.219972 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 could not be found. Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Returning 404 to user: Instance a48e3e7f-6700-477e-88cb-6bb28f8a1493 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fee6d48-4b14-4a20-9c86-a28eece44f1c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493" status: 404 len: 111 microversion: 2.1 time: 0.085971 Sep 16 14:35:50.226052 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2943/5902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:50 2022] GET /compute/v2.1/servers/a48e3e7f-6700-477e-88cb-6bb28f8a1493 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:35:51.249031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:51.249644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:51.269954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:51.270496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:51.270947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:51.271681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:51.272224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:51.272568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:51.737692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:51.754213 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c23e5b4-9e36-4542-b54c-abc155e95e57 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1295 microversion: 2.1 time: 0.508682 Sep 16 14:35:51.757171 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2960/5903] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:51 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1295 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:52.799034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:52.800556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:52.830313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:52.833113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:52.833894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:52.837447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:52.838245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:52.846502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:53.485106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:53.501903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ad0766e-aa71-450d-8de4-2f27fd2e340b tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.706818 Sep 16 14:35:53.515404 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2944/5904] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:52 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:54.545041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:54.547830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:54.563446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:54.564164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:54.565409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:54.568476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:54.569123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:54.570449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:56.291587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:56.310506 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e7d3831-0247-49a8-ba4e-b1faf0a22952 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 1.770155 Sep 16 14:35:56.311118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2961/5905] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:54 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:56.959340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-413978aa-8538-4e91-9795-58816f8bcdbb req-92d70d3c-4966-4b26-b11b-e8d4c5e7e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cdea053-4911-483f-b5f2-7e94048ddaa9", "tag": "574d11e8-4831-4b07-90f9-d5cf91041b12"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:35:57.003465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:57.008861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-413978aa-8538-4e91-9795-58816f8bcdbb req-92d70d3c-4966-4b26-b11b-e8d4c5e7e1b7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:57.009366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-413978aa-8538-4e91-9795-58816f8bcdbb req-92d70d3c-4966-4b26-b11b-e8d4c5e7e1b7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:57.013420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-413978aa-8538-4e91-9795-58816f8bcdbb req-92d70d3c-4966-4b26-b11b-e8d4c5e7e1b7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:57.026093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:57.061346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-413978aa-8538-4e91-9795-58816f8bcdbb req-92d70d3c-4966-4b26-b11b-e8d4c5e7e1b7 service nova] Creating event network-changed:574d11e8-4831-4b07-90f9-d5cf91041b12 for instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 on n-h1-858129-2 Sep 16 14:35:57.074467 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-413978aa-8538-4e91-9795-58816f8bcdbb req-92d70d3c-4966-4b26-b11b-e8d4c5e7e1b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121578 Sep 16 14:35:57.076817 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2945/5906] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:35:57.338898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:57.341437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:57.348990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:57.375978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:57.377952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:57.378771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:57.379544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:57.380019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:57.382712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:57.457366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:57.954276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:57.977818 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11dab7f9-0135-4453-95f2-a83010398d62 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.637758 Sep 16 14:35:57.981754 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2962/5907] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:57 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:35:59.012720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:35:59.014031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:35:59.016495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:59.017944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:35:59.035420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:59.038537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:59.039677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:59.040598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:35:59.041663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:35:59.042263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:35:59.257084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:35:59.266957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eee2102a-9feb-495b-af76-98d5a7074f84 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.265707 Sep 16 14:35:59.295231 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2946/5908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:35:58 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:00.309106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:00.314295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:00.369417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:00.369417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:00.371990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:00.376969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:00.379003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:00.383227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:01.141392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:01.156643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-878f23d4-d195-40d5-9ad3-b69285238a01 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.856242 Sep 16 14:36:01.159805 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2963/5909] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:00 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:02.188097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:02.188724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:02.210982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:02.213252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:02.215378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:02.221940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:02.227660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:02.228894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:02.885117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:02.920724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd199ce1-8556-47da-a233-1e9f6d3d3c7d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.738338 Sep 16 14:36:02.938661 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2947/5910] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:02 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:03.955111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:03.959818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:03.987138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:03.988997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:03.990382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:03.997126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:03.999719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:04.001192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:04.398264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-011520b0-6ac0-4e1d-ade6-e5b5136e1291 req-1d4e20a2-4483-49e2-a273-13725f2be250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cdea053-4911-483f-b5f2-7e94048ddaa9", "name": "network-vif-plugged", "status": "completed", "tag": "574d11e8-4831-4b07-90f9-d5cf91041b12"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:04.419175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-011520b0-6ac0-4e1d-ade6-e5b5136e1291 req-1d4e20a2-4483-49e2-a273-13725f2be250 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:04.420171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-011520b0-6ac0-4e1d-ade6-e5b5136e1291 req-1d4e20a2-4483-49e2-a273-13725f2be250 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:04.421505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-011520b0-6ac0-4e1d-ade6-e5b5136e1291 req-1d4e20a2-4483-49e2-a273-13725f2be250 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:04.459545 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-011520b0-6ac0-4e1d-ade6-e5b5136e1291 req-1d4e20a2-4483-49e2-a273-13725f2be250 service nova] Creating event network-vif-plugged:574d11e8-4831-4b07-90f9-d5cf91041b12 for instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 on n-h1-858129-2 Sep 16 14:36:04.467514 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-011520b0-6ac0-4e1d-ade6-e5b5136e1291 req-1d4e20a2-4483-49e2-a273-13725f2be250 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078059 Sep 16 14:36:04.469493 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2948/5911] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:36:04.473233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:04.509652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56a004c3-08d6-4970-9f73-bb160afeb0a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.565367 Sep 16 14:36:04.530655 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2964/5912] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:03 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:04.967649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-79948837", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "0fc0ae2a-5dd3-4fe1-a067-1a7da4959464"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:05.070120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] validate_networks() for [('0fc0ae2a-5dd3-4fe1-a067-1a7da4959464', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:36:05.557999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:05.572975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:05.605818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:05.610618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:05.612184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:05.613835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:05.615364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:05.616481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:05.901528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:36:05.905144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:36:05.905906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:36:05.906545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:36:05.907210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:36:05.919615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:05.920346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:05.920986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:05.921919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:05.922596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:05.923314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:05.948213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Getting quotas for project 42e9b8aa0ca94d2da7320d250be583bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:36:05.957462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Getting quotas for user 6bf6ac99d7584a5faefbce2a4fae7d92 and project 42e9b8aa0ca94d2da7320d250be583bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:36:05.977310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:36:05.982034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:36:06.055929 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4529649-6503-44ef-b280-7bd137de9f1b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095127 Sep 16 14:36:06.061573 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2949/5913] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:36:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:36:06.104148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:06.160649 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cccf638e-4e19-4564-b972-3315931254aa tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1362 microversion: 2.1 time: 0.625556 Sep 16 14:36:06.161110 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2965/5914] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:05 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1362 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:06.300370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a098831-34de-4384-95b2-6972829de9dd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:06.302053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a098831-34de-4384-95b2-6972829de9dd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:06.413609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8a098831-34de-4384-95b2-6972829de9dd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:06.438352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a098831-34de-4384-95b2-6972829de9dd tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1217 microversion: 2.1 time: 0.366380 Sep 16 14:36:06.442321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2950/5915] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:06 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1217 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:07.188068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:07.188683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:07.207494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:07.208011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:07.208455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:07.209208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:07.209674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:07.210109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:07.465897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:07.514960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:07.530424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:07.532672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:07.537303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:07.540648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:07.542804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:07.544004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:07.761951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:07.777753 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8231edf0-64ff-4cbc-8cdc-b0c8ee100179 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1548 microversion: 2.1 time: 0.593752 Sep 16 14:36:07.778722 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2966/5916] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:07 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1548 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:07.784975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:07.799175 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e4e281f-7e48-4c6e-929c-b63f5aa21f21 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1269 microversion: 2.1 time: 0.334206 Sep 16 14:36:07.799845 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2951/5917] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:07 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1269 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:36:07.814587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:07.814587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:07.818731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:07.820713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:07.820713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:07.823361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:07.824450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:07.824893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:08.025982 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-518c31de-ac35-4940-9067-0576f14a4e06 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222289 Sep 16 14:36:08.027994 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2967/5918] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:36:07 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:36:08.829567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:08.830968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:08.872010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:08.873731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:08.876602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:08.878113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:08.882979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:08.883881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:09.007068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:09.019006 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5c2be6c-d861-454b-882e-b51f9912978c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1275 microversion: 2.1 time: 0.193868 Sep 16 14:36:09.023921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2952/5919] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:08 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:10.059003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:10.060734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:10.079381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:10.079867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:10.080539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:10.081460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:10.082106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:10.082627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:10.214636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:10.229232 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b3aa114-2822-44a5-add9-6380c036c273 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1275 microversion: 2.1 time: 0.182224 Sep 16 14:36:10.249165 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2968/5920] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:10 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:11.253852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:11.257558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:11.266214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:11.267034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:11.267639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:11.268919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:11.269542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:11.270154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:11.546025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:11.557054 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d854fa4c-3c63-44e7-a280-bfcd2047577a tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1317 microversion: 2.1 time: 0.307251 Sep 16 14:36:11.557798 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2953/5921] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:11 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:12.005061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d247f8b9-2086-4151-8b2a-4a83cf88fa9b req-a6e39862-e442-47e5-8caf-d258e6521130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cdea053-4911-483f-b5f2-7e94048ddaa9", "tag": "574d11e8-4831-4b07-90f9-d5cf91041b12"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:12.022595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d247f8b9-2086-4151-8b2a-4a83cf88fa9b req-a6e39862-e442-47e5-8caf-d258e6521130 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:12.023422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d247f8b9-2086-4151-8b2a-4a83cf88fa9b req-a6e39862-e442-47e5-8caf-d258e6521130 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:12.024163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d247f8b9-2086-4151-8b2a-4a83cf88fa9b req-a6e39862-e442-47e5-8caf-d258e6521130 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:12.050583 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d247f8b9-2086-4151-8b2a-4a83cf88fa9b req-a6e39862-e442-47e5-8caf-d258e6521130 service nova] Creating event network-changed:574d11e8-4831-4b07-90f9-d5cf91041b12 for instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 on n-h1-858129-2 Sep 16 14:36:12.056750 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d247f8b9-2086-4151-8b2a-4a83cf88fa9b req-a6e39862-e442-47e5-8caf-d258e6521130 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199903 Sep 16 14:36:12.059008 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2969/5922] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:12.147231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ade968b7-24d2-4e13-a014-b15900404efb req-e94cae0c-746a-4a6b-8114-202cf33a5399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2ea5d7-6421-4d30-8224-c88da32adf4e", "tag": "140bea18-c729-42e7-892a-ec14b9a4b96b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:12.179275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ade968b7-24d2-4e13-a014-b15900404efb req-e94cae0c-746a-4a6b-8114-202cf33a5399 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:12.181402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ade968b7-24d2-4e13-a014-b15900404efb req-e94cae0c-746a-4a6b-8114-202cf33a5399 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:12.183307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ade968b7-24d2-4e13-a014-b15900404efb req-e94cae0c-746a-4a6b-8114-202cf33a5399 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:12.214338 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ade968b7-24d2-4e13-a014-b15900404efb req-e94cae0c-746a-4a6b-8114-202cf33a5399 service nova] Creating event network-changed:140bea18-c729-42e7-892a-ec14b9a4b96b for instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e on n-h2-858129-2 Sep 16 14:36:12.233659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ade968b7-24d2-4e13-a014-b15900404efb req-e94cae0c-746a-4a6b-8114-202cf33a5399 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087626 Sep 16 14:36:12.237446 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2954/5923] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:12.582647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:12.583369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:12.603471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:12.603999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:12.604484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:12.605333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:12.616445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:12.616901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:13.241380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:13.265195 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7251e856-e53b-4d77-8d7b-5124c84568c8 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1317 microversion: 2.1 time: 0.687880 Sep 16 14:36:13.267447 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2970/5924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:12 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:14.293955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:14.294353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:14.311095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:14.314697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:14.315288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:14.316309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:14.323380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:14.327257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:14.892231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:14.918833 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2ac47cb-3a71-4616-a381-0eabec55809c tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1317 microversion: 2.1 time: 0.628647 Sep 16 14:36:14.921554 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2955/5925] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:14 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:36:15.945443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:15.947971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:15.969540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:15.970369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:15.974502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:15.975585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:15.976337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:15.976975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:16.795010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:16.806590 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c17d372-0010-4748-a796-58ee06aef4c2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1317 microversion: 2.1 time: 0.864146 Sep 16 14:36:16.812993 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2971/5926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:15 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:17.829907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:17.830572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:17.833462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:17.834181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:17.863498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:17.864388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:17.864888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:17.865660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:17.869894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:17.870386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:18.795679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:18.810057 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ffd519b-a4ea-408f-a6ec-96313bde0326 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1317 microversion: 2.1 time: 0.984374 Sep 16 14:36:18.817422 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2956/5927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:17 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1317 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:19.429335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-080b272a-5546-4dee-a63d-a1a3fb8d3ca8 req-53693553-d121-462a-ba2f-07b049b2e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2ea5d7-6421-4d30-8224-c88da32adf4e", "name": "network-vif-plugged", "status": "completed", "tag": "140bea18-c729-42e7-892a-ec14b9a4b96b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:19.453165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-080b272a-5546-4dee-a63d-a1a3fb8d3ca8 req-53693553-d121-462a-ba2f-07b049b2e06b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:19.453655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-080b272a-5546-4dee-a63d-a1a3fb8d3ca8 req-53693553-d121-462a-ba2f-07b049b2e06b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:19.455381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-080b272a-5546-4dee-a63d-a1a3fb8d3ca8 req-53693553-d121-462a-ba2f-07b049b2e06b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:19.487475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-080b272a-5546-4dee-a63d-a1a3fb8d3ca8 req-53693553-d121-462a-ba2f-07b049b2e06b service nova] Creating event network-vif-plugged:140bea18-c729-42e7-892a-ec14b9a4b96b for instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e on n-h2-858129-2 Sep 16 14:36:19.497467 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-080b272a-5546-4dee-a63d-a1a3fb8d3ca8 req-53693553-d121-462a-ba2f-07b049b2e06b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074717 Sep 16 14:36:19.498779 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2972/5928] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:19.848392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:19.850656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:19.871563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:19.877528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:19.878773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:19.879736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:19.880378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:19.880999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:20.407773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:20.421846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d58c4155-80b8-49c8-bb81-c14bb28965a3 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1317 microversion: 2.1 time: 0.578421 Sep 16 14:36:20.425367 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2957/5929] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:19 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:21.485608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:21.486495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:21.518664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:21.518664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:21.521193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:21.521929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:21.524213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:21.529355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:21.979241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:21.989142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ef99f1be-108f-4a22-bfcd-646b262311d9 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1506 microversion: 2.1 time: 0.508247 Sep 16 14:36:21.992127 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2973/5930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:21 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:36:22.015951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9118c666-9d38-4869-8bcd-614f491dd79c", "device": "/dev/sdb"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:22.019992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:22.028582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:22.029347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:22.029975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:22.030900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:22.031526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:22.032117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:22.552106 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9dc6647e-2a24-4279-ac4f-cdfaa954121e tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "POST /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539906 Sep 16 14:36:22.580469 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2958/5931] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:36:22 2022] POST /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:29.401846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:29.402442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:29.405651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=24 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:29.436508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:29.437011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:29.441613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:29.442721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:29.443367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:29.443972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:29.460134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=62 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:29.535411 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-49cc3c11-81bd-4f80-b4dd-9eccb0ce8aab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/ips" status: 200 len: 147 microversion: 2.1 time: 0.138381 Sep 16 14:36:29.543908 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2974/5932] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:36:29 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/ips => generated 147 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:31.354506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99219e1b-52e4-436b-951e-1b81949a2a7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: .version_select at 0x7f7247f4ba60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-823601188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAjxyJWoFe1Sax5A3ma4JOHRPZsSGw43FJr2pFKny8zSKFeEjcgBXV195ZTXgD3KUgzM7JRFKdMuk6MRB5cBjIXvHbmsNEVkZclL4n2WA8oZULZxSeMRP0SpNdEQrBWmA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:31.371812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:31.396499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-99219e1b-52e4-436b-951e-1b81949a2a7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:36:31.412435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-99219e1b-52e4-436b-951e-1b81949a2a7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:36:31.464565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99219e1b-52e4-436b-951e-1b81949a2a7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.483042 Sep 16 14:36:31.466738 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2959/5933] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:36:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:32.722685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce2300aa-19fd-4556-afa0-a9830cedc007"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:32.726036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:32.739748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:32.740243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:32.748249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:32.749025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:32.749497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:32.752517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:33.202249 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c4e53f1-dac4-45fa-9ace-0b81890535ad tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491504 Sep 16 14:36:33.202905 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2975/5934] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:36:32 2022] POST /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:36:51.368803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:51.369707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:51.370702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:51.376688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-731588896", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "fab541e0-8f08-4a11-8815-a328be77c311"}], "key_name": "tempest-TestNetworkAdvancedServerOps-823601188", "security_groups": [{"name": "tempest-secgroup-smoke-1164521354"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:51.683192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:51.684018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:36:51.689220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-144e3419-a8a9-41f3-8f1e-ac0e6a20e137 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: .version_select at 0x7f724c47f280>, body: {"keypair": {"name": "tempest-keypair-86181659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiKrTvGxi4l3/EX3mhvtFvS5DFM28waSsWaQ1rDtjbNTCIAgoDF+lVmwqPAYOvomzLY5QtiS0565ALvl7DqVMtdj8bVg+Xo6dpbfcrbtXzM9j2maH3fAQ4vFjFnuoDUVg=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:51.690917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] validate_networks() for [('fab541e0-8f08-4a11-8815-a328be77c311', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:36:51.728581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-144e3419-a8a9-41f3-8f1e-ac0e6a20e137 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:36:51.748519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-144e3419-a8a9-41f3-8f1e-ac0e6a20e137 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:36:51.802591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-144e3419-a8a9-41f3-8f1e-ac0e6a20e137 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.121239 Sep 16 14:36:51.809983 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2976/5935] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:36:51 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:36:52.420997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:36:52.421542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:36:52.421902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:36:52.422319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:36:52.422782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:36:52.449888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:52.450909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:52.451532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:52.452583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:52.454812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:52.455509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:52.481550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:36:52.488817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:36:52.520550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:36:52.524546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:36:52.660559 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4cbaced7-1baa-4c61-8cc1-3d9bb91b7c2f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.293829 Sep 16 14:36:52.665951 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2960/5936] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:36:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:36:52.677226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0160dbb7-ec6d-4775-a5e0-43321189e9ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:52.678028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0160dbb7-ec6d-4775-a5e0-43321189e9ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:52.983644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0160dbb7-ec6d-4775-a5e0-43321189e9ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:52.998240 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0160dbb7-ec6d-4775-a5e0-43321189e9ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1265 microversion: 2.1 time: 0.324975 Sep 16 14:36:52.999239 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2977/5937] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:52 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:54.026299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:54.026947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:54.038667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:54.040806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:54.042227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:54.046245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:54.046986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:54.047648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:54.301347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:54.311324 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-885d1b02-36c0-4896-afc6-d0b5f95c8bd2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1317 microversion: 2.1 time: 0.293396 Sep 16 14:36:54.321116 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2961/5938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:54 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:55.347806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:55.348985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:55.365093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:55.368092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:55.369374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:55.371349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:55.375160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:55.375898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:55.545934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:55.554840 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-026837d9-49b9-49a3-9e70-4e84abb78d0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1323 microversion: 2.1 time: 0.211054 Sep 16 14:36:55.577678 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2978/5939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:55 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:56.586855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:56.588153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:56.601250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:56.603391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:56.604068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:56.607067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:56.608798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:56.611094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:56.643987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1022364502", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c17062a-3bb6-45ab-8062-5725ef0d7c64"}], "security_groups": [{"name": "tempest-securitygroup--1636661010"}], "key_name": "tempest-keypair-86181659", "user_data": "}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:36:57.163953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] validate_networks() for [('1c17062a-3bb6-45ab-8062-5725ef0d7c64', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:36:57.847944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:36:57.869709 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6320e590-4acf-40dc-bf41-54e1b8734e90 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 1.288691 Sep 16 14:36:57.892760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2962/5940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:56 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:36:58.923814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:36:58.924810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:36:58.952402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:58.952948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:58.953399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:36:58.954636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:36:58.955483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:36:58.955677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:00.094878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:37:00.095958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:37:00.096890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:37:00.098628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:37:00.103275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:37:00.168717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:00.177485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:00.183911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:00.183911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:00.185192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:00.195362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:00.327283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:37:00.328428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:00.341756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdd8d388-5e22-4d08-b807-6397398d9ac1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 1.422578 Sep 16 14:37:00.348070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2963/5941] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:36:58 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:00.359726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:37:00.382530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:00.383181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:00.411601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:00.412248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:00.412925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:00.413713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:00.414186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:00.414838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:00.437358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:37:00.446247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:37:00.660200 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [cb088013-cbf5-4942-a724-7ade4b787699] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 14:37:00.708871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lazy-loading 'services' on Instance uuid 8d2ea5d7-6421-4d30-8224-c88da32adf4e {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:37:00.964708 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0568ad25-b046-4151-af95-f4fc4057211b tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e/os-volume_attachments/9118c666-9d38-4869-8bcd-614f491dd79c" status: 202 len: 0 microversion: 2.1 time: 0.614978 Sep 16 14:37:00.965865 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2964/5942] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:37:00 2022] DELETE /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e/os-volume_attachments/9118c666-9d38-4869-8bcd-614f491dd79c => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:37:01.222155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-368494f0-6cb0-40ce-902b-8a242a04a606 req-8408c3af-a61b-44c4-b4fa-5a1e2dc482a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:01.257779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-368494f0-6cb0-40ce-902b-8a242a04a606 req-8408c3af-a61b-44c4-b4fa-5a1e2dc482a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:01.279632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-368494f0-6cb0-40ce-902b-8a242a04a606 req-8408c3af-a61b-44c4-b4fa-5a1e2dc482a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:01.284111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-368494f0-6cb0-40ce-902b-8a242a04a606 req-8408c3af-a61b-44c4-b4fa-5a1e2dc482a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:01.356852 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-368494f0-6cb0-40ce-902b-8a242a04a606 req-8408c3af-a61b-44c4-b4fa-5a1e2dc482a4 service nova] Creating event network-changed:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h1-858129-2 Sep 16 14:37:01.378929 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-368494f0-6cb0-40ce-902b-8a242a04a606 req-8408c3af-a61b-44c4-b4fa-5a1e2dc482a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161706 Sep 16 14:37:01.382596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2965/5943] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:37:01.394632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:01.396571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:01.417043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:01.417858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:01.418909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:01.420235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:01.421694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:01.423103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:01.676086 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [cb088013-cbf5-4942-a724-7ade4b787699] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53324. Sep 16 14:37:01.687086 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e705cd63-4308-4a1f-9f76-c9ddbdaaa540 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.047999 Sep 16 14:37:01.688291 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2979/5944] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:36:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 5052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:37:01.715483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71e7543d-fc17-4637-98b9-62e1b6f53b1a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:01.719597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71e7543d-fc17-4637-98b9-62e1b6f53b1a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:01.986135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71e7543d-fc17-4637-98b9-62e1b6f53b1a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:02.018141 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71e7543d-fc17-4637-98b9-62e1b6f53b1a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1240 microversion: 2.1 time: 0.318510 Sep 16 14:37:02.022467 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2980/5945] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:01 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1240 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:02.188946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:02.242906 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56fcef66-f9f3-4b9a-90d2-d666db41c1ca tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 0.854874 Sep 16 14:37:02.249131 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2966/5946] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:01 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:03.061762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5c7d186-f244-40b2-87ae-e6ace1c9d6c8 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:03.064752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5c7d186-f244-40b2-87ae-e6ace1c9d6c8 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:03.278556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:03.284611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:03.289871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:03.291236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a5c7d186-f244-40b2-87ae-e6ace1c9d6c8 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:03.298274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:03.327726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:03.328966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:03.339600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:03.341519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:03.342912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:03.343945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:03.371942 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5c7d186-f244-40b2-87ae-e6ace1c9d6c8 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1240 microversion: 2.1 time: 0.325059 Sep 16 14:37:03.373242 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2981/5947] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:03 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1240 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:03.897523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:03.942889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69cd7663-3c37-4b2e-be7a-d5ea8a9af13a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 0.667486 Sep 16 14:37:03.952216 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2967/5948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:03 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:04.421824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:04.423286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:04.436007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:04.437686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:04.438735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:04.439791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:04.440699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:04.441378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:04.644023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:04.654272 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b76d9441-b55f-4bae-8064-3d9395845050 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1292 microversion: 2.1 time: 0.236817 Sep 16 14:37:04.674439 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2982/5949] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:04 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1292 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:04.983709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:04.988295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:05.034573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:05.036137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:05.037998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:05.043331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:05.047774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:05.050149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:05.686793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:05.687603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:05.702434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:05.702978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:05.703425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:05.704159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:05.705880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:05.706329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:05.913150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:05.929044 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-95f43569-caf4-422a-85cd-8ede351549f1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 0.960560 Sep 16 14:37:05.934830 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2968/5950] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:04 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:06.055938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:06.065935 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6693a1dd-ce12-47a5-a840-72fd0f482110 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1298 microversion: 2.1 time: 0.384151 Sep 16 14:37:06.083189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2983/5951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:05 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1298 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:06.959635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:06.962053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:07.000029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:07.003118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:07.003661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:07.006879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:07.007626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:07.008423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:07.105379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:07.110625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:07.136123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:07.138484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:07.139577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:07.142143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:07.143580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:07.144154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:07.575205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:07.602841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2fb00fe2-6f68-4377-89c8-55d7e209a733 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1298 microversion: 2.1 time: 0.497618 Sep 16 14:37:07.610551 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2984/5952] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:07 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1298 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:08.008788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:08.027455 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-291036de-367e-4601-ad1f-860014826d96 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 1.070491 Sep 16 14:37:08.029260 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2969/5953] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:06 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:08.648605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:08.649212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:08.664112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:08.665503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:08.666209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:08.668800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:08.681601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:08.682825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:09.072415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:09.073707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:09.085756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:09.089971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:09.090435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:09.091184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:09.093287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:09.100157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:09.759616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:09.771196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af52b275-2b95-4b41-a47f-38a2fb0b3f00 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 1.128738 Sep 16 14:37:09.773858 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2985/5954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:08 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:10.250520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:10.261631 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a41afbd-341f-40ad-b9a3-a2ab3b4b9c91 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 1.193464 Sep 16 14:37:10.274523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2970/5955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:09 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:10.796192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:10.796823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:10.811504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:10.819297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:10.820067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:10.827117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:10.828158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:10.828832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:10.829454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:11.037290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-258151a0-aade-4f37-9ffa-ae43010b05c5 req-b01fcdc0-36b2-4436-a286-c887a325d13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "name": "network-vif-plugged", "status": "completed", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:11.065794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-258151a0-aade-4f37-9ffa-ae43010b05c5 req-b01fcdc0-36b2-4436-a286-c887a325d13b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:11.066287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-258151a0-aade-4f37-9ffa-ae43010b05c5 req-b01fcdc0-36b2-4436-a286-c887a325d13b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:11.069873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-258151a0-aade-4f37-9ffa-ae43010b05c5 req-b01fcdc0-36b2-4436-a286-c887a325d13b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:11.103025 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-258151a0-aade-4f37-9ffa-ae43010b05c5 req-b01fcdc0-36b2-4436-a286-c887a325d13b service nova] Creating event network-vif-plugged:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h1-858129-2 Sep 16 14:37:11.109111 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-258151a0-aade-4f37-9ffa-ae43010b05c5 req-b01fcdc0-36b2-4436-a286-c887a325d13b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076673 Sep 16 14:37:11.114837 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2971/5956] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:11.308933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:11.310425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:11.355702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:11.356641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:11.357309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:11.358278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:11.359192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:11.359911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:12.015897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:12.046494 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b16833aa-e37e-4cb0-ae9c-7d5b8bab1d6f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 0.759156 Sep 16 14:37:12.047122 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2972/5957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:11 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:12.177705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:12.191294 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7f4a8ac-f52b-4ed6-8b99-fc0d4298b815 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 1.398302 Sep 16 14:37:12.196965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2986/5958] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:10 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:12.475919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6c28e8f9-33dd-4b72-9708-560797ae8088 req-23817b7e-29ee-4cbb-8f01-86e31d59fc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f77dd48-0efa-406e-8f66-be8872c67c7b", "tag": "3b0def02-386a-4e4a-81fa-88365f54268c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:12.501422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6c28e8f9-33dd-4b72-9708-560797ae8088 req-23817b7e-29ee-4cbb-8f01-86e31d59fc56 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:12.506949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6c28e8f9-33dd-4b72-9708-560797ae8088 req-23817b7e-29ee-4cbb-8f01-86e31d59fc56 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:12.507455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6c28e8f9-33dd-4b72-9708-560797ae8088 req-23817b7e-29ee-4cbb-8f01-86e31d59fc56 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:12.533775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6c28e8f9-33dd-4b72-9708-560797ae8088 req-23817b7e-29ee-4cbb-8f01-86e31d59fc56 service nova] Creating event network-changed:3b0def02-386a-4e4a-81fa-88365f54268c for instance 9f77dd48-0efa-406e-8f66-be8872c67c7b on n-h2-858129-2 Sep 16 14:37:12.546790 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6c28e8f9-33dd-4b72-9708-560797ae8088 req-23817b7e-29ee-4cbb-8f01-86e31d59fc56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076307 Sep 16 14:37:12.555579 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2973/5959] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:12.950706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:12.951579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:12.966356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:12.967499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:12.972452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:12.975452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:12.976145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:12.977677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:12.978931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:12.980518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:12.981261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:12.986170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:12.987363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:12.988340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:12.990652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:12.992973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.047588 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0970d2cd-5472-40e3-8671-ee5915726aba tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/ips" status: 200 len: 146 microversion: 2.1 time: 0.087016 Sep 16 14:37:13.048188 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2974/5960] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:37:12 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:13.051361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:37:13.069433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:13.070071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:13.092620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:13.093120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:13.093554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.094266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:13.102301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:13.102846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.289681 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c63c1db5-0d26-4a32-a783-235c017aaeb2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 204 len: 0 microversion: 2.1 time: 0.348959 Sep 16 14:37:13.291212 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2987/5961] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:37:12 2022] DELETE /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:37:13.300937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:13.304610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:13.319967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:13.324542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:13.327632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.328616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:13.332401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:13.333106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.377575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:13.611837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:13.629226 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ad5b6188-57fc-4625-abc3-d9b8f3bb42bf tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1391 microversion: 2.1 time: 0.563803 Sep 16 14:37:13.647604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2975/5962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:13 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1391 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:13.653958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:13.655148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:13.663343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:13.664230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:13.664938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.666014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:13.666792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:13.667503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:13.802916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:13.825299 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-45f79183-d1dd-4328-abcc-6cec3465772e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 0.528240 Sep 16 14:37:13.828673 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2988/5963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:13 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:14.005319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:14.018107 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12902791-00ab-4ff6-8d9b-c1f137282a45 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1512 microversion: 2.1 time: 0.365721 Sep 16 14:37:14.019113 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2976/5964] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:13 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:14.660010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:14.660630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:14.674491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:14.678536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:14.679234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:14.680736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:14.681387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:14.682017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:14.868335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:14.869796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:14.887341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:14.888167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:14.889322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:14.892602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:14.895106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:14.896481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:15.022743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:15.036571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4165041-8eed-417b-b148-d65431e5606d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1563 microversion: 2.1 time: 0.380291 Sep 16 14:37:15.039781 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2989/5965] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:14 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1563 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:15.060715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:15.063502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:15.084301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:15.088890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:15.089671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:15.090455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:15.090939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:15.091370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:15.585724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:15.589432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:15.614704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6f2309f8-b901-43f2-8c85-2fbba54870b2 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1512 microversion: 2.1 time: 0.572635 Sep 16 14:37:15.615532 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2990/5966] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:15 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:15.617686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d773355-3e99-4b3c-b2a9-1fc34ebdce45 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 0.756288 Sep 16 14:37:15.631395 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2977/5967] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:14 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:15.631643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:15.631643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:15.655071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:15.657194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:15.657610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:15.670104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:15.671684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:15.672733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:15.975693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:15.986341 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d0f19c72-f68b-4d23-9dbd-fd7e3e8265a0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1563 microversion: 2.1 time: 0.367482 Sep 16 14:37:15.988057 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2991/5968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:15 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1563 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:16.189281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "024c5e2f-95cf-4412-b9fe-4586a7a06e30"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:16.193607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:16.209045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:16.209746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:16.211129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:16.218541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:16.219304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:16.220266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:16.395120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:16.639245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:16.640032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:16.659074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:16.661697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:16.663486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:16.666803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:16.669424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:16.669995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:16.836220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efbc5b90-4216-404a-99f0-b98d6ef1f89d tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630445 Sep 16 14:37:16.842875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2978/5969] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:37:16 2022] POST /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:16.865178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:16.870137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:16.921788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:16.922890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:16.933970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:16.937908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:16.950794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:16.952162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:18.080441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:18.095633 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-78a55b9b-d47d-485d-873e-fcab8106ae1c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 1.253206 Sep 16 14:37:18.111598 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2979/5970] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:16 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:18.586423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:18.606463 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-95e1d327-5000-45a7-a669-4ff39ab2e056 tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1512 microversion: 2.1 time: 1.971036 Sep 16 14:37:18.610588 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2992/5971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:16 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1512 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:19.131523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:19.134856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:19.158646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:19.159538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:19.160347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:19.161707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:19.187386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:19.188699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:19.635969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:19.637358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:19.667910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:19.668771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:19.669551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:19.673185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:19.673990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:19.674651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:20.561933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:20.574862 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1485639a-d04e-4676-b096-af99b880c6c3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 1.451766 Sep 16 14:37:20.586566 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2980/5972] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:19 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:20.590910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf6ac99d7584a5faefbce2a4fae7d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e9b8aa0ca94d2da7320d250be583bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:20.614846 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8de2f11-d9d2-4e78-9cf8-2b33fe57f96d tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 200 len: 1470 microversion: 2.1 time: 0.980001 Sep 16 14:37:20.616172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2993/5973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:19 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 1470 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:20.621993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1a31027a-cdaa-4b92-89d7-d0fcf281fcd4 req-d85b1c0e-3ebf-4e81-b255-da1b2187883f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2ea5d7-6421-4d30-8224-c88da32adf4e", "name": "network-vif-deleted", "tag": "140bea18-c729-42e7-892a-ec14b9a4b96b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:20.671158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1a31027a-cdaa-4b92-89d7-d0fcf281fcd4 req-d85b1c0e-3ebf-4e81-b255-da1b2187883f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:20.674461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1a31027a-cdaa-4b92-89d7-d0fcf281fcd4 req-d85b1c0e-3ebf-4e81-b255-da1b2187883f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:20.675032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1a31027a-cdaa-4b92-89d7-d0fcf281fcd4 req-d85b1c0e-3ebf-4e81-b255-da1b2187883f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:20.698007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1a31027a-cdaa-4b92-89d7-d0fcf281fcd4 req-d85b1c0e-3ebf-4e81-b255-da1b2187883f service nova] Creating event network-vif-deleted:140bea18-c729-42e7-892a-ec14b9a4b96b for instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e on n-h2-858129-2 Sep 16 14:37:20.711996 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1a31027a-cdaa-4b92-89d7-d0fcf281fcd4 req-d85b1c0e-3ebf-4e81-b255-da1b2187883f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104861 Sep 16 14:37:20.715484 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2981/5974] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:21.613371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:21.614783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:21.628928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:21.634861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:21.635719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:21.636658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:21.637325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:21.638679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:21.648691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:21.657702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] [instance: 8d2ea5d7-6421-4d30-8224-c88da32adf4e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:21.698331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:21.709701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:21.711088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:21.711889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:21.713134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:21.713943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:21.714718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:21.775060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] HTTP exception thrown: Instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e could not be found. Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Request method failure captured: Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e HTTP/1.1 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIip-Jw_71mLP3_o3kGQ0fdjtcC8hemiS0pW_g8LOZCTeeypKZDfMwRIxkAb_e63gTyl6IrDE3sWxnos5j2VkTqlYOtJA3pXLVmuh5HCx9DzGnoclNn2YthQaisr-iDFWPMForNQXkpGAnzvTYQ4qkULwuwNKYf-nNbfsxYMCp7XE-g Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 42e9b8aa0ca94d2da7320d250be583bb Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1490310063 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_42e9b8aa0ca94d2da7320d250be583bb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42e9b8aa0ca94d2da7320d250be583bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/42e9b8aa0ca94d2da7320d250be583bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42e9b8aa0ca94d2da7320d250be583bb"}]}] Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesSnapshotTestJSON-1490310063 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 42e9b8aa0ca94d2da7320d250be583bb Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1490310063 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesSnapshotTestJSON-1490310063-project Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 6bf6ac99d7584a5faefbce2a4fae7d92 Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesSnapshotTestJSON-1490310063-project Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e could not be found. Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '8d2ea5d7-6421-4d30-8224-c88da32adf4e'} Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e could not be found. Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e could not be found. Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:37:21.777989 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e could not be found. Sep 16 14:37:21.784205 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:37:21.786313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] Returning 404 to user: Instance 8d2ea5d7-6421-4d30-8224-c88da32adf4e could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:37:21.787907 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7646d3e8-bba1-48b8-bbfd-60686f96b0ef tempest-VolumesSnapshotTestJSON-1490310063 tempest-VolumesSnapshotTestJSON-1490310063-project] 10.222.0.60 "GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e" status: 404 len: 111 microversion: 2.1 time: 0.149681 Sep 16 14:37:21.789662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2982/5975] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:21 2022] GET /compute/v2.1/servers/8d2ea5d7-6421-4d30-8224-c88da32adf4e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:37:22.002375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:22.005986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:22.016756 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8424fb4-7545-4f45-af62-df2b9bc72525 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 0.407262 Sep 16 14:37:22.020935 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2994/5976] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:21 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:22.621610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:22.622762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:22.636238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:22.638671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:22.640597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:22.643772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:22.658153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:22.659594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:22.661284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-631dca4b-882b-4380-82e0-5e63c1b17134 req-f1f9669d-b65c-4e6f-a08a-781aa4a170e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:22.672533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:22.712207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-631dca4b-882b-4380-82e0-5e63c1b17134 req-f1f9669d-b65c-4e6f-a08a-781aa4a170e7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:22.713250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-631dca4b-882b-4380-82e0-5e63c1b17134 req-f1f9669d-b65c-4e6f-a08a-781aa4a170e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:22.714105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-631dca4b-882b-4380-82e0-5e63c1b17134 req-f1f9669d-b65c-4e6f-a08a-781aa4a170e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:22.747546 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-631dca4b-882b-4380-82e0-5e63c1b17134 req-f1f9669d-b65c-4e6f-a08a-781aa4a170e7 service nova] Creating event network-changed:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h1-858129-2 Sep 16 14:37:22.764970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-631dca4b-882b-4380-82e0-5e63c1b17134 req-f1f9669d-b65c-4e6f-a08a-781aa4a170e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116830 Sep 16 14:37:22.765606 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2995/5977] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:37:23.051766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:23.064943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:23.065661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:23.071543 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e7a2865-7049-4a7c-a14e-319d290777a3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1563 microversion: 2.1 time: 0.453576 Sep 16 14:37:23.072585 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2983/5978] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:22 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1563 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:23.085212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:23.085716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:23.086154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:23.086914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:23.087374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:23.087804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:23.716827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-42b17d9f-c973-4fe3-a89b-7b25bba5ded4 req-0269dc94-450a-4925-a4ec-246845301e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f77dd48-0efa-406e-8f66-be8872c67c7b", "name": "network-vif-plugged", "status": "completed", "tag": "3b0def02-386a-4e4a-81fa-88365f54268c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:23.746336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-42b17d9f-c973-4fe3-a89b-7b25bba5ded4 req-0269dc94-450a-4925-a4ec-246845301e7b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:23.747370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-42b17d9f-c973-4fe3-a89b-7b25bba5ded4 req-0269dc94-450a-4925-a4ec-246845301e7b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:23.749210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-42b17d9f-c973-4fe3-a89b-7b25bba5ded4 req-0269dc94-450a-4925-a4ec-246845301e7b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:23.869722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-42b17d9f-c973-4fe3-a89b-7b25bba5ded4 req-0269dc94-450a-4925-a4ec-246845301e7b service nova] Creating event network-vif-plugged:3b0def02-386a-4e4a-81fa-88365f54268c for instance 9f77dd48-0efa-406e-8f66-be8872c67c7b on n-h2-858129-2 Sep 16 14:37:23.924265 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-42b17d9f-c973-4fe3-a89b-7b25bba5ded4 req-0269dc94-450a-4925-a4ec-246845301e7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210870 Sep 16 14:37:23.928974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2984/5979] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:37:24.687699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:24.710257 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55fa1793-cc01-41ed-9ad0-fe4244316dbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 1.641323 Sep 16 14:37:24.715131 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2996/5980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:23 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:37:25.742617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:25.743502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:25.765359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:25.765359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:25.765359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:25.772869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:25.773480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:25.773912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:26.126706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:26.138655 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c536132-f1c1-4a82-b52d-a0d2cc48d3aa tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1366 microversion: 2.1 time: 0.400500 Sep 16 14:37:26.151663 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2985/5981] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:25 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:27.178538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:27.178538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:27.198252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:27.198989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:27.199639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:27.200544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:27.201114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:27.201727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:28.087060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:37:28.128525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-636815d3-a5d6-4415-8e9c-ec8081c3cf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1554 microversion: 2.1 time: 0.964606 Sep 16 14:37:28.135341 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2997/5982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:37:27 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1554 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:37:28.157325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:28.157937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:28.172096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:28.172620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:28.173079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:28.173819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:28.180561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:28.181245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:28.708346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c60dc5ac-ee21-4b0d-aba1-809e5f046573 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.555680 Sep 16 14:37:28.721524 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2986/5983] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:37:28 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/os-interface => generated 284 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:31.921094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-20fbf993-544d-45dc-bdd1-403ad93c3031 req-ab4ce2c9-3808-4e6a-97cd-c52a4ca4fdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f77dd48-0efa-406e-8f66-be8872c67c7b", "tag": "3b0def02-386a-4e4a-81fa-88365f54268c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:31.939967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-20fbf993-544d-45dc-bdd1-403ad93c3031 req-ab4ce2c9-3808-4e6a-97cd-c52a4ca4fdca service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:31.940515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-20fbf993-544d-45dc-bdd1-403ad93c3031 req-ab4ce2c9-3808-4e6a-97cd-c52a4ca4fdca service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:31.940989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-20fbf993-544d-45dc-bdd1-403ad93c3031 req-ab4ce2c9-3808-4e6a-97cd-c52a4ca4fdca service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:31.961772 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-20fbf993-544d-45dc-bdd1-403ad93c3031 req-ab4ce2c9-3808-4e6a-97cd-c52a4ca4fdca service nova] Creating event network-changed:3b0def02-386a-4e4a-81fa-88365f54268c for instance 9f77dd48-0efa-406e-8f66-be8872c67c7b on n-h2-858129-2 Sep 16 14:37:31.971111 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-20fbf993-544d-45dc-bdd1-403ad93c3031 req-ab4ce2c9-3808-4e6a-97cd-c52a4ca4fdca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055226 Sep 16 14:37:31.987453 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2998/5984] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:42.921130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:42.924300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:42.933528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=9 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:42.934506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:42.936870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:42.937595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:42.938178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:42.939501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:42.940496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:42.941240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:42.981678 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21863167-86dc-4a51-bb14-d4bdde1a05a9 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065029 Sep 16 14:37:42.982517 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2987/5985] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:37:42 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:43.021449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:37:43.035221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:43.049999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=7 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:43.051073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=17 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:37:43.053421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:43.054538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:43.055415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:43.056625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:43.057370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:43.058002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:43.116185 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1e683f6b-ecff-4cc3-970e-c8122217e292 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/024c5e2f-95cf-4412-b9fe-4586a7a06e30" status: 200 len: 194 microversion: 2.1 time: 0.124183 Sep 16 14:37:43.119188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 2999/5986] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Sep 16 14:37:42 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/024c5e2f-95cf-4412-b9fe-4586a7a06e30 => generated 194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:37:46.204530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbfc96e2-f503-4917-9e92-0201b0358010"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:46.209669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:46.224671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:46.225846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:46.227083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:46.228817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:46.230212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:46.231172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:47.243883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65b8d4f1-7cb8-467e-aba1-37be4ab93414 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "POST /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.046540 Sep 16 14:37:47.249894 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2988/5987] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:37:46 2022] POST /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments => generated 194 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:37:49.106698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:37:49.110860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:37:49.143643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:49.145434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:49.145915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:49.149961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:37:49.150562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:37:49.151016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:37:49.314838 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0f3673c-e5e4-47bf-8d36-459001e14d5e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action" status: 200 len: 24566 microversion: 2.1 time: 0.215514 Sep 16 14:37:49.315448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3000/5988] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:37:49 2022] POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action => generated 24566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:38:02.702024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:02.708580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:02.722644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:02.723603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:02.732447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:02.735015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:02.735672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:02.743524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:02.744187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:02.744768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:02.808948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-631b3dc4-16bd-442b-bbd9-546456e024d1 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.113505 Sep 16 14:38:02.817717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2989/5989] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:38:02 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:02.963538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:02.964123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:02.974199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:02.977513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:02.986746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:02.987283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:02.987910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:02.989572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:02.990197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:02.993034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:03.084201 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69e5b291-e9e3-4b1d-b9f6-d395cea8b832 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/024c5e2f-95cf-4412-b9fe-4586a7a06e30" status: 200 len: 194 microversion: 2.1 time: 0.124988 Sep 16 14:38:03.084790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3001/5990] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Sep 16 14:38:02 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/024c5e2f-95cf-4412-b9fe-4586a7a06e30 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:03.097621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:03.098380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:03.109758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:03.128754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:03.129443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:03.130366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:03.131172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:03.131758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:03.391143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lazy-loading 'services' on Instance uuid 1cdea053-4911-483f-b5f2-7e94048ddaa9 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:38:03.520505 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5f7bbeb-6ffd-431f-a3d7-b60447a5ad2e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/024c5e2f-95cf-4412-b9fe-4586a7a06e30" status: 202 len: 0 microversion: 2.1 time: 0.427320 Sep 16 14:38:03.526917 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2990/5991] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:38:03 2022] DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/024c5e2f-95cf-4412-b9fe-4586a7a06e30 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:38:14.028070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:14.028669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:14.041914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:14.042715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:14.046577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:14.047055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:14.050283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:14.051693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:14.053621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:14.055744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:14.217263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97a100e6-9b29-41c6-bf0f-612547aca40e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/dbfc96e2-f503-4917-9e92-0201b0358010" status: 200 len: 194 microversion: 2.1 time: 0.190367 Sep 16 14:38:14.223712 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3002/5992] 10.222.0.60 () {58 vars in 1413 bytes} [Fri Sep 16 14:38:14 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/dbfc96e2-f503-4917-9e92-0201b0358010 => generated 194 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:14.238489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:14.240125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:14.249851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:14.274133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:14.324626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:14.325459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:14.326549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:14.326968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:14.331070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:14.331678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:15.133945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lazy-loading 'services' on Instance uuid 1cdea053-4911-483f-b5f2-7e94048ddaa9 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:38:15.304751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c50ae3a4-ab90-41ab-97a2-05c62c26ee4c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/dbfc96e2-f503-4917-9e92-0201b0358010" status: 202 len: 0 microversion: 2.1 time: 1.073668 Sep 16 14:38:15.305710 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2991/5993] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:38:14 2022] DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments/dbfc96e2-f503-4917-9e92-0201b0358010 => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:38:19.759632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:19.760682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:19.770126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:19.770651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:19.771083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:19.777027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:19.777604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:19.783700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:20.409841 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7eb13f0a-04c4-4001-8cbc-66827372b74d tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1833 microversion: 2.1 time: 0.653197 Sep 16 14:38:20.414849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3003/5994] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:19 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1833 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:20.435683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:20.437057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:20.480577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:20.482905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:20.483874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:20.492417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:20.493131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:20.495478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:20.886686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:20.896864 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-447c18ad-0568-4994-8df7-6a7d9f8833d7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1682 microversion: 2.1 time: 0.467245 Sep 16 14:38:20.898796 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2992/5995] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:20 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1682 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:21.119626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:21.121995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:21.139189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:21.139706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:21.140177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:21.145067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:21.145575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:21.146027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:21.280586 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-86b83399-221d-446c-a90e-5e6087a9a78f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action" status: 200 len: 32644 microversion: 2.1 time: 0.165370 Sep 16 14:38:21.282800 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3004/5996] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:38:21 2022] POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action => generated 32644 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:38:21.432884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:21.433961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:21.457391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:21.458158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:21.458331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:21.459083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:21.459545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:21.459977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:21.822068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8d2c8645a47a4cffa188319754ba5118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ec1e5f2d53429f8e84a166fe159f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:21.824047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] flavor_id is None. Assuming migration. {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 16 14:38:21.824840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:38:22.780578 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a22b24a2-eb22-47e9-b96a-ce3e6d70af11 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action" status: 202 len: 0 microversion: 2.1 time: 1.351755 Sep 16 14:38:22.789582 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2993/5997] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:38:21 2022] POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action => generated 0 bytes in 1362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:38:22.800190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:22.800919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:22.825187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:22.833375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:22.834189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:22.836092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:22.836788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:22.841420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:23.339498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:23.352640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d2f0e4c4-19d9-4142-92ef-c66d8eed817a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1691 microversion: 2.1 time: 0.558011 Sep 16 14:38:23.356869 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3005/5998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:22 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1691 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:24.384416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:24.385045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:24.442979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:24.446760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:24.447219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:24.447975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:24.448437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:24.448862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:25.553046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:25.566667 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db5cf52f-cebf-41e3-a75f-c5af54000475 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1691 microversion: 2.1 time: 1.182984 Sep 16 14:38:25.568030 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2994/5999] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:24 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1691 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:38:26.595075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:26.595871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:26.627830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:26.631166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:26.631631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:26.634998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:26.636866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:26.637718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:27.257154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:27.291339 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b022623-64cd-475b-afc3-7a841b6d7fd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1691 microversion: 2.1 time: 0.700698 Sep 16 14:38:27.292346 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3006/6000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:26 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1691 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:28.324829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:28.325600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:28.344756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:28.355259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:28.359905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:28.368184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:28.372258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:28.392276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:28.605299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:28.607540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:28.620766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:28.621282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:28.621732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:28.622515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:28.622997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:28.623425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:28.701469 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-99a44bc1-ba5d-47bf-a974-7ed04b58fa44 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100593 Sep 16 14:38:28.702849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3007/6001] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:38:28 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 14:38:28.996316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:28.999069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:29.007279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:29.008106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:29.008746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:29.009693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:29.010340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:29.010967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:29.054570 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4190d6d-f44c-4ba2-8c1c-bb83b8d56843 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063030 Sep 16 14:38:29.061127 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3008/6002] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:38:28 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:38:29.264218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:29.265684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:29.296337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:29.296857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:29.297349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:29.298036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:29.298528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:29.304313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:29.313393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:29.332012 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d466d932-4f4a-4181-a6df-6e45ee32f84c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1691 microversion: 2.1 time: 1.012098 Sep 16 14:38:29.335533 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2995/6003] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:28 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1691 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:29.372261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:38:29.519052 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8cf7bf6-3d0e-4e2f-95e6-2048c07fac28 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 204 len: 0 microversion: 2.1 time: 0.258702 Sep 16 14:38:29.520060 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3009/6004] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:38:29 2022] DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:38:29.543127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:29.547679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:29.567279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:29.568345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:29.569299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:29.570766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:29.571452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:29.572192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:29.841402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:29.855304 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4c6b2b0-3ca8-4e19-a907-951ff528c8f8 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1673 microversion: 2.1 time: 0.330020 Sep 16 14:38:29.856342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2996/6005] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:29 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1673 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:30.361845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:30.362880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:30.381405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:30.381925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:30.382364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:30.396841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:30.398331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:30.399035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:30.758873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:30.771700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4752b2a0-67a3-43f4-8cd6-3389bccfec0d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1691 microversion: 2.1 time: 0.413676 Sep 16 14:38:30.773017 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3010/6006] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:30 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1691 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:30.889687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:30.890289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:30.897976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:30.898882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:30.899570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:30.900539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:30.901239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:30.901905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:31.201654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:31.212398 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-851afe53-5301-4030-9d6f-abd491ae286c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1673 microversion: 2.1 time: 0.327717 Sep 16 14:38:31.213204 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2997/6007] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:30 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1673 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:31.796316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:31.796954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:31.809118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:31.809646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:31.810080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:31.810860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:31.811849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:31.812276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:32.206694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:32.219402 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b99f9349-6ea9-456b-a29f-37bd094e0a2e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.427232 Sep 16 14:38:32.223866 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3011/6008] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:31 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:32.238436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:32.239766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:32.258336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:32.262396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:32.263265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:32.277542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:32.278268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:32.278968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:32.797094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:32.810517 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74ae9a77-272c-4a12-a525-689a90d4704e tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1673 microversion: 2.1 time: 0.577674 Sep 16 14:38:32.811565 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2998/6009] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:32 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1673 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:33.250559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:33.251170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:33.264998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:33.270734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:33.271390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:33.272292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:33.272899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:33.273485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:33.718972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:33.731957 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1949a981-55fb-443b-b730-ce9b56b8e35a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.485631 Sep 16 14:38:33.732958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3012/6010] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:33 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:33.839545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:33.840298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:33.853887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:33.856940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:33.860451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:33.882319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:33.897970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:33.898438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:34.237566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:34.249962 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a29c173-e4b5-4e7c-b2a4-d3ddf80bd8c4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1606 microversion: 2.1 time: 0.414408 Sep 16 14:38:34.251541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 2999/6011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:33 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1606 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:34.774980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:34.775619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:34.792324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:34.792713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:34.793151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:34.799800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:34.800296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:34.800744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:34.863448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6e213fae-b6c8-4bb3-af44-157988ee0133 req-540758b2-26dd-4613-ac84-15bf20ef5cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cdea053-4911-483f-b5f2-7e94048ddaa9", "name": "network-vif-deleted", "tag": "574d11e8-4831-4b07-90f9-d5cf91041b12"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:34.921565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6e213fae-b6c8-4bb3-af44-157988ee0133 req-540758b2-26dd-4613-ac84-15bf20ef5cf1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:34.926727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6e213fae-b6c8-4bb3-af44-157988ee0133 req-540758b2-26dd-4613-ac84-15bf20ef5cf1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:34.929316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6e213fae-b6c8-4bb3-af44-157988ee0133 req-540758b2-26dd-4613-ac84-15bf20ef5cf1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:34.974220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6e213fae-b6c8-4bb3-af44-157988ee0133 req-540758b2-26dd-4613-ac84-15bf20ef5cf1 service nova] Creating event network-vif-deleted:574d11e8-4831-4b07-90f9-d5cf91041b12 for instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 on n-h1-858129-2 Sep 16 14:38:34.981861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6e213fae-b6c8-4bb3-af44-157988ee0133 req-540758b2-26dd-4613-ac84-15bf20ef5cf1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127236 Sep 16 14:38:34.984028 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3000/6012] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:38:35.125940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:35.139041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ef8b95f6-d34d-4a38-9261-0b06b6581e7a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.374864 Sep 16 14:38:35.143160 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3013/6013] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:34 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:35.281209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:35.282164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:35.300379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:35.302770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:35.303185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:35.305086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:35.309913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:35.310577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:35.427084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:35.427843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:35.428437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:35.430871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lazy-loading 'fault' on Instance uuid 1cdea053-4911-483f-b5f2-7e94048ddaa9 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:38:35.594217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67181b6dea474d52af92f466ac92d055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ad0ff4a2bb4402bae5c96d46cd528e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:35.622259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d249e11-282e-4724-9a92-66dbe836b0a0 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 200 len: 1327 microversion: 2.1 time: 0.346515 Sep 16 14:38:35.627330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3001/6014] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:35 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 1327 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:36.176566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:36.177990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:36.191626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:36.192508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:36.201353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:36.210840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:36.212105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:36.212754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:36.521634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:36.536927 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad123838-467e-4ff4-af46-7ae74b4fb7b1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.369639 Sep 16 14:38:36.539688 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3014/6015] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:36 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:36.652331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:36.652992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:36.662801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:36.668378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:36.669108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:36.672592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:36.673290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:36.673885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:36.708676 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] HTTP exception thrown: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Request method failure captured: Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 HTTP/1.1 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIiAS0nr6gn8XgciYSFaZ1I9-Zxk79uvRNlqFzEMSwTCH7CjMDUd-HDUx1p7ueoNTjrC8oMvpmCQjWro5tDt9rbLkTDl8ZA3pOvTu60fn13_2TWpQjAQuq8OQ7kibW3wnhmNCyLUtS6ny0wWl1ukocT4skgJxyUcC5ZAtCDIpyK2ICI Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86ad0ff4a2bb4402bae5c96d46cd528e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}] Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 67181b6dea474d52af92f466ac92d055 Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1cdea053-4911-483f-b5f2-7e94048ddaa9'} Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:36.716327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:36.721510 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:36.722935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Returning 404 to user: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:36.724910 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-641aad31-6c9b-4b0f-bf82-b6503189a16f tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 404 len: 111 microversion: 2.1 time: 0.076908 Sep 16 14:38:36.729537 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3002/6016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:36 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:38:36.738774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b7383f6-1d00-4cab-bf4f-380a377692ab tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '.version_select at 0x7f724c656ee0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:36.778527 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b7383f6-1d00-4cab-bf4f-380a377692ab tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064536850" status: 202 len: 0 microversion: 2.1 time: 0.045964 Sep 16 14:38:36.779554 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3015/6017] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064536850 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:38:37.568726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:37.569711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:37.583117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:37.586840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:37.587591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:37.588501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:37.589700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:37.590998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:38.157550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:38.175979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e0c771c-0a8b-4ba5-af5e-5488fc7e1e51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.614596 Sep 16 14:38:38.178252 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3003/6018] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:37 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:39.210252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:39.211014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:39.251482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:39.253590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:39.254042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:39.254821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:39.260180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:39.260740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:39.739021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:39.764241 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93a7e6ff-3526-405b-98e7-072cf54562b5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.559845 Sep 16 14:38:39.776065 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3016/6019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:39 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:40.822435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:40.825814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:40.840163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:40.840677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:40.841131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:40.841900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:40.858395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:40.858884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:41.689047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:41.701435 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1e07165-113f-41c5-9bdb-dd13721d81a9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.899813 Sep 16 14:38:41.702044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3004/6020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:40 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:42.733196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:42.735145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:42.750222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:42.753071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:42.753865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:42.754959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:42.755779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:42.756750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:43.053447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:43.067547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e824d32-b2d0-4f4b-9de3-6cf8d53af821 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.337983 Sep 16 14:38:43.068176 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3017/6021] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:42 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:44.099049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:44.099763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:44.119593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:44.120128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:44.120788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:44.122258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:44.122843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:44.123840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:44.385675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:44.394708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:44.398055 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0cb12820-8711-4c18-be54-140919fe69a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.303962 Sep 16 14:38:44.418244 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3005/6022] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:44 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:45.423744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:45.424372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:45.427353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:45.501318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:45.501833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:45.502283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:45.503042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:45.503502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:45.503934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:45.556473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:46.099096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:46.114147 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8967cd0f-cc36-4c2d-ab17-93ef8c351a9f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.695377 Sep 16 14:38:46.146287 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3018/6023] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:45 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:47.156442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:47.157628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:47.165596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=35 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:38:47.177968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:47.180162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:47.180790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:47.181625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:47.184195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:47.186892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:47.471379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:47.483895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d57648f0-d336-44c8-8b89-182eb852661b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.334619 Sep 16 14:38:47.485661 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3006/6024] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:47 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:48.217435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:48.218608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:48.231220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.233662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.234282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.237982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.238707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.239321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.307422 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9e4182b7-1cc1-47ce-8020-506cdd27d7f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/ips" status: 200 len: 147 microversion: 2.1 time: 0.096138 Sep 16 14:38:48.309069 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3019/6025] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:38:48 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/ips => generated 147 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:48.320810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce2300aa-19fd-4556-afa0-a9830cedc007"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:48.323385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:48.337440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.338098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.338610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.343366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.343855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.344303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.495577 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Invalid volume: volume ce2300aa-19fd-4556-afa0-a9830cedc007 is already attached to instances: 58e2a4b1-5232-4366-9496-53a98f1e80b2 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/os-volume_attachments HTTP/1.1 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 74 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: {"volumeAttachment": {"volumeId": "ce2300aa-19fd-4556-afa0-a9830cedc007"}} Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid volume: volume ce2300aa-19fd-4556-afa0-a9830cedc007 is already attached to instances: 58e2a4b1-5232-4366-9496-53a98f1e80b2 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '9f77dd48-0efa-406e-8f66-be8872c67c7b', 'body': {'volumeAttachment': {'volumeId': 'ce2300aa-19fd-4556-afa0-a9830cedc007'}}} Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce2300aa-19fd-4556-afa0-a9830cedc007 is already attached to instances: 58e2a4b1-5232-4366-9496-53a98f1e80b2 Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:38:48.497603 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce2300aa-19fd-4556-afa0-a9830cedc007 is already attached to instances: 58e2a4b1-5232-4366-9496-53a98f1e80b2 Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce2300aa-19fd-4556-afa0-a9830cedc007 is already attached to instances: 58e2a4b1-5232-4366-9496-53a98f1e80b2 Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 400 to user: Invalid volume: volume ce2300aa-19fd-4556-afa0-a9830cedc007 is already attached to instances: 58e2a4b1-5232-4366-9496-53a98f1e80b2 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:48.502298 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f48d8f6c-bea3-4856-b839-392d641f4ff9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.183182 Sep 16 14:38:48.509488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:48.510272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:48.516911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3007/6026] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:38:48 2022] POST /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:38:48.522301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.522911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.523362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.524096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.532248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.534045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.535256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:48.536389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:48.556142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.556788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.557252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.558001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.558486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.558918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.675590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:38:48.806360 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8eefec4-a59f-4cc8-8389-5e33b503336a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 204 len: 0 microversion: 2.1 time: 0.283351 Sep 16 14:38:48.807716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3008/6027] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:38:48 2022] DELETE /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:38:48.822683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:48.825410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:48.842517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.844473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.848631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.849889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:48.850552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:48.851158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:48.879154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:48.890263 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-774c1a9a-2097-4c4a-86e0-e065a7e7ef6d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.384817 Sep 16 14:38:48.893599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3020/6028] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:48 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:49.135949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:49.155203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88d514be-f06e-4f9c-9bad-a94a03eae925 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1678 microversion: 2.1 time: 0.341834 Sep 16 14:38:49.156395 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3009/6029] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:48 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1678 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:49.920674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:49.921480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:49.937132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:49.939313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:49.940454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:49.942138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:49.945435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:49.946563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:50.183966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:50.187273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:50.202941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:50.203447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:50.207047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:50.207824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:50.208625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:50.209082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:50.508965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:50.535931 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d29796b-f359-43d7-931e-28480f11adf4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.620580 Sep 16 14:38:50.537259 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3021/6030] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:49 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:50.650266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:50.665633 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cac21f53-6bc1-4f49-a0f8-355470241f6b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1678 microversion: 2.1 time: 0.485221 Sep 16 14:38:50.667582 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3010/6031] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:50 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1678 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:50.914895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:50.915427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:50.934236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:50.936373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:50.936826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:50.937610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:50.938146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:50.950380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:50.993744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] HTTP exception thrown: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Request method failure captured: Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 HTTP/1.1 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIiAS0nr6gn8XgciYSFaZ1I9-Zxk79uvRNlqFzEMSwTCH7CjMDUd-HDUx1p7ueoNTjrC8oMvpmCQjWro5tDt9rbLkTDl8ZA3pOvTu60fn13_2TWpQjAQuq8OQ7kibW3wnhmNCyLUtS6ny0wWl1ukocT4skgJxyUcC5ZAtCDIpyK2ICI Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86ad0ff4a2bb4402bae5c96d46cd528e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}] Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 67181b6dea474d52af92f466ac92d055 Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1cdea053-4911-483f-b5f2-7e94048ddaa9'} Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:38:51.003254 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Returning 404 to user: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:51.007212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bb027e48-29d8-4ea4-8ef7-f1634bbcb9b4 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 404 len: 111 microversion: 2.1 time: 0.094844 Sep 16 14:38:51.018877 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3022/6032] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:38:50 2022] DELETE /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:38:51.027721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:51.028368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: 1cdea053-4911-483f-b5f2-7e94048ddaa9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:51.046954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:51.047467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:51.048033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:51.048658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:51.049119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:51.049591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:51.076047 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] HTTP exception thrown: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Request method failure captured: Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 HTTP/1.1 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIiAS0nr6gn8XgciYSFaZ1I9-Zxk79uvRNlqFzEMSwTCH7CjMDUd-HDUx1p7ueoNTjrC8oMvpmCQjWro5tDt9rbLkTDl8ZA3pOvTu60fn13_2TWpQjAQuq8OQ7kibW3wnhmNCyLUtS6ny0wWl1ukocT4skgJxyUcC5ZAtCDIpyK2ICI Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86ad0ff4a2bb4402bae5c96d46cd528e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}] Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 67181b6dea474d52af92f466ac92d055 Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1cdea053-4911-483f-b5f2-7e94048ddaa9'} Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:51.086638 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Returning 404 to user: Instance 1cdea053-4911-483f-b5f2-7e94048ddaa9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4ae095e-13d1-48df-bf7f-3695258e4708 tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9" status: 404 len: 111 microversion: 2.1 time: 0.064848 Sep 16 14:38:51.090693 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3011/6033] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:51 2022] GET /compute/v2.1/servers/1cdea053-4911-483f-b5f2-7e94048ddaa9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:38:51.569320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:51.569937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:51.600249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:51.600997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:51.601706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:51.602744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:51.604235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:51.604881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:51.706732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:51.708746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:51.725570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:51.726085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:51.726525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:51.727250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:51.727709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:51.728137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:52.076478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:52.097655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:52.105987 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d15375b3-33f6-4182-b5dd-94d8def2322d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1610 microversion: 2.1 time: 0.406341 Sep 16 14:38:52.107654 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-03fd84b6-a4ed-4cd4-be90-bc916a37ffb8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.529503 Sep 16 14:38:52.110849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3023/6034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:51 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:52.111975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3012/6035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:51 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1610 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:38:53.144272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:53.144888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:53.145285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:53.146634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:53.168979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:53.171365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:53.176437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:53.177310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:53.177923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:53.178724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:53.179675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:53.180735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:53.181368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:53.183250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:53.183947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:53.184572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:53.410624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:53.419030 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af6a9a49-a256-407e-8263-fdb1d6ec24a6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1610 microversion: 2.1 time: 0.287223 Sep 16 14:38:53.442530 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3024/6036] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:53 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1610 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:53.631377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:53.646613 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3fe0e7dd-568e-4606-b4f8-b795e306ec49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1696 microversion: 2.1 time: 0.510590 Sep 16 14:38:53.647271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3013/6037] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:53 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1696 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:53.729273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-456b7474-ce7d-42aa-96c7-1cbdc25ccbb4 req-f4ec392e-4a91-4f3b-a594-a478083b6b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f77dd48-0efa-406e-8f66-be8872c67c7b", "name": "network-vif-deleted", "tag": "3b0def02-386a-4e4a-81fa-88365f54268c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:53.757782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-456b7474-ce7d-42aa-96c7-1cbdc25ccbb4 req-f4ec392e-4a91-4f3b-a594-a478083b6b90 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:53.758305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-456b7474-ce7d-42aa-96c7-1cbdc25ccbb4 req-f4ec392e-4a91-4f3b-a594-a478083b6b90 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:53.760183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-456b7474-ce7d-42aa-96c7-1cbdc25ccbb4 req-f4ec392e-4a91-4f3b-a594-a478083b6b90 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:53.807993 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-456b7474-ce7d-42aa-96c7-1cbdc25ccbb4 req-f4ec392e-4a91-4f3b-a594-a478083b6b90 service nova] Creating event network-vif-deleted:3b0def02-386a-4e4a-81fa-88365f54268c for instance 9f77dd48-0efa-406e-8f66-be8872c67c7b on n-h2-858129-2 Sep 16 14:38:53.824215 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-456b7474-ce7d-42aa-96c7-1cbdc25ccbb4 req-f4ec392e-4a91-4f3b-a594-a478083b6b90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102641 Sep 16 14:38:53.827378 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3025/6038] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:54.457361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:54.458154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:54.483749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:54.484257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:54.484705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:54.500457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:54.500974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:54.501526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:54.641187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:54.644540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:54.646764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:54.648068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'fault' on Instance uuid 9f77dd48-0efa-406e-8f66-be8872c67c7b {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:38:54.674252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:54.675016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:54.688541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:54.688957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:54.689426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:54.690113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:54.695495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:54.696172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:54.892878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:54.904508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66776b2b-a4ab-4417-b820-810b96e61fe4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 200 len: 1330 microversion: 2.1 time: 0.451196 Sep 16 14:38:54.908230 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3014/6039] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:54 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 1330 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:55.102632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:55.114060 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f34aba0d-c397-42c8-aae3-0df85493209d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1695 microversion: 2.1 time: 0.445224 Sep 16 14:38:55.115315 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3026/6040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:54 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1695 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:38:55.885908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "name": "network-vif-unplugged", "status": "completed", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:55.904658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:55.905391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:55.906090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:55.923083 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] Creating event network-vif-unplugged:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h2-858129-2 Sep 16 14:38:55.930370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:38:55.937418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:55.939023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:55.952423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:55.957705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:55.959088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:55.960463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:55.963644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:55.964324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:55.978215 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ebade258-17ce-4048-aaa1-ea928f2fe976 req-92234183-084a-4ace-aa0b-fef34f0d459a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104727 Sep 16 14:38:55.982899 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3015/6041] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:55.994862 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b HTTP/1.1 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9f77dd48-0efa-406e-8f66-be8872c67c7b'} Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:55.996720 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be1a8946-358a-4668-b2e6-64c40f698ba4 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 404 len: 111 microversion: 2.1 time: 0.066082 Sep 16 14:38:56.000388 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3027/6042] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:55 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:38:56.013172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-336663cb-70b4-4a81-bc64-fe82fcf2b06b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '.version_select at 0x7f724c285700>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:56.044229 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-336663cb-70b4-4a81-bc64-fe82fcf2b06b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86181659" status: 202 len: 0 microversion: 2.1 time: 0.038647 Sep 16 14:38:56.045740 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3016/6043] 10.222.0.60 () {58 vars in 1215 bytes} [Fri Sep 16 14:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86181659 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:38:56.140406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:56.141318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:56.149969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:56.152571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:56.154562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:56.155540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:56.156613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:56.157906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:56.648639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:56.659606 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aba32759-1ad8-4e36-ad84-926dae55f99d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1695 microversion: 2.1 time: 0.523828 Sep 16 14:38:56.660231 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3028/6044] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:56 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1695 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:57.688059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:57.689414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:57.708327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:57.709770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:57.710507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:57.711457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:57.712154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:57.714151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:57.797194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:57.797860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:57.805188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:57.805849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:57.806390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:57.807251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:57.807929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:57.808466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:57.829248 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] HTTP exception thrown: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Request method failure captured: Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f HTTP/1.1 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIiAS0nr6gn8XgciYSFaZ1I9-Zxk79uvRNlqFzEMSwTCH7CjMDUd-HDUx1p7ueoNTjrC8oMvpmCQjWro5tDt9rbLkTDl8ZA3pOvTu60fn13_2TWpQjAQuq8OQ7kibW3wnhmNCyLUtS6ny0wWl1ukocT4skgJxyUcC5ZAtCDIpyK2ICI Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86ad0ff4a2bb4402bae5c96d46cd528e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}] Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 67181b6dea474d52af92f466ac92d055 Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f5210058-ed7d-44e7-82d4-a0636df6787f'} Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:38:57.839870 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.844816 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.846684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Returning 404 to user: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:57.847796 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-41ac2e37-ec2f-4c19-a75e-5d690e1073ae tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 404 len: 111 microversion: 2.1 time: 0.058149 Sep 16 14:38:57.854498 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3029/6045] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:38:57 2022] DELETE /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:38:57.866304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:57.869301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] [instance: f5210058-ed7d-44e7-82d4-a0636df6787f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:57.884962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:57.890535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:57.893613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:57.897331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:57.898868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:57.902876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:57.946856 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] HTTP exception thrown: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Request method failure captured: Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f HTTP/1.1 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIiAS0nr6gn8XgciYSFaZ1I9-Zxk79uvRNlqFzEMSwTCH7CjMDUd-HDUx1p7ueoNTjrC8oMvpmCQjWro5tDt9rbLkTDl8ZA3pOvTu60fn13_2TWpQjAQuq8OQ7kibW3wnhmNCyLUtS6ny0wWl1ukocT4skgJxyUcC5ZAtCDIpyK2ICI Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86ad0ff4a2bb4402bae5c96d46cd528e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86ad0ff4a2bb4402bae5c96d46cd528e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86ad0ff4a2bb4402bae5c96d46cd528e"}]}] Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 86ad0ff4a2bb4402bae5c96d46cd528e Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417790629 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 67181b6dea474d52af92f466ac92d055 Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeTestJSON-417790629-project Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f5210058-ed7d-44e7-82d4-a0636df6787f'} Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:38:57.947964 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] Returning 404 to user: Instance f5210058-ed7d-44e7-82d4-a0636df6787f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aa2f9abd-941f-47db-9c5b-cbaea7d1bd7c tempest-AttachVolumeTestJSON-417790629 tempest-AttachVolumeTestJSON-417790629-project] 10.222.0.60 "GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f" status: 404 len: 111 microversion: 2.1 time: 0.090952 Sep 16 14:38:57.951561 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3030/6046] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:57 2022] GET /compute/v2.1/servers/f5210058-ed7d-44e7-82d4-a0636df6787f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:38:58.167454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:58.167791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:58.180082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:58.180585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:58.181022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:58.181739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:58.182191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:58.182646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:58.381744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'services' on Instance uuid 58e2a4b1-5232-4366-9496-53a98f1e80b2 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:38:58.478141 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e36b2211-3c8f-4422-b29e-f9a3e4715836 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments/ce2300aa-19fd-4556-afa0-a9830cedc007" status: 202 len: 0 microversion: 2.1 time: 0.318324 Sep 16 14:38:58.479293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3031/6047] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:38:58 2022] DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments/ce2300aa-19fd-4556-afa0-a9830cedc007 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:38:58.504228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:58.511227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:58.527261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:58.527988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:58.529137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:58.534931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:58.535665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:58.536245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:58.608425 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82701ca4-dc72-4e68-ab9c-4c827e5fc4eb tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122813 Sep 16 14:38:58.609032 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3032/6048] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:38:58 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:58.621435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:38:58.647795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:58.648817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:58.649400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:58.664782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:38:58.681292 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e4f0fa4-df49-4f7e-8ce0-b3434f167d29 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1695 microversion: 2.1 time: 0.995004 Sep 16 14:38:58.682668 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3017/6049] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:57 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1695 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:38:58.741340 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] Creating event network-changed:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h2-858129-2 Sep 16 14:38:58.767675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:38:58.784260 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e25a18a4-47ce-455b-a4cd-c89f3c60d051 req-30490b94-2ec2-459f-8f70-c1cf7d71b7ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168521 Sep 16 14:38:58.785978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3033/6050] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:38:59.628281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:59.630860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:59.645055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:59.645564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:59.647022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:59.649634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:59.650377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:59.651695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:59.723415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:38:59.726105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:38:59.744566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:59.751165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:59.754145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:59.758834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:38:59.764071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:38:59.767394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:38:59.770256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9d04102-e9a5-41b2-a0c0-93949f7c2338 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149505 Sep 16 14:38:59.778963 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3018/6051] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:38:59 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:00.225027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:00.239437 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-611a3381-923e-4fe8-9470-23d808d3c54f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1695 microversion: 2.1 time: 0.528297 Sep 16 14:39:00.254454 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3034/6052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:38:59 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1695 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:00.810306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:00.852515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:00.897668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:00.898389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:00.904318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:00.905110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:00.905591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:00.906030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:00.990169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3037c9ab-0417-4b65-bf65-5e36364c3761 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202357 Sep 16 14:39:00.995672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3019/6053] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:00 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:01.264403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:01.265186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:01.278013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:01.278621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:01.279068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:01.279795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:01.280253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:01.280684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:01.524289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:01.539483 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e37a28c3-b3ca-4cba-8a4b-a1b2ae3b1a03 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1693 microversion: 2.1 time: 0.279275 Sep 16 14:39:01.552449 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3035/6054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:01 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1693 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:02.003654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:02.006833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:02.025958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:02.026987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:02.029432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:02.031182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:02.033890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:02.035716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:02.097307 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0d06179-9610-4b95-8da1-667e086486d2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098498 Sep 16 14:39:02.098185 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3020/6055] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:01 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:02.575217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:02.576536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:02.585052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:02.585799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:02.586500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:02.587505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:02.588190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:02.588840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:02.784356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:02.795983 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f44ab3f-6834-4e1e-a11c-d99aa2382ac9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1693 microversion: 2.1 time: 0.222915 Sep 16 14:39:02.804912 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3036/6056] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:02 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:03.113545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:03.115816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:03.133890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:03.134421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:03.137895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:03.139207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:03.141313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:03.141773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:03.188878 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93cb589a-cf3b-4bfa-b23d-36dd87867f54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077651 Sep 16 14:39:03.190777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3021/6057] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:03 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:03.832023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:03.832713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:03.847702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:03.848211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:03.848656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:03.849386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:03.849843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:03.857036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.204324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:04.206598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:04.218584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:04.219095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:04.219545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.220265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:04.220722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:04.221161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.286260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:04.348475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a4cc998-4757-4f0a-a060-e730a31e531a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148635 Sep 16 14:39:04.355051 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3022/6058] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:04 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:39:04.469015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:04.498460 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7dad6fb5-efe6-4533-8bc4-14384b145fbe tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1690 microversion: 2.1 time: 0.670712 Sep 16 14:39:04.510670 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3037/6059] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:03 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1690 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:04.525999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:04.526575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:04.541485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:04.541973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:04.542633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.545311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:04.547632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:04.549667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.741751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48722bce-7f0f-4bce-818a-920ec6eee551 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action" status: 204 len: 0 microversion: 2.1 time: 0.219734 Sep 16 14:39:04.745472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3023/6060] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:39:04 2022] POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:39:04.753937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:04.765493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:04.802744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:04.804793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:04.807075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.819549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:04.820034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:04.823199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:04.827251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:05.248034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:05.263970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40052792-71f7-43ae-83f5-970275aa1744 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1690 microversion: 2.1 time: 0.513793 Sep 16 14:39:05.264586 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3038/6061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:04 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1690 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:05.369147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:05.381828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:05.405852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:05.406357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:05.415089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:05.419294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:05.420001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:05.423026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:05.512674 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6df0b992-9652-450f-b811-bc3d9ff46d39 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148321 Sep 16 14:39:05.516981 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3024/6062] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:05 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:06.298559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:06.299336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:06.316849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:06.322009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:06.322811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:06.325478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:06.329498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:06.331591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:06.525427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:06.529428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:06.545738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:06.546592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:06.548863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:06.549814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:06.552020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:06.552723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:06.630522 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a133ed5-3a1a-40c0-86ab-800147b68932 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107805 Sep 16 14:39:06.645460 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3025/6063] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:06 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:06.787554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:06.801318 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-22fcccef-0ac0-46ca-8965-d1c5b2545cac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1690 microversion: 2.1 time: 0.509145 Sep 16 14:39:06.807418 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3039/6064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:06 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1690 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:07.646140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:07.648445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:07.663911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.664426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.664877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.665805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.667750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.668428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.676645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-cc7b9f3c-b17d-4948-9cae-235a96fd3553 req-5b724b60-204d-4562-b71b-70614438c01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "name": "network-vif-plugged", "status": "completed", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:07.709669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cc7b9f3c-b17d-4948-9cae-235a96fd3553 req-5b724b60-204d-4562-b71b-70614438c01a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.710389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cc7b9f3c-b17d-4948-9cae-235a96fd3553 req-5b724b60-204d-4562-b71b-70614438c01a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.711040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-cc7b9f3c-b17d-4948-9cae-235a96fd3553 req-5b724b60-204d-4562-b71b-70614438c01a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.729227 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-cc7b9f3c-b17d-4948-9cae-235a96fd3553 req-5b724b60-204d-4562-b71b-70614438c01a service nova] Creating event network-vif-plugged:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h2-858129-2 Sep 16 14:39:07.743417 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-cc7b9f3c-b17d-4948-9cae-235a96fd3553 req-5b724b60-204d-4562-b71b-70614438c01a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070685 Sep 16 14:39:07.746843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3040/6065] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:39:07.751698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bcf2c07f-2eae-44ad-8142-28c5c6b4fefd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109485 Sep 16 14:39:07.755229 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3026/6066] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:39:07 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:39:07.844421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:07.845419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:07.866748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.867255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.867697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.869704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.869704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.869704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.883842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:07.884362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:07.894531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.895040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.895488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.896206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:07.896675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:07.897111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:07.991102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:39:08.158019 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74cdc0de-78db-4351-87d6-d947263d19f7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 204 len: 0 microversion: 2.1 time: 0.277081 Sep 16 14:39:08.161583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3027/6067] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:39:07 2022] DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:39:08.185379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:08.188519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:08.195156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:08.206589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:08.208542 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-21bc42c0-5f3a-449c-af71-3e7bccfb7444 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1682 microversion: 2.1 time: 0.372596 Sep 16 14:39:08.215891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:08.217061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:08.218339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:08.220816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:08.221514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:08.224275 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3041/6068] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:07 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:08.461419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:08.477181 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8cbf9f80-1a25-4f28-bc1e-0d69a29874ab tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1679 microversion: 2.1 time: 0.305060 Sep 16 14:39:08.491875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3028/6069] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:08 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1679 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:09.512945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:09.514512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:09.523480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:09.524327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:09.525291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:09.526261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:09.526956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:09.528389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:09.822950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:09.838768 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f08ebed-4cbc-4fd0-8cc3-6ae979832c0f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1679 microversion: 2.1 time: 0.330904 Sep 16 14:39:09.840810 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3042/6070] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:09 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:10.865344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:10.865956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:10.888293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:10.889260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:10.891386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:10.893302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:10.895445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:10.896244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:11.183304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:11.193351 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f3dc1c0-aba6-426a-9a1e-097dde3e1f3b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1679 microversion: 2.1 time: 0.331720 Sep 16 14:39:11.194011 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3029/6071] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:10 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1679 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:11.895715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-446051a7-57a8-48cf-8e0f-61187857c870 req-7958fcbb-0e3b-4bb5-8d07-7f101a8c18c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e2a4b1-5232-4366-9496-53a98f1e80b2", "name": "network-vif-deleted", "tag": "e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:11.925736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-446051a7-57a8-48cf-8e0f-61187857c870 req-7958fcbb-0e3b-4bb5-8d07-7f101a8c18c2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:11.926573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-446051a7-57a8-48cf-8e0f-61187857c870 req-7958fcbb-0e3b-4bb5-8d07-7f101a8c18c2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:11.927354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-446051a7-57a8-48cf-8e0f-61187857c870 req-7958fcbb-0e3b-4bb5-8d07-7f101a8c18c2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:11.957675 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-446051a7-57a8-48cf-8e0f-61187857c870 req-7958fcbb-0e3b-4bb5-8d07-7f101a8c18c2 service nova] Creating event network-vif-deleted:e8b74aba-6ae7-41e0-bb33-ffc82a6ddd7f for instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 on n-h2-858129-2 Sep 16 14:39:11.966704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-446051a7-57a8-48cf-8e0f-61187857c870 req-7958fcbb-0e3b-4bb5-8d07-7f101a8c18c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079398 Sep 16 14:39:11.969155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3043/6072] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:39:12.223253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:12.224998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:12.243278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:12.244993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:12.248191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:12.249206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:12.251086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:12.252079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:12.348022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:12.348534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:12.348999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:12.349452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'fault' on Instance uuid 58e2a4b1-5232-4366-9496-53a98f1e80b2 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:39:12.469239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:12.479130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7698e80c-071b-4d3b-a9e2-8d8293f4c69a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 200 len: 1332 microversion: 2.1 time: 0.260926 Sep 16 14:39:12.484830 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3030/6073] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:12 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 1332 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:13.519907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:13.521664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:13.548559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:13.550116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:13.550720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:13.555882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:13.556955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:13.561174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:13.613702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 HTTP/1.1 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '58e2a4b1-5232-4366-9496-53a98f1e80b2'} Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:39:13.616166 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:39:13.621315 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:39:13.622781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:39:13.625716 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d935fefb-fd00-4c96-8189-adca1b6c7d20 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 404 len: 111 microversion: 2.1 time: 0.109906 Sep 16 14:39:13.626326 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3044/6074] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:13 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:39:13.634894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59f165c2-f55a-4da1-9fad-9e734da12fbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '.version_select at 0x7f7251769280>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:13.677394 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59f165c2-f55a-4da1-9fad-9e734da12fbd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029246519" status: 202 len: 0 microversion: 2.1 time: 0.046160 Sep 16 14:39:13.683965 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3031/6075] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029246519 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:39:15.172710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cbb79af1-9dc0-4c13-ab1c-1481364d9a32 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: .version_select at 0x7f724da8ea60>, body: {"keypair": {"name": "tempest-keypair-1028460225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpTZ2z+cYPdmG446y5l9W5CzJcI6jzpJJ4NgJFb7yX17iilofFVpfAHWtkLtebgIW3Uh6SLmMBxfEHWaMHeUqLg6OBP166QvD1cykhJnXHxAyGekCDY8qkA23VqOJjiPw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:15.209090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-cbb79af1-9dc0-4c13-ab1c-1481364d9a32 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:39:15.218732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-cbb79af1-9dc0-4c13-ab1c-1481364d9a32 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:39:15.247786 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cbb79af1-9dc0-4c13-ab1c-1481364d9a32 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088809 Sep 16 14:39:15.248718 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3045/6076] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:39:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:18.178277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1213576974", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c17062a-3bb6-45ab-8062-5725ef0d7c64"}], "security_groups": [{"name": "tempest-securitygroup--541889189"}], "key_name": "tempest-keypair-1028460225", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:18.204426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:18.374944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] validate_networks() for [('1c17062a-3bb6-45ab-8062-5725ef0d7c64', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:39:18.983501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:39:18.984284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:39:18.984838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:39:18.985777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:39:18.986582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:39:18.999418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:19.000119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:19.000724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:19.002312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:19.002813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:19.003406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:19.033393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:39:19.041131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:39:19.057207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:39:19.065438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:39:19.119269 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c3fe7ec-97a4-4fe8-88b9-f4e250a1decf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.948783 Sep 16 14:39:19.122569 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3032/6077] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:39:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:39:19.132473 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7af13fc7-3e70-488e-a65b-d9c8aab6978a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:19.133084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7af13fc7-3e70-488e-a65b-d9c8aab6978a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:19.145405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:19.293805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7af13fc7-3e70-488e-a65b-d9c8aab6978a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:19.306528 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7af13fc7-3e70-488e-a65b-d9c8aab6978a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1242 microversion: 2.1 time: 0.177328 Sep 16 14:39:19.327694 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3046/6078] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:19 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:20.333079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:20.334259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:20.347982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:20.348699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:20.350888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:20.352523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:20.353179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:20.356195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:20.504543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:20.513507 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3f1fd77e-be34-4a35-bf9c-986771d05b52 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1294 microversion: 2.1 time: 0.185346 Sep 16 14:39:20.516953 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3033/6079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:20 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1294 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:21.556452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:21.558151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:21.578669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:21.579176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:21.579619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:21.586710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:21.587379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:21.589769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:21.733280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:21.751667 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26a14d0c-b522-4eb2-834d-453eb11524ca tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1300 microversion: 2.1 time: 0.207708 Sep 16 14:39:21.754124 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3047/6080] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:21 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:22.780811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:22.782159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:22.797649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:22.799377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:22.801765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:22.802776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:22.805034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:22.805571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:23.269580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:23.284720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2420881-c747-40a8-92d9-2ebb4cacdd6a tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.506386 Sep 16 14:39:23.287831 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3034/6081] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:22 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:23.545675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-540b3a1b-cfd4-4cea-b5cf-221df9677288 req-502c9730-7fc2-463d-bf39-d8ebfc59bfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff33b64b-2980-407e-a2ce-d1277edd008b", "tag": "c30e5ca1-d2d6-4e78-9410-84b46ab67ee5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:23.585215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-540b3a1b-cfd4-4cea-b5cf-221df9677288 req-502c9730-7fc2-463d-bf39-d8ebfc59bfe2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:23.585925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-540b3a1b-cfd4-4cea-b5cf-221df9677288 req-502c9730-7fc2-463d-bf39-d8ebfc59bfe2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:23.586474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-540b3a1b-cfd4-4cea-b5cf-221df9677288 req-502c9730-7fc2-463d-bf39-d8ebfc59bfe2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:23.622737 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-540b3a1b-cfd4-4cea-b5cf-221df9677288 req-502c9730-7fc2-463d-bf39-d8ebfc59bfe2 service nova] Creating event network-changed:c30e5ca1-d2d6-4e78-9410-84b46ab67ee5 for instance ff33b64b-2980-407e-a2ce-d1277edd008b on n-h2-858129-2 Sep 16 14:39:23.628547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-540b3a1b-cfd4-4cea-b5cf-221df9677288 req-502c9730-7fc2-463d-bf39-d8ebfc59bfe2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086799 Sep 16 14:39:23.629571 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3048/6082] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:23.993063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4406b38-e6a3-4d83-adb6-2fff63fbd41d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Action: 'create', calling method: .version_select at 0x7f7251691dc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1057552017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNedYlBCO6Y7ou1g9IlTdkHwzJiQ8jBPaCm85+kJqSds35qXRoBwNqbhuoAIKixvMVnuyt0NjFTBPJUk+Aie/G2IwbCrChpjlou5OuzWUWA9Pa6Es+hzlO1iG55jNSPVA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:24.024014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-b4406b38-e6a3-4d83-adb6-2fff63fbd41d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Getting quotas for project e6ba48e463ee401cad1876d9ba4c4d0d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:39:24.033562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-b4406b38-e6a3-4d83-adb6-2fff63fbd41d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Getting quotas for user 16cad71b03f84b03a95aa191eef3ae8f and project e6ba48e463ee401cad1876d9ba4c4d0d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:39:24.066804 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4406b38-e6a3-4d83-adb6-2fff63fbd41d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.439483 Sep 16 14:39:24.068390 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3035/6083] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:39:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:39:24.311909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:24.312869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:24.329305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:24.331312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:24.331981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:24.333396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:24.336331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:24.336996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:24.635105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:24.657826 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-413d474b-785e-4886-b75b-e75f3e4d372e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.350573 Sep 16 14:39:24.659374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3049/6084] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:24 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:25.684962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:25.686260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:25.693693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:25.695225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:25.696550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:25.697772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:25.699419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:25.700154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:26.023624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:26.037846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45cb0dfa-e9ee-4591-a210-ac9fcf2629d7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.359743 Sep 16 14:39:26.039307 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3036/6085] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:25 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:26.527633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-477540887", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "9eae03e8-4b53-4255-a7c0-e9afbda19658"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:26.600443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] validate_networks() for [('9eae03e8-4b53-4255-a7c0-e9afbda19658', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:39:27.062868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:27.063331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:27.078061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:27.078845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:27.079452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:27.080333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:27.080946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:27.081561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:27.660270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:27.671563 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0bdeb4b5-b01f-49d7-8b7c-cecd70dd340f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.613873 Sep 16 14:39:27.672997 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3037/6086] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:27 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:39:27.862854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:39:27.864149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:39:27.864417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:39:27.864908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:39:27.865330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:39:27.878692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:27.879801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:27.880527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:27.881129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:27.882079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:27.882764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:27.911127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Getting quotas for project c2a7d26d621f44e28dee868516a6bebb. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:39:27.918167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Getting quotas for user f52ff94171544f86ae8ec644619ec9df and project c2a7d26d621f44e28dee868516a6bebb. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:39:27.937454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:39:27.940097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:39:28.016784 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b7a216d5-a7d8-4502-860c-abab045cd00f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.674309 Sep 16 14:39:28.030873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3624853-0289-41c4-a5f1-27559704ff99 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:28.031585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3624853-0289-41c4-a5f1-27559704ff99 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:28.035746 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3050/6087] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:39:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:39:28.206010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a3624853-0289-41c4-a5f1-27559704ff99 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:28.216176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3624853-0289-41c4-a5f1-27559704ff99 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1213 microversion: 2.1 time: 0.190581 Sep 16 14:39:28.227904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3038/6088] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:28 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:28.707661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:28.708698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:28.748361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:28.748618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:28.760800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:28.761922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:28.762853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:28.763451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:29.243075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:29.253652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:29.254871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:29.283661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:29.285405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:29.286105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:29.300992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:29.302219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:29.302948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:29.407370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:29.574790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:29.584070 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ea6e906-5cf9-46f2-a01b-bb849b69f838 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1265 microversion: 2.1 time: 0.342132 Sep 16 14:39:29.590578 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3039/6089] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:29 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:29.616433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:29.628589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd073774-98e1-4c92-8075-151c13092af0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.935790 Sep 16 14:39:29.629940 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3051/6090] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:28 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:30.614970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:30.616684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:30.628974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:30.629488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:30.629929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:30.630689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:30.631157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:30.631587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:30.664992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:30.666265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:30.682945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:30.686587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:30.687430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:30.701440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:30.702697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:30.703385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:30.877716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:30.902811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7dc59831-5761-45a2-8c1b-d212daa45d4d tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1271 microversion: 2.1 time: 0.284391 Sep 16 14:39:30.903605 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3040/6091] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:30 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:31.093575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:31.106951 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67a7e396-12ea-4030-922b-eaf5edad5fc7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.456778 Sep 16 14:39:31.132078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3052/6092] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:30 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:31.933982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:31.936408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:31.947307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:31.955244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:31.955856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:31.956975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:31.957251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:31.958443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:32.083499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-19502e8b-8a53-46eb-83ac-24a04ab134f2 req-ebab9f3b-622e-4acd-87ff-baaf14dd55a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33b64b-2980-407e-a2ce-d1277edd008b", "name": "network-vif-plugged", "status": "completed", "tag": "c30e5ca1-d2d6-4e78-9410-84b46ab67ee5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:32.103650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-19502e8b-8a53-46eb-83ac-24a04ab134f2 req-ebab9f3b-622e-4acd-87ff-baaf14dd55a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:32.112331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-19502e8b-8a53-46eb-83ac-24a04ab134f2 req-ebab9f3b-622e-4acd-87ff-baaf14dd55a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:32.113013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-19502e8b-8a53-46eb-83ac-24a04ab134f2 req-ebab9f3b-622e-4acd-87ff-baaf14dd55a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:32.150047 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-19502e8b-8a53-46eb-83ac-24a04ab134f2 req-ebab9f3b-622e-4acd-87ff-baaf14dd55a4 service nova] Creating event network-vif-plugged:c30e5ca1-d2d6-4e78-9410-84b46ab67ee5 for instance ff33b64b-2980-407e-a2ce-d1277edd008b on n-h2-858129-2 Sep 16 14:39:32.162909 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-19502e8b-8a53-46eb-83ac-24a04ab134f2 req-ebab9f3b-622e-4acd-87ff-baaf14dd55a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082017 Sep 16 14:39:32.164440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3053/6093] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:39:32.176427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:32.177338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:32.207394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:32.211714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:32.218906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:32.220857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:32.221542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:32.222144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:32.328005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:32.355966 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8059f7b-c571-4c3a-824c-2621aa52de87 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.420701 Sep 16 14:39:32.364193 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3041/6094] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:31 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:33.228320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:33.237832 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2638910-7e3b-4350-a88d-1009408d0f86 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 1.071843 Sep 16 14:39:33.239134 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3054/6095] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:32 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:33.404790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:33.407393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:33.424653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:33.425579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:33.428537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:33.430273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:33.431114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:33.434534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:33.774700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ec3869ab-e11c-4f30-ab44-88b313995361 req-bd8bcb38-7368-40c4-94bf-84d746eaab63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4317a62e-adc9-4bf5-8dea-7b79eecedaf5", "tag": "f7e76a6a-1355-4df9-be76-2a9973423df6"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:33.785251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ec3869ab-e11c-4f30-ab44-88b313995361 req-bd8bcb38-7368-40c4-94bf-84d746eaab63 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:33.789071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ec3869ab-e11c-4f30-ab44-88b313995361 req-bd8bcb38-7368-40c4-94bf-84d746eaab63 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:33.790858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ec3869ab-e11c-4f30-ab44-88b313995361 req-bd8bcb38-7368-40c4-94bf-84d746eaab63 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:33.827510 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ec3869ab-e11c-4f30-ab44-88b313995361 req-bd8bcb38-7368-40c4-94bf-84d746eaab63 service nova] Creating event network-changed:f7e76a6a-1355-4df9-be76-2a9973423df6 for instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 on n-h1-858129-2 Sep 16 14:39:33.832999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:33.836035 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ec3869ab-e11c-4f30-ab44-88b313995361 req-bd8bcb38-7368-40c4-94bf-84d746eaab63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065958 Sep 16 14:39:33.841527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3055/6096] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:33.843166 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1e8daca-6ebe-45dc-91f6-d03722321619 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.452061 Sep 16 14:39:33.844615 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3042/6097] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:33 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:34.262804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:34.264974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:34.278396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:34.279414 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:34.281978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:34.283070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:34.283945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:34.287394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:34.485741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:34.505689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-614c2f76-1e53-4cfd-99a5-66f55ed6d87f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1367 microversion: 2.1 time: 0.243533 Sep 16 14:39:34.507619 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3056/6098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:34 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:34.877902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:34.879500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:34.902792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:34.904201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:34.904899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:34.906005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:34.906768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:34.915095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:35.125808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:35.139985 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e2b8b63f-0ff2-489a-9869-48fea96882de tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.275427 Sep 16 14:39:35.165968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3043/6099] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:34 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:35.537681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:35.539757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:35.559259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:35.560132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:35.561355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:35.562340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:35.563115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:35.563774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:35.567190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=74 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:35.993675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:36.010757 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8df74070-eb79-4abe-b325-f1d556a08c7b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1556 microversion: 2.1 time: 0.475479 Sep 16 14:39:36.014869 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3057/6100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:35 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1556 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:36.038718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:36.039229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:36.048144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:36.049210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:36.050650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:36.051610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:36.052764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:36.053374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:36.169011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:36.169886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:36.170312 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87cf5cde-1cfe-4380-b1d9-1fa361f14e40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135587 Sep 16 14:39:36.171549 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3044/6101] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:39:36 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:36.182354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:36.183513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:36.189622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:36.191521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:36.192355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:36.194742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:36.342041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-495718137-access_point-810801735", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "73285dfc-5516-4c1b-b4e4-67610f591b4c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1057552017", "security_groups": [{"name": "tempest-secgroup_access--710071836"}, {"name": "tempest-secgroup_general--198690525"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:36.709963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:36.721389 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ffa5b8ac-4df1-4fd3-a571-0f447f60f692 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.558247 Sep 16 14:39:36.724663 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3058/6102] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:36 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:36.841669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] validate_networks() for [('73285dfc-5516-4c1b-b4e4-67610f591b4c', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:39:37.744664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:37.755332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:37.778156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:37.778975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:37.780372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:37.781298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:37.782080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:37.782735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:37.897881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:37.926774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:38.213993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:38.473091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:38.489518 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-87a75eda-7c31-4573-97cd-c24d4fbf0004 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.746958 Sep 16 14:39:38.490184 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3059/6103] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:37 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:38.501992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-caf17079-3b5b-4c85-9788-24c68800a9c6 req-fa8f2ab2-3890-4e2a-a53d-84b9fa179056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff33b64b-2980-407e-a2ce-d1277edd008b", "tag": "c30e5ca1-d2d6-4e78-9410-84b46ab67ee5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:38.529793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-caf17079-3b5b-4c85-9788-24c68800a9c6 req-fa8f2ab2-3890-4e2a-a53d-84b9fa179056 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:38.532052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-caf17079-3b5b-4c85-9788-24c68800a9c6 req-fa8f2ab2-3890-4e2a-a53d-84b9fa179056 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:38.532759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-caf17079-3b5b-4c85-9788-24c68800a9c6 req-fa8f2ab2-3890-4e2a-a53d-84b9fa179056 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:38.578872 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-caf17079-3b5b-4c85-9788-24c68800a9c6 req-fa8f2ab2-3890-4e2a-a53d-84b9fa179056 service nova] Creating event network-changed:c30e5ca1-d2d6-4e78-9410-84b46ab67ee5 for instance ff33b64b-2980-407e-a2ce-d1277edd008b on n-h2-858129-2 Sep 16 14:39:38.601482 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-caf17079-3b5b-4c85-9788-24c68800a9c6 req-fa8f2ab2-3890-4e2a-a53d-84b9fa179056 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107909 Sep 16 14:39:38.605215 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3060/6104] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:38.621381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:38.625092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:38.633770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:38.636045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:38.636864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:38.637947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:38.656271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:38.657142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:38.756860 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a112da9-0c12-473e-a5f7-9e0a683735e6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action" status: 200 len: 24582 microversion: 2.1 time: 0.149991 Sep 16 14:39:38.757616 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3061/6105] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:39:38 2022] POST /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3/action => generated 24582 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:39:38.896612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:39:38.897976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:39:38.898743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:39:38.899409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:39:38.900107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:39:38.923953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:38.924713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:38.925404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:38.926726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:38.927576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:38.931264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:38.955855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Getting quotas for project e6ba48e463ee401cad1876d9ba4c4d0d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:39:38.963588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Getting quotas for user 16cad71b03f84b03a95aa191eef3ae8f and project e6ba48e463ee401cad1876d9ba4c4d0d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:39:38.982551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:39:38.985397 n-d-858129-2 devstack@n-api.service[128642]: WARNING nova.utils [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-495718137-access_point-810801735 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-495718137-acc Sep 16 14:39:38.987187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:39:39.084918 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ec72b11-49ac-4ecf-ae96-f48a3ac5827b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.746874 Sep 16 14:39:39.098593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fa804852-ec1d-4d5d-946b-797f581077e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:39.099674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fa804852-ec1d-4d5d-946b-797f581077e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:39.105186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3045/6106] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:39:36 2022] POST /compute/v2.1/servers => generated 456 bytes in 2755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:39:39.240025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fa804852-ec1d-4d5d-946b-797f581077e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:39.249119 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fa804852-ec1d-4d5d-946b-797f581077e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1293 microversion: 2.1 time: 0.153811 Sep 16 14:39:39.251476 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3062/6107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:39 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:39:39.517130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:39.519475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:39.538195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:39.539223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:39.540707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:39.545490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:39.546107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:39.546644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:40.267373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:40.277844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:40.278482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:40.278586 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-452d2b3d-a50f-4844-8b7a-4abc4db6cd22 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.768578 Sep 16 14:39:40.279085 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3046/6108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:39 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:40.293962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:40.293962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:40.293962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:40.293962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:40.293962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:40.293962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:40.464212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:40.510865 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-aed11413-9cfd-4ca6-97d0-10c9205c0d3a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1297 microversion: 2.1 time: 0.229334 Sep 16 14:39:40.518980 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3063/6109] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:40 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1297 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:41.304095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:41.304095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:41.320402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:41.320912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:41.321358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:41.330767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:41.331397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:41.331856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:41.541953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:41.542662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:41.560337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:41.560842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:41.561276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:41.562002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:41.562495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:41.562931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:41.789325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:41.813475 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f1d3defa-920b-4a52-8351-60a4aac4e05e tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.516028 Sep 16 14:39:41.827320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3047/6110] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:41 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:41.861143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:41.871826 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-349985b1-20f2-4470-b76b-6be7b211f1d7 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1363 microversion: 2.1 time: 0.334454 Sep 16 14:39:41.875582 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3064/6111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:41 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:39:42.008233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-88e27ad7-f20a-4a88-abe0-1d62293d52c5 req-ebd806eb-b110-4606-9f8e-d4db4388242c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4317a62e-adc9-4bf5-8dea-7b79eecedaf5", "name": "network-vif-plugged", "status": "completed", "tag": "f7e76a6a-1355-4df9-be76-2a9973423df6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:42.045122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-88e27ad7-f20a-4a88-abe0-1d62293d52c5 req-ebd806eb-b110-4606-9f8e-d4db4388242c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:42.048559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-88e27ad7-f20a-4a88-abe0-1d62293d52c5 req-ebd806eb-b110-4606-9f8e-d4db4388242c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:42.050200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-88e27ad7-f20a-4a88-abe0-1d62293d52c5 req-ebd806eb-b110-4606-9f8e-d4db4388242c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:42.095090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-88e27ad7-f20a-4a88-abe0-1d62293d52c5 req-ebd806eb-b110-4606-9f8e-d4db4388242c service nova] Creating event network-vif-plugged:f7e76a6a-1355-4df9-be76-2a9973423df6 for instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 on n-h1-858129-2 Sep 16 14:39:42.112253 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-88e27ad7-f20a-4a88-abe0-1d62293d52c5 req-ebd806eb-b110-4606-9f8e-d4db4388242c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105834 Sep 16 14:39:42.114612 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3048/6112] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:39:42.848833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:42.851429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:42.865203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:42.865965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:42.870972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:42.871985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:42.872672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:42.873827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:42.901113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:42.901899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:42.922883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:42.931078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:42.931722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:42.932597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:42.933179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:42.938714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:43.590844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:43.631506 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06c155d4-a38a-4ea4-ac8c-5f124e540680 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1313 microversion: 2.1 time: 0.794389 Sep 16 14:39:43.631633 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3065/6113] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:42 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:43.684695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:43.698182 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-56b38dfb-5a66-4fd7-bd67-d8c0442b83dd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.800674 Sep 16 14:39:43.715150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3049/6114] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:42 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:39:44.346820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-34502a77-3500-458c-8831-b79fd336ef6d req-3d224ba2-809b-4e97-a1fe-4ca0ccfb9bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7102b24-9a70-4b86-a37b-ddae02e2e5b6", "tag": "b1ea140c-a1d5-40db-add5-470c4ee619bc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:44.367446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-34502a77-3500-458c-8831-b79fd336ef6d req-3d224ba2-809b-4e97-a1fe-4ca0ccfb9bb6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:44.368265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-34502a77-3500-458c-8831-b79fd336ef6d req-3d224ba2-809b-4e97-a1fe-4ca0ccfb9bb6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:44.370583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-34502a77-3500-458c-8831-b79fd336ef6d req-3d224ba2-809b-4e97-a1fe-4ca0ccfb9bb6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:44.397257 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-34502a77-3500-458c-8831-b79fd336ef6d req-3d224ba2-809b-4e97-a1fe-4ca0ccfb9bb6 service nova] Creating event network-changed:b1ea140c-a1d5-40db-add5-470c4ee619bc for instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 on n-h2-858129-2 Sep 16 14:39:44.408236 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-34502a77-3500-458c-8831-b79fd336ef6d req-3d224ba2-809b-4e97-a1fe-4ca0ccfb9bb6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064939 Sep 16 14:39:44.410994 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3066/6115] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:44.658681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:44.659571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:44.683816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:44.684339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:44.685268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:44.686028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:44.686759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:44.687206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:44.727799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:44.729617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:44.751071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:44.751637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:44.752177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:44.753019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:44.753567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:44.754088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:45.032873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:45.046509 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af6d8470-5d8d-445c-9ce2-088b273e5c69 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1497 microversion: 2.1 time: 0.392661 Sep 16 14:39:45.048178 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3050/6116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:44 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1497 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:45.095409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:45.111717 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90b53b5d-d52c-4904-ae2f-791ce701e6e9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.389498 Sep 16 14:39:45.112577 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3067/6117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:44 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:39:46.137498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:46.138132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:46.146065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:46.147626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:46.148826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:46.149820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:46.150537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:46.151185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:46.425066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:46.434689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-11a5c606-67d6-467c-b29b-4c214380fa1a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.302551 Sep 16 14:39:46.435458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3051/6118] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:46 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:47.464967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:47.465719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:47.475233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:47.476019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:47.476921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:47.477915 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:47.479275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:47.479772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:47.793845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:47.805369 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3c348f6-bedf-44d2-b1b3-51c8db4b5950 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.347794 Sep 16 14:39:47.806233 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3068/6119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:47 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:48.830612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:48.831260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:48.841761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:48.855450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:48.856638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:48.857303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:48.858174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:48.858926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:48.859693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:48.947653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:48.975570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:49.054018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:49.063261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eaa1d918-54ca-432d-95db-5314d49c6385 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.237538 Sep 16 14:39:49.064150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3052/6120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:48 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:49.089931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:49.090646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:49.097618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:49.098314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:49.098970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:49.099682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:49.100139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:49.100569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:49.134591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:39:49.219490 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7e93159a-9d28-4064-a5a6-0bf9fa4ecdb6 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 204 len: 0 microversion: 2.1 time: 0.133214 Sep 16 14:39:49.220129 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3069/6121] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:39:49 2022] DELETE /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:39:49.229137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:49.229759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:49.237159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:49.237742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:49.238283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:49.239086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:49.239659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:49.240399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:49.412387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:49.421862 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f31025a-b19b-45d0-8c0f-db543d10974a tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1503 microversion: 2.1 time: 0.197220 Sep 16 14:39:49.423221 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3053/6122] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:49 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:50.089726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:50.090580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:50.092728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:50.093692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:50.102243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:50.102776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:50.103400 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:50.104108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:50.104560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:50.104972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:50.338109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:50.355143 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-980e906a-0704-407c-9edc-36bbb120abcb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.268578 Sep 16 14:39:50.373955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3070/6123] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:50 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:50.449621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:50.450435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:50.457778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:50.458629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:50.459310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:50.460233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:50.460908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:50.461567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:50.643501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:50.661477 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-799e5320-2665-459c-9b07-abcb28fff75f tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1503 microversion: 2.1 time: 0.216377 Sep 16 14:39:50.663951 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3054/6124] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:50 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:51.384749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:51.386053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:51.393481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:51.394190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:51.394877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:51.395824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:51.396478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:51.397101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:51.662707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-52f5be46-116d-4ecb-8e5c-49b28c616e30 req-37badfac-51eb-4b9d-9620-3376f9398768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4317a62e-adc9-4bf5-8dea-7b79eecedaf5", "name": "network-vif-deleted", "tag": "f7e76a6a-1355-4df9-be76-2a9973423df6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:51.663227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:51.672194 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3f3dce51-d569-4f8f-b6d5-4485f932f3f0 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.292322 Sep 16 14:39:51.673632 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3071/6125] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:51 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:51.681199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-52f5be46-116d-4ecb-8e5c-49b28c616e30 req-37badfac-51eb-4b9d-9620-3376f9398768 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:51.681199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-52f5be46-116d-4ecb-8e5c-49b28c616e30 req-37badfac-51eb-4b9d-9620-3376f9398768 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:51.681448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-52f5be46-116d-4ecb-8e5c-49b28c616e30 req-37badfac-51eb-4b9d-9620-3376f9398768 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:51.687603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:51.688788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:51.695382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:51.696759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:51.697443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:51.698791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:51.699346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:51.699994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:51.718741 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-52f5be46-116d-4ecb-8e5c-49b28c616e30 req-37badfac-51eb-4b9d-9620-3376f9398768 service nova] Creating event network-vif-deleted:f7e76a6a-1355-4df9-be76-2a9973423df6 for instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 on n-h1-858129-2 Sep 16 14:39:51.741397 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-52f5be46-116d-4ecb-8e5c-49b28c616e30 req-37badfac-51eb-4b9d-9620-3376f9398768 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084103 Sep 16 14:39:51.742370 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3055/6126] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:51.782455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ff94171544f86ae8ec644619ec9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a7d26d621f44e28dee868516a6bebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:51.793489 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80aee3f9-1ca4-4ba7-9d7a-f44296ef8470 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 200 len: 1461 microversion: 2.1 time: 0.110279 Sep 16 14:39:51.806702 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3072/6127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:51 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 1461 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:52.014265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-fe07e298-d407-458e-8ee7-8e45650c1883 req-ff3786b5-3747-49be-9dbd-76ecef3cc51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7102b24-9a70-4b86-a37b-ddae02e2e5b6", "name": "network-vif-plugged", "status": "completed", "tag": "b1ea140c-a1d5-40db-add5-470c4ee619bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:52.025692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fe07e298-d407-458e-8ee7-8e45650c1883 req-ff3786b5-3747-49be-9dbd-76ecef3cc51a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:52.026318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fe07e298-d407-458e-8ee7-8e45650c1883 req-ff3786b5-3747-49be-9dbd-76ecef3cc51a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:52.027036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-fe07e298-d407-458e-8ee7-8e45650c1883 req-ff3786b5-3747-49be-9dbd-76ecef3cc51a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:52.048490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-fe07e298-d407-458e-8ee7-8e45650c1883 req-ff3786b5-3747-49be-9dbd-76ecef3cc51a service nova] Creating event network-vif-plugged:b1ea140c-a1d5-40db-add5-470c4ee619bc for instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 on n-h2-858129-2 Sep 16 14:39:52.059203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-fe07e298-d407-458e-8ee7-8e45650c1883 req-ff3786b5-3747-49be-9dbd-76ecef3cc51a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049649 Sep 16 14:39:52.060371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3056/6128] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:39:52.701435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:52.702859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:52.710179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:52.710720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:52.711172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:52.711941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:52.712397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:52.712819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:52.819470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:52.820229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] [instance: 4317a62e-adc9-4bf5-8dea-7b79eecedaf5] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:52.827661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:52.828257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:52.828770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:52.829548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:52.830083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:52.830729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:52.845092 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] HTTP exception thrown: Instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 could not be found. Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Request method failure captured: Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 HTTP/1.1 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIqbiENH-BnyOX-e3dcWxT3Kg0EAUvDwadFLnKVMCTXU7IzhiS02aljIdXS02cyWZml_fUIsfWwPfSvYgo5Ptt7KRpyElcdg2PMWeSpIomWEo4PWfpslPxhcT2xyx-CBO7XQiNc-aOENK9CVaQlkPXQihXcRLf6y8VBAjNtFrQCBAAE Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: c2a7d26d621f44e28dee868516a6bebb Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-VolumesActionsTest-2143149281 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c2a7d26d621f44e28dee868516a6bebb", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2a7d26d621f44e28dee868516a6bebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c2a7d26d621f44e28dee868516a6bebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c2a7d26d621f44e28dee868516a6bebb"}]}] Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-VolumesActionsTest-2143149281 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: c2a7d26d621f44e28dee868516a6bebb Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-VolumesActionsTest-2143149281 Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-VolumesActionsTest-2143149281-project Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: f52ff94171544f86ae8ec644619ec9df Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-VolumesActionsTest-2143149281-project Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 could not be found. Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '4317a62e-adc9-4bf5-8dea-7b79eecedaf5'} Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 could not be found. Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 could not be found. Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:39:52.846826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 could not be found. Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] Returning 404 to user: Instance 4317a62e-adc9-4bf5-8dea-7b79eecedaf5 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:39:52.851452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca2f9200-0d68-4728-935f-c915e151a3d3 tempest-VolumesActionsTest-2143149281 tempest-VolumesActionsTest-2143149281-project] 10.222.0.60 "GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5" status: 404 len: 111 microversion: 2.1 time: 0.034840 Sep 16 14:39:52.858580 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3057/6129] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:52 2022] GET /compute/v2.1/servers/4317a62e-adc9-4bf5-8dea-7b79eecedaf5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:39:53.008445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:53.022587 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e927f5c-6903-4f0e-a3ad-0830c059a730 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1469 microversion: 2.1 time: 0.326558 Sep 16 14:39:53.023538 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3073/6130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:52 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:54.047515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:54.048132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:54.057960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:54.064258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:54.064741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:54.065535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:54.065998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:54.066643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:54.346945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:54.357506 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3fd90e26-318f-4588-866f-62c7d93d4e0b tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1640 microversion: 2.1 time: 0.313700 Sep 16 14:39:54.366928 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3058/6131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:54 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1640 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:54.380377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:54.380995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:54.389268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:54.389824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:54.390244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:54.390980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:54.391449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:54.391857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:54.653914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:39:54.674875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:54.679357 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd64f05c-0d71-46ab-a557-4c2e9fdb6f80 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1640 microversion: 2.1 time: 0.302543 Sep 16 14:39:54.699030 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3074/6132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:54 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1640 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:39:54.702466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:39:54.710562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:39:54.743987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:54.744988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:54.745559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:54.748793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:54.753156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:54.753994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:55.240685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:39:55.244940 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e725f412-412d-496c-b229-8f1c8e980c3d tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1791 microversion: 2.1 time: 0.546569 Sep 16 14:39:55.245564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3059/6133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:39:54 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1791 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:39:58.351460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e63f33ba-1806-4a38-9978-f4264241b83a req-8c4c9c5f-2be2-441e-ab7d-f7f4436611ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7102b24-9a70-4b86-a37b-ddae02e2e5b6", "tag": "b1ea140c-a1d5-40db-add5-470c4ee619bc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:39:58.375633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e63f33ba-1806-4a38-9978-f4264241b83a req-8c4c9c5f-2be2-441e-ab7d-f7f4436611ea service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:39:58.376135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e63f33ba-1806-4a38-9978-f4264241b83a req-8c4c9c5f-2be2-441e-ab7d-f7f4436611ea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:39:58.376569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e63f33ba-1806-4a38-9978-f4264241b83a req-8c4c9c5f-2be2-441e-ab7d-f7f4436611ea service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:39:58.428646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e63f33ba-1806-4a38-9978-f4264241b83a req-8c4c9c5f-2be2-441e-ab7d-f7f4436611ea service nova] Creating event network-changed:b1ea140c-a1d5-40db-add5-470c4ee619bc for instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 on n-h2-858129-2 Sep 16 14:39:58.446943 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e63f33ba-1806-4a38-9978-f4264241b83a req-8c4c9c5f-2be2-441e-ab7d-f7f4436611ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104975 Sep 16 14:39:58.447566 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3075/6134] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:40:01.472358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:01.473143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:01.481003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:01.481884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:01.482328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:01.483254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:01.483988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:01.484563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:01.651748 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8bce06b4-47a1-45ba-9482-a277fb1dd882 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1833 microversion: 2.1 time: 0.183803 Sep 16 14:40:01.667640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3060/6135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:01 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1833 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:03.366280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-71a3397e-8465-4f5f-94d0-cfc993506be4 req-8d573e51-ab17-4324-b5f7-88d2e613c4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:03.369544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:03.370250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:03.393286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:03.393286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:03.393286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:03.393286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:03.393286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:03.399003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-71a3397e-8465-4f5f-94d0-cfc993506be4 req-8d573e51-ab17-4324-b5f7-88d2e613c4f2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:03.399494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-71a3397e-8465-4f5f-94d0-cfc993506be4 req-8d573e51-ab17-4324-b5f7-88d2e613c4f2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:03.402215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:03.402783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-71a3397e-8465-4f5f-94d0-cfc993506be4 req-8d573e51-ab17-4324-b5f7-88d2e613c4f2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:03.448625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-71a3397e-8465-4f5f-94d0-cfc993506be4 req-8d573e51-ab17-4324-b5f7-88d2e613c4f2 service nova] Creating event network-changed:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h2-858129-2 Sep 16 14:40:03.474161 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-71a3397e-8465-4f5f-94d0-cfc993506be4 req-8d573e51-ab17-4324-b5f7-88d2e613c4f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111350 Sep 16 14:40:03.478656 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3061/6136] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:40:03.487413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:40:03.746726 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7defb509-6d21-486a-9656-4bf586bbc961 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 204 len: 0 microversion: 2.1 time: 0.390348 Sep 16 14:40:03.750932 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3076/6137] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:40:03 2022] DELETE /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:40:03.758219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:03.759414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:03.767462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:03.767967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:03.768417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:03.769366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:03.769830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:03.770445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:03.952167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:03.986805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c7b2754-9343-4b6f-bd03-c0b831f570ea tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1688 microversion: 2.1 time: 0.232268 Sep 16 14:40:04.005993 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3062/6138] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:03 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:05.030698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:05.031398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:05.041596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:05.042084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:05.042554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:05.043259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:05.043709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:05.044128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:05.524078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:05.560194 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf181c6d-40b2-4338-804e-bd277432ee51 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1688 microversion: 2.1 time: 0.533944 Sep 16 14:40:05.564374 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3077/6139] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:05 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1688 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:06.514831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-511041c9-b670-48c5-b144-a83b6dff88b1 req-27a32db0-fd4b-4f66-8fff-2d0d147033d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086e7a05-6719-44f2-91cd-81fc5ce956e3", "name": "network-vif-deleted", "tag": "81dc7ab2-c3c5-46d3-b1f3-542c963374ff"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:06.530434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-511041c9-b670-48c5-b144-a83b6dff88b1 req-27a32db0-fd4b-4f66-8fff-2d0d147033d7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:06.531503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-511041c9-b670-48c5-b144-a83b6dff88b1 req-27a32db0-fd4b-4f66-8fff-2d0d147033d7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:06.533389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-511041c9-b670-48c5-b144-a83b6dff88b1 req-27a32db0-fd4b-4f66-8fff-2d0d147033d7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:06.550709 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-511041c9-b670-48c5-b144-a83b6dff88b1 req-27a32db0-fd4b-4f66-8fff-2d0d147033d7 service nova] Creating event network-vif-deleted:81dc7ab2-c3c5-46d3-b1f3-542c963374ff for instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 on n-h2-858129-2 Sep 16 14:40:06.559195 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-511041c9-b670-48c5-b144-a83b6dff88b1 req-27a32db0-fd4b-4f66-8fff-2d0d147033d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048312 Sep 16 14:40:06.559822 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3063/6140] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:40:06.596962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:06.597750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:06.605134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:06.605995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:06.606638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:06.607579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:06.608135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:06.609000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:06.692422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:06.700958 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1444963d-5944-4696-a8a6-0a4272d43eae tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 200 len: 1501 microversion: 2.1 time: 0.110441 Sep 16 14:40:06.701559 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3078/6141] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:06 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 1501 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:07.725682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:07.726485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 086e7a05-6719-44f2-91cd-81fc5ce956e3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:07.734313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:07.735087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:07.735570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:07.736299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:07.736959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:07.737570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:07.752225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] HTTP exception thrown: Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 could not be found. Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Request method failure captured: Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 HTTP/1.1 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIntDKRZ4QqUPjM5AB-8_Gwg-dOv23461hiXyb_tXnwb5dvj9M0pQQqn0sQjUMlAyiTUssIlJMZkO9pWU44eRrFMjR0bpaXHP-8S_1X0DuKcmEy4bYZQYoZG4OQyOrunKl4SFLWOj5xXkGXRWINY5Q5rucW9wVD8Fojj3TAMYGSZis8 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9da7c684cd0c42e1904ea60b02e60465", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}] Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ccf53133b4d94387b8bb277f44c5f780 Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 could not be found. Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '086e7a05-6719-44f2-91cd-81fc5ce956e3'} Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 could not be found. Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 could not be found. Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:40:07.753927 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 could not be found. Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Returning 404 to user: Instance 086e7a05-6719-44f2-91cd-81fc5ce956e3 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a7c9dfc-e43a-4924-9994-b228b3b46b01 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3" status: 404 len: 111 microversion: 2.1 time: 0.033965 Sep 16 14:40:07.760552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3064/6142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:07 2022] GET /compute/v2.1/servers/086e7a05-6719-44f2-91cd-81fc5ce956e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:40:13.916344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-960e7c4d-aba5-4e86-af2b-bd3dfe20e071 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '.version_select at 0x7f724c722310>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:13.954248 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-960e7c4d-aba5-4e86-af2b-bd3dfe20e071 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-823601188" status: 202 len: 0 microversion: 2.1 time: 0.045984 Sep 16 14:40:13.955704 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3079/6143] 10.222.0.60 () {58 vars in 1281 bytes} [Fri Sep 16 14:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-823601188 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:40:14.003145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d2100cf-314c-458c-b95c-68bd283401eb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: .version_select at 0x7f72516919d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1279406571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAjkIfQs8p82H9Wl/76OZi6tiWX3rRtj3advH/mSWB9BFLWRAdXCfRoGyV9yra2BjMVLWMJPZnyUBuCOVVgGi3iFxt3p7nYUzlVBFo7UX1XaKh2F47izU9wVMpVxEXUUw=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:14.026094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7d2100cf-314c-458c-b95c-68bd283401eb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:40:14.032496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7d2100cf-314c-458c-b95c-68bd283401eb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:40:14.076869 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d2100cf-314c-458c-b95c-68bd283401eb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.079561 Sep 16 14:40:14.089373 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3065/6144] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:40:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:40:25.592986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:25.593856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:25.599304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1389929584", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "e96eb925-dc84-4d8b-a852-aa26c5284c9c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1279406571", "security_groups": [{"name": "tempest-secgroup-smoke-1971572327"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:25.836635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] validate_networks() for [('e96eb925-dc84-4d8b-a852-aa26c5284c9c', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:40:26.688326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:40:26.688998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:40:26.689327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:40:26.689802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:40:26.690220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:40:26.702273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:26.703054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:26.703744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:26.704831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:26.706542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:26.707168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:26.745423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:40:26.752535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:40:26.793051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:40:26.795961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:40:26.857584 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5f0ce59c-7971-4c50-8cf2-86c29e362f4b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.266410 Sep 16 14:40:26.864512 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3080/6145] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:40:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:40:26.871421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a8cb9d7-9925-4851-8abf-b1410d2447b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:26.872061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a8cb9d7-9925-4851-8abf-b1410d2447b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:26.882793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=18 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:26.883630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:26.884341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:26.986487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a8cb9d7-9925-4851-8abf-b1410d2447b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:26.994861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a8cb9d7-9925-4851-8abf-b1410d2447b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1267 microversion: 2.1 time: 0.128356 Sep 16 14:40:26.996144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3066/6146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:26 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:28.025065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:28.025735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:28.051728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:28.052246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:28.055941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:28.056767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:28.057245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:28.057679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:28.204533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:28.218755 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7ac0cb2-7f10-4e67-81b5-fd59ca8c344c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1271 microversion: 2.1 time: 0.200933 Sep 16 14:40:28.234645 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3081/6147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:28 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:29.244605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:29.245320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:29.269394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:29.269943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:29.270759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:29.271508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:29.274636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:29.275123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:29.488377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:29.505880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ef9c112-dadb-43a0-8551-8de3dfcac649 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1337 microversion: 2.1 time: 0.267629 Sep 16 14:40:29.508313 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3067/6148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:29 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1337 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:30.537625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:30.539438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:30.557173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:30.558581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:30.560383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:30.562312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:30.563077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:30.563694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:30.756095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:30.776117 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be9e34c7-e3c7-48ce-a83d-4a7b5286bde3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1325 microversion: 2.1 time: 0.244955 Sep 16 14:40:30.792019 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3082/6149] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:30 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:31.815413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:31.823881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:31.839087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:31.842059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:31.842729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:31.843716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:31.845142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:31.847908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:32.181384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:32.191425 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e25dafd-4aa4-4167-9148-a531d90d53a6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1393 microversion: 2.1 time: 0.382842 Sep 16 14:40:32.192736 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3068/6150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:31 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1393 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:40:32.899888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-f1081152-5462-4be4-ae34-9c2116af1aee req-1bc6c9f4-9705-4299-9287-f410e86265d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:32.926535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f1081152-5462-4be4-ae34-9c2116af1aee req-1bc6c9f4-9705-4299-9287-f410e86265d7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:32.927391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f1081152-5462-4be4-ae34-9c2116af1aee req-1bc6c9f4-9705-4299-9287-f410e86265d7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:32.928054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-f1081152-5462-4be4-ae34-9c2116af1aee req-1bc6c9f4-9705-4299-9287-f410e86265d7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:32.942028 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-f1081152-5462-4be4-ae34-9c2116af1aee req-1bc6c9f4-9705-4299-9287-f410e86265d7 service nova] Creating event network-changed:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:40:32.948755 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-f1081152-5462-4be4-ae34-9c2116af1aee req-1bc6c9f4-9705-4299-9287-f410e86265d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358912 Sep 16 14:40:32.949891 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3083/6151] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:40:33.216575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:33.217169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:33.225277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:33.225773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:33.226445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:33.227171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:33.227632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:33.228290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:33.393243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:33.402358 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ce6b0bb-e29e-4b58-8efd-e694086022b8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1393 microversion: 2.1 time: 0.189731 Sep 16 14:40:33.403184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3069/6152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:33 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:34.433300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:34.434349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:34.453882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:34.454862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:34.457431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:34.459216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:34.459902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:34.460478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:34.672599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:34.682777 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-23013bdf-44d8-4842-8a7d-4b8a1dbfec7b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1393 microversion: 2.1 time: 0.256517 Sep 16 14:40:34.685742 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3084/6153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:34 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:40:35.710266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:35.712327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:35.728230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:35.729119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:35.729811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:35.730680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:35.731267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:35.734014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:35.999682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:36.008374 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5730ee75-7f08-46a0-818f-6b013b53ac36 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1393 microversion: 2.1 time: 0.303588 Sep 16 14:40:36.024559 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3070/6154] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:35 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1393 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:37.036202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:37.036835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:37.041248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:37.042783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:37.051630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:37.052491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:37.053764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:37.062842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:37.063682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:37.064334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:37.325557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:40:37.428433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:37.438707 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ea7ac020-c502-4603-92ad-a121fe643b98 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1393 microversion: 2.1 time: 0.410573 Sep 16 14:40:37.450776 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3085/6155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:37 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1393 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:37.518828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-27c0097b-0b7a-496b-b2e4-fda7526dae4a req-e6ce3550-e05c-460e-8635-4a49f94d8172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "name": "network-vif-plugged", "status": "completed", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:37.534172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-27c0097b-0b7a-496b-b2e4-fda7526dae4a req-e6ce3550-e05c-460e-8635-4a49f94d8172 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:37.535438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-27c0097b-0b7a-496b-b2e4-fda7526dae4a req-e6ce3550-e05c-460e-8635-4a49f94d8172 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:37.536122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-27c0097b-0b7a-496b-b2e4-fda7526dae4a req-e6ce3550-e05c-460e-8635-4a49f94d8172 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:37.556859 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-27c0097b-0b7a-496b-b2e4-fda7526dae4a req-e6ce3550-e05c-460e-8635-4a49f94d8172 service nova] Creating event network-vif-plugged:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:40:37.562571 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-27c0097b-0b7a-496b-b2e4-fda7526dae4a req-e6ce3550-e05c-460e-8635-4a49f94d8172 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244962 Sep 16 14:40:37.570045 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3071/6156] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:40:38.464363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:38.465452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:38.475616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:38.477095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:38.477863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:38.478978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:38.479790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:38.481030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:38.699443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:38.709039 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c044952-8d00-41e2-8f99-ea111b27d7b2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1393 microversion: 2.1 time: 0.249873 Sep 16 14:40:38.709988 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3086/6157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:38 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1393 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:39.737556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:39.740810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:39.748726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:39.749512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:39.749960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:39.750702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:39.751331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:39.751774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:40.033495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:40.047319 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f2a93cf5-bfcc-4eed-be7a-a514ea37eaa7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1565 microversion: 2.1 time: 0.316528 Sep 16 14:40:40.064185 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3072/6158] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:39 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1565 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:40:40.078811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:40.079532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:40.088166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:40.088775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:40.089290 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:40.090073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:40.090647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:40.091143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:40.351814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:40.365096 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ca2dda7b-69dd-40bd-a565-50e5cfe05dc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1565 microversion: 2.1 time: 0.290109 Sep 16 14:40:40.367212 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3087/6159] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:40 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1565 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:40:43.372177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:40:43.372820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:40:43.375636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b79c1f1c-def6-42d5-bf89-073f29de4c50 req-2285262d-8917-4935-a8e9-926083a2d254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:40:43.385588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:43.386091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:43.386574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:43.387342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:43.387743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:43.390508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:43.393257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b79c1f1c-def6-42d5-bf89-073f29de4c50 req-2285262d-8917-4935-a8e9-926083a2d254 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:40:43.393749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b79c1f1c-def6-42d5-bf89-073f29de4c50 req-2285262d-8917-4935-a8e9-926083a2d254 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:40:43.394195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b79c1f1c-def6-42d5-bf89-073f29de4c50 req-2285262d-8917-4935-a8e9-926083a2d254 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:40:43.413301 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b79c1f1c-def6-42d5-bf89-073f29de4c50 req-2285262d-8917-4935-a8e9-926083a2d254 service nova] Creating event network-changed:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:40:43.434339 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b79c1f1c-def6-42d5-bf89-073f29de4c50 req-2285262d-8917-4935-a8e9-926083a2d254 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054054 Sep 16 14:40:43.435632 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3088/6160] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:40:43.813845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:40:43.824126 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24c9f977-a9d5-4223-8aba-d95e977697e9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1565 microversion: 2.1 time: 0.454249 Sep 16 14:40:43.826915 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3073/6161] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:40:43 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1565 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:04.905680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:04.906685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=42 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:05.154846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:05.155743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:05.167434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:05.168385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:05.168596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:05.173048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:05.173048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:05.173048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:05.197303 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e328a7e0-b505-42c0-9052-078194d8528c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/ips" status: 200 len: 148 microversion: 2.1 time: 0.293943 Sep 16 14:41:05.198218 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3089/6162] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:41:04 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/ips => generated 148 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:07.965634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07c9ae96-8853-471c-af49-99fd5af86146"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:07.968926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:07.978229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=18 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:07.980844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=38 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:07.988917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:08.002874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:08.007770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:08.010876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:08.011817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:08.012641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:08.505573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-960282f7-921d-4ba6-8920-7cec85895732 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544014 Sep 16 14:41:08.507377 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3074/6163] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:41:07 2022] POST /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:14.579068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:14.581367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:14.589368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:14.589861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:14.590381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:14.591224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:14.591683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:14.592100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:14.669607 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06ae6693-5110-4f9d-ac90-91940ffb8648 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action" status: 200 len: 24560 microversion: 2.1 time: 0.094631 Sep 16 14:41:14.671205 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3090/6164] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:41:14 2022] POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action => generated 24560 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:41:22.398998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07c9ae96-8853-471c-af49-99fd5af86146"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:22.402306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:22.413265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:22.414071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:22.421682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:22.422182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:22.422900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:22.423788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:22.424406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:22.425060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:22.611316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Invalid volume: volume 07c9ae96-8853-471c-af49-99fd5af86146 is already attached to instances: ff33b64b-2980-407e-a2ce-d1277edd008b Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments HTTP/1.1 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 74 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: {"volumeAttachment": {"volumeId": "07c9ae96-8853-471c-af49-99fd5af86146"}} Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid volume: volume 07c9ae96-8853-471c-af49-99fd5af86146 is already attached to instances: ff33b64b-2980-407e-a2ce-d1277edd008b Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': 'ff33b64b-2980-407e-a2ce-d1277edd008b', 'body': {'volumeAttachment': {'volumeId': '07c9ae96-8853-471c-af49-99fd5af86146'}}} Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 07c9ae96-8853-471c-af49-99fd5af86146 is already attached to instances: ff33b64b-2980-407e-a2ce-d1277edd008b Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:41:22.619440 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 07c9ae96-8853-471c-af49-99fd5af86146 is already attached to instances: ff33b64b-2980-407e-a2ce-d1277edd008b Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 07c9ae96-8853-471c-af49-99fd5af86146 is already attached to instances: ff33b64b-2980-407e-a2ce-d1277edd008b Sep 16 14:41:22.624165 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:22.628876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 400 to user: Invalid volume: volume 07c9ae96-8853-471c-af49-99fd5af86146 is already attached to instances: ff33b64b-2980-407e-a2ce-d1277edd008b {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:41:22.630005 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-64fd3ac7-c96d-4e87-920d-776534c06ced tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.239340 Sep 16 14:41:22.631217 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3075/6165] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:41:22 2022] POST /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 174 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 14:41:22.753485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:22.754041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:22.764006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:22.765238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:22.766889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:22.767963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:22.768723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:22.769878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:22.997441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'services' on Instance uuid ff33b64b-2980-407e-a2ce-d1277edd008b {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:41:23.177550 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3894677-0e96-421d-b982-9562b8b8061d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments/07c9ae96-8853-471c-af49-99fd5af86146" status: 202 len: 0 microversion: 2.1 time: 0.429109 Sep 16 14:41:23.178440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3091/6166] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:41:22 2022] DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments/07c9ae96-8853-471c-af49-99fd5af86146 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:41:23.192126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:23.196727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:23.233737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:23.237070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:23.238321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:23.242502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:23.245304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:23.246084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:23.376683 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc34bf92-724f-490b-8dce-48507cb9f2e5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185351 Sep 16 14:41:23.380138 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3076/6167] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:23 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:24.397875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:24.400806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:24.417201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:24.419117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:24.420949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:24.421862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:24.424783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:24.425402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:24.539525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1645c86f-a82f-429e-b8bf-ac55faf77e3e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147475 Sep 16 14:41:24.542060 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3092/6168] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:24 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:25.258691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-727784793", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "205ec06b-c64a-4071-af20-e89db49f0fee"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1057552017", "security_groups": []}, "os:scheduler_hints": {"different_host": ["e7102b24-9a70-4b86-a37b-ddae02e2e5b6"]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:25.409883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] validate_networks() for [('205ec06b-c64a-4071-af20-e89db49f0fee', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:41:25.555827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:25.558726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:25.573244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:25.573737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:25.578714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:25.579620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:25.580260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:25.580868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:25.675169 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-94bcf5c9-2fb7-409f-b16e-b228b795fe44 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125166 Sep 16 14:41:25.682860 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3093/6169] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:25 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:26.688029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:26.691384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:26.728140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:26.735093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:26.735861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:26.738546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:26.739279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:26.739960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:26.863342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:41:26.864305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:41:26.864982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:41:26.865958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:41:26.866579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:41:26.880022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16354249-bf0f-4116-ab42-7707a06f0476 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190202 Sep 16 14:41:26.881280 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3094/6170] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:26 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:26.896779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:26.897284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:26.897727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:26.898527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:26.899076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:26.899397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:26.985578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Getting quotas for project e6ba48e463ee401cad1876d9ba4c4d0d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:41:27.006045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Getting quotas for user 16cad71b03f84b03a95aa191eef3ae8f and project e6ba48e463ee401cad1876d9ba4c4d0d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:41:27.063728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:41:27.076316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:41:27.171832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7704853d-306b-4382-aec7-7a8c7874e145 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.916178 Sep 16 14:41:27.176501 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3077/6171] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:41:25 2022] POST /compute/v2.1/servers => generated 361 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:41:27.199665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-762074ec-91ff-4b2d-bf35-71b7c3b35f50 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:27.200586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-762074ec-91ff-4b2d-bf35-71b7c3b35f50 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:27.307477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-762074ec-91ff-4b2d-bf35-71b7c3b35f50 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:27.323340 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-762074ec-91ff-4b2d-bf35-71b7c3b35f50 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1241 microversion: 2.1 time: 0.131127 Sep 16 14:41:27.345486 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3095/6172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:27 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:27.893864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:27.896221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:27.923329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:27.923845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:27.924727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:27.929255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:27.934625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:27.935172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:27.999338 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-307351ff-1110-42f8-8c36-84dbf8e9147d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109915 Sep 16 14:41:28.004964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3078/6173] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:27 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:28.360555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e1dc7682-a8fc-4ada-a765-2c8768f683aa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:28.361171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e1dc7682-a8fc-4ada-a765-2c8768f683aa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:28.488844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e1dc7682-a8fc-4ada-a765-2c8768f683aa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:28.497304 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e1dc7682-a8fc-4ada-a765-2c8768f683aa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1241 microversion: 2.1 time: 0.141580 Sep 16 14:41:28.497897 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3096/6174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:28 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:29.012644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:29.018857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:29.042203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:29.044460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:29.045221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:29.049145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:29.051135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:29.052168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:29.128818 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0ab70935-6e11-461d-8edd-6b30f1f77678 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120236 Sep 16 14:41:29.130010 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3079/6175] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:29 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:29.522670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:29.522670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:29.546498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:29.547000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:29.547443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:29.556155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:29.557105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:29.557724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:29.676657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:29.687542 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f1b8375-4e62-4eee-9d3c-372f5382eaa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1293 microversion: 2.1 time: 0.170778 Sep 16 14:41:29.688532 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3097/6176] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:29 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:30.141651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:30.160178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:30.196946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:30.200574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:30.203814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:30.205104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:30.206445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:30.217284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:30.341349 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-600b2480-d985-4409-bcbd-4fc79e869e4c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203702 Sep 16 14:41:30.359514 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3080/6177] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:30 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:30.716000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:30.717449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:30.734006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:30.734959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:30.735629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:30.736848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:30.738681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:30.739361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:30.918094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:30.931583 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-64812fec-5688-4ace-bb3c-f3a3e3c478a8 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.221893 Sep 16 14:41:30.934325 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3098/6178] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:30 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:31.357571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:31.360003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:31.379698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:31.380140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:31.380612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:31.381325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:31.381794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:31.382234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:31.446159 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3cb9147-3979-4d54-a51b-354e1c02668f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092738 Sep 16 14:41:31.447002 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3081/6179] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:31 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:31.978039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:31.979607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:31.997457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:31.998343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:31.998981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:32.003976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:32.005465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:32.006100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:32.462240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:32.465182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:32.495148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:32.495148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:32.495420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:32.496105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:32.496569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:32.497011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:32.585156 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b9f9b1d-058c-4080-936e-8731f20a0d75 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128079 Sep 16 14:41:32.590104 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3082/6180] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:32 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:41:32.766596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:32.791300 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4b55739d-3d6f-41dd-a333-d6c579e8a0fd tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.826175 Sep 16 14:41:32.802299 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3099/6181] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:31 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:33.380128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-04dccc17-37b6-46bb-866f-7beff528c00f req-58df5a50-18ef-4c3b-aeeb-f91abda816ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92aa898e-147f-4ebf-80ec-2ca4c60fe5f9", "tag": "5e34b87c-a859-4cbe-a4b1-f08bab519725"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:33.399139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-04dccc17-37b6-46bb-866f-7beff528c00f req-58df5a50-18ef-4c3b-aeeb-f91abda816ee service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:33.399633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-04dccc17-37b6-46bb-866f-7beff528c00f req-58df5a50-18ef-4c3b-aeeb-f91abda816ee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:33.400370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-04dccc17-37b6-46bb-866f-7beff528c00f req-58df5a50-18ef-4c3b-aeeb-f91abda816ee service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:33.415090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-04dccc17-37b6-46bb-866f-7beff528c00f req-58df5a50-18ef-4c3b-aeeb-f91abda816ee service nova] Creating event network-changed:5e34b87c-a859-4cbe-a4b1-f08bab519725 for instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 on n-h1-858129-2 Sep 16 14:41:33.423404 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-04dccc17-37b6-46bb-866f-7beff528c00f req-58df5a50-18ef-4c3b-aeeb-f91abda816ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255492 Sep 16 14:41:33.425150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3083/6182] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:33.598456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:33.601465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:33.610312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:33.611209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:33.611876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:33.612806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:33.613944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:33.614643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:33.655468 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d45d99bf-4356-4ad6-b4c7-20bd2a674144 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061573 Sep 16 14:41:33.656257 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3100/6183] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:33 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:33.844636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:33.846567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:33.858199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:33.859072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:33.859577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:33.860495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:33.860934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:33.862607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:33.990014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:33.998904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a66c528-6dd4-4501-ac37-f9b0f33acd7f tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.161719 Sep 16 14:41:33.999494 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3084/6184] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:33 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:34.668926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:34.671395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:34.682799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:34.683328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:34.683771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:34.684488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:34.684941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:34.685958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:34.723801 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7cdf50f-fcf5-4506-8c4f-5dd02a6dfd65 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059315 Sep 16 14:41:34.729674 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3101/6185] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:41:34 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:41:34.801087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:34.802441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:34.810339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:34.810921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:34.811951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:34.812482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:34.813124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:34.813823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:34.860490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:41:35.022456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf79b1ca-1001-4c05-83ed-069f01facf43 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 204 len: 0 microversion: 2.1 time: 0.225178 Sep 16 14:41:35.023957 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3085/6186] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:41:34 2022] DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:41:35.031521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:35.032557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:35.035274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:35.035435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=31 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:35.036450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:35.044762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:35.045667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:35.045812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:35.046233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:35.046673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:35.046789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:35.047391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:35.047842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:35.048258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:35.048521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:35.050046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:35.050734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:35.064684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:35.229361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:35.243271 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6be14476-0a59-4655-b883-67ebb24e630d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.213056 Sep 16 14:41:35.244790 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3102/6187] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:35 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:35.300140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:35.309938 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69d18876-9d9c-4850-b67c-a0bd30c76ec7 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1680 microversion: 2.1 time: 0.281607 Sep 16 14:41:35.311124 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3086/6188] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:35 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:36.270607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:36.271789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:36.288096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:36.290639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:36.291476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:36.293988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:36.294942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:36.297702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:36.336431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:36.337065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:36.360315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:36.362028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:36.364618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:36.365591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:36.366364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:36.367557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:36.577044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:36.589679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5100fe0f-963e-4f13-a66e-bf9f1e081c18 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.323996 Sep 16 14:41:36.603340 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3103/6189] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:36 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:36.725184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:36.738078 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d04a63a2-68a8-47be-959e-45a42731c746 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1680 microversion: 2.1 time: 0.408175 Sep 16 14:41:36.738730 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3087/6190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:36 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1680 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:37.618199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:37.619423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:37.635327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:37.637100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:37.642986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:37.644087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:37.647108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:37.647733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:37.769141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:37.770471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:37.780602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:37.783707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:37.793211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:37.793942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:37.795001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:37.795905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:37.796590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:37.797883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:37.854769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:37.863875 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb70e18c-e75f-4bf8-8f93-0e0af32233eb tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.250808 Sep 16 14:41:37.873389 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3104/6191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:37 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:37.937698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:37.954078 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9fa63b8-3856-47c5-891e-37dd092533f2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1613 microversion: 2.1 time: 0.194367 Sep 16 14:41:37.969427 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3088/6192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:37 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1613 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:38.241138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-122f0dd8-1e95-4914-9b4a-be4a8df257a7 req-8b805c44-324a-4697-a8bc-03502ad93355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33b64b-2980-407e-a2ce-d1277edd008b", "name": "network-vif-deleted", "tag": "c30e5ca1-d2d6-4e78-9410-84b46ab67ee5"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:38.255052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-122f0dd8-1e95-4914-9b4a-be4a8df257a7 req-8b805c44-324a-4697-a8bc-03502ad93355 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:38.256260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-122f0dd8-1e95-4914-9b4a-be4a8df257a7 req-8b805c44-324a-4697-a8bc-03502ad93355 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:38.256728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-122f0dd8-1e95-4914-9b4a-be4a8df257a7 req-8b805c44-324a-4697-a8bc-03502ad93355 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:38.298701 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-122f0dd8-1e95-4914-9b4a-be4a8df257a7 req-8b805c44-324a-4697-a8bc-03502ad93355 service nova] Creating event network-vif-deleted:c30e5ca1-d2d6-4e78-9410-84b46ab67ee5 for instance ff33b64b-2980-407e-a2ce-d1277edd008b on n-h2-858129-2 Sep 16 14:41:38.312672 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-122f0dd8-1e95-4914-9b4a-be4a8df257a7 req-8b805c44-324a-4697-a8bc-03502ad93355 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073895 Sep 16 14:41:38.318031 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3105/6193] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:38.906824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:38.909346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:38.927430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:38.930173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:38.930830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:38.933833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:38.937514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:38.939310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:38.983830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:38.985137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:38.987967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:39.016500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:39.021248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:39.021884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:39.023952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:39.024422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:39.024851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:39.167708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:39.168791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:39.171655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:39.172754 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'fault' on Instance uuid ff33b64b-2980-407e-a2ce-d1277edd008b {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:41:39.273301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:39.286145 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf834b08-542a-46f9-a0cc-b230fb4599f3 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 200 len: 1332 microversion: 2.1 time: 0.307512 Sep 16 14:41:39.287110 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3106/6194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:38 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 1332 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:39.329279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:39.348059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2202bc9-4f8d-47e1-a468-9eeecba91fa9 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.444829 Sep 16 14:41:39.350343 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3089/6195] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:38 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:39.575159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-063d12f5-141c-4232-bf6b-df8e3cd509f2 req-3d0dfe23-37ab-4037-a593-4186378bbd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aa898e-147f-4ebf-80ec-2ca4c60fe5f9", "name": "network-vif-plugged", "status": "completed", "tag": "5e34b87c-a859-4cbe-a4b1-f08bab519725"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:39.599717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-063d12f5-141c-4232-bf6b-df8e3cd509f2 req-3d0dfe23-37ab-4037-a593-4186378bbd10 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:39.600438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-063d12f5-141c-4232-bf6b-df8e3cd509f2 req-3d0dfe23-37ab-4037-a593-4186378bbd10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:39.601046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-063d12f5-141c-4232-bf6b-df8e3cd509f2 req-3d0dfe23-37ab-4037-a593-4186378bbd10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:39.632783 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-063d12f5-141c-4232-bf6b-df8e3cd509f2 req-3d0dfe23-37ab-4037-a593-4186378bbd10 service nova] Creating event network-vif-plugged:5e34b87c-a859-4cbe-a4b1-f08bab519725 for instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 on n-h1-858129-2 Sep 16 14:41:39.644898 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-063d12f5-141c-4232-bf6b-df8e3cd509f2 req-3d0dfe23-37ab-4037-a593-4186378bbd10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073923 Sep 16 14:41:39.647804 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3107/6196] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:41:40.312398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:40.313676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:40.324517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:40.325513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:40.326447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:40.327826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:40.328462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:40.329071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:40.365363 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b HTTP/1.1 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ff33b64b-2980-407e-a2ce-d1277edd008b'} Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:41:40.368281 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:41:40.373360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:40.375298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:41:40.376352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1bb84a41-dfec-474d-bbf1-fc9642f89f15 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 404 len: 111 microversion: 2.1 time: 0.068388 Sep 16 14:41:40.379270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:40.380691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:40.381182 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3090/6197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:40 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:41:40.386746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c07dca26-b7b3-4250-b182-b0ad50302567 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '.version_select at 0x7f724d7114c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:40.395200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:40.395856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:40.398996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:40.399987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:40.400688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:40.401231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:40.412387 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c07dca26-b7b3-4250-b182-b0ad50302567 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028460225" status: 202 len: 0 microversion: 2.1 time: 0.029746 Sep 16 14:41:40.413505 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3091/6198] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:41:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028460225 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:41:40.647277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:40.658837 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c3b28d3-6480-419f-8556-870a119c8cd5 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1299 microversion: 2.1 time: 0.289923 Sep 16 14:41:40.662842 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3108/6199] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:40 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:41.384471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-502da871-6ddf-408b-bd47-dd6d4b8ee64f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: .version_select at 0x7f7251691700>, body: {"keypair": {"name": "tempest-keypair-880799976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdhK3Z4xtLslw1B0DtqDNO3YE+BMNJkpipBUOFhvv83hXIHfverGPHAftO9/Pe4JHcmE1XZAEay33FnnJBWt08RIkvdsZHi4cuJm0cngNU5Aaaa37d2OuOnQZz74CGFMw=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:41.430695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-502da871-6ddf-408b-bd47-dd6d4b8ee64f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:41:41.453044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-502da871-6ddf-408b-bd47-dd6d4b8ee64f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:41:41.519953 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-502da871-6ddf-408b-bd47-dd6d4b8ee64f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142759 Sep 16 14:41:41.522883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3092/6200] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:41:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:41.692261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:41.694391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:41.703209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:41.703882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:41.704467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:41.706141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:41.707441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:41.708148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:41.884863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:41.899763 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ff995d2a-5457-4558-abcc-95c5602f8e24 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1472 microversion: 2.1 time: 0.211211 Sep 16 14:41:41.902154 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3109/6201] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:41 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:41.931112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:41.931745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:41.947063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:41.947581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:41.948033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:41.949139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:41.949791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:41.950391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.091494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:42.096786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:42.112028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a178c9a-d295-4fea-be15-cc33fdfb3efa tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1472 microversion: 2.1 time: 0.184690 Sep 16 14:41:42.114271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3093/6202] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:41 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:42.137534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:42.138448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:42.147402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.148342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.149084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.167670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.168174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.170145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.321214 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1078e988-97c2-424d-aa85-08ddca8134ec tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1623 microversion: 2.1 time: 0.187806 Sep 16 14:41:42.322565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3110/6203] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:42 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1623 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:42.348600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:42.349527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:42.358104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.358889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.359508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.360750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.362192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.362893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.630771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1843013-52bd-40bb-bb14-8437c56ad9eb tempest-TestSecurityGroupsBasicOps-1978441497 tempest-TestSecurityGroupsBasicOps-1978441497-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1910 microversion: 2.1 time: 0.288635 Sep 16 14:41:42.632371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3094/6204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:42 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1910 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:42.731305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:42.732354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:42.751017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.751514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.751975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.752682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.753132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.754328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.801429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:41:42.938029 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a2985eca-8f74-46a8-a8a1-49d1cbe8dd4d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "DELETE /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 204 len: 0 microversion: 2.1 time: 0.222891 Sep 16 14:41:42.940513 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3111/6205] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:41:42 2022] DELETE /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:41:42.949056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:42.949686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:42.958881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.959598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.960206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:42.961104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:42.961566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:42.962158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:43.120027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:43.132801 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c37d644-71fa-4932-9848-ade05b93b4a3 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1478 microversion: 2.1 time: 0.187947 Sep 16 14:41:43.143303 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3095/6206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:42 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1478 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:43.480743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-504242644", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c17062a-3bb6-45ab-8062-5725ef0d7c64"}], "security_groups": [{"name": "tempest-securitygroup--1588219283"}], "key_name": "tempest-keypair-880799976", "user_data": "}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:43.621285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] validate_networks() for [('1c17062a-3bb6-45ab-8062-5725ef0d7c64', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:41:44.142340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:41:44.143952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:41:44.144438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:41:44.144857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:41:44.145277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:41:44.159911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:44.161001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:44.161511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:44.161953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:44.162665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:44.162801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:44.163167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:44.163601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:44.172834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:44.173796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:44.174772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:44.175756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:44.176443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:44.177321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:44.205832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:41:44.222267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Getting quotas for user c97bf103a09e4909af4b161222e8a167 and project ca2f19665b6245b796fe6e9d4ef089a0. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:41:44.245879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:41:44.258901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:41:44.331864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:44.351125 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a1474b4c-4fed-4f67-ba3c-015f0ebaed40 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.877309 Sep 16 14:41:44.357558 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87360c94-9640-411e-a568-68cdb546e124 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1478 microversion: 2.1 time: 0.202122 Sep 16 14:41:44.358781 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3096/6207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:44 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1478 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:44.359946 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3112/6208] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:41:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:41:44.371767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d539086-cdf8-4336-a11e-622268d78580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:44.372749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6d539086-cdf8-4336-a11e-622268d78580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:44.507825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6d539086-cdf8-4336-a11e-622268d78580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:44.524484 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d539086-cdf8-4336-a11e-622268d78580 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1240 microversion: 2.1 time: 0.156740 Sep 16 14:41:44.525389 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3097/6209] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:44 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1240 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:45.262615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:45.263244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:45.283093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.283523 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.283968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.284698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.285159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.285593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.381860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:45.383175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:45.401689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.406369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.408936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.409991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.411461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.414010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.682331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:45.699087 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5f3b7290-1ed7-411a-9540-7ab1912cb03d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 200 len: 1478 microversion: 2.1 time: 0.321027 Sep 16 14:41:45.732685 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3098/6210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:45 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:45.738719 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b29dc75f-0ef1-4f8a-bb13-0c5e0e0bc1ee tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1835 microversion: 2.1 time: 0.842010 Sep 16 14:41:45.740480 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3113/6211] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:44 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1835 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:45.754504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-61ceca92-5198-4dca-a233-e39fd6881bb5 req-1fee62ce-c11d-43b9-8fe9-d29bf2a93979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aa898e-147f-4ebf-80ec-2ca4c60fe5f9", "name": "network-vif-deleted", "tag": "5e34b87c-a859-4cbe-a4b1-f08bab519725"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:45.754960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:45.755614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:45.786308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-61ceca92-5198-4dca-a233-e39fd6881bb5 req-1fee62ce-c11d-43b9-8fe9-d29bf2a93979 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.788204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.788660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.789446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-61ceca92-5198-4dca-a233-e39fd6881bb5 req-1fee62ce-c11d-43b9-8fe9-d29bf2a93979 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.790330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-61ceca92-5198-4dca-a233-e39fd6881bb5 req-1fee62ce-c11d-43b9-8fe9-d29bf2a93979 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.792564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.795577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:45.796103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:45.798822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:45.821598 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-61ceca92-5198-4dca-a233-e39fd6881bb5 req-1fee62ce-c11d-43b9-8fe9-d29bf2a93979 service nova] Creating event network-vif-deleted:5e34b87c-a859-4cbe-a4b1-f08bab519725 for instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 on n-h1-858129-2 Sep 16 14:41:45.857603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-61ceca92-5198-4dca-a233-e39fd6881bb5 req-1fee62ce-c11d-43b9-8fe9-d29bf2a93979 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118272 Sep 16 14:41:45.859449 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3099/6212] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:46.045642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:46.056092 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f4bded1-4f74-4770-a9d8-0451f9e4797d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1292 microversion: 2.1 time: 0.313566 Sep 16 14:41:46.063592 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3114/6213] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:45 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1292 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:46.083051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:46.083884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:46.096402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:46.097162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:46.098786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:46.099709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:46.100571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:46.101236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:46.549569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:46.563700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2cb91268-36c6-4767-a0a6-8043a579cec0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1684 microversion: 2.1 time: 0.701592 Sep 16 14:41:46.565357 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3100/6214] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:45 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1684 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:46.718159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:46.720114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:46.729322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:46.735852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:46.737302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:46.747614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:46.748707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:46.749509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:46.751857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:46.752391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:46.755939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:46.756926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:46.759544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:46.760145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:46.764465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:46.765708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:46.825897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] HTTP exception thrown: Instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 could not be found. Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Request method failure captured: Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 HTTP/1.1 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIqY33yWvJwflRg5b_5HKBHzRLJbBPvVb00NXf92QWA8DS7-74Lmn0gAoCRkXa8ny-S6piUlgak-l5lgWVLYUXxQCJz0nX3Rac5QSJbeBVWUrRZbIElCVaSRXOrHLgD5NMixX3FU2yGDB3UvGHU2Nsahkk8vv0tD3Vovgau-zpBnnhA Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6ba48e463ee401cad1876d9ba4c4d0d Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-495718137 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6ba48e463ee401cad1876d9ba4c4d0d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6ba48e463ee401cad1876d9ba4c4d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6ba48e463ee401cad1876d9ba4c4d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6ba48e463ee401cad1876d9ba4c4d0d"}]}] Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestSecurityGroupsBasicOps-495718137 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6ba48e463ee401cad1876d9ba4c4d0d Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-495718137 Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestSecurityGroupsBasicOps-495718137-project Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 16cad71b03f84b03a95aa191eef3ae8f Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestSecurityGroupsBasicOps-495718137-project Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 could not be found. Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '92aa898e-147f-4ebf-80ec-2ca4c60fe5f9'} Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 could not be found. Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 could not be found. Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:41:46.833251 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 could not be found. Sep 16 14:41:46.838367 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:41:46.840638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Returning 404 to user: Instance 92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:41:46.842935 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2cd6d1e-2784-4256-8b17-4a199f8c6e95 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9" status: 404 len: 111 microversion: 2.1 time: 0.111593 Sep 16 14:41:46.845771 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3101/6215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:46 2022] GET /compute/v2.1/servers/92aa898e-147f-4ebf-80ec-2ca4c60fe5f9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:41:46.894029 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-367a9192-9ab1-4973-8bfe-578b873dda53 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action" status: 200 len: 32634 microversion: 2.1 time: 0.181000 Sep 16 14:41:46.895544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3115/6216] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:41:46 2022] POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action => generated 32634 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:41:47.048610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:47.049624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:47.062922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:47.065276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:47.066016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:47.069740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:47.071418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:47.072081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:47.092012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:47.092907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:47.105936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:47.110974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:47.113758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:47.114740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:47.115433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:47.119270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:47.173101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8d2c8645a47a4cffa188319754ba5118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ec1e5f2d53429f8e84a166fe159f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:47.179586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] flavor_id is None. Assuming migration. {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 16 14:41:47.180896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:41:47.453012 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c238ee4-4810-46d5-a582-bbf034032afe tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action" status: 202 len: 0 microversion: 2.1 time: 0.409883 Sep 16 14:41:47.454355 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3102/6217] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:41:47 2022] POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:41:47.466273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:47.467309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:47.484646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:47.485579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:47.486832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:47.487826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:47.492865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:47.493637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:47.548388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:47.558807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3332a61f-810d-4284-b53b-a0d5dda67060 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1298 microversion: 2.1 time: 0.471507 Sep 16 14:41:47.580354 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3116/6218] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:47 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1298 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:48.350094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:48.365146 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a92a1628-939a-4ff9-9af4-42b19335dd3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1693 microversion: 2.1 time: 0.906041 Sep 16 14:41:48.375451 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3103/6219] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:47 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1693 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:48.605941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:48.606900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:48.640840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:48.643356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:48.650205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:48.651282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:48.651916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:48.653511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:49.209062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:49.218197 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7793b79c-ed69-485a-8965-11b862b68c77 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.617437 Sep 16 14:41:49.225780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3117/6220] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:48 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:49.390822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:49.392688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:49.425988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:49.427959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:49.436229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:49.437179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:49.440047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:49.440619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:49.902074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:49.936742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5007cc1-76d2-4b2c-ab67-3f1e52fbb50b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1693 microversion: 2.1 time: 0.548842 Sep 16 14:41:49.936742 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3104/6221] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:49 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1693 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:50.248930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:50.249554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:50.262219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:50.263009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:50.263617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:50.268122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:50.268876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:50.269310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:50.449750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d9cee4c4-5e63-40f3-871b-3964118e23a1 req-d923f185-0a7a-4fa6-a012-bbdd06505300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4addfd-be2a-4280-ac40-553534761192", "tag": "2d6ad625-2821-4ac2-97ba-5c53e76f8951"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:50.473596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:50.478230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d9cee4c4-5e63-40f3-871b-3964118e23a1 req-d923f185-0a7a-4fa6-a012-bbdd06505300 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:50.481089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d9cee4c4-5e63-40f3-871b-3964118e23a1 req-d923f185-0a7a-4fa6-a012-bbdd06505300 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:50.481938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d9cee4c4-5e63-40f3-871b-3964118e23a1 req-d923f185-0a7a-4fa6-a012-bbdd06505300 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:50.515890 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d9cee4c4-5e63-40f3-871b-3964118e23a1 req-d923f185-0a7a-4fa6-a012-bbdd06505300 service nova] Creating event network-changed:2d6ad625-2821-4ac2-97ba-5c53e76f8951 for instance 8a4addfd-be2a-4280-ac40-553534761192 on n-h2-858129-2 Sep 16 14:41:50.539905 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d9cee4c4-5e63-40f3-871b-3964118e23a1 req-d923f185-0a7a-4fa6-a012-bbdd06505300 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093940 Sep 16 14:41:50.541150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3105/6222] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:41:50.784499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:50.795541 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8c56db10-e1f4-4fee-9833-c3482fecee83 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.550272 Sep 16 14:41:50.796820 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3118/6223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:50 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:50.976981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:50.978110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:50.988723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:50.989546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:50.991238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:50.992194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:50.993492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:50.994141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:51.385533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:51.397410 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cb1a2e5-4ad6-4e47-bd33-ba13502555cb tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1693 microversion: 2.1 time: 0.431943 Sep 16 14:41:51.398779 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3106/6224] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:50 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1693 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:51.820171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:51.820950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:51.833244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:51.834920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:51.836619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:51.841497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:51.841983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:51.842440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:51.846135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:52.156738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:52.169701 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53ec25dd-08c5-4da1-a212-2b9b4978653f tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.353056 Sep 16 14:41:52.174329 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3119/6225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:51 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:52.429066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:52.429693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:52.441789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:52.442526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:52.444122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:52.445097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:52.446200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:52.446827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:52.833017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:52.841958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e08d88f-05a2-4b78-8808-b5e409317006 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1693 microversion: 2.1 time: 0.417000 Sep 16 14:41:52.843196 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3107/6226] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:52 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1693 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:53.198379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:53.200031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:53.213898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:53.214387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:53.228685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:53.245874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:53.271461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:53.271461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:53.643501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:53.652662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5d14314-9428-4d40-ae52-bc2296d27438 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.457944 Sep 16 14:41:53.653846 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3120/6227] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:53 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:53.872427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:53.873861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:53.885795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:53.888750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:53.889467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:53.890344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:53.891009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:53.891700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:54.514305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:54.521785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:54.526104 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5a701c0-51a1-4169-bd15-aca40a9a175a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1693 microversion: 2.1 time: 0.659750 Sep 16 14:41:54.535228 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3108/6228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:53 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1693 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:54.678187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:54.681751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:54.696358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:54.703415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:54.709566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:54.710385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:54.711731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:54.712712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:54.713390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:54.713984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:55.171087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:55.207661 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6355737d-606b-4ef4-80d7-6ee7af029bf5 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.533210 Sep 16 14:41:55.236678 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3121/6229] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:54 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:55.575895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:55.578257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:55.600025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:55.600840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:55.601506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:55.604318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:55.606149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:55.607416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:55.858670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:55.876423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17356c63-2bb2-4bbc-ae0a-4ba571f7be1a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1693 microversion: 2.1 time: 0.312924 Sep 16 14:41:55.884480 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3109/6230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:55 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1693 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:56.268489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:56.270383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:56.284032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.285417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.287469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.288617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.289321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.290367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.564226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:56.564845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:56.575376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.576103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.576759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.577449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.578027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.578605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.607837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:56.608814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:41:56.617191 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f3260fb-2625-4378-a426-69b571d319fd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.352864 Sep 16 14:41:56.624620 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3122/6231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:56 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:56.635354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6ab4fd39-a100-488b-87f0-62cb2ba02def req-c72cb1c5-8ced-45cb-9c77-c8132b3b564b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7102b24-9a70-4b86-a37b-ddae02e2e5b6", "tag": "b1ea140c-a1d5-40db-add5-470c4ee619bc"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:56.649803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:41:56.665828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6ab4fd39-a100-488b-87f0-62cb2ba02def req-c72cb1c5-8ced-45cb-9c77-c8132b3b564b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.666345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6ab4fd39-a100-488b-87f0-62cb2ba02def req-c72cb1c5-8ced-45cb-9c77-c8132b3b564b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.668021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6ab4fd39-a100-488b-87f0-62cb2ba02def req-c72cb1c5-8ced-45cb-9c77-c8132b3b564b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.704652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6ab4fd39-a100-488b-87f0-62cb2ba02def req-c72cb1c5-8ced-45cb-9c77-c8132b3b564b service nova] Creating event network-changed:b1ea140c-a1d5-40db-add5-470c4ee619bc for instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 on n-h2-858129-2 Sep 16 14:41:56.720481 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6ab4fd39-a100-488b-87f0-62cb2ba02def req-c72cb1c5-8ced-45cb-9c77-c8132b3b564b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093697 Sep 16 14:41:56.721085 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3123/6232] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:56.734568 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02ed7d86-dfe9-4a99-b534-ce2b32ec5862 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 204 len: 0 microversion: 2.1 time: 0.174572 Sep 16 14:41:56.735913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3110/6233] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:41:56 2022] DELETE /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:41:56.744521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:56.745228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:56.765913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.765913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.765913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.765913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.765913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.765913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.943336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:56.944349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:56.969224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.973851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.974594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:56.976328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:56.977719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:56.979210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:57.072380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:57.101697 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0eabca17-35c7-4cfb-b46a-6bc83b76b63d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1765 microversion: 2.1 time: 0.343699 Sep 16 14:41:57.102705 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3124/6234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:56 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1765 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:57.224699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:57.235498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7020f8ef-a6ea-476a-ac17-a6619a4aa4dd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.328777 Sep 16 14:41:57.236768 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3111/6235] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:56 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:57.650272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:57.654939 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:57.665881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:57.666782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:57.667749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:57.669075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:57.670013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:57.670604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:57.856674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:57.870912 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81a74cdc-6ef5-43fb-944f-b74cbc32beb1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.225974 Sep 16 14:41:57.871948 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3125/6236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:57 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:58.130208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:58.131162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:58.150448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:58.151085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:58.151651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:58.152900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:58.158998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:58.159523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:58.260351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:58.261218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:58.271899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:58.272580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:58.274152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:58.275387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:58.276207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:58.276780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:59.199296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:59.215196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d4ffdfce-9e5c-45df-95c8-56398f16beed tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.953378 Sep 16 14:41:59.216320 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3126/6237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:58 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:41:59.231149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:41:59.234613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:41:59.235685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:59.246884 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ead66bf-6acc-44f3-a275-5dcc073b4d9a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1765 microversion: 2.1 time: 1.121565 Sep 16 14:41:59.252181 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3112/6238] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:58 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1765 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:41:59.253176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:59.254045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:59.254658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:59.255559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:59.256300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:59.256870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:59.257381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-bb779a6a-84d2-4cf0-b49c-7f17332e0caa req-bcb59274-e4a8-418e-b4ae-22af344d01ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4addfd-be2a-4280-ac40-553534761192", "name": "network-vif-plugged", "status": "completed", "tag": "2d6ad625-2821-4ac2-97ba-5c53e76f8951"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:59.282160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bb779a6a-84d2-4cf0-b49c-7f17332e0caa req-bcb59274-e4a8-418e-b4ae-22af344d01ed service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:59.282949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bb779a6a-84d2-4cf0-b49c-7f17332e0caa req-bcb59274-e4a8-418e-b4ae-22af344d01ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:59.283714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bb779a6a-84d2-4cf0-b49c-7f17332e0caa req-bcb59274-e4a8-418e-b4ae-22af344d01ed service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:59.322221 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-bb779a6a-84d2-4cf0-b49c-7f17332e0caa req-bcb59274-e4a8-418e-b4ae-22af344d01ed service nova] Creating event network-vif-plugged:2d6ad625-2821-4ac2-97ba-5c53e76f8951 for instance 8a4addfd-be2a-4280-ac40-553534761192 on n-h2-858129-2 Sep 16 14:41:59.352610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-bb779a6a-84d2-4cf0-b49c-7f17332e0caa req-bcb59274-e4a8-418e-b4ae-22af344d01ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092574 Sep 16 14:41:59.353322 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3113/6239] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:59.446063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a10e9014-28e4-4711-a663-c9457e7ea23e req-c2a428d0-80a4-49a2-9b72-df4be0557451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7102b24-9a70-4b86-a37b-ddae02e2e5b6", "name": "network-vif-deleted", "tag": "b1ea140c-a1d5-40db-add5-470c4ee619bc"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:41:59.490259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a10e9014-28e4-4711-a663-c9457e7ea23e req-c2a428d0-80a4-49a2-9b72-df4be0557451 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:41:59.490792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a10e9014-28e4-4711-a663-c9457e7ea23e req-c2a428d0-80a4-49a2-9b72-df4be0557451 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:41:59.496641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a10e9014-28e4-4711-a663-c9457e7ea23e req-c2a428d0-80a4-49a2-9b72-df4be0557451 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:41:59.526273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a10e9014-28e4-4711-a663-c9457e7ea23e req-c2a428d0-80a4-49a2-9b72-df4be0557451 service nova] Creating event network-vif-deleted:b1ea140c-a1d5-40db-add5-470c4ee619bc for instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 on n-h2-858129-2 Sep 16 14:41:59.573322 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a10e9014-28e4-4711-a663-c9457e7ea23e req-c2a428d0-80a4-49a2-9b72-df4be0557451 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138466 Sep 16 14:41:59.578620 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3114/6240] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:41:59.845281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:41:59.862689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06f111ec-c29f-475a-9560-3ad290556ddd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.645152 Sep 16 14:41:59.863750 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3127/6241] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:41:59 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:00.243079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:00.243840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:00.260610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.261117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.261566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:00.262313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.262806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.271890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:00.281740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:00.310331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:00.324604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.325859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.327626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:00.328592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.329864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.332119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:00.452744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.453141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.456326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:00.459012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lazy-loading 'fault' on Instance uuid e7102b24-9a70-4b86-a37b-ddae02e2e5b6 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:42:00.479310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:00.495369 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c637d9f4-61cf-4a18-a9cb-ef95098743bc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.257103 Sep 16 14:42:00.517643 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3115/6242] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:00 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:00.538999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cad71b03f84b03a95aa191eef3ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ba48e463ee401cad1876d9ba4c4d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:00.549353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1ebef13-8b7e-4868-9e47-5bc52a5f1534 tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 200 len: 1383 microversion: 2.1 time: 0.276037 Sep 16 14:42:00.564223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3128/6243] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:00 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 1383 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:00.886646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:00.887495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:00.895461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.896186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.896948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:00.897880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:00.898568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:00.899308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:01.197422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:01.207010 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99e68aa7-9cbd-4b9e-aac6-30a165feb5d0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1366 microversion: 2.1 time: 0.323608 Sep 16 14:42:01.207828 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3116/6244] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:00 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:01.525186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:01.525807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:01.533504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:01.534187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:01.534822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:01.535728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:01.536352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:01.536945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:01.581775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:01.582659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] [instance: e7102b24-9a70-4b86-a37b-ddae02e2e5b6] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:01.614053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:01.616480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:01.619898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:01.620634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:01.621107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:01.621661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:01.675096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] HTTP exception thrown: Instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 could not be found. Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Request method failure captured: Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 HTTP/1.1 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIqY33yWvJwflRg5b_5HKBHzRLJbBPvVb00NXf92QWA8DS7-74Lmn0gAoCRkXa8ny-S6piUlgak-l5lgWVLYUXxQCJz0nX3Rac5QSJbeBVWUrRZbIElCVaSRXOrHLgD5NMixX3FU2yGDB3UvGHU2Nsahkk8vv0tD3Vovgau-zpBnnhA Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: e6ba48e463ee401cad1876d9ba4c4d0d Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-495718137 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e6ba48e463ee401cad1876d9ba4c4d0d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6ba48e463ee401cad1876d9ba4c4d0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e6ba48e463ee401cad1876d9ba4c4d0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e6ba48e463ee401cad1876d9ba4c4d0d"}]}] Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestSecurityGroupsBasicOps-495718137 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: e6ba48e463ee401cad1876d9ba4c4d0d Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-495718137 Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestSecurityGroupsBasicOps-495718137-project Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 16cad71b03f84b03a95aa191eef3ae8f Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestSecurityGroupsBasicOps-495718137-project Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 could not be found. Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e7102b24-9a70-4b86-a37b-ddae02e2e5b6'} Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 could not be found. Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 could not be found. Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:42:01.680925 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 could not be found. Sep 16 14:42:01.686256 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:42:01.689845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Returning 404 to user: Instance e7102b24-9a70-4b86-a37b-ddae02e2e5b6 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:42:01.691811 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-441e2f92-a1d1-4e7f-885d-1deca18ee09d tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6" status: 404 len: 111 microversion: 2.1 time: 0.115097 Sep 16 14:42:01.692909 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3117/6245] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:01 2022] GET /compute/v2.1/servers/e7102b24-9a70-4b86-a37b-ddae02e2e5b6 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:42:01.799148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:01.807871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8437306a-df27-4685-93a3-97bdff8cf68f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.286500 Sep 16 14:42:01.812297 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3129/6246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:01 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:02.230929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:02.231700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:02.245278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:02.245783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:02.246232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:02.252241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:02.252765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:02.254742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:02.505039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:02.521388 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47017f43-cc85-4a99-842b-bf07835b5c31 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1554 microversion: 2.1 time: 0.294779 Sep 16 14:42:02.523070 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3118/6247] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:02 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:02.549984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:02.550542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:02.561183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:02.561683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:02.564191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:02.564952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:02.565426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:02.566631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:02.727357 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ac5910a1-47d9-401b-af46-23250ab4dadc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181493 Sep 16 14:42:02.728686 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3130/6248] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:42:02 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:42:02.833762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:02.834758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:02.842244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:02.842976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:02.843594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:02.845239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:02.845872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:02.846494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:03.397497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:03.424272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-336867cb-b31a-4a8b-9427-f599ad63f78e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.594343 Sep 16 14:42:03.425200 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3119/6249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:02 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:04.452820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:04.454776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:04.482242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:04.491535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:04.494349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:04.496625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:04.499535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:04.500209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:04.508035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e0328eec-8b86-45f7-9deb-32e898d12530 req-bb558402-ea95-4efc-ac02-0483c95920e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4addfd-be2a-4280-ac40-553534761192", "tag": "2d6ad625-2821-4ac2-97ba-5c53e76f8951"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:04.523634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e0328eec-8b86-45f7-9deb-32e898d12530 req-bb558402-ea95-4efc-ac02-0483c95920e6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:04.524224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e0328eec-8b86-45f7-9deb-32e898d12530 req-bb558402-ea95-4efc-ac02-0483c95920e6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:04.524665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e0328eec-8b86-45f7-9deb-32e898d12530 req-bb558402-ea95-4efc-ac02-0483c95920e6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:04.537612 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e0328eec-8b86-45f7-9deb-32e898d12530 req-bb558402-ea95-4efc-ac02-0483c95920e6 service nova] Creating event network-changed:2d6ad625-2821-4ac2-97ba-5c53e76f8951 for instance 8a4addfd-be2a-4280-ac40-553534761192 on n-h2-858129-2 Sep 16 14:42:04.543744 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e0328eec-8b86-45f7-9deb-32e898d12530 req-bb558402-ea95-4efc-ac02-0483c95920e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039657 Sep 16 14:42:04.545061 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3120/6250] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:42:04.936899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:04.974704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d62fb764-bbd8-4014-addb-a0e8c49bad34 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.526885 Sep 16 14:42:04.975335 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3131/6251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:04 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:06.007850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:06.010698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:06.044648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:06.045275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:06.048202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:06.050638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:06.053988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:06.058119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:06.634221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:06.675130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc04e589-3f83-4d36-ba98-d6e9489d8878 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.675360 Sep 16 14:42:06.688788 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3121/6252] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:05 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:07.717629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:07.718256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:07.721793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:07.736315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:07.736824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:07.737263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:07.739642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:07.740317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:07.740934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:08.018770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:08.028190 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f41f6177-772a-4d5c-bbc3-cf23172fc3ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.314692 Sep 16 14:42:08.029431 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3132/6253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:07 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:08.402133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e4b159b-59c6-4095-a181-3bee4505a92a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] Calling method '.version_select at 0x7f724c4dcca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:08.445996 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e4b159b-59c6-4095-a181-3bee4505a92a tempest-TestSecurityGroupsBasicOps-495718137 tempest-TestSecurityGroupsBasicOps-495718137-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1057552017" status: 202 len: 0 microversion: 2.1 time: 0.047527 Sep 16 14:42:08.447945 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3122/6254] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 14:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1057552017 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:42:09.054986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:09.056505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:09.065637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:09.066395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:09.066955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:09.067790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:09.068461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:09.068910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:09.232605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:09.243891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d6634720-8150-4a12-ab6b-e5bc1112756f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.193474 Sep 16 14:42:09.244572 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3133/6255] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:09 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:10.273524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:10.274149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:10.286103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:10.293608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:10.294142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:10.303562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:10.304560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:10.305551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:10.679705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:10.690554 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b8cf46f-b7cf-4ce7-ae25-ba8c8f3b226f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.421662 Sep 16 14:42:10.708657 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3123/6256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:10 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:11.716135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:11.717352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:11.732145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:11.732948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:11.735081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:11.736206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:11.742682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:11.743748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:12.043737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:12.060950 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d78e91d7-27b1-4b29-b699-5a879fb2fc3f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.348968 Sep 16 14:42:12.075553 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3134/6257] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:11 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:13.089789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:13.093557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:13.125954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:13.126885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:13.127554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:13.148485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:13.149232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:13.150156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:13.621884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:13.636853 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-098423cb-11bd-44d9-ab57-03fa904ab42c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.553603 Sep 16 14:42:13.654073 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3124/6258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:13 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:14.664673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:14.666014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:14.681097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:14.683878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:14.694721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:14.695815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:14.699087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:14.699782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:15.200101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:15.223258 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ae36e8da-0210-4a42-afcd-c53248db282a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.564995 Sep 16 14:42:15.224115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3135/6259] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:14 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:42:16.254087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:16.258455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:16.286048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:16.289669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:16.290476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:16.292201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:16.295347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:16.297669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:16.873758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:16.883459 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0af94961-431b-41ce-8a71-bcdb3c811aa1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 0.635271 Sep 16 14:42:16.898930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3125/6260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:16 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:17.911326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:17.911996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:17.932706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:17.935416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:17.935909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:17.940348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:17.940852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:17.941301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:17.995177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=100 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:19.771783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "name": "network-vif-unplugged", "status": "completed", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:19.791315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:19.792033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:19.794965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:19.823221 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] Creating event network-vif-unplugged:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h2-858129-2 Sep 16 14:42:19.838276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:42:19.862264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e35a3866-56b9-4db8-a518-3d49513a5e52 req-0774ea9c-b373-485c-97a7-d1bd05887779 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094287 Sep 16 14:42:19.868010 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3126/6261] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:42:20.220927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:20.239475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0f688b5-f70f-48f2-a23a-3399566da98d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1698 microversion: 2.1 time: 2.332170 Sep 16 14:42:20.245639 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3136/6262] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:17 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1698 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:21.270763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:21.271683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:21.284629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:21.296402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:21.322931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:21.323666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:21.324557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:21.325158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:21.325704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:21.758152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d6c2a16-b433-477d-9598-accfe107769b tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'create', calling method: .version_select at 0x7f724c44f5e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-767602570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5YmikuN0aPfKcT/UM9X7woyftJ41HwTb1HjzqkFtnhc31EQf9ugbUus1DaBvBCNuvbqQ6eNTNtVvjVxOvAK7MGuDpyidgGr5we82vfWxeG/je12J9yftvB80M3bAp+Yw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:21.825929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3d6c2a16-b433-477d-9598-accfe107769b tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:42:21.842254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3d6c2a16-b433-477d-9598-accfe107769b tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for user eddb0f0a09b64efc880c28290991fd0b and project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:42:21.875052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:21.892864 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2478aa79-907c-4430-b8c6-39a450c18c3d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1697 microversion: 2.1 time: 0.627280 Sep 16 14:42:21.900239 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3127/6263] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:21 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1697 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:21.920897 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d6c2a16-b433-477d-9598-accfe107769b tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.172647 Sep 16 14:42:21.923470 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3137/6264] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:42:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:42:21.941930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:21.966227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:21.971840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:21.973104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:22.024690 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] Creating event network-changed:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h2-858129-2 Sep 16 14:42:22.048564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:42:22.090227 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c22f6669-5683-4e3a-9aaf-251293de865b req-70906cb1-ec80-42c3-b817-97bd138e227d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150214 Sep 16 14:42:22.093988 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3128/6265] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:42:22.923439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:22.924212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:22.949341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:22.950018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:22.950615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:22.951990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:22.953242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:22.956841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:23.759145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:23.775235 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bd45cb32-df86-4e36-82cf-17c56a908160 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1695 microversion: 2.1 time: 0.856524 Sep 16 14:42:23.778058 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3138/6266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:22 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1695 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:24.835563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:24.837295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:24.871152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:24.871902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:24.872511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:24.874067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:24.874748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:24.875706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:25.196687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:25.208883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-07f2048f-be96-4d30-a6e8-5bc632e2b8fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1695 microversion: 2.1 time: 0.407542 Sep 16 14:42:25.213644 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3129/6267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:24 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1695 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:25.622819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1867936307", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "1f3ad093-eae9-494a-b208-e4b109205711"}], "key_name": "tempest-TestNetworkBasicOps-767602570", "security_groups": [{"name": "tempest-secgroup-smoke-398719631"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:25.879209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] validate_networks() for [('1f3ad093-eae9-494a-b208-e4b109205711', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:42:26.238035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:26.238689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:26.256094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:26.260207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:26.260207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:26.260207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:26.260207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:26.261415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:26.822987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:26.835157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:26.839976 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58873df3-ef95-42c8-8976-b6e9b40c0232 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1692 microversion: 2.1 time: 0.606294 Sep 16 14:42:26.846595 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3130/6268] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:26 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1692 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:26.869433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:26.870386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:26.880238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:26.880971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:26.881621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:26.882572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:26.883214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:26.883847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:27.168402 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c6d4950-4bcf-42ee-87c2-ee007dd89509 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action" status: 202 len: 0 microversion: 2.1 time: 0.304891 Sep 16 14:42:27.169382 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3131/6269] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:42:26 2022] POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:42:27.189546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:27.195382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:27.213600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:27.215446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:27.215792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:27.218250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:27.220563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:27.221225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:27.601499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:42:27.603715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:42:27.604625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:42:27.608401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:42:27.609055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:42:27.649137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:27.650624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:27.654219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:27.656791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:27.658329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:27.661565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:27.715053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:42:27.731464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:27.744541 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da1e4d00-3f8c-4d7a-ba26-834aba1577c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.569554 Sep 16 14:42:27.745435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for user eddb0f0a09b64efc880c28290991fd0b and project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:42:27.747268 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3132/6270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:27 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:27.781332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:42:27.790231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:42:27.894045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fa95e94-3cdb-4294-8e3b-7384bc691d7d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.285556 Sep 16 14:42:27.908628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab9ccfad-87e3-45d6-acf5-81a1deb47018 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:27.909569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab9ccfad-87e3-45d6-acf5-81a1deb47018 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:27.916383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3139/6271] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:42:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:42:28.022696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab9ccfad-87e3-45d6-acf5-81a1deb47018 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:28.031109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab9ccfad-87e3-45d6-acf5-81a1deb47018 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1248 microversion: 2.1 time: 0.127174 Sep 16 14:42:28.050044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3133/6272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:27 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1248 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:28.770007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:28.770986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:28.789000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:28.790826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:28.791813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:28.794577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:28.796661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:28.799208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:29.058341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:29.058997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:29.079783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:29.080217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:29.086574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:29.090357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:29.092313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:29.093743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:29.108393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:29.120405 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7c2b59e4-1e3f-4025-b704-611305eecea7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.354691 Sep 16 14:42:29.121857 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3140/6273] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:28 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:29.299351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:29.319561 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5023b5b8-465d-4e80-9254-902e72991912 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1244 microversion: 2.1 time: 0.265642 Sep 16 14:42:29.337993 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3134/6274] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:29 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1244 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:42:30.150548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:30.150548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:30.174392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:30.174986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:30.175431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:30.176191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:30.176661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:30.177089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:30.345834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:30.348048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:30.372665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:30.377694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:30.378891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:30.382621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:30.384647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:30.387438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:30.581577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:30.591269 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8301d19-5fad-4c66-baef-d4c0aa11e957 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1306 microversion: 2.1 time: 0.250520 Sep 16 14:42:30.613293 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3135/6275] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:30 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1306 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:42:30.715457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:30.726561 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-611bfef5-9c08-4aa8-aeb1-0b8e83d85f50 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.582632 Sep 16 14:42:30.728890 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3141/6276] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:30 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:31.626867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:31.628224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:31.642516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:31.647557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:31.648456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:31.651335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:31.652115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:31.658190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:31.758656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:31.759492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:31.789165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:31.789765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:31.797616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:31.800906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:31.801493 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:31.802019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:33.088696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:33.103915 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4e54a58-f062-4b6b-981e-7ede0748a61c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 1.477735 Sep 16 14:42:33.112609 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3136/6277] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:31 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:33.595232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:33.607467 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ebfd8622-33ae-4692-ac3b-4677a34c1f49 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 1.853489 Sep 16 14:42:33.619271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3142/6278] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:31 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:34.144788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:34.146676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:34.162464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:34.163235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:34.163897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:34.164847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:34.165527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:34.166664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:34.513171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:34.556657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-781d64cd-0884-421a-b87e-07bf1674e0fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.415679 Sep 16 14:42:34.574394 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3137/6279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:34 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:34.646623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:34.651025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:34.673168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:34.673667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:34.674106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:34.674855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:34.675314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:34.675741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:34.888760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f6b9521b-4e0e-4484-9078-af676ecb80ca req-5205d8e5-08d5-466a-ae9c-ebe3551f5550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c34ad8-0722-4351-b7a0-e049a2a5e942", "tag": "73ed9529-b33b-46df-a9ea-ee58b9b19add"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:34.972296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f6b9521b-4e0e-4484-9078-af676ecb80ca req-5205d8e5-08d5-466a-ae9c-ebe3551f5550 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:34.974653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f6b9521b-4e0e-4484-9078-af676ecb80ca req-5205d8e5-08d5-466a-ae9c-ebe3551f5550 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:34.974815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:34.975574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f6b9521b-4e0e-4484-9078-af676ecb80ca req-5205d8e5-08d5-466a-ae9c-ebe3551f5550 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:34.987963 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dfb4cf31-1000-4a09-8eee-ea9b8d0c2da2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.349203 Sep 16 14:42:34.989178 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3143/6280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:34 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:35.040797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f6b9521b-4e0e-4484-9078-af676ecb80ca req-5205d8e5-08d5-466a-ae9c-ebe3551f5550 service nova] Creating event network-changed:73ed9529-b33b-46df-a9ea-ee58b9b19add for instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 on n-h1-858129-2 Sep 16 14:42:35.076111 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f6b9521b-4e0e-4484-9078-af676ecb80ca req-5205d8e5-08d5-466a-ae9c-ebe3551f5550 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184639 Sep 16 14:42:35.081664 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3138/6281] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:42:35.586902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:35.591976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:35.600679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:35.601499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:35.602133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:35.603125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:35.604670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:35.605359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:35.987337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:36.000702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a9ed626f-2922-4cae-a5b6-ce538c3c64ec tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.418740 Sep 16 14:42:36.001975 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3144/6282] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:35 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:36.012444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:36.013984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:36.075534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:36.096341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:36.098361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:36.101524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:36.102235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:36.104896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:36.463536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:36.474857 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-478e67c6-438f-4213-9ef2-8b28e347d65e tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.466177 Sep 16 14:42:36.476166 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3139/6283] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:36 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:36.650255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:36.666796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:36.667278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:36.668205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:36.690671 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] Creating event network-changed:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:42:36.703154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:42:36.720037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ad293e21-87a6-4c63-9e66-fe7385981f0a req-6cdaaa0b-6a9d-4710-b048-774539b5d6a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073692 Sep 16 14:42:36.721431 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3145/6284] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:42:37.030986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:37.032244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:37.052988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:37.055968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:37.056734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:37.058346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:37.064583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:37.065578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:37.441968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:37.454759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7a94f98-d00c-4990-b5ad-30bbd78b1b3a tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.428720 Sep 16 14:42:37.476275 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3140/6285] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:37 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:37.506730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:37.507918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:37.578133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:37.579329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:37.580034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:37.624711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:37.626598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:37.635188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:37.689887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:37.766502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:37.841423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:37.850368 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-32414faf-9d1a-4d0c-9a07-bcd03fabce5f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.349761 Sep 16 14:42:37.851883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3146/6286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:37 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:38.490680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:38.491423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:38.493352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:38.513107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:38.517385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:38.519335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:38.521063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:38.527153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:38.528303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:38.858710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:38.879623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:38.881222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:38.901127 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d431fc1f-4f23-408a-85a2-89125bf3d5b6 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.415126 Sep 16 14:42:38.910891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:38.913192 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3141/6287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:38 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:38.916483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:38.919777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:38.920393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:38.921515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:38.922197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:38.922894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:39.214836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:39.223565 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc00221c-d7d5-4704-ad06-8e82be674ee7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.347874 Sep 16 14:42:39.238506 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3147/6288] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:38 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:39.935413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:39.936756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:39.949745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:39.950688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:39.951372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:39.953497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:39.955339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:39.957055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:40.175880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:40.188307 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c291b90b-2c8e-48b8-9a13-35d8bfdebfa8 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.256666 Sep 16 14:42:40.189729 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3142/6289] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:39 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:40.248560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:40.250135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:40.260703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:40.261209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:40.261652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:40.262373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:40.262859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:40.263286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:40.502569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:40.513766 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02d9fe24-b4a8-4d66-b936-008c2af61f9a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.270056 Sep 16 14:42:40.515464 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3148/6290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:40 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:42:41.220384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:41.221119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:41.234270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:41.234910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:41.244170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:41.245049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:41.245606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:41.246843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:41.505093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:41.526302 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6eb57d7f-5a02-4947-a3cb-73045a4774d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.310749 Sep 16 14:42:41.535326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3143/6291] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:41 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:41.541089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:41.541712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:41.567641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:41.568475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:41.568608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:41.569341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:41.579490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:41.582859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:42.204601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cb38c071-62d4-4e35-a095-37173a9d364a req-32323f24-b45f-4dc0-9503-2443b3b2253f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c34ad8-0722-4351-b7a0-e049a2a5e942", "name": "network-vif-plugged", "status": "completed", "tag": "73ed9529-b33b-46df-a9ea-ee58b9b19add"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:42.237754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cb38c071-62d4-4e35-a095-37173a9d364a req-32323f24-b45f-4dc0-9503-2443b3b2253f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:42.247660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cb38c071-62d4-4e35-a095-37173a9d364a req-32323f24-b45f-4dc0-9503-2443b3b2253f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:42.249143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cb38c071-62d4-4e35-a095-37173a9d364a req-32323f24-b45f-4dc0-9503-2443b3b2253f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:42.311699 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cb38c071-62d4-4e35-a095-37173a9d364a req-32323f24-b45f-4dc0-9503-2443b3b2253f service nova] Creating event network-vif-plugged:73ed9529-b33b-46df-a9ea-ee58b9b19add for instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 on n-h1-858129-2 Sep 16 14:42:42.320924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cb38c071-62d4-4e35-a095-37173a9d364a req-32323f24-b45f-4dc0-9503-2443b3b2253f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121587 Sep 16 14:42:42.322177 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3144/6292] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:42:42.389614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:42.403413 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba9a0099-fa6e-4820-aa10-c6e41cfbbfaa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1691 microversion: 2.1 time: 0.863594 Sep 16 14:42:42.406548 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3149/6293] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:41 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1691 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:42.562615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:42.563370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:42.593568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:42.594948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:42.597192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:42.605082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:42.605929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:42.608538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:43.055890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:43.065049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9c3a017-98b7-4f89-8c06-aa9ee1318a3f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.510379 Sep 16 14:42:43.079805 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3145/6294] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:42 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:43.429070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:43.429687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:43.450134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:43.450671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:43.451107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:43.452437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:43.452902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:43.453334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:43.651188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:43.662661 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc73ff1e-4197-4efa-9432-7943adbd5dcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1684 microversion: 2.1 time: 0.236730 Sep 16 14:42:43.671135 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3150/6295] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:43 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1684 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:44.089883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:44.091374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:44.105491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:44.106935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:44.108465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:44.109571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:44.110828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:44.111563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:44.315431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:44.326167 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91121212-9e0e-4e0b-93c3-03fb276bc675 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1373 microversion: 2.1 time: 0.240813 Sep 16 14:42:44.330009 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3146/6296] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:44 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1373 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:42:45.352957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:45.354565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:45.363738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:45.364384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:45.364895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:45.365703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:45.366159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:45.366613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:45.545221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:45.555125 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-26e24a26-17f1-4731-a0c6-668993ae23ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1545 microversion: 2.1 time: 0.205984 Sep 16 14:42:45.557757 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3151/6297] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:45 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1545 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:45.582592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:42:45.583910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:42:45.596996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:45.597501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:45.597956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:45.598718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:45.599191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:45.599630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:45.794767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:42:45.799572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:42:45.813478 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c9515de-d83a-4979-8705-fbc3943f342d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1545 microversion: 2.1 time: 0.238132 Sep 16 14:42:45.825087 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3147/6298] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:42:45 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1545 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:42:46.145240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-16649a90-c98f-4c12-8065-188c07b79c82 req-ffdc5e36-509d-40ba-80fa-0a294df3ccbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "name": "network-vif-plugged", "status": "completed", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:46.157930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-16649a90-c98f-4c12-8065-188c07b79c82 req-ffdc5e36-509d-40ba-80fa-0a294df3ccbf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:46.158739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-16649a90-c98f-4c12-8065-188c07b79c82 req-ffdc5e36-509d-40ba-80fa-0a294df3ccbf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:46.159319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-16649a90-c98f-4c12-8065-188c07b79c82 req-ffdc5e36-509d-40ba-80fa-0a294df3ccbf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:46.173571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-16649a90-c98f-4c12-8065-188c07b79c82 req-ffdc5e36-509d-40ba-80fa-0a294df3ccbf service nova] Creating event network-vif-plugged:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:42:46.182261 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-16649a90-c98f-4c12-8065-188c07b79c82 req-ffdc5e36-509d-40ba-80fa-0a294df3ccbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038385 Sep 16 14:42:46.184848 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3152/6299] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:42:48.774723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-44e0e1c2-c25d-4f2a-95b6-15a8583685ac req-2c4d494f-63ab-4e03-a300-cb847b0ec364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c34ad8-0722-4351-b7a0-e049a2a5e942", "tag": "73ed9529-b33b-46df-a9ea-ee58b9b19add"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:42:48.801027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-44e0e1c2-c25d-4f2a-95b6-15a8583685ac req-2c4d494f-63ab-4e03-a300-cb847b0ec364 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:42:48.803199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-44e0e1c2-c25d-4f2a-95b6-15a8583685ac req-2c4d494f-63ab-4e03-a300-cb847b0ec364 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:42:48.804748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-44e0e1c2-c25d-4f2a-95b6-15a8583685ac req-2c4d494f-63ab-4e03-a300-cb847b0ec364 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:42:48.847172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-44e0e1c2-c25d-4f2a-95b6-15a8583685ac req-2c4d494f-63ab-4e03-a300-cb847b0ec364 service nova] Creating event network-changed:73ed9529-b33b-46df-a9ea-ee58b9b19add for instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 on n-h1-858129-2 Sep 16 14:42:48.856427 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-44e0e1c2-c25d-4f2a-95b6-15a8583685ac req-2c4d494f-63ab-4e03-a300-cb847b0ec364 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086178 Sep 16 14:42:48.857288 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3148/6300] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:15.970152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:15.972538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:15.984351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=11 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:15.985080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=83 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:15.986987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:15.987489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:15.988524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:15.990177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:15.990852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:15.991712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:16.072870 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38924ff8-afcf-4d6a-acc6-2561fa8af8c7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action" status: 200 len: 63187 microversion: 2.1 time: 0.107254 Sep 16 14:43:16.073630 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3153/6301] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:43:15 2022] POST /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223/action => generated 63187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:43:19.138001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:19.139234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:19.148218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=49 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:19.149120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:19.151591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:19.152315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:19.153412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:19.154508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:19.155151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:19.155585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:19.227046 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b7f3fbb-62ab-406a-b651-4c980fc7b2c0 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/ips" status: 200 len: 147 microversion: 2.1 time: 0.094054 Sep 16 14:43:19.229083 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3149/6302] 10.222.0.60 () {58 vars in 1248 bytes} [Fri Sep 16 14:43:19 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/ips => generated 147 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:21.232000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:21.234347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:21.265112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:21.267381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:21.267901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:21.279714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:21.280709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:21.281347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:21.385023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d5d4479-a45a-44b9-8129-72ff812fc3e2 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942/action" status: 200 len: 24552 microversion: 2.1 time: 0.157244 Sep 16 14:43:21.385878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3154/6303] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:43:21 2022] POST /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942/action => generated 24552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:43:21.820573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f413f70-c26c-4b7b-a6d9-8c002dfd8e30"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:21.833572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:21.847268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:21.848003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:21.848619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:21.849483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:21.850097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:21.850745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:22.650683 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5eade04c-f446-4e4f-867c-ec82e44eea13 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "POST /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831927 Sep 16 14:43:22.651803 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3150/6304] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 14:43:21 2022] POST /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:28.314508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-892526675", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "793f36d1-572d-46da-bb30-dd593c76b540"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:28.401740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] validate_networks() for [('793f36d1-572d-46da-bb30-dd593c76b540', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:43:28.889914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:43:28.890758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:43:28.891505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:43:28.892165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:43:28.892798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:43:28.932116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:28.936590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:28.937534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:28.938715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:28.940596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:28.941379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:28.973040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Getting quotas for project b1257cd8f0ad42f7a6e6d1d1006e3ef5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:43:28.980947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Getting quotas for user fcec7b8c03144358aaa253da60c892ad and project b1257cd8f0ad42f7a6e6d1d1006e3ef5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:43:28.997548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:43:29.001961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:43:29.068630 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e8da9d8-2023-4d04-8b52-aa03e1ed0faf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905375 Sep 16 14:43:29.071553 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3155/6305] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:43:29.082079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8c536ec9-d5c0-466a-960a-e11dff187396 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:29.083122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8c536ec9-d5c0-466a-960a-e11dff187396 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:29.187722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8c536ec9-d5c0-466a-960a-e11dff187396 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:29.196832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8c536ec9-d5c0-466a-960a-e11dff187396 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1214 microversion: 2.1 time: 0.119076 Sep 16 14:43:29.218460 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3151/6306] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:29 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:30.233943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:30.234900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:30.248195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:30.248195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:30.248195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:30.248195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:30.248195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:30.248195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:30.322577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:30.331567 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cc425aab-0dab-4b5b-bb9a-a0c7ed754df0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1266 microversion: 2.1 time: 0.103294 Sep 16 14:43:30.332176 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3156/6307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:30 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:31.358804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:31.360416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:31.373648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:31.375735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:31.376908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:31.378486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:31.379563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:31.380611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:31.574474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:31.588036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-649b13ac-ae5a-40c4-9035-d5ad2e680d73 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.232332 Sep 16 14:43:31.590737 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3152/6308] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:31 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:32.376817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d0878aad-8f8b-4efb-974d-05a803ad39aa req-e1ad38c9-c3f5-40a3-826e-6ef671ecf856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ff9f84-6874-467f-a19b-07d24ec909bd", "tag": "b03e2012-8fb0-4231-b4a5-96598a435f6b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:32.392256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d0878aad-8f8b-4efb-974d-05a803ad39aa req-e1ad38c9-c3f5-40a3-826e-6ef671ecf856 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:32.393079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d0878aad-8f8b-4efb-974d-05a803ad39aa req-e1ad38c9-c3f5-40a3-826e-6ef671ecf856 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:32.393732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d0878aad-8f8b-4efb-974d-05a803ad39aa req-e1ad38c9-c3f5-40a3-826e-6ef671ecf856 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:32.409756 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d0878aad-8f8b-4efb-974d-05a803ad39aa req-e1ad38c9-c3f5-40a3-826e-6ef671ecf856 service nova] Creating event network-changed:b03e2012-8fb0-4231-b4a5-96598a435f6b for instance 98ff9f84-6874-467f-a19b-07d24ec909bd on n-h2-858129-2 Sep 16 14:43:32.432711 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d0878aad-8f8b-4efb-974d-05a803ad39aa req-e1ad38c9-c3f5-40a3-826e-6ef671ecf856 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056454 Sep 16 14:43:32.433795 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3157/6309] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:32.625372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:32.629223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:32.642518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:32.645059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:32.645680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:32.646617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:32.647666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:32.648274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:32.850114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:32.862157 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f73c1769-ca3c-467d-8e9f-920ebb47fbe0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.248840 Sep 16 14:43:32.864420 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3153/6310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:32 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:33.888709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:33.889507 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:33.896209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:33.896706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:33.897148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:33.897860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:33.898318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:33.898772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:34.069229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:34.077839 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4cb1c33-b384-43ce-ac36-8af77908ab97 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.194319 Sep 16 14:43:34.083168 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3158/6311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:33 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:35.106713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:35.107318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:35.114987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:35.115487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:35.115934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:35.116660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:35.117126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:35.117563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:35.316466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:35.328220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37d8a8ad-45ab-4c03-970f-8c914c372aaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.226515 Sep 16 14:43:35.328930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3154/6312] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:35 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:43:36.157497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:36.158668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:36.168240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:36.169393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:36.169901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:36.170861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:36.171593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:36.172162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:36.333330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'services' on Instance uuid 8a4addfd-be2a-4280-ac40-553534761192 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:43:36.351230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:36.351831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:36.364113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:36.365081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:36.365718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:36.366661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:36.367298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:36.368183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:36.454337 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4dfe957-3acb-4fa4-883b-6657a476bc54 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments/9f413f70-c26c-4b7b-a6d9-8c002dfd8e30" status: 202 len: 0 microversion: 2.1 time: 0.300898 Sep 16 14:43:36.460326 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3159/6313] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 14:43:36 2022] DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments/9f413f70-c26c-4b7b-a6d9-8c002dfd8e30 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:43:36.487068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:36.490313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:36.504370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:36.505016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:36.506373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:36.507255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:36.507772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:36.508202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:36.584548 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-354acc38-a969-4c83-9a5f-393122b5f7bd tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121949 Sep 16 14:43:36.585154 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3160/6314] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:36 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:36.611880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:36.625322 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa5c66d4-771d-43ac-b1c7-13b21680ce30 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.277619 Sep 16 14:43:36.626191 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3155/6315] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:36 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:43:37.597818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:37.600640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:37.611958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:37.612513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:37.613079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:37.613961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:37.614825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:37.615299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:37.656506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:37.657142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:37.668505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:37.675326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:37.676047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:37.676996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:37.677636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:37.678246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:37.693472 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cf0e825e-8b43-4b70-8504-2be43237033c tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099876 Sep 16 14:43:37.700834 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3161/6316] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:37 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:37.864311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:37.872306 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bba8970f-0278-46df-909f-61a2553c9016 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.220460 Sep 16 14:43:37.874021 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3156/6317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:37 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:38.708621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:38.712227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:38.725559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:38.727495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:38.728743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:38.731707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:38.733126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:38.734147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:38.789043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9824e1e3-5a86-41bf-8c38-6499554f0166 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085701 Sep 16 14:43:38.789999 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3162/6318] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:38 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:38.896643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:38.898053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:38.914071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:38.915716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:38.916431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:38.917759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:38.918525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:38.919195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:39.106428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:39.107805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:39.111532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:39.113173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:39.129626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:39.130140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:39.130633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:39.131364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:39.131826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:39.132259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:39.201152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:39.247919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:39.257874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09b05d37-6a03-4fe9-b7dc-5826ca8e8ff5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.365222 Sep 16 14:43:39.263278 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3157/6319] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:38 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:39.280385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9787c663-0f11-48f8-a2f6-389c9eecaf9f req-02488fde-f4eb-41e6-9bcb-073cb4b04c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ff9f84-6874-467f-a19b-07d24ec909bd", "name": "network-vif-plugged", "status": "completed", "tag": "b03e2012-8fb0-4231-b4a5-96598a435f6b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:39.303157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9787c663-0f11-48f8-a2f6-389c9eecaf9f req-02488fde-f4eb-41e6-9bcb-073cb4b04c20 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:39.305176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9787c663-0f11-48f8-a2f6-389c9eecaf9f req-02488fde-f4eb-41e6-9bcb-073cb4b04c20 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:39.305745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9787c663-0f11-48f8-a2f6-389c9eecaf9f req-02488fde-f4eb-41e6-9bcb-073cb4b04c20 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:39.323015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9787c663-0f11-48f8-a2f6-389c9eecaf9f req-02488fde-f4eb-41e6-9bcb-073cb4b04c20 service nova] Creating event network-vif-plugged:b03e2012-8fb0-4231-b4a5-96598a435f6b for instance 98ff9f84-6874-467f-a19b-07d24ec909bd on n-h2-858129-2 Sep 16 14:43:39.329032 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9787c663-0f11-48f8-a2f6-389c9eecaf9f req-02488fde-f4eb-41e6-9bcb-073cb4b04c20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064539 Sep 16 14:43:39.329668 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3158/6320] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:39.412523 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e73e49b-6077-4641-8bba-0b2c9ea41181 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1835 microversion: 2.1 time: 0.314071 Sep 16 14:43:39.413126 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3163/6321] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:39 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1835 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:43:39.810048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:39.812684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:39.830640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:39.834331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:39.834944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:39.835784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:39.837589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:39.838139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:39.906777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1127207-abfe-463d-b429-eace19a659db tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106978 Sep 16 14:43:39.908640 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3159/6322] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:39 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:40.308271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:40.309016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:40.318465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.318964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.330594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.331779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.333708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.334362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.547143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:40.557343 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-799edef5-9d52-450c-a085-52aec70a5908 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1314 microversion: 2.1 time: 0.272943 Sep 16 14:43:40.559603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3164/6323] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:40 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:40.726918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:40.727433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:40.729757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d517905f-9f40-4dfe-9211-3e280c723884 req-27faf34e-43fe-4539-9a03-33fd2bb84729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:40.740243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d517905f-9f40-4dfe-9211-3e280c723884 req-27faf34e-43fe-4539-9a03-33fd2bb84729 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.741024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d517905f-9f40-4dfe-9211-3e280c723884 req-27faf34e-43fe-4539-9a03-33fd2bb84729 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.741288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.741451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d517905f-9f40-4dfe-9211-3e280c723884 req-27faf34e-43fe-4539-9a03-33fd2bb84729 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.741808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.742252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.743317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.744008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.747389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.754655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d517905f-9f40-4dfe-9211-3e280c723884 req-27faf34e-43fe-4539-9a03-33fd2bb84729 service nova] Creating event network-changed:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:43:40.760415 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d517905f-9f40-4dfe-9211-3e280c723884 req-27faf34e-43fe-4539-9a03-33fd2bb84729 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034617 Sep 16 14:43:40.762279 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3165/6324] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:40.810533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:43:40.922637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:40.927087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:40.946016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.950017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.952207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.955318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:40.956174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:40.956857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:40.980908 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1eb51c93-578d-4174-b148-7e6213959820 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 204 len: 0 microversion: 2.1 time: 0.257705 Sep 16 14:43:40.981604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3160/6325] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:43:40 2022] DELETE /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:43:40.994527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:40.995292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:41.021749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:41.022251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:41.022732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:41.023433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:41.023894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:41.024321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:41.052219 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c4cb422-f6ae-4d55-9bcd-923fe066f0c2 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131490 Sep 16 14:43:41.053612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3166/6326] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:40 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:43:41.384195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:41.399932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f15ba00e-0acd-4cee-bead-b1d1cb1ffbef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1690 microversion: 2.1 time: 0.413424 Sep 16 14:43:41.401186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3161/6327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:40 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1690 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:41.594025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:41.596011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:41.608401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:41.609057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:41.609642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:41.610485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:41.611079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:41.611768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:41.853624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:41.862944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e456be33-afbc-448c-a064-f527164769e3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1499 microversion: 2.1 time: 0.284555 Sep 16 14:43:41.863819 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3167/6328] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:41 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1499 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:41.890191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:41.891019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:41.904610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:41.905385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:41.906000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:41.907001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:41.907657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:41.908444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.066107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:42.068674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:42.080104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.080671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.084136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.084964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.085431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.085867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.146255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:42.155680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2afa2799-4d94-4efa-aff7-030fc5236c2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1499 microversion: 2.1 time: 0.269854 Sep 16 14:43:42.156371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3162/6329] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:41 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1499 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:42.174502 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b5fd27a7-9970-4bbc-bebd-404385729922 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110304 Sep 16 14:43:42.183856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:42.184358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:42.191200 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3168/6330] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:42 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:42.192889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.193388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.193831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.194573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.195036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.195465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.248792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lazy-loading 'flavor' on Instance uuid 98ff9f84-6874-467f-a19b-07d24ec909bd {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:43:42.292216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:42.399777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98071f3d-5276-44b5-b5f1-42149f7a8436 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action" status: 202 len: 0 microversion: 2.1 time: 0.221543 Sep 16 14:43:42.401308 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3163/6331] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:43:42 2022] POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:43:42.409809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:42.410740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:42.429246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.430562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.434679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.436909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.437747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:42.438179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.439446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:42.440613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.465874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.467242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.468060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.469575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:42.470630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:42.471625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:42.844756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:42.854023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c7e6790-990e-473f-a7ca-d2404491f9f3 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1507 microversion: 2.1 time: 0.448309 Sep 16 14:43:42.855187 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3169/6332] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:42 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:42.880069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:42.888555 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17893bdd-3687-4650-8607-6dd240d2bbc2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1690 microversion: 2.1 time: 0.464264 Sep 16 14:43:42.903488 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3164/6333] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:42 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1690 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:43.185120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:43.187646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:43.200167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.202504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.203562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.208819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.209579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.210244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.263857 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2eb2ec35-4296-42d5-8a7d-843e1025ccff tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083205 Sep 16 14:43:43.271155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3170/6334] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 14:43:43 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 14:43:43.363261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:43.364615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:43.373919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.374779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.375491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.376538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.377287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.378034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.418528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:43:43.521155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-ae69a213-575b-4e80-9386-c1b9af98a88b req-7d0ed709-69e4-47f0-92f7-b9230e9bffa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff744b4-ccd5-4788-a2ee-531161bb2223", "name": "network-vif-deleted", "tag": "e265c558-307b-437a-858a-a622c39a8b76"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:43.532008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ae69a213-575b-4e80-9386-c1b9af98a88b req-7d0ed709-69e4-47f0-92f7-b9230e9bffa4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.532874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ae69a213-575b-4e80-9386-c1b9af98a88b req-7d0ed709-69e4-47f0-92f7-b9230e9bffa4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.533519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-ae69a213-575b-4e80-9386-c1b9af98a88b req-7d0ed709-69e4-47f0-92f7-b9230e9bffa4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.562798 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-ae69a213-575b-4e80-9386-c1b9af98a88b req-7d0ed709-69e4-47f0-92f7-b9230e9bffa4 service nova] Creating event network-vif-deleted:e265c558-307b-437a-858a-a622c39a8b76 for instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 on n-h1-858129-2 Sep 16 14:43:43.563686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9fea2765-30e7-4cd0-b8fc-ce46c5405310 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 204 len: 0 microversion: 2.1 time: 0.206457 Sep 16 14:43:43.567498 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3165/6335] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:43:43 2022] DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:43:43.582458 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-ae69a213-575b-4e80-9386-c1b9af98a88b req-7d0ed709-69e4-47f0-92f7-b9230e9bffa4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065764 Sep 16 14:43:43.585926 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3171/6336] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:43:43.586872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:43.587712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:43.597628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.598428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.598898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.599622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.600239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.600679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.831399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:43.840324 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0269ebbb-c44e-4da8-b64d-3f3d976fd73e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1678 microversion: 2.1 time: 0.259269 Sep 16 14:43:43.841583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3166/6337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:43 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:43.880147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:43.881495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:43.890454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.891014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.891444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.892331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.892945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.893574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.899113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:43.922447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:43.923380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:43.937909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.938442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.939156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:43.941434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:43.942174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:43.942810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.013052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.013704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.015330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.015920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lazy-loading 'fault' on Instance uuid 0ff744b4-ccd5-4788-a2ee-531161bb2223 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:43:44.079914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:44.089981 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61f8fc04-859e-4cfc-9814-4aa71d82f6da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 200 len: 1357 microversion: 2.1 time: 0.175075 Sep 16 14:43:44.090867 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3167/6338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:43 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:43:44.129134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:44.148245 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-762196b1-37b1-432e-a9a1-3da40f60cdf9 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1490 microversion: 2.1 time: 0.274047 Sep 16 14:43:44.149627 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3172/6339] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:43 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1490 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:43:44.174923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:44.175748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:44.185816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.186527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.187065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.187908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.188468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.189044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.273969 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee16f95e-ae54-4972-a9a9-3a82bbdfea69 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action" status: 202 len: 0 microversion: 2.1 time: 0.105576 Sep 16 14:43:44.275005 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3168/6340] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:43:44 2022] POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:43:44.286266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:44.287052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:44.295677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.297095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.297803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.298615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.299309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.299740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.487704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:44.496662 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4236a796-0a68-4250-85bd-3abfd09109b6 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1496 microversion: 2.1 time: 0.217284 Sep 16 14:43:44.497390 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3173/6341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:44 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1496 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:44.864733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:44.865995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:44.875024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.875519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.882887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:44.902942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:44.903519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:44.903976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:45.070893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:45.079684 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48d0459b-1ed4-4746-ac9c-a9911d9750d9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1678 microversion: 2.1 time: 0.219098 Sep 16 14:43:45.080701 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3169/6342] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:44 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:45.115238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:45.116655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 0ff744b4-ccd5-4788-a2ee-531161bb2223] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:45.127282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:45.128106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:45.128753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:45.130264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:45.131043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:45.132173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:45.149455 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] HTTP exception thrown: Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 could not be found. Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Request method failure captured: Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 HTTP/1.1 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIntDKRZ4QqUPjM5AB-8_Gwg-dOv23461hiXyb_tXnwb5dvj9M0pQQqn0sQjUMlAyiTUssIlJMZkO9pWU44eRrFMjR0bpaXHP-8S_1X0DuKcmEy4bYZQYoZG4OQyOrunKl4SFLWOj5xXkGXRWINY5Q5rucW9wVD8Fojj3TAMYGSZis8 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9da7c684cd0c42e1904ea60b02e60465", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}] Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ccf53133b4d94387b8bb277f44c5f780 Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 could not be found. Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '0ff744b4-ccd5-4788-a2ee-531161bb2223'} Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 could not be found. Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 could not be found. Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:45.151273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 could not be found. Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Returning 404 to user: Instance 0ff744b4-ccd5-4788-a2ee-531161bb2223 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1199bfd2-8db6-4dcd-816e-9cf109cf3127 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223" status: 404 len: 111 microversion: 2.1 time: 0.044843 Sep 16 14:43:45.157273 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3174/6343] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:45 2022] GET /compute/v2.1/servers/0ff744b4-ccd5-4788-a2ee-531161bb2223 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:43:45.523185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:45.525306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:45.535814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:45.536619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:45.537381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:45.538307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:45.538988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:45.539594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:46.054713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:46.078598 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f9e05a7-1a98-40ef-8de1-ef9e2d639562 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1496 microversion: 2.1 time: 0.545537 Sep 16 14:43:46.078598 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3170/6344] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:45 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1496 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:46.105421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:46.105901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:46.113065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:46.115516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:46.117303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:46.117953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:46.118877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:46.128161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:46.128690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:46.471663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:46.498225 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-489b9ae2-1bd4-474d-b043-26e9e3e0250d tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1678 microversion: 2.1 time: 0.398360 Sep 16 14:43:46.499237 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3175/6345] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:46 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1678 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:47.093604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:47.096032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:47.119512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.121712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.122496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.123520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.124718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.125733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.454928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:47.460579 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f882404-45f1-4264-8279-e86ab0fe4c8e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1499 microversion: 2.1 time: 0.374949 Sep 16 14:43:47.461760 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3171/6346] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:47 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:47.496506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:47.497286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:47.522161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:47.522976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:47.526010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.527142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.529578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.530870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.532332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.533012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.545793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.546347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.551769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.552050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.552319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.552764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.583927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lazy-loading 'flavor' on Instance uuid 98ff9f84-6874-467f-a19b-07d24ec909bd {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:43:47.682074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:47.700272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68700948-7a1e-4bf9-9c85-2dee1e2759e1 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1610 microversion: 2.1 time: 0.181708 Sep 16 14:43:47.701185 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3172/6347] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:47 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1610 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:47.734143 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2fe3752b-a113-4b3a-bbf5-40eb3cfe58fd tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action" status: 202 len: 0 microversion: 2.1 time: 0.250936 Sep 16 14:43:47.739318 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3176/6348] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:43:47 2022] POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:43:47.750851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:47.751765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:47.764380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.765193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.765802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:47.766757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:47.767390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:47.767985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:48.088302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0717ad63-4c28-4224-b13b-11f9e36e191c req-700be0c7-b85a-4e47-aca6-442082b1a6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4addfd-be2a-4280-ac40-553534761192", "name": "network-vif-deleted", "tag": "2d6ad625-2821-4ac2-97ba-5c53e76f8951"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:48.110627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0717ad63-4c28-4224-b13b-11f9e36e191c req-700be0c7-b85a-4e47-aca6-442082b1a6ab service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:48.111387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0717ad63-4c28-4224-b13b-11f9e36e191c req-700be0c7-b85a-4e47-aca6-442082b1a6ab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:48.112314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0717ad63-4c28-4224-b13b-11f9e36e191c req-700be0c7-b85a-4e47-aca6-442082b1a6ab service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:48.147155 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0717ad63-4c28-4224-b13b-11f9e36e191c req-700be0c7-b85a-4e47-aca6-442082b1a6ab service nova] Creating event network-vif-deleted:2d6ad625-2821-4ac2-97ba-5c53e76f8951 for instance 8a4addfd-be2a-4280-ac40-553534761192 on n-h2-858129-2 Sep 16 14:43:48.161793 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0717ad63-4c28-4224-b13b-11f9e36e191c req-700be0c7-b85a-4e47-aca6-442082b1a6ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077905 Sep 16 14:43:48.167920 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3177/6349] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:48.285548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:48.323428 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dcc5e9e8-b060-4f78-9049-1c815da1fbaf tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1507 microversion: 2.1 time: 0.571462 Sep 16 14:43:48.323428 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3173/6350] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:47 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:48.733740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:48.736587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:48.756052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:48.756781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:48.757235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:48.759026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:48.759609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:48.760053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:48.887054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:48.887713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:48.888156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:48.888625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lazy-loading 'fault' on Instance uuid 8a4addfd-be2a-4280-ac40-553534761192 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:43:49.079387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97bf103a09e4909af4b161222e8a167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2f19665b6245b796fe6e9d4ef089a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:49.111602 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e7c04529-e9c3-4448-99bc-86e556e314a9 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 200 len: 1330 microversion: 2.1 time: 0.388842 Sep 16 14:43:49.112969 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3178/6351] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:48 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 1330 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:49.354961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:49.355715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:49.362388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:49.363897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:49.364404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:49.364847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:49.365612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:49.366081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:49.366573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:49.739746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:49.749350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea27fc54-1fcf-40d3-9aa0-48f64e1a72ce tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1490 microversion: 2.1 time: 0.399232 Sep 16 14:43:49.763214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3174/6352] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:49 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1490 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:49.774957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:49.775575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:49.785303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:49.785921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:49.786360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:49.787111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:49.787567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:49.787994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:49.921199 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2430b076-aab2-4d28-bdda-ef3a69a92a2e tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action" status: 202 len: 0 microversion: 2.1 time: 0.146397 Sep 16 14:43:49.924303 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3179/6353] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:43:49 2022] POST /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:43:49.932254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:49.933209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:49.943783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:49.944657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:49.945281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:49.946200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:49.946916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:49.947560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:50.141430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:50.142146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:50.149304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:50.149822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:50.150256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:50.151005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:50.152419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:50.153134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:50.180574 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 HTTP/1.1 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8a4addfd-be2a-4280-ac40-553534761192'} Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:50.184245 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c267ae1b-7690-448b-9b4c-7fd22f5e2bcc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 404 len: 111 microversion: 2.1 time: 0.058625 Sep 16 14:43:50.205848 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3180/6354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:50 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:43:50.223172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c8c03174-461b-4052-91fd-1f351f5c8dfc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '.version_select at 0x7f724c44fe50>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:50.257186 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c8c03174-461b-4052-91fd-1f351f5c8dfc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880799976" status: 202 len: 0 microversion: 2.1 time: 0.037804 Sep 16 14:43:50.258380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3181/6355] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 14:43:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880799976 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:43:50.516937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:50.534445 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c3049c0-62a9-49f2-9d92-fb488d659372 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1496 microversion: 2.1 time: 0.603169 Sep 16 14:43:50.550871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3175/6356] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:49 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1496 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:51.583526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:51.589874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:51.662897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:51.663708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:51.664615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:51.665658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:51.666355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:51.667217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:52.110860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:52.124323 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-482f4856-1763-43da-a015-117f33649ad5 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1496 microversion: 2.1 time: 0.567304 Sep 16 14:43:52.127849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3182/6357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:51 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1496 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:53.149054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:53.150382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:53.184028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:53.184871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:53.185491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:53.186481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:53.190873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:53.195229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:53.267716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:43:53.787821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:53.807827 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-db951f0b-bc67-4869-a0d1-037d4bbb8006 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1496 microversion: 2.1 time: 0.660975 Sep 16 14:43:53.808674 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3176/6358] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:53 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1496 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:54.087143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16036f83-a723-417e-9c37-df7909401139 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '.version_select at 0x7f724c4340d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:54.154600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16036f83-a723-417e-9c37-df7909401139 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1279406571" status: 202 len: 0 microversion: 2.1 time: 0.072214 Sep 16 14:43:54.158918 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3183/6359] 10.222.0.60 () {58 vars in 1284 bytes} [Fri Sep 16 14:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1279406571 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:43:54.211757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-20bf1557-6b7b-4ce4-96ca-eea9a9fd0443 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: .version_select at 0x7f724d1c69d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-697879678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBdvzjFs6JYiT0bj5EILDr2dEjjXjqJF+hXV+cI7iEactyzWA3+FzC8hkvRX9zDX0tk1va3RzRD5zqTyzJ63aidl95IjQs/fvSLr3up0GJrPGT8GLWz7m0iEDwZVdTb7w=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:54.262361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-20bf1557-6b7b-4ce4-96ca-eea9a9fd0443 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:43:54.276954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-20bf1557-6b7b-4ce4-96ca-eea9a9fd0443 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:43:54.318540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-20bf1557-6b7b-4ce4-96ca-eea9a9fd0443 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.112133 Sep 16 14:43:54.319904 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3177/6360] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:43:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:54.835150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:54.836703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:54.850659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:54.852822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:54.854661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:54.855782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:54.856413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:54.857023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:55.219577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:55.232824 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9ce3aa3-fd2c-48bd-9335-636fda223b1d tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1499 microversion: 2.1 time: 0.401865 Sep 16 14:43:55.237362 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3184/6361] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:54 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1499 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:55.259163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:55.260831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:55.274648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:55.276463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:55.277888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:55.279038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:55.283582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:55.284302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:55.366327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:43:55.527641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c2504d7e-c36e-439d-bb8b-dd66e69df497 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "DELETE /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 204 len: 0 microversion: 2.1 time: 0.269613 Sep 16 14:43:55.528421 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3178/6362] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:43:55 2022] DELETE /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:43:55.538138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:55.538956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:55.559472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:55.561500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:55.562009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:55.567496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:55.568998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:55.569605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:55.996798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:56.011708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dd8d3c04-2d4f-453a-b5e8-4e3f8c2ab935 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1505 microversion: 2.1 time: 0.478566 Sep 16 14:43:56.027643 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3185/6363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:55 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:56.644323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6e5ba713-0dcd-48d8-92d8-57f826dce395 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'create', calling method: .version_select at 0x7f7251795d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1940809289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4P8NQLzYSgGjLxvoatuQdhOuG2HDLdYyhdOjqkMLuqA40E8nNxjSJvqQT0HTnqKkCgag3evchGTwyq9eboP8xt67tzC7xo8k0LbywmNdOdgk6j8dsP/x0AqVIHUAilBQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:56.680449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6e5ba713-0dcd-48d8-92d8-57f826dce395 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:43:56.695223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6e5ba713-0dcd-48d8-92d8-57f826dce395 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for user eddb0f0a09b64efc880c28290991fd0b and project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:43:56.759251 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6e5ba713-0dcd-48d8-92d8-57f826dce395 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.119582 Sep 16 14:43:56.759912 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3179/6364] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:43:56 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:43:57.040809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:57.042177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:57.052769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:57.054793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:57.059603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:57.060565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:57.061208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:57.061986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:57.450747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:57.464034 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1cb1442-84df-49fb-abcb-b1cb92d4b542 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1505 microversion: 2.1 time: 0.427954 Sep 16 14:43:57.466748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3186/6365] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:57 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:58.510696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:58.512600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:58.522163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:58.523012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:58.523710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:58.524641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:58.525798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:58.526710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:58.610549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:58.611035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:58.628141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:58.628666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:58.629102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:58.634048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:58.634863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:58.635520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:58.676524 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 HTTP/1.1 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8a4addfd-be2a-4280-ac40-553534761192'} Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:43:58.685634 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.690681 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.695211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:43:58.703206 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-399ef74f-dc64-49b8-9d3f-0f83ebe65983 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 404 len: 111 microversion: 2.1 time: 0.096987 Sep 16 14:43:58.705256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3187/6366] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:43:58 2022] DELETE /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:43:58.725789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:58.728553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 8a4addfd-be2a-4280-ac40-553534761192] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:58.751306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:58.752129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:58.753889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:58.754934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:58.759061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:58.759808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:58.800003 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 HTTP/1.1 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '8a4addfd-be2a-4280-ac40-553534761192'} Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:43:58.810649 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. Sep 16 14:43:58.816066 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:43:58.817823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 8a4addfd-be2a-4280-ac40-553534761192 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:43:58.821916 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-069c6826-2ad4-4951-9458-36254cf2d942 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192" status: 404 len: 111 microversion: 2.1 time: 0.108611 Sep 16 14:43:58.825097 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3188/6367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:58 2022] GET /compute/v2.1/servers/8a4addfd-be2a-4280-ac40-553534761192 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:43:58.856446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:43:58.873206 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e10eb4b2-513f-4cfc-92f8-95ab557a0931 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1463 microversion: 2.1 time: 0.367428 Sep 16 14:43:58.874034 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3180/6368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:58 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1463 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:43:59.109962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-32b76aa2-2e8f-49a1-9aa1-ffaeee6177d4 req-94a0547d-1457-4248-84b1-1b52827f73c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ff9f84-6874-467f-a19b-07d24ec909bd", "name": "network-vif-deleted", "tag": "b03e2012-8fb0-4231-b4a5-96598a435f6b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:43:59.165982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-32b76aa2-2e8f-49a1-9aa1-ffaeee6177d4 req-94a0547d-1457-4248-84b1-1b52827f73c4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:59.171763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-32b76aa2-2e8f-49a1-9aa1-ffaeee6177d4 req-94a0547d-1457-4248-84b1-1b52827f73c4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:59.172248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-32b76aa2-2e8f-49a1-9aa1-ffaeee6177d4 req-94a0547d-1457-4248-84b1-1b52827f73c4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:59.216608 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-32b76aa2-2e8f-49a1-9aa1-ffaeee6177d4 req-94a0547d-1457-4248-84b1-1b52827f73c4 service nova] Creating event network-vif-deleted:b03e2012-8fb0-4231-b4a5-96598a435f6b for instance 98ff9f84-6874-467f-a19b-07d24ec909bd on n-h2-858129-2 Sep 16 14:43:59.233289 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-32b76aa2-2e8f-49a1-9aa1-ffaeee6177d4 req-94a0547d-1457-4248-84b1-1b52827f73c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127704 Sep 16 14:43:59.265896 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3189/6369] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:43:59.906085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:43:59.914104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:43:59.987982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:59.988821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:43:59.989561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:43:59.990675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:43:59.991588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:00.007309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:00.157784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:00.161421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:00.162229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:00.163367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lazy-loading 'fault' on Instance uuid 98ff9f84-6874-467f-a19b-07d24ec909bd {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:44:00.297145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1793673146", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "75ce8ff1-ef06-411e-a162-dc5d3317501d"}], "key_name": "tempest-TestNetworkBasicOps-1940809289", "security_groups": [{"name": "tempest-secgroup-smoke-880474438"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:00.347639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcec7b8c03144358aaa253da60c892ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1257cd8f0ad42f7a6e6d1d1006e3ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:00.361896 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec594da6-043f-4308-9342-0093c8e4d3ea tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 200 len: 1304 microversion: 2.1 time: 0.463389 Sep 16 14:44:00.363318 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3181/6370] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:43:59 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 1304 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:01.402218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:01.403625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] [instance: 98ff9f84-6874-467f-a19b-07d24ec909bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:01.417047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:01.417997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:01.421252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:01.422956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:01.423611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:01.425815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:01.461476 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] HTTP exception thrown: Instance 98ff9f84-6874-467f-a19b-07d24ec909bd could not be found. Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Request method failure captured: Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd HTTP/1.1 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIuOriYtTDkT3KaXCpvigAlNMxD9tuUOzAO0w627eziFsEZ5iw5jlxR9QLEEU5ZlrYd2ZZnB_bn71Ar-mBKGdckWpm1IBlPNoGVwTEmO0P19-KWIh6odkGTEj6DpAoo3zedY1D6NR7sLMsU0YQmNGaugvpbqFNRrBS6ZjuEGJiOEn0c Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b1257cd8f0ad42f7a6e6d1d1006e3ef5 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestServerAdvancedOps-869057759 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b1257cd8f0ad42f7a6e6d1d1006e3ef5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1257cd8f0ad42f7a6e6d1d1006e3ef5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b1257cd8f0ad42f7a6e6d1d1006e3ef5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1257cd8f0ad42f7a6e6d1d1006e3ef5"}]}] Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestServerAdvancedOps-869057759 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b1257cd8f0ad42f7a6e6d1d1006e3ef5 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestServerAdvancedOps-869057759 Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestServerAdvancedOps-869057759-project Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: fcec7b8c03144358aaa253da60c892ad Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestServerAdvancedOps-869057759-project Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 98ff9f84-6874-467f-a19b-07d24ec909bd could not be found. Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '98ff9f84-6874-467f-a19b-07d24ec909bd'} Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ff9f84-6874-467f-a19b-07d24ec909bd could not be found. Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ff9f84-6874-467f-a19b-07d24ec909bd could not be found. Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:01.466658 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ff9f84-6874-467f-a19b-07d24ec909bd could not be found. Sep 16 14:44:01.470991 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:01.472505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] Returning 404 to user: Instance 98ff9f84-6874-467f-a19b-07d24ec909bd could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:01.475511 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a3b9ba3-f2cd-41aa-a0f1-5d0c7a16c4a0 tempest-TestServerAdvancedOps-869057759 tempest-TestServerAdvancedOps-869057759-project] 10.222.0.60 "GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd" status: 404 len: 111 microversion: 2.1 time: 0.077822 Sep 16 14:44:01.477558 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3182/6371] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:01 2022] GET /compute/v2.1/servers/98ff9f84-6874-467f-a19b-07d24ec909bd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:44:01.509519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] validate_networks() for [('75ce8ff1-ef06-411e-a162-dc5d3317501d', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:44:03.080181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:44:03.082135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:44:03.082886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:44:03.084222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:44:03.084823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:44:03.107433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:03.113430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:03.114146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:03.115893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:03.116562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:03.117177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:03.182606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:44:03.202061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for user eddb0f0a09b64efc880c28290991fd0b and project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:44:03.263955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:44:03.272250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:44:03.419338 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a0301f31-fa21-4766-8233-0afecf1576fd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.126603 Sep 16 14:44:03.420531 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3190/6372] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:44:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 3133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:44:03.437788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98045acb-7ac6-4be4-8f5a-1e06cc76a692 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:03.438603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98045acb-7ac6-4be4-8f5a-1e06cc76a692 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:03.608271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98045acb-7ac6-4be4-8f5a-1e06cc76a692 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:03.637805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98045acb-7ac6-4be4-8f5a-1e06cc76a692 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1249 microversion: 2.1 time: 0.205682 Sep 16 14:44:03.657868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3183/6373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:03 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1249 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:44:04.710505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:04.711282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:04.793733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:04.796913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:04.798864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:04.803520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:04.805533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:04.807106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:05.163482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:05.191145 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7ed199d0-9558-4611-85e7-63c30199d273 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1245 microversion: 2.1 time: 0.487196 Sep 16 14:44:05.202872 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3191/6374] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:04 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1245 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:06.228078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:06.230092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:06.244197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:06.245078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:06.246989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:06.248045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:06.251270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:06.254956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:06.656518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:06.677987 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af8de389-77c6-46a8-9858-eafb09a16fc5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1307 microversion: 2.1 time: 0.451873 Sep 16 14:44:06.678995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3184/6375] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:06 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:44:07.135652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:07.137022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:07.144755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.145738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.146463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.147445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.148165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.148830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.179225 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b HTTP/1.1 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'ff33b64b-2980-407e-a2ce-d1277edd008b'} Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:07.185405 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4b314ad-f46c-4925-bc99-87a1f6b7aac6 tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 404 len: 111 microversion: 2.1 time: 0.057930 Sep 16 14:44:07.191401 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3192/6376] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:44:07 2022] DELETE /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:44:07.201776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:07.203104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: ff33b64b-2980-407e-a2ce-d1277edd008b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:07.215887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.216701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.217319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.218301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.218988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.219598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.250062 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b HTTP/1.1 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ff33b64b-2980-407e-a2ce-d1277edd008b'} Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.252606 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. Sep 16 14:44:07.257584 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.279615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance ff33b64b-2980-407e-a2ce-d1277edd008b could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:07.284021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-83a1a280-4cd0-4500-91fb-36f84fea1edf tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b" status: 404 len: 111 microversion: 2.1 time: 0.089362 Sep 16 14:44:07.287514 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3185/6377] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:07 2022] GET /compute/v2.1/servers/ff33b64b-2980-407e-a2ce-d1277edd008b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:44:07.315118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:07.315617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:07.326358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.327351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.336102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.358557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.360154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.361345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.398775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:07.401155 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b HTTP/1.1 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '9f77dd48-0efa-406e-8f66-be8872c67c7b'} Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:07.405899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.410691 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.421045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:07.422973 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46655681-49f7-4c8c-8997-e127a429b1da tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 404 len: 111 microversion: 2.1 time: 0.122143 Sep 16 14:44:07.424858 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3193/6378] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:44:07 2022] DELETE /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:44:07.435116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:07.436013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 9f77dd48-0efa-406e-8f66-be8872c67c7b] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:07.448868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.449071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.449511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.454760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.455262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.455718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.509947 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b HTTP/1.1 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9f77dd48-0efa-406e-8f66-be8872c67c7b'} Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:07.514599 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. Sep 16 14:44:07.520043 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:44:07.522133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 9f77dd48-0efa-406e-8f66-be8872c67c7b could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:07.524579 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4e9bddc-221d-43bc-abd4-7755deecc55b tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b" status: 404 len: 111 microversion: 2.1 time: 0.093435 Sep 16 14:44:07.541864 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3186/6379] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:07 2022] GET /compute/v2.1/servers/9f77dd48-0efa-406e-8f66-be8872c67c7b => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:44:07.734748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:07.735702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:07.783873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.787475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.793892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:07.804300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:07.808997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:07.809757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:09.788749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:09.865748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-61c4df6e-5107-4f49-aa49-2c8600e31bf0 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 2.137328 Sep 16 14:44:09.880911 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3194/6380] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:07 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:10.895066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:10.896363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:10.923771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:10.924981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:10.925902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:10.927412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:10.935807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:10.936895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:12.195667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:12.210808 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d80f0f1-b973-480b-9b62-667998dc434d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 1.319683 Sep 16 14:44:12.215560 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3187/6381] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:10 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:13.254064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:13.265893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:13.272390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:13.273576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:13.342260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:13.343171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:13.343945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:13.354893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:13.356320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:13.357379 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:13.599207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-719232449", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "b71c9662-fb66-4c72-ab80-35a60dc54ece"}], "key_name": "tempest-TestNetworkAdvancedServerOps-697879678", "security_groups": [{"name": "tempest-secgroup-smoke-932303209"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:13.643001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=10 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:14.228003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] validate_networks() for [('b71c9662-fb66-4c72-ab80-35a60dc54ece', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:44:14.372830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:14.388626 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-15e051dc-5782-4fad-8a67-dc212d32f7d3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 1.151518 Sep 16 14:44:14.389887 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3195/6382] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:13 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:14.398726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-aa6584fa-2f1b-4187-aba3-9f3578c29cf2 req-02d2fb0d-28f9-486c-8d9d-97ffed9bc6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd814b00-792c-4e6b-b7d7-937a92d095a2", "tag": "02ee0aa8-316f-49da-951f-7dbefd29d42e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:14.457747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-aa6584fa-2f1b-4187-aba3-9f3578c29cf2 req-02d2fb0d-28f9-486c-8d9d-97ffed9bc6db service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:14.458983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-aa6584fa-2f1b-4187-aba3-9f3578c29cf2 req-02d2fb0d-28f9-486c-8d9d-97ffed9bc6db service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:14.459632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-aa6584fa-2f1b-4187-aba3-9f3578c29cf2 req-02d2fb0d-28f9-486c-8d9d-97ffed9bc6db service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:14.473545 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-aa6584fa-2f1b-4187-aba3-9f3578c29cf2 req-02d2fb0d-28f9-486c-8d9d-97ffed9bc6db service nova] Creating event network-changed:02ee0aa8-316f-49da-951f-7dbefd29d42e for instance fd814b00-792c-4e6b-b7d7-937a92d095a2 on n-h2-858129-2 Sep 16 14:44:14.481797 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-aa6584fa-2f1b-4187-aba3-9f3578c29cf2 req-02d2fb0d-28f9-486c-8d9d-97ffed9bc6db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090252 Sep 16 14:44:14.483223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3196/6383] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:44:14.640616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:14.641413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:14.656479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:14.657016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:14.657480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:14.661254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:14.661881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:14.667876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:14.701574 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 HTTP/1.1 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '58e2a4b1-5232-4366-9496-53a98f1e80b2'} Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:14.708766 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.714480 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.716480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:14.717583 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-107bb695-dc78-426d-a077-8de638c0c6cc tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 404 len: 111 microversion: 2.1 time: 0.081702 Sep 16 14:44:14.720122 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3197/6384] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:44:14 2022] DELETE /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:44:14.732101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:14.732737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] [instance: 58e2a4b1-5232-4366-9496-53a98f1e80b2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:14.750845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:14.751478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:14.752000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:14.752756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:14.753227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:14.753663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:14.789700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] HTTP exception thrown: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Request method failure captured: Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 HTTP/1.1 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJImFBF-7Ow0sNIWS45jWQnC5XOtcu9LttAcZ1ER5m29TO-Cdyk1HkCz4KBliezrtMq-XWT9NluH6fw9WmSh2J5FlzSpyI3kHJgPIz4PRsZFDAgx2ty8hAU5enqtCdFLTK-RvYmDGJTm9rwGr45ulPtk8e5PIPJHv77hvBmqv4-obbSg Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca2f19665b6245b796fe6e9d4ef089a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca2f19665b6245b796fe6e9d4ef089a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca2f19665b6245b796fe6e9d4ef089a0"}]}] Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: ca2f19665b6245b796fe6e9d4ef089a0 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124563528 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c97bf103a09e4909af4b161222e8a167 Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-AttachVolumeNegativeTest-1124563528-project Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '58e2a4b1-5232-4366-9496-53a98f1e80b2'} Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:44:14.797544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] Returning 404 to user: Instance 58e2a4b1-5232-4366-9496-53a98f1e80b2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1bf5ed9a-9fea-452a-85e7-32c884ddab1e tempest-AttachVolumeNegativeTest-1124563528 tempest-AttachVolumeNegativeTest-1124563528-project] 10.222.0.60 "GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2" status: 404 len: 111 microversion: 2.1 time: 0.072350 Sep 16 14:44:14.807384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3198/6385] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:14 2022] GET /compute/v2.1/servers/58e2a4b1-5232-4366-9496-53a98f1e80b2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:44:15.436219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:15.438259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:15.459205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:15.460117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:15.461890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:15.468480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:15.474905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:15.477264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:15.928002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:15.937212 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f1a03f6c-573b-4c5d-8caa-180d1623a050 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 0.520707 Sep 16 14:44:15.943150 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3199/6386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:15 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:16.298243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:44:16.299271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:44:16.299923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:44:16.300500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:44:16.301079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:44:16.340733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:16.346900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:16.356895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:16.362660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:16.363671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:16.364391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:16.421393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:44:16.436797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:44:16.479665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:44:16.490858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:44:16.620681 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af06f7b7-c403-4715-b63c-487773fe35f2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.030242 Sep 16 14:44:16.626762 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3188/6387] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:44:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 3037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:44:16.632976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd05e695-ea8d-473d-a4fe-9835bbce59ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:16.634262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd05e695-ea8d-473d-a4fe-9835bbce59ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:16.647359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:16.823593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd05e695-ea8d-473d-a4fe-9835bbce59ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:16.830341 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd05e695-ea8d-473d-a4fe-9835bbce59ba tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1265 microversion: 2.1 time: 0.201476 Sep 16 14:44:16.830965 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3200/6388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:16 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:16.986501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:16.992191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:17.008119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:17.022842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:17.023419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:17.024526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:17.025627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:17.026067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:17.295113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:17.309527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c560380e-8b35-4711-ad4f-469f543f5da1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 0.343942 Sep 16 14:44:17.313978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3189/6389] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:16 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:17.855095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:17.855896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:17.877877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:17.893922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:17.896771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:17.900421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:17.915259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:17.916825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:18.092035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:18.109877 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30eb0a3f-a259-4e2d-a159-efe51fd1461a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1317 microversion: 2.1 time: 0.259928 Sep 16 14:44:18.110905 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3201/6390] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:17 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:18.338149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:18.338933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:18.352392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:18.369804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:18.370736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:18.371776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:18.372370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:18.372915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:19.104360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:19.112598 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c944853-52c0-479f-9844-3045f01c02e1 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 0.779193 Sep 16 14:44:19.113198 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3190/6391] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:18 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:19.136910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:19.138360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:19.154287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:19.156899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:19.160794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:19.161904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:19.162777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:19.163454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:19.328820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:19.340792 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1a5124e1-daf1-49aa-9abc-3019faf88eef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1323 microversion: 2.1 time: 0.208903 Sep 16 14:44:19.347184 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3202/6392] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:19 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:20.140397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:20.141132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:20.151740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:20.155530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:20.156721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:20.157717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:20.160173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:20.161439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:20.162599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:20.372049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:20.372858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:20.384223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:20.385857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:20.386429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:20.392432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:20.393076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:20.393618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:20.575729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:20.586833 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-761b2125-2f53-47d9-ab63-42f32c50cee5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1323 microversion: 2.1 time: 0.218930 Sep 16 14:44:20.589693 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3203/6393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:20 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:44:20.646368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:20.662491 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4471cb0f-eee8-47fb-82e6-404df0404010 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 0.525771 Sep 16 14:44:20.679589 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3191/6394] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:20 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:44:21.363965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-760ab0a3-7f28-411a-b872-cbd5b38cf9c4 req-eb28c54e-03d2-4928-a162-fcfee87396b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd814b00-792c-4e6b-b7d7-937a92d095a2", "name": "network-vif-plugged", "status": "completed", "tag": "02ee0aa8-316f-49da-951f-7dbefd29d42e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:21.387192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-760ab0a3-7f28-411a-b872-cbd5b38cf9c4 req-eb28c54e-03d2-4928-a162-fcfee87396b0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:21.395480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-760ab0a3-7f28-411a-b872-cbd5b38cf9c4 req-eb28c54e-03d2-4928-a162-fcfee87396b0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:21.396208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-760ab0a3-7f28-411a-b872-cbd5b38cf9c4 req-eb28c54e-03d2-4928-a162-fcfee87396b0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:21.428107 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-760ab0a3-7f28-411a-b872-cbd5b38cf9c4 req-eb28c54e-03d2-4928-a162-fcfee87396b0 service nova] Creating event network-vif-plugged:02ee0aa8-316f-49da-951f-7dbefd29d42e for instance fd814b00-792c-4e6b-b7d7-937a92d095a2 on n-h2-858129-2 Sep 16 14:44:21.447910 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-760ab0a3-7f28-411a-b872-cbd5b38cf9c4 req-eb28c54e-03d2-4928-a162-fcfee87396b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087110 Sep 16 14:44:21.448727 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3204/6395] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:44:21.613481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:21.614281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:21.627494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:21.628093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:21.628547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:21.629269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:21.630359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:21.630853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:21.699992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:21.701724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:21.711376 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:21.712758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:21.713860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:21.714967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:21.715653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:21.716319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:22.015945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:22.048207 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc75dae2-2f2c-447d-9a86-9d6f4246ecc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.438976 Sep 16 14:44:22.048744 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3192/6396] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:21 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:22.290655 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:22.302098 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7a8c2d2e-0bb1-421d-a856-2cebe209564d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 0.610191 Sep 16 14:44:22.303542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3205/6397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:21 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:23.072092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:23.072739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:23.085390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:23.085895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:23.086333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:23.087140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:23.087632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:23.088171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:23.317793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-419828a9-9eb8-4948-9b44-c7a7af12b799 req-eb850c48-6ff3-4233-a9a2-cd0d35a6845f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:23.360948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-419828a9-9eb8-4948-9b44-c7a7af12b799 req-eb850c48-6ff3-4233-a9a2-cd0d35a6845f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:23.361855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-419828a9-9eb8-4948-9b44-c7a7af12b799 req-eb850c48-6ff3-4233-a9a2-cd0d35a6845f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:23.367358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-419828a9-9eb8-4948-9b44-c7a7af12b799 req-eb850c48-6ff3-4233-a9a2-cd0d35a6845f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:23.401714 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-419828a9-9eb8-4948-9b44-c7a7af12b799 req-eb850c48-6ff3-4233-a9a2-cd0d35a6845f service nova] Creating event network-changed:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h1-858129-2 Sep 16 14:44:23.423406 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-419828a9-9eb8-4948-9b44-c7a7af12b799 req-eb850c48-6ff3-4233-a9a2-cd0d35a6845f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109559 Sep 16 14:44:23.424367 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3206/6398] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:44:23.430065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:23.432097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:23.444595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:23.445091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:23.452717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:23.453502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:23.453979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:23.454605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:23.564740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:23.571866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:23.586145 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c6593a2c-a19b-43a6-a0a2-0a157cedbfc9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.517745 Sep 16 14:44:23.638764 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3193/6399] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:23 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:23.860820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:23.872934 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-90120729-4673-481c-8024-0766f18da245 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1374 microversion: 2.1 time: 0.447284 Sep 16 14:44:23.876858 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3207/6400] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:23 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1374 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:24.624726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:24.627226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:24.648023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:24.649956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:24.651079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:24.652909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:24.654020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:24.655080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:24.900296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:24.901095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:24.912301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:24.913562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:24.914310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:24.914784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:24.916159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:24.916870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:24.917630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:24.925096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0351439d-ce38-4516-8393-6a372a7163da tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.312729 Sep 16 14:44:24.938451 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3194/6401] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:24 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:25.139415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:25.165885 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0dd80af-63fb-44b7-9a2d-2ea60023ca09 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1547 microversion: 2.1 time: 0.271240 Sep 16 14:44:25.168493 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3208/6402] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:24 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1547 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:25.189571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:25.190581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:25.197858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:25.198766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:25.199427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:25.200357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:25.201041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:25.201731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:25.420019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:25.434256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f154ca98-7872-4775-ac20-f4d606c0c2ed tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1547 microversion: 2.1 time: 0.248545 Sep 16 14:44:25.435199 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3195/6403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:25 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1547 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:25.968871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:25.970120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:25.978130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:25.978947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:25.979586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:25.980490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:25.981159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:25.981761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:26.266258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:26.280602 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-711f3e5b-e5be-4d43-8360-db158be7aef4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.315543 Sep 16 14:44:26.281447 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3209/6404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:25 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:27.304649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:27.306618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:27.313586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:27.315197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:27.319941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:27.323275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:27.324457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:27.326658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:27.328127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:27.330191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:27.551403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:27.563408 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9b656267-2aa6-4fdf-8654-49bd2407cd68 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.262870 Sep 16 14:44:27.564218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3196/6405] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:27 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:28.587350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:28.588039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:28.599815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:44:28.608741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:28.610888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:28.614746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:28.619028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:28.620164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:28.621349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:28.949016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:28.961242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-978fae38-d85f-48e0-bf0e-c921aea68ee2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.378392 Sep 16 14:44:28.964853 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3210/6406] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:28 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:29.992248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:29.996024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:30.009873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:30.011797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:30.013611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:30.014683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:30.016142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:30.017050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:30.318582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:30.327985 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45964d36-3fe6-483e-a95c-c99e18a17a5a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.339359 Sep 16 14:44:30.336509 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3197/6407] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:29 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:30.623184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4542edf7-8a8e-4b8b-94b2-3d3b6729e408 req-47460873-0a23-4c85-9039-f35661e9f114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "name": "network-vif-plugged", "status": "completed", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:30.643391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4542edf7-8a8e-4b8b-94b2-3d3b6729e408 req-47460873-0a23-4c85-9039-f35661e9f114 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:30.644682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4542edf7-8a8e-4b8b-94b2-3d3b6729e408 req-47460873-0a23-4c85-9039-f35661e9f114 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:30.645151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4542edf7-8a8e-4b8b-94b2-3d3b6729e408 req-47460873-0a23-4c85-9039-f35661e9f114 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:30.669196 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4542edf7-8a8e-4b8b-94b2-3d3b6729e408 req-47460873-0a23-4c85-9039-f35661e9f114 service nova] Creating event network-vif-plugged:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h1-858129-2 Sep 16 14:44:30.692260 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4542edf7-8a8e-4b8b-94b2-3d3b6729e408 req-47460873-0a23-4c85-9039-f35661e9f114 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075233 Sep 16 14:44:30.696101 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3211/6408] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:44:31.364834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:31.365457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:31.375792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:31.377239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:31.378926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:31.379873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:31.380541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:31.381233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:31.584443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:31.595239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0e5a163-a147-4e29-9999-36e8190ce6f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1390 microversion: 2.1 time: 0.235897 Sep 16 14:44:31.611076 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3198/6409] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:31 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:32.623372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:32.625058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:32.636961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:32.640315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:32.640852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:32.641701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:32.644630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:32.645314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:33.022169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:33.034480 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52f365f4-0ed1-4fd5-9f3f-d73b4f832375 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1562 microversion: 2.1 time: 0.418209 Sep 16 14:44:33.041360 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3212/6410] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:32 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1562 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:33.059998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:33.060737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:33.068061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:33.068651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:33.068974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:33.069601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:33.070059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:33.070568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:33.318559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:33.329418 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a40180e-479b-4871-8242-bfa763c95537 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1562 microversion: 2.1 time: 0.274050 Sep 16 14:44:33.335718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3199/6411] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:33 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1562 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:44:35.835071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8b6e4cef-a7f1-47bc-bf61-23b11ed5883c req-25e2b761-6cc4-4d97-8baa-8f104d81de9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:44:35.835780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:44:35.841302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:44:35.853488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:35.854115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:35.860641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:35.862879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:35.863967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:35.864416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:35.872698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b6e4cef-a7f1-47bc-bf61-23b11ed5883c req-25e2b761-6cc4-4d97-8baa-8f104d81de9a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:44:35.873544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b6e4cef-a7f1-47bc-bf61-23b11ed5883c req-25e2b761-6cc4-4d97-8baa-8f104d81de9a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:44:35.878569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8b6e4cef-a7f1-47bc-bf61-23b11ed5883c req-25e2b761-6cc4-4d97-8baa-8f104d81de9a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:44:35.926807 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8b6e4cef-a7f1-47bc-bf61-23b11ed5883c req-25e2b761-6cc4-4d97-8baa-8f104d81de9a service nova] Creating event network-changed:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h1-858129-2 Sep 16 14:44:35.936308 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8b6e4cef-a7f1-47bc-bf61-23b11ed5883c req-25e2b761-6cc4-4d97-8baa-8f104d81de9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105552 Sep 16 14:44:35.937763 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3200/6412] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:44:36.185465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:44:36.196819 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d9fa4d86-c216-452a-8940-2cd9467f2b87 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1562 microversion: 2.1 time: 0.371539 Sep 16 14:44:36.197422 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3213/6413] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:44:35 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1562 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:02.834819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:02.835997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:02.853805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=19 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:02.854715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=39 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:02.857864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:02.858451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:02.859082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:02.860003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:02.860486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:02.860930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:02.918714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:45:03.081819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d47b0bd-bb22-4dc1-ac31-2e08f3a83699 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 204 len: 0 microversion: 2.1 time: 0.249287 Sep 16 14:45:03.083021 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3201/6414] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:45:02 2022] DELETE /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:45:03.093420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:03.095289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:03.099500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=29 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:03.102471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=90 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:03.113444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:03.114286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:03.114991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:03.116765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:03.117995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:03.119430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:03.354346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:03.364105 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d89f9369-491d-435d-b0a3-5ec1290d488c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1553 microversion: 2.1 time: 0.274978 Sep 16 14:45:03.365316 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3214/6415] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:03 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:04.395395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:04.397855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:04.408544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:04.409890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:04.410589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:04.411492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:04.412115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:04.412661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:04.654220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:04.665641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-03d14cfc-326b-44a9-bb80-b39adc215669 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1553 microversion: 2.1 time: 0.278801 Sep 16 14:45:04.666672 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3202/6416] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:04 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:05.554460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-70045eff-fe24-4a32-a86c-cd7288418d26 req-8e60a4b8-94ba-497b-8a40-d10f735876b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd814b00-792c-4e6b-b7d7-937a92d095a2", "name": "network-vif-deleted", "tag": "02ee0aa8-316f-49da-951f-7dbefd29d42e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:05.572584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-70045eff-fe24-4a32-a86c-cd7288418d26 req-8e60a4b8-94ba-497b-8a40-d10f735876b4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:05.573943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-70045eff-fe24-4a32-a86c-cd7288418d26 req-8e60a4b8-94ba-497b-8a40-d10f735876b4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:05.574696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-70045eff-fe24-4a32-a86c-cd7288418d26 req-8e60a4b8-94ba-497b-8a40-d10f735876b4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:05.622858 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-70045eff-fe24-4a32-a86c-cd7288418d26 req-8e60a4b8-94ba-497b-8a40-d10f735876b4 service nova] Creating event network-vif-deleted:02ee0aa8-316f-49da-951f-7dbefd29d42e for instance fd814b00-792c-4e6b-b7d7-937a92d095a2 on n-h2-858129-2 Sep 16 14:45:05.629477 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-70045eff-fe24-4a32-a86c-cd7288418d26 req-8e60a4b8-94ba-497b-8a40-d10f735876b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079385 Sep 16 14:45:05.630461 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3215/6417] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:05.692577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:05.693204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:05.705508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:05.706544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:05.707270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:05.708582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:05.709346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:05.710692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:05.753665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:05.754359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:05.755042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:05.755800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lazy-loading 'fault' on Instance uuid fd814b00-792c-4e6b-b7d7-937a92d095a2 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:45:05.835772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:05.849036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a1e3b77-d55b-4a2f-b97a-ee94dbe1ab0f tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 200 len: 1339 microversion: 2.1 time: 0.160177 Sep 16 14:45:05.850320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3203/6418] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:05 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:06.895155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:06.896548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: fd814b00-792c-4e6b-b7d7-937a92d095a2] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:06.905398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:06.906311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:06.907070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:06.908805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:06.909541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:06.910856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:06.928992 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] HTTP exception thrown: Instance fd814b00-792c-4e6b-b7d7-937a92d095a2 could not be found. Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Request method failure captured: Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 HTTP/1.1 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIs_p0NV9eKl8RbiJPKPdksjEFebL4F40_tq7H3FaYiW85tpaeRUhkUZ_obJwYvWtsaL9lVlU3uPYfzG4Ko3yVbJnRxAopya4o8GbIF8Un5st7znyRJKjgM4wyeVXDKhvyiO27cCO-JL_WWB6TT60w4Vu89zWKamIVfzsbMTpCQgHuI Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c3ac59d69df04ee5993d89d4c6d43c89 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c3ac59d69df04ee5993d89d4c6d43c89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3ac59d69df04ee5993d89d4c6d43c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c3ac59d69df04ee5993d89d4c6d43c89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3ac59d69df04ee5993d89d4c6d43c89"}]}] Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c3ac59d69df04ee5993d89d4c6d43c89 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkBasicOps-1626025916-project Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: eddb0f0a09b64efc880c28290991fd0b Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkBasicOps-1626025916-project Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance fd814b00-792c-4e6b-b7d7-937a92d095a2 could not be found. Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'fd814b00-792c-4e6b-b7d7-937a92d095a2'} Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd814b00-792c-4e6b-b7d7-937a92d095a2 could not be found. Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd814b00-792c-4e6b-b7d7-937a92d095a2 could not be found. Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:45:06.931673 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd814b00-792c-4e6b-b7d7-937a92d095a2 could not be found. Sep 16 14:45:06.937185 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:06.939603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Returning 404 to user: Instance fd814b00-792c-4e6b-b7d7-937a92d095a2 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:45:06.940883 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-17c7a86e-5309-45c4-b670-a1b22c2f06c7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2" status: 404 len: 111 microversion: 2.1 time: 0.051608 Sep 16 14:45:06.944745 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3216/6419] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:06 2022] GET /compute/v2.1/servers/fd814b00-792c-4e6b-b7d7-937a92d095a2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:45:07.177105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c6d3f7d-48ef-4995-9e4c-84d4ee8e34f9 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '.version_select at 0x7f724d690550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:07.218695 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c6d3f7d-48ef-4995-9e4c-84d4ee8e34f9 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1940809289" status: 202 len: 0 microversion: 2.1 time: 0.047310 Sep 16 14:45:07.219504 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3204/6420] 10.222.0.60 () {58 vars in 1257 bytes} [Fri Sep 16 14:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1940809289 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:45:08.643839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:08.646479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:08.666506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:08.667315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:08.667945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:08.668868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:08.669499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:08.670095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:08.769992 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed9f9fc7-3d65-4ffc-9632-a4b6cfa1a19b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action" status: 200 len: 24575 microversion: 2.1 time: 0.132091 Sep 16 14:45:08.771043 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3217/6421] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:45:08 2022] POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action => generated 24575 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:45:09.891718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eeb6399c-53ff-4683-920a-e856880f81e4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Action: 'create', calling method: .version_select at 0x7f724c4acee0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-866804544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI69ytNKVpWCj2hNnUQu9j2Nf5jjOkdrPGy5PFq+k+hmB/EayDNETvkKYD9PdkpbNAzVJwf0qTTLpmrekkFN/mgXFHdY7OhvJR3SLDs7cznJWMV3I2lJ6MHlN33+8050+w=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:09.921335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-eeb6399c-53ff-4683-920a-e856880f81e4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Getting quotas for project 77ca11f2fea54cb8a557fea24a312ea1. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:45:09.931384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-eeb6399c-53ff-4683-920a-e856880f81e4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Getting quotas for user 6060e3241b8942248f10d858ee63efa7 and project 77ca11f2fea54cb8a557fea24a312ea1. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:45:09.973154 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eeb6399c-53ff-4683-920a-e856880f81e4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.090169 Sep 16 14:45:09.978543 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3205/6422] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:45:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:10.494909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:10.495592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:10.502259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6ffbf571-1d92-4e78-9de7-2d2cae0ecdc2 req-77fc526b-6a40-4842-a933-4c1c4e7eab80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c34ad8-0722-4351-b7a0-e049a2a5e942", "tag": "73ed9529-b33b-46df-a9ea-ee58b9b19add"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:10.511552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:10.513140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:10.516242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6ffbf571-1d92-4e78-9de7-2d2cae0ecdc2 req-77fc526b-6a40-4842-a933-4c1c4e7eab80 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:10.516492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:10.518117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:10.521296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:10.523838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:10.524886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6ffbf571-1d92-4e78-9de7-2d2cae0ecdc2 req-77fc526b-6a40-4842-a933-4c1c4e7eab80 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:10.525487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6ffbf571-1d92-4e78-9de7-2d2cae0ecdc2 req-77fc526b-6a40-4842-a933-4c1c4e7eab80 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:10.552854 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6ffbf571-1d92-4e78-9de7-2d2cae0ecdc2 req-77fc526b-6a40-4842-a933-4c1c4e7eab80 service nova] Creating event network-changed:73ed9529-b33b-46df-a9ea-ee58b9b19add for instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 on n-h1-858129-2 Sep 16 14:45:10.568338 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6ffbf571-1d92-4e78-9de7-2d2cae0ecdc2 req-77fc526b-6a40-4842-a933-4c1c4e7eab80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069549 Sep 16 14:45:10.569735 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3206/6423] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:45:10.577833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:45:10.723552 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f45efde-5d18-4517-a1a3-53b180ed56bd tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 204 len: 0 microversion: 2.1 time: 0.241350 Sep 16 14:45:10.728544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3218/6424] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:45:10 2022] DELETE /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:45:10.738647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:10.739656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:10.748068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:10.748817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:10.749484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:10.750518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:10.751532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:10.752003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:10.991763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:11.008684 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3467096b-2445-4418-af9b-706d6e03f133 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1669 microversion: 2.1 time: 0.274057 Sep 16 14:45:11.010091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3207/6425] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:10 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1669 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:11.686732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-202688307", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "09a8a60c-04d3-49f5-9088-d99440516d08", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-866804544", "security_groups": [{"name": "tempest-secgroup-smoke-1255287341"}], "networks": [{"uuid": "3384827d-4cf6-4182-a48c-265773bb85e1"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:11.824885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] validate_networks() for [('3384827d-4cf6-4182-a48c-265773bb85e1', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:45:12.051068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:12.051710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:12.060032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:12.060528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:12.060967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:12.061691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:12.062176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:12.062640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:12.447292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:12.461618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c7e1b07-d325-4a77-a69a-9dbe88f3e735 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1669 microversion: 2.1 time: 0.414484 Sep 16 14:45:12.475834 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3208/6426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:12 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1669 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:45:12.912389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cbf06c25-1813-4ec4-b91a-bdcadc10f816 req-eb574720-475f-4db5-98df-53f064be71b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c34ad8-0722-4351-b7a0-e049a2a5e942", "name": "network-vif-deleted", "tag": "73ed9529-b33b-46df-a9ea-ee58b9b19add"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:12.923570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cbf06c25-1813-4ec4-b91a-bdcadc10f816 req-eb574720-475f-4db5-98df-53f064be71b0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:12.924117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cbf06c25-1813-4ec4-b91a-bdcadc10f816 req-eb574720-475f-4db5-98df-53f064be71b0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:12.924502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cbf06c25-1813-4ec4-b91a-bdcadc10f816 req-eb574720-475f-4db5-98df-53f064be71b0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:12.940228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cbf06c25-1813-4ec4-b91a-bdcadc10f816 req-eb574720-475f-4db5-98df-53f064be71b0 service nova] Creating event network-vif-deleted:73ed9529-b33b-46df-a9ea-ee58b9b19add for instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 on n-h1-858129-2 Sep 16 14:45:12.945686 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cbf06c25-1813-4ec4-b91a-bdcadc10f816 req-eb574720-475f-4db5-98df-53f064be71b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037119 Sep 16 14:45:12.946316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3209/6427] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:13.397929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:45:13.400306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:45:13.401535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:45:13.402844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:45:13.403908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:45:13.416246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:13.416599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:13.417310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:13.418252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:13.418767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:13.419197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:13.443645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Getting quotas for project 77ca11f2fea54cb8a557fea24a312ea1. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:45:13.463610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Getting quotas for user 6060e3241b8942248f10d858ee63efa7 and project 77ca11f2fea54cb8a557fea24a312ea1. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:45:13.500024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:13.500024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:13.514139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:13.518022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:13.518550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:13.519315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:13.519788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:13.520223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:13.589349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:13.590437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:13.591163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:13.591697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lazy-loading 'fault' on Instance uuid e1c34ad8-0722-4351-b7a0-e049a2a5e942 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:45:13.642025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:45:13.644940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09a8a60c-04d3-49f5-9088-d99440516d08',volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:45:13.668967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:13.685981 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a84d40a-fc54-45bb-8a8f-db19cc88e0e3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 200 len: 1489 microversion: 2.1 time: 0.198537 Sep 16 14:45:13.687980 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3210/6428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:13 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 1489 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:13.911187 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fcaa9f51-ff2a-4876-9100-96e8031af134 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.229438 Sep 16 14:45:13.913514 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3219/6429] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:45:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:45:13.925554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-309adf0a-be8c-4b4f-ae53-25011ede13d4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:13.926506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-309adf0a-be8c-4b4f-ae53-25011ede13d4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:14.076099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-309adf0a-be8c-4b4f-ae53-25011ede13d4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:14.087488 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-309adf0a-be8c-4b4f-ae53-25011ede13d4 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1097 microversion: 2.1 time: 0.166014 Sep 16 14:45:14.088316 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3211/6430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:13 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1097 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:14.712464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:14.713074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: e1c34ad8-0722-4351-b7a0-e049a2a5e942] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:14.721296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:14.722081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:14.722945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:14.723892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:14.724549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:14.725199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:14.741168 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] HTTP exception thrown: Instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 could not be found. Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Request method failure captured: Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 HTTP/1.1 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIs_p0NV9eKl8RbiJPKPdksjEFebL4F40_tq7H3FaYiW85tpaeRUhkUZ_obJwYvWtsaL9lVlU3uPYfzG4Ko3yVbJnRxAopya4o8GbIF8Un5st7znyRJKjgM4wyeVXDKhvyiO27cCO-JL_WWB6TT60w4Vu89zWKamIVfzsbMTpCQgHuI Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c3ac59d69df04ee5993d89d4c6d43c89 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c3ac59d69df04ee5993d89d4c6d43c89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3ac59d69df04ee5993d89d4c6d43c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c3ac59d69df04ee5993d89d4c6d43c89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3ac59d69df04ee5993d89d4c6d43c89"}]}] Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c3ac59d69df04ee5993d89d4c6d43c89 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkBasicOps-1626025916-project Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: eddb0f0a09b64efc880c28290991fd0b Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkBasicOps-1626025916-project Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 could not be found. Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'e1c34ad8-0722-4351-b7a0-e049a2a5e942'} Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 could not be found. Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 could not be found. Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:45:14.743382 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 could not be found. Sep 16 14:45:14.749014 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:45:14.750647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Returning 404 to user: Instance e1c34ad8-0722-4351-b7a0-e049a2a5e942 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:45:14.752105 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6b8e130b-088a-4c6c-8f1f-06ce0a4c85a3 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942" status: 404 len: 111 microversion: 2.1 time: 0.044366 Sep 16 14:45:14.757096 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3220/6431] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:14 2022] GET /compute/v2.1/servers/e1c34ad8-0722-4351-b7a0-e049a2a5e942 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:45:15.052793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7168b7b9-343e-475c-a0d4-a8d7895547fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '.version_select at 0x7f724c43e4c0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:15.105679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7168b7b9-343e-475c-a0d4-a8d7895547fb tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-767602570" status: 202 len: 0 microversion: 2.1 time: 0.043326 Sep 16 14:45:15.108515 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3212/6432] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Sep 16 14:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-767602570 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:45:15.114925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:15.115559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:15.124658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:15.125060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:15.125716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:15.126482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:15.126934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:15.127555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:15.226459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:15.235744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-35f25ef7-4464-4cfd-8d46-0f9a800a3ccb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1195 microversion: 2.1 time: 0.124746 Sep 16 14:45:15.236327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3221/6433] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:15 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1195 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:45:16.278536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:16.287302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:16.327788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:16.328460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:16.329178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:16.330294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:16.331173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:16.332001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:16.517139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:16.555452 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ba7f2d5-e7f2-43ac-95f3-95ad83367ac7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1213 microversion: 2.1 time: 0.291087 Sep 16 14:45:16.573479 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3213/6434] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:16 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1213 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:17.602124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:17.603251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:17.619139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:17.619639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:17.620085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:17.620823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:17.621297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:17.621724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:17.981040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:18.005618 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b6c5ec8-eeef-4e86-9e8c-a278136a6e55 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1281 microversion: 2.1 time: 0.408233 Sep 16 14:45:18.007741 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3222/6435] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:17 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1281 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:18.527677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3bc7334b-979e-4132-924b-d6f13407ac15 req-f27d9cc9-18da-4c62-933a-67e4f049a0fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:18.572793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3bc7334b-979e-4132-924b-d6f13407ac15 req-f27d9cc9-18da-4c62-933a-67e4f049a0fd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:18.573853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3bc7334b-979e-4132-924b-d6f13407ac15 req-f27d9cc9-18da-4c62-933a-67e4f049a0fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:18.574329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3bc7334b-979e-4132-924b-d6f13407ac15 req-f27d9cc9-18da-4c62-933a-67e4f049a0fd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:18.618610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3bc7334b-979e-4132-924b-d6f13407ac15 req-f27d9cc9-18da-4c62-933a-67e4f049a0fd service nova] Creating event network-changed:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:45:18.632712 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3bc7334b-979e-4132-924b-d6f13407ac15 req-f27d9cc9-18da-4c62-933a-67e4f049a0fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112643 Sep 16 14:45:18.633820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3214/6436] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:19.031981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:19.033275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:19.050983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:19.051826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:19.052538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:19.054891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:19.056844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:19.062312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:19.569896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:19.586018 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c83f5146-a07a-4519-b986-b87a10906c64 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1281 microversion: 2.1 time: 0.558510 Sep 16 14:45:19.589294 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3223/6437] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:19 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1281 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:20.612652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:20.613397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:20.631418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:20.641914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:20.643703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:20.646151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:20.647992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:20.649459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:21.068375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:21.079630 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16fd0b0d-be00-4d7c-a9fa-1619529c3725 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1281 microversion: 2.1 time: 0.470681 Sep 16 14:45:21.082307 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3215/6438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:20 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:22.106221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:22.107812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:22.121750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:22.122683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:22.123358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:22.124332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:22.125033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:22.125840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:22.405602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:22.415256 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2e55e2cc-e17a-4f54-8fc4-5ea08d31a2aa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1281 microversion: 2.1 time: 0.313122 Sep 16 14:45:22.416228 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3224/6439] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:22 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1281 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:23.440157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:23.441424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:23.454220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:23.454736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:23.467574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:23.471492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:23.472808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:23.473958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:23.696548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:23.710096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e96915d-c96e-42ad-a955-bff3690785a3 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1281 microversion: 2.1 time: 0.274863 Sep 16 14:45:23.710912 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3216/6440] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:23 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:24.734440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:24.735019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:24.738606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:24.739460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:24.748743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:24.749537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:24.750268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:24.751237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:24.751940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:24.752580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:25.001036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:25.010321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3a769038-595f-49d8-97c5-3495a782a622 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.280026 Sep 16 14:45:25.028130 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3225/6441] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:24 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:26.035047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:26.035704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:26.038282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:26.045208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:26.045714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:26.046165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:26.047159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:26.047626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:26.048062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:26.213714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:26.222640 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb8a1423-6a3f-4e23-b1a4-3bfd1ebd13fa tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.191318 Sep 16 14:45:26.224581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3217/6442] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:26 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:27.248613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:27.249201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:27.275255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:27.275750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:27.276180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:27.282082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:27.282928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:27.283580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:27.811207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:27.822966 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97448b76-c5c0-41a2-a291-90b8b93c0a30 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.579163 Sep 16 14:45:27.826723 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3226/6443] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:27 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:28.556854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba33d0c6-6382-4ef7-80e6-3736b5552448 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'create', calling method: .version_select at 0x7f724c334e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-823889277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFftw4p3dXi3ZFJxQMw25P+KxBBfpJZpgYy1TDvEh6K3SVVuWd7wuN6Wfut/hvUPhsXrCOWM2MGrG5YmE+63ftYWW4kccC5XNtFhu/8Z9ncElToORx7n47Uxeg8UqAVLhw=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:28.599435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ba33d0c6-6382-4ef7-80e6-3736b5552448 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:45:28.614096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ba33d0c6-6382-4ef7-80e6-3736b5552448 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for user eddb0f0a09b64efc880c28290991fd0b and project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:45:28.655805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba33d0c6-6382-4ef7-80e6-3736b5552448 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.103848 Sep 16 14:45:28.668577 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3218/6444] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:45:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:28.859774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:28.860434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:28.881972 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:28.882696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:28.883174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:28.883932 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:28.884395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:28.885033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:29.251397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:29.261614 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-03d52d55-3bcd-4217-9d6a-0e5661de159d tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.412811 Sep 16 14:45:29.275596 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3227/6445] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:28 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:45:30.288998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:30.289625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:30.318475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:30.319373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:30.321950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:30.322751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:30.323231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:30.323703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:30.877515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:30.892607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-571cf371-9fd5-4a3d-b968-9e46fa7fb6dd tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.608826 Sep 16 14:45:30.894002 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3219/6446] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:30 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:31.196360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-660518440", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "bbc0f5e7-643a-4630-8564-17c1a0be2e99"}], "key_name": "tempest-TestNetworkBasicOps-823889277", "security_groups": [{"name": "tempest-secgroup-smoke-94804208"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:31.335769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] validate_networks() for [('bbc0f5e7-643a-4630-8564-17c1a0be2e99', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:45:31.805069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:45:31.805763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:45:31.806250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:45:31.806734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:45:31.807454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:45:31.819044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:31.819641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:31.820381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:31.821377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:31.821908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:31.822611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:31.844577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:45:31.850302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Getting quotas for user eddb0f0a09b64efc880c28290991fd0b and project c3ac59d69df04ee5993d89d4c6d43c89. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:45:31.864131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:45:31.866390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:45:31.921299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:31.921966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:31.932513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:31.933391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:31.936132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:31.944688 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d060bf5f-7a70-4095-926b-875d1ba3ce75 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.748200 Sep 16 14:45:31.945740 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3228/6447] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:45:31 2022] POST /compute/v2.1/servers => generated 404 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:45:31.967422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8e6fc2b-fd13-451d-a198-828831f48b16 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:31.969041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:31.969642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:31.970058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b8e6fc2b-fd13-451d-a198-828831f48b16 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:31.971863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:32.143895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b8e6fc2b-fd13-451d-a198-828831f48b16 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:32.156498 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8e6fc2b-fd13-451d-a198-828831f48b16 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1247 microversion: 2.1 time: 0.196859 Sep 16 14:45:32.167393 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3229/6448] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:31 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1247 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:32.372452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:32.388308 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18f423e1-07f2-417f-9815-b416c9d6e66b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.471973 Sep 16 14:45:32.414820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3220/6449] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:31 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:33.184295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:33.185648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:33.193354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:33.195892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:33.196669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:33.197695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:33.198820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:33.199295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:33.199706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:33.213137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:33.297532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:33.311676 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb9a3c7b-b200-4ba3-aac9-a58391407694 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1299 microversion: 2.1 time: 0.132564 Sep 16 14:45:33.312684 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3230/6450] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:33 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:33.425405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:33.426025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:33.430849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:33.443408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:33.443939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:33.448504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:33.451037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:33.451524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:33.453473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:33.462715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:33.838183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:33.852357 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f98e207-d9a9-49ae-8531-4fc746a50995 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.430708 Sep 16 14:45:33.853803 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3221/6451] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:33 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:34.340512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:34.341728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:34.351714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:34.353007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:34.353713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:34.354751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:34.355435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:34.356146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:34.461961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:34.480960 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02816f28-f917-4c5a-a6bf-74ebbd95f128 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1305 microversion: 2.1 time: 0.142972 Sep 16 14:45:34.487441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3231/6452] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:34 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:34.893487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:34.897205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:34.912748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:34.913261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:34.913702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:34.925330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:34.926755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:34.929426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:35.509521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:35.512338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:35.528220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:35.529234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:35.529876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:35.530842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:35.531497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:35.532693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:35.715930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:35.731412 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c29d3de-b0bc-455a-919d-b4396f18c9eb tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.853168 Sep 16 14:45:35.732029 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3222/6453] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:34 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:35.864845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:35.872242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39560fae-591a-41a3-9245-8f48a7ab4f25 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.366789 Sep 16 14:45:35.873204 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3232/6454] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:35 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:45:36.144043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0fd92003-06b4-4654-974f-025333f7bba1 req-3cf10cd4-dda6-4d7a-8a0b-28c46eac3e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "name": "network-vif-plugged", "status": "completed", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:36.165591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0fd92003-06b4-4654-974f-025333f7bba1 req-3cf10cd4-dda6-4d7a-8a0b-28c46eac3e66 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:36.168271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0fd92003-06b4-4654-974f-025333f7bba1 req-3cf10cd4-dda6-4d7a-8a0b-28c46eac3e66 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:36.169027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0fd92003-06b4-4654-974f-025333f7bba1 req-3cf10cd4-dda6-4d7a-8a0b-28c46eac3e66 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:36.189328 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0fd92003-06b4-4654-974f-025333f7bba1 req-3cf10cd4-dda6-4d7a-8a0b-28c46eac3e66 service nova] Creating event network-vif-plugged:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:45:36.197225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0fd92003-06b4-4654-974f-025333f7bba1 req-3cf10cd4-dda6-4d7a-8a0b-28c46eac3e66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060482 Sep 16 14:45:36.198182 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3223/6455] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:36.753716 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b3b69dbc-7e22-4675-80c6-69e30a5c66d7 req-03394ddb-9450-4a65-b5cf-ff0e09862976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1058f54d-8b10-4bcc-ad48-30669c8861f3", "tag": "339b2afd-97d8-4ffb-8d51-1448e44a7b6a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:36.754785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:36.756369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:36.764528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:36.765230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:36.765897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:36.766196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b3b69dbc-7e22-4675-80c6-69e30a5c66d7 req-03394ddb-9450-4a65-b5cf-ff0e09862976 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:36.766825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b3b69dbc-7e22-4675-80c6-69e30a5c66d7 req-03394ddb-9450-4a65-b5cf-ff0e09862976 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:36.767741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b3b69dbc-7e22-4675-80c6-69e30a5c66d7 req-03394ddb-9450-4a65-b5cf-ff0e09862976 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:36.768280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:36.769175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:36.772822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:36.780740 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b3b69dbc-7e22-4675-80c6-69e30a5c66d7 req-03394ddb-9450-4a65-b5cf-ff0e09862976 service nova] Creating event network-changed:339b2afd-97d8-4ffb-8d51-1448e44a7b6a for instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 on n-h1-858129-2 Sep 16 14:45:36.786529 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b3b69dbc-7e22-4675-80c6-69e30a5c66d7 req-03394ddb-9450-4a65-b5cf-ff0e09862976 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237942 Sep 16 14:45:36.787704 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3233/6456] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:36.897432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:36.898571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:36.905672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:36.906313 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:36.906949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:36.907763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:36.908623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:36.909292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:37.020589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:37.031551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da5ee799-6490-4fb2-a5f4-e444e7230f6f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.281521 Sep 16 14:45:37.034734 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3224/6457] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:36 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:37.218260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:37.226920 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c10c1fa-7107-4806-a081-0c8bfde32638 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.334488 Sep 16 14:45:37.227530 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3234/6458] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:36 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:38.057167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:38.057798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:38.064655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:38.065437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:38.065875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:38.066621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:38.067082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:38.067499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:38.253934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:38.255504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:38.271309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:38.271827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:38.272279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:38.273454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:38.274669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:38.275283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:38.308956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:38.320432 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24f7c024-966a-433e-8a56-7e5e2985314b tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1269 microversion: 2.1 time: 0.267601 Sep 16 14:45:38.321836 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3225/6459] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:38 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1269 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:38.532715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:38.541037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f465208-b84f-49fa-bb39-39ce0dc7665d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.294680 Sep 16 14:45:38.541630 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3235/6460] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:38 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:39.226785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:39.228070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:39.233843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:39.237536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.238035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.238740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.239537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.240511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.240936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.344767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:39.346510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:39.353223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.353865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.354610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.355616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.356491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.357181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.688220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:39.702856 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e02a8a93-fa91-4f3f-9652-f64bf1e922f9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1681 microversion: 2.1 time: 0.480223 Sep 16 14:45:39.704417 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3226/6461] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:39 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1681 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:39.709324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:39.710045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:39.716343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.717182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.717871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.718855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.719569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.720231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.810368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:39.828686 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-57d3d18c-3722-4838-96d2-3019b8b4c0b6 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1458 microversion: 2.1 time: 0.487633 Sep 16 14:45:39.829190 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3236/6462] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:39 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1458 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:45:39.841574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:39.845099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:39.852235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.852729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.853163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.853906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.854462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.854890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.930871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f8175047-2305-4e4c-bce6-1dfedb1026b9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action" status: 200 len: 32648 microversion: 2.1 time: 0.100041 Sep 16 14:45:39.931920 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3237/6463] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:45:39 2022] POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action => generated 32648 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:45:39.938968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:39.945172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:39.957683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.958986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.959751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:39.960701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:39.961769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:39.962354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:40.243580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:40.251638 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6fa8d9e-20fe-4509-8d40-fab98d7cbbe5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.546101 Sep 16 14:45:40.252344 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3227/6464] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:39 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:40.257920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:40.258660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:40.264995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:40.265670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:40.266074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:40.266912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:40.267944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:40.268632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:40.783039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:40.791536 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0fc38e11-47ef-4604-b3b3-c5ab5b4f0404 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1458 microversion: 2.1 time: 0.858134 Sep 16 14:45:40.792719 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3238/6465] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:39 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1458 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:40.951256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53e3c0b8-95d2-4f43-b95a-7300e22adea1 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1832 microversion: 2.1 time: 0.697767 Sep 16 14:45:40.952287 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3228/6466] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:40 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1832 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:40.984934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:40.987638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:40.996712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:40.997487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:40.998127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:40.999061 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:40.999515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:40.999948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:41.071071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lazy-loading 'flavor' on Instance uuid 49aff419-8888-45be-8df4-1cba101a0f6d {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:45:41.103514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Going to try to live migrate instance to another host {{(pid=128643) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 16 14:45:41.284565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:41.285258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:41.307871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:41.310354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:41.311025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:41.312054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:41.312718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:41.313350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:41.687246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:41.695641 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cfdf0d0-8018-49bb-8dc5-66cbaa8c54e7 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.415837 Sep 16 14:45:41.696710 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3229/6467] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:41 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:41.834458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:42.155075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=8 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:42.740301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-46a92ec0-722a-4965-9808-e4a37d456f68 req-475007a2-7836-4204-954b-04af76a11f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1058f54d-8b10-4bcc-ad48-30669c8861f3", "name": "network-vif-plugged", "status": "completed", "tag": "339b2afd-97d8-4ffb-8d51-1448e44a7b6a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:42.752097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-46a92ec0-722a-4965-9808-e4a37d456f68 req-475007a2-7836-4204-954b-04af76a11f47 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:42.753110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-46a92ec0-722a-4965-9808-e4a37d456f68 req-475007a2-7836-4204-954b-04af76a11f47 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:42.753785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-46a92ec0-722a-4965-9808-e4a37d456f68 req-475007a2-7836-4204-954b-04af76a11f47 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:42.771207 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-46a92ec0-722a-4965-9808-e4a37d456f68 req-475007a2-7836-4204-954b-04af76a11f47 service nova] Creating event network-vif-plugged:339b2afd-97d8-4ffb-8d51-1448e44a7b6a for instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 on n-h1-858129-2 Sep 16 14:45:42.776920 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-46a92ec0-722a-4965-9808-e4a37d456f68 req-475007a2-7836-4204-954b-04af76a11f47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147556 Sep 16 14:45:42.777937 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3230/6468] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:45:42.784737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:42.785651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:42.792619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:42.793212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:42.793716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:42.794511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:42.795042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:42.795534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:43.082875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:43.092220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e759cb46-3222-4eae-a263-9f8bd2c5ca2e tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.312962 Sep 16 14:45:43.106820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3231/6469] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:42 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:43.451351 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-940be11e-76e0-4509-979d-494747570788 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action" status: 202 len: 0 microversion: 2.1 time: 2.470810 Sep 16 14:45:43.451991 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3239/6470] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:45:40 2022] POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action => generated 0 bytes in 2472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:45:43.463693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:43.464647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:43.472928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:43.473746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:43.474614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:43.475839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:43.476529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:43.477294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:43.625742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:43.634458 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-73aa35db-a6bb-46ea-b6d5-1ce82409bb9b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.174948 Sep 16 14:45:43.635159 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3232/6471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:43 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:44.119540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:44.121366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:44.138981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:44.139647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:44.140255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:44.141228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:44.141794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:44.142328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:44.377798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ae8a4564-1850-4745-8694-489f6d022459 req-7a9be421-ff10-46de-b21b-261d1eb43936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:44.400364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ae8a4564-1850-4745-8694-489f6d022459 req-7a9be421-ff10-46de-b21b-261d1eb43936 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:44.401138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ae8a4564-1850-4745-8694-489f6d022459 req-7a9be421-ff10-46de-b21b-261d1eb43936 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:44.404186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ae8a4564-1850-4745-8694-489f6d022459 req-7a9be421-ff10-46de-b21b-261d1eb43936 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:44.442508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ae8a4564-1850-4745-8694-489f6d022459 req-7a9be421-ff10-46de-b21b-261d1eb43936 service nova] Creating event network-changed:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:45:44.459010 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ae8a4564-1850-4745-8694-489f6d022459 req-7a9be421-ff10-46de-b21b-261d1eb43936 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085220 Sep 16 14:45:44.459964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3233/6472] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:45:44.526420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:44.536743 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8e86fe06-1e3e-48c2-ad39-b7939a042c72 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1371 microversion: 2.1 time: 0.422956 Sep 16 14:45:44.537351 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3240/6473] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:44 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:44.670720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:44.672353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:44.683990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:44.685007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:44.685651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:44.686664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:44.687308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:44.688130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:45.131572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:45.141541 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a940cdcd-d1e0-452e-8f2c-c2395244dfc7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.485009 Sep 16 14:45:45.143378 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3234/6474] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:44 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:45.565148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:45.565845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:45.583690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:45.584276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:45.584713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:45.585430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:45.585879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:45.589674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:45.962077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:45.973438 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-16dc4c6d-2de1-4f5b-aeec-9db956e6b309 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1543 microversion: 2.1 time: 0.411735 Sep 16 14:45:45.974047 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3241/6475] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:45 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1543 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:45.997099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:45.997887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:46.004589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:46.005578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:46.006316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:46.006995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:46.007443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:46.007873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:46.165280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:46.165900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:46.175312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:46.176095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:46.177286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:46.178305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:46.179037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:46.179640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:46.339574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:46.351337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-520b9e55-91fd-448c-94f8-caf13dd0c700 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1543 microversion: 2.1 time: 0.358725 Sep 16 14:45:46.356401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3235/6476] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:45 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1543 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:46.361986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6d88375a-1f55-4773-beb0-856598743d12 req-0e573c4f-25e5-4c16-b8f7-8a7d91b9fc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:46.372704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6d88375a-1f55-4773-beb0-856598743d12 req-0e573c4f-25e5-4c16-b8f7-8a7d91b9fc97 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:46.373615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6d88375a-1f55-4773-beb0-856598743d12 req-0e573c4f-25e5-4c16-b8f7-8a7d91b9fc97 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:46.374867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6d88375a-1f55-4773-beb0-856598743d12 req-0e573c4f-25e5-4c16-b8f7-8a7d91b9fc97 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:46.391960 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6d88375a-1f55-4773-beb0-856598743d12 req-0e573c4f-25e5-4c16-b8f7-8a7d91b9fc97 service nova] Creating event network-vif-unplugged:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h1-858129-2 Sep 16 14:45:46.405902 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6d88375a-1f55-4773-beb0-856598743d12 req-0e573c4f-25e5-4c16-b8f7-8a7d91b9fc97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047607 Sep 16 14:45:46.406959 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3236/6477] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:46.511219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}, {"name": "network-changed", "server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:46.523531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:46.524334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:46.524968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:46.538931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] Creating event network-changed:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:45:46.540657 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] Creating event network-changed:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:45:46.547740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-514ce2ec-5b6d-4857-88d4-f299133cd73c req-5944c1bd-87f1-4f1c-8216-d34a2d4b570f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041659 Sep 16 14:45:46.551720 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3237/6478] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:47.016269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:47.027972 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c1a7cffb-7cd8-4de5-ba28-714f1c294b64 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.866227 Sep 16 14:45:47.029815 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3242/6479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:46 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:48.054699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:48.056163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:48.062595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:48.063230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:48.063839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:48.064557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:48.065022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:48.065453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:48.220150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:48.229427 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-391837f9-517b-4e6c-a2bb-89c0dc5f3389 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.180825 Sep 16 14:45:48.230020 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3238/6480] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:48 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:48.441132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-099dc5bb-435f-41b7-9589-e2e80a4f270a req-5fdbcbbb-f0ed-4c2f-8aec-182e832eafd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:48.455811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-099dc5bb-435f-41b7-9589-e2e80a4f270a req-5fdbcbbb-f0ed-4c2f-8aec-182e832eafd1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:48.456684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-099dc5bb-435f-41b7-9589-e2e80a4f270a req-5fdbcbbb-f0ed-4c2f-8aec-182e832eafd1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:48.457315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-099dc5bb-435f-41b7-9589-e2e80a4f270a req-5fdbcbbb-f0ed-4c2f-8aec-182e832eafd1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:48.473138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-099dc5bb-435f-41b7-9589-e2e80a4f270a req-5fdbcbbb-f0ed-4c2f-8aec-182e832eafd1 service nova] Creating event network-changed:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h1-858129-2 Sep 16 14:45:48.481863 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-099dc5bb-435f-41b7-9589-e2e80a4f270a req-5fdbcbbb-f0ed-4c2f-8aec-182e832eafd1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045208 Sep 16 14:45:48.483231 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3243/6481] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:49.256360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:49.257930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:49.276727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:49.278397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:49.279331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:49.280669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:49.281439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:49.283041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:49.645624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:49.655249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68d5fac0-d645-49c9-bb90-e4576ab3b302 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.403369 Sep 16 14:45:49.659253 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3239/6482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:49 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:49.928382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-de508ee4-5f55-4a52-9997-3a8ffbd6d63c req-153cdf70-6d81-4326-8800-71e44c537c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1058f54d-8b10-4bcc-ad48-30669c8861f3", "tag": "339b2afd-97d8-4ffb-8d51-1448e44a7b6a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:45:49.941926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-de508ee4-5f55-4a52-9997-3a8ffbd6d63c req-153cdf70-6d81-4326-8800-71e44c537c62 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:49.943150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-de508ee4-5f55-4a52-9997-3a8ffbd6d63c req-153cdf70-6d81-4326-8800-71e44c537c62 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:49.943697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-de508ee4-5f55-4a52-9997-3a8ffbd6d63c req-153cdf70-6d81-4326-8800-71e44c537c62 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:49.961318 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-de508ee4-5f55-4a52-9997-3a8ffbd6d63c req-153cdf70-6d81-4326-8800-71e44c537c62 service nova] Creating event network-changed:339b2afd-97d8-4ffb-8d51-1448e44a7b6a for instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 on n-h1-858129-2 Sep 16 14:45:49.967547 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-de508ee4-5f55-4a52-9997-3a8ffbd6d63c req-153cdf70-6d81-4326-8800-71e44c537c62 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044229 Sep 16 14:45:49.969084 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3244/6483] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:45:50.689136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:50.689912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:50.700843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:50.701546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:50.710525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:50.711845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:50.712598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:50.713279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:50.969261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:50.978167 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81a99d29-b7bb-4bab-89d7-9a5a231842f6 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.294514 Sep 16 14:45:50.978978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3240/6484] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:50 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:52.008365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:52.009073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:52.016145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:52.016991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:52.017621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:52.018329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:52.018812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:52.019234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:52.267615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:52.278996 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a108d21d-ccf1-49c0-a925-705d98bd673a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.274584 Sep 16 14:45:52.279752 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3245/6485] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:52 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:53.304153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:53.305754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:53.313522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:53.314295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:53.314770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:53.316841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:53.319097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:53.320929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:53.332172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:53.612060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:53.628035 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99b497c1-d1f8-4dfc-8c60-77e81c4759c0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.328011 Sep 16 14:45:53.646271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3241/6486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:53 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:54.652857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:54.653594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:54.662617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:54.663109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:54.663534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:54.664541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:54.665334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:54.666000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:54.867073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:54.876359 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-22f79db1-73c6-4b2d-9662-f54a496b4f7d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.227567 Sep 16 14:45:54.893170 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3246/6487] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:54 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:55.901759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:55.902511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:55.910550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:55.911183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:55.911709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:55.912519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:55.913246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:55.913870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:56.154811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:56.165897 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4be489a6-06e5-4f9f-8f43-c99efeb413fc tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.268159 Sep 16 14:45:56.167781 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3242/6488] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:55 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:57.192628 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:57.193333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:57.200547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:57.201044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:57.201492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:57.202218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:57.202711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:57.203137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:57.219981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:45:57.529627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:57.562229 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-994d18ba-45c8-408b-a25a-7da5e89b967f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.361577 Sep 16 14:45:57.564685 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3247/6489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:57 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:58.594135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:58.595877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:58.610607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:58.611681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:58.612633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:58.613631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:58.615034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:58.615586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:58.792106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:45:58.813719 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9221afbe-631e-4ee6-8f47-4dfc1cfd4dd9 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1691 microversion: 2.1 time: 0.227003 Sep 16 14:45:58.814330 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3243/6490] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:58 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:45:59.839044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:45:59.840010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:45:59.847402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:59.847910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:59.848918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:45:59.849642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:45:59.850107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:45:59.851202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:00.093561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:00.106620 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c501f500-346b-42bd-89a2-62714fbb3b07 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1681 microversion: 2.1 time: 0.271187 Sep 16 14:46:00.107471 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3248/6491] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:45:59 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:00.133882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:00.133882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:00.140562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:00.147340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:00.147842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:00.148706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:00.149261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:00.149715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:00.373155 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a27cda0-310a-4afb-8227-2e34eda31059 tempest-TestNetworkAdvancedServerOps-1096636846 tempest-TestNetworkAdvancedServerOps-1096636846-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1832 microversion: 2.1 time: 0.244966 Sep 16 14:46:00.374121 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3244/6492] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:00 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1832 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:00.412578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:00.413765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:00.422039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:00.423476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:00.424337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:00.425347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:00.426109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:00.427337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:00.621223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:00.629624 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3a6e7365-99dd-43ae-8bdf-b1967aa3d159 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1681 microversion: 2.1 time: 0.228980 Sep 16 14:46:00.630227 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3249/6493] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:00 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:46:03.053965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:03.056303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:03.063492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:03.063984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:03.064421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:03.065405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:03.065917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:03.066355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:03.145647 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ddb49f17-56f5-4cd4-a261-ee350ddc0216 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action" status: 200 len: 38640 microversion: 2.1 time: 0.096078 Sep 16 14:46:03.146370 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3245/6494] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:46:03 2022] POST /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d/action => generated 38640 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:46:04.350818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:04.351472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:04.356495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-72b29e61-0f6f-4f47-b56d-59226fba2776 req-790b18dc-1d44-46c1-a0a4-91f9fd8a84e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:04.359181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=42 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:04.361805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:04.362944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:04.363712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:04.364975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:04.365987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:04.366690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:04.367135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=50 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:04.383415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-72b29e61-0f6f-4f47-b56d-59226fba2776 req-790b18dc-1d44-46c1-a0a4-91f9fd8a84e3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:04.384194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-72b29e61-0f6f-4f47-b56d-59226fba2776 req-790b18dc-1d44-46c1-a0a4-91f9fd8a84e3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:04.384863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-72b29e61-0f6f-4f47-b56d-59226fba2776 req-790b18dc-1d44-46c1-a0a4-91f9fd8a84e3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:04.398727 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-72b29e61-0f6f-4f47-b56d-59226fba2776 req-790b18dc-1d44-46c1-a0a4-91f9fd8a84e3 service nova] Creating event network-changed:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h2-858129-2 Sep 16 14:46:04.405068 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-72b29e61-0f6f-4f47-b56d-59226fba2776 req-790b18dc-1d44-46c1-a0a4-91f9fd8a84e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055551 Sep 16 14:46:04.406380 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3246/6495] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:46:04.412747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:46:04.534562 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b0e99458-5042-4868-bb22-14986f490efa tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 204 len: 0 microversion: 2.1 time: 0.188468 Sep 16 14:46:04.539720 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3250/6496] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:46:04 2022] DELETE /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:46:04.546011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:04.547001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:04.554235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:04.556039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:04.556755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:04.557935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:04.558814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:04.559356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:04.736245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:04.745356 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ab06f2e-5963-4cd8-acdf-4a960c0343be tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1687 microversion: 2.1 time: 0.204627 Sep 16 14:46:04.746332 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3247/6497] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:04 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:46:05.771751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:05.772480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:05.780357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:05.780704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:05.781146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:05.782078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:05.782945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:05.783553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:05.882347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:05.891614 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19948d42-aeb4-474c-9f45-dc47b6520435 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 200 len: 1501 microversion: 2.1 time: 0.124748 Sep 16 14:46:05.892286 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3251/6498] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:05 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 1501 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:06.434289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6f32a57c-1231-4feb-8d82-f6baacb00ade req-85e297b8-b0f2-4cb0-9909-b0e1957f2ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aff419-8888-45be-8df4-1cba101a0f6d", "name": "network-vif-deleted", "tag": "a11d95a2-15c2-4e82-bf6b-4913f1b13d21"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:06.455003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6f32a57c-1231-4feb-8d82-f6baacb00ade req-85e297b8-b0f2-4cb0-9909-b0e1957f2ae2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:06.455928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6f32a57c-1231-4feb-8d82-f6baacb00ade req-85e297b8-b0f2-4cb0-9909-b0e1957f2ae2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:06.456597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6f32a57c-1231-4feb-8d82-f6baacb00ade req-85e297b8-b0f2-4cb0-9909-b0e1957f2ae2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:06.471785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6f32a57c-1231-4feb-8d82-f6baacb00ade req-85e297b8-b0f2-4cb0-9909-b0e1957f2ae2 service nova] Creating event network-vif-deleted:a11d95a2-15c2-4e82-bf6b-4913f1b13d21 for instance 49aff419-8888-45be-8df4-1cba101a0f6d on n-h2-858129-2 Sep 16 14:46:06.477617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6f32a57c-1231-4feb-8d82-f6baacb00ade req-85e297b8-b0f2-4cb0-9909-b0e1957f2ae2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055336 Sep 16 14:46:06.478242 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3248/6499] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:46:06.916615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:06.917238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 49aff419-8888-45be-8df4-1cba101a0f6d] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:06.925321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:06.925840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:06.927148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:06.928101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:06.928588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:06.929066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:06.944613 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] HTTP exception thrown: Instance 49aff419-8888-45be-8df4-1cba101a0f6d could not be found. Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Request method failure captured: Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d HTTP/1.1 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIntDKRZ4QqUPjM5AB-8_Gwg-dOv23461hiXyb_tXnwb5dvj9M0pQQqn0sQjUMlAyiTUssIlJMZkO9pWU44eRrFMjR0bpaXHP-8S_1X0DuKcmEy4bYZQYoZG4OQyOrunKl4SFLWOj5xXkGXRWINY5Q5rucW9wVD8Fojj3TAMYGSZis8 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9da7c684cd0c42e1904ea60b02e60465", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}] Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: ccf53133b4d94387b8bb277f44c5f780 Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 49aff419-8888-45be-8df4-1cba101a0f6d could not be found. Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '49aff419-8888-45be-8df4-1cba101a0f6d'} Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aff419-8888-45be-8df4-1cba101a0f6d could not be found. Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aff419-8888-45be-8df4-1cba101a0f6d could not be found. Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:06.946319 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aff419-8888-45be-8df4-1cba101a0f6d could not be found. Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Returning 404 to user: Instance 49aff419-8888-45be-8df4-1cba101a0f6d could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb3665c1-5dab-43e3-a053-4fccf20cb775 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d" status: 404 len: 111 microversion: 2.1 time: 0.035678 Sep 16 14:46:06.958861 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3252/6500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:06 2022] GET /compute/v2.1/servers/49aff419-8888-45be-8df4-1cba101a0f6d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:46:11.275396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8679832e-0199-4392-be15-5d6e933a2bef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '.version_select at 0x7f724c334430>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:11.311862 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8679832e-0199-4392-be15-5d6e933a2bef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697879678" status: 202 len: 0 microversion: 2.1 time: 0.042363 Sep 16 14:46:11.312705 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3249/6501] 10.222.0.60 () {58 vars in 1281 bytes} [Fri Sep 16 14:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697879678 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:46:11.345368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5006bcbe-ac49-413e-ab77-eac6a42c6b2c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: .version_select at 0x7f724c28e550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1482921314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMfXDgUDjCIACWZxr0tq5HdVGvujfIQZEyrUbTmkfPXj7CkOnUPDOfBHGzbYnNM38PCj/lEwXMzzJjkmWaUnnM7MnqtLb3uTdjoScfDnru6d+1qks2fERqN/gOmhsymqA=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:11.362011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5006bcbe-ac49-413e-ab77-eac6a42c6b2c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:46:11.369040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-5006bcbe-ac49-413e-ab77-eac6a42c6b2c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:46:11.407412 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5006bcbe-ac49-413e-ab77-eac6a42c6b2c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.065567 Sep 16 14:46:11.408026 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3253/6502] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:46:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:46:18.488643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:18.489592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:18.495574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:18.499750 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3047a011-f9a4-4935-b6e6-ef53047000fa req-51a7368d-75e5-4991-88a9-a3282c875262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:18.520685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=37 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:18.528565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:18.529231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:18.529520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:18.530240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:18.530727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:18.531653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3047a011-f9a4-4935-b6e6-ef53047000fa req-51a7368d-75e5-4991-88a9-a3282c875262 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:18.532300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:18.539384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3047a011-f9a4-4935-b6e6-ef53047000fa req-51a7368d-75e5-4991-88a9-a3282c875262 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:18.539835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3047a011-f9a4-4935-b6e6-ef53047000fa req-51a7368d-75e5-4991-88a9-a3282c875262 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:18.568173 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3047a011-f9a4-4935-b6e6-ef53047000fa req-51a7368d-75e5-4991-88a9-a3282c875262 service nova] Creating event network-changed:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:46:18.579404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:46:18.584156 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3047a011-f9a4-4935-b6e6-ef53047000fa req-51a7368d-75e5-4991-88a9-a3282c875262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090096 Sep 16 14:46:18.587528 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3254/6503] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:46:18.753891 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-23f9afcb-febf-42fb-822f-ad3e388e0512 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "DELETE /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 204 len: 0 microversion: 2.1 time: 0.267524 Sep 16 14:46:18.755772 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3250/6504] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:46:18 2022] DELETE /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:46:18.765636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:18.766366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:18.779633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:18.782887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:18.783885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:18.789007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:18.790107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:18.791789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:19.070575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:19.085278 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-82a24488-8365-4a37-8bf3-fee75405efe7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1581 microversion: 2.1 time: 0.324454 Sep 16 14:46:19.086959 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3255/6505] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:18 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1581 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:19.149901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1454757663", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "22860ceb-268c-441c-8091-4d85145df1b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1482921314", "security_groups": [{"name": "tempest-secgroup-smoke-1590215454"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:19.418466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] validate_networks() for [('22860ceb-268c-441c-8091-4d85145df1b5', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:46:20.123389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:20.125480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:20.145223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:20.150073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:20.151809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:20.152780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:20.155352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:20.157765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:20.437998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:46:20.438592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:46:20.438945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:46:20.439366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:46:20.439790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:46:20.457903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:20.458496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:20.462112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:20.464949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:20.465467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:20.465920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:20.513725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:46:20.532450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Getting quotas for user ccf53133b4d94387b8bb277f44c5f780 and project 9da7c684cd0c42e1904ea60b02e60465. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:46:20.544289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:20.556337 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-afe32614-e786-4e56-8d4b-530e5177d7d5 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1581 microversion: 2.1 time: 0.443627 Sep 16 14:46:20.561210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:46:20.564479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:46:20.585773 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3256/6506] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:20 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1581 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:46:20.599152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:20.605797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:20.627228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:20.628558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:20.629862 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:20.631894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:20.632384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:20.634165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:20.656730 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9bd2808c-060d-451d-a065-796ef3f00d0f tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.519249 Sep 16 14:46:20.663539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3251/6507] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:46:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:46:20.675916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a5c68a6-89b9-474f-8295-f4da66275ea2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:20.676878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a5c68a6-89b9-474f-8295-f4da66275ea2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:20.729821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-426c16c4-a51e-4b36-b4e1-fef6f9f5991d tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3/action" status: 200 len: 24569 microversion: 2.1 time: 0.142441 Sep 16 14:46:20.730532 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3257/6508] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:46:20 2022] POST /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3/action => generated 24569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:46:20.806134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a5c68a6-89b9-474f-8295-f4da66275ea2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:20.815609 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a5c68a6-89b9-474f-8295-f4da66275ea2 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1267 microversion: 2.1 time: 0.144156 Sep 16 14:46:20.818391 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3252/6509] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:20 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:21.588054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:21.592733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:21.593723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:21.603478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:21.604232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:21.604834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:21.605731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:21.606363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:21.607013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:21.796353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:21.804545 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5af28205-a026-4af1-92d4-e62b6a4c5461 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1464 microversion: 2.1 time: 0.218236 Sep 16 14:46:21.805846 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3258/6510] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:21 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:21.844487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:21.845254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:21.854523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:21.855201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:21.857410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:21.858637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:21.859348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:21.860506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:21.962612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:21.972837 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d62296c-1637-4c40-aa2d-034e7ab93c38 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1319 microversion: 2.1 time: 0.132311 Sep 16 14:46:21.979107 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3253/6511] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:21 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:22.056138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-782e653e-8f71-42b1-892f-6dbeb15784ec req-c111d7cd-995c-4b41-97f3-5b849f775337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08194719-560d-4b8b-a524-6fb2908f6a18", "name": "network-vif-deleted", "tag": "f304c118-2c0e-4fe7-a81f-6c552f5aceeb"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:22.067556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-782e653e-8f71-42b1-892f-6dbeb15784ec req-c111d7cd-995c-4b41-97f3-5b849f775337 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:22.068133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-782e653e-8f71-42b1-892f-6dbeb15784ec req-c111d7cd-995c-4b41-97f3-5b849f775337 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:22.068625 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-782e653e-8f71-42b1-892f-6dbeb15784ec req-c111d7cd-995c-4b41-97f3-5b849f775337 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:22.080979 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-782e653e-8f71-42b1-892f-6dbeb15784ec req-c111d7cd-995c-4b41-97f3-5b849f775337 service nova] Creating event network-vif-deleted:f304c118-2c0e-4fe7-a81f-6c552f5aceeb for instance 08194719-560d-4b8b-a524-6fb2908f6a18 on n-h2-858129-2 Sep 16 14:46:22.087457 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-782e653e-8f71-42b1-892f-6dbeb15784ec req-c111d7cd-995c-4b41-97f3-5b849f775337 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 Sep 16 14:46:22.091430 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3259/6512] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:46:22.829810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:22.830469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:22.850422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:22.851162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:22.851629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:22.852873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:22.853350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:22.853789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:23.001876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:23.003262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:23.011134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:23.011873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:23.012503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:23.013387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:23.014008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:23.014793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:23.018285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:23.036536 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-06915c73-fbe9-4674-b5dc-ad4a9cd570be tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1228 microversion: 2.1 time: 0.208000 Sep 16 14:46:23.037692 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3254/6513] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:22 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1228 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:23.141567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:23.152873 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f2741f8b-988e-4ada-8831-9c4dc314ff1c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1325 microversion: 2.1 time: 0.155909 Sep 16 14:46:23.166438 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3260/6514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:22 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:24.064226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:24.065783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:24.074133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:24.074982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:24.075864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:24.076789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:24.077438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:24.078054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:24.185713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:24.186512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:24.200041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:24.200783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:24.201442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:24.202510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:24.203126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:24.203749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:24.239164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:24.252984 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-154a5c35-2cbf-4c15-a0f9-c0f89a8dd910 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1228 microversion: 2.1 time: 0.192583 Sep 16 14:46:24.255472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3255/6515] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:24 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1228 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:24.733759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:24.743434 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11427cf3-f618-435f-be87-f3e9b5db2237 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.562098 Sep 16 14:46:24.744266 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3261/6516] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:24 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:46:24.812303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e8b48808-a3d0-4974-b964-8e05f7eecd72 req-36d2d506-bad7-447e-94d3-7d1da7fe5cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89698173-dc48-43a0-8151-6c0b93095d8e", "tag": "6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:24.824631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e8b48808-a3d0-4974-b964-8e05f7eecd72 req-36d2d506-bad7-447e-94d3-7d1da7fe5cb9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:24.825214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e8b48808-a3d0-4974-b964-8e05f7eecd72 req-36d2d506-bad7-447e-94d3-7d1da7fe5cb9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:24.825651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e8b48808-a3d0-4974-b964-8e05f7eecd72 req-36d2d506-bad7-447e-94d3-7d1da7fe5cb9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:24.838595 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e8b48808-a3d0-4974-b964-8e05f7eecd72 req-36d2d506-bad7-447e-94d3-7d1da7fe5cb9 service nova] Creating event network-changed:6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e for instance 89698173-dc48-43a0-8151-6c0b93095d8e on n-h1-858129-2 Sep 16 14:46:24.843968 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e8b48808-a3d0-4974-b964-8e05f7eecd72 req-36d2d506-bad7-447e-94d3-7d1da7fe5cb9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037716 Sep 16 14:46:24.844587 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3256/6517] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:46:25.277055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:25.277678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:25.287761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:25.288673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:25.289555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:25.290803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:25.302511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:25.303033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:25.400848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:25.411528 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-78451dd2-8292-4868-a916-84057ec05b63 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1228 microversion: 2.1 time: 0.139229 Sep 16 14:46:25.412413 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3262/6518] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:25 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1228 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:25.768810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:25.770254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:25.777708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:25.778927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:25.779623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:25.780423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:25.781123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:25.781639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:25.931065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:25.939407 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a9e935ce-25e2-45d2-bd89-82e6e6ca90d3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.175915 Sep 16 14:46:25.940006 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3257/6519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:25 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:26.436143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:26.436709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:26.444045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:26.444525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:26.444960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:26.445668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:26.446130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:26.446588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:26.516024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:26.525106 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e24c5b59-ba6b-4207-9c91-2ff080b9c5f7 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1228 microversion: 2.1 time: 0.094270 Sep 16 14:46:26.526107 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3263/6520] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:26 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:26.963660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:26.964921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:26.972910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:26.973412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:26.973951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:26.974854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:26.975574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:26.976030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:27.132535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:27.141114 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-80e67912-07b3-423f-8f12-99c745295213 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.181794 Sep 16 14:46:27.142129 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3258/6521] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:26 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:27.549526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:27.552092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:27.562438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:27.563212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:27.563820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:27.565066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:27.566428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:27.567053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:27.624003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:27.624845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:27.625479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:27.626011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lazy-loading 'fault' on Instance uuid 08194719-560d-4b8b-a524-6fb2908f6a18 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:46:27.695406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6060e3241b8942248f10d858ee63efa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ca11f2fea54cb8a557fea24a312ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:27.707354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0cdaa1c9-89c5-4741-a166-ef2731b7f65a tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 200 len: 1233 microversion: 2.1 time: 0.161775 Sep 16 14:46:27.728924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3264/6522] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:27 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 1233 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:28.165791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:28.167991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:28.182355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:28.183537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:28.184394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:28.186527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:28.187357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:28.188229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:28.367701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:28.380321 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b21f0a1-875f-4e7d-9d69-83724a987b23 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.217838 Sep 16 14:46:28.381663 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3259/6523] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:28 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:28.745206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:28.746056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] [instance: 08194719-560d-4b8b-a524-6fb2908f6a18] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:28.752646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:28.753670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:28.754114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:28.754894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:28.755530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:28.755944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:28.771801 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] HTTP exception thrown: Instance 08194719-560d-4b8b-a524-6fb2908f6a18 could not be found. Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Request method failure captured: Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 HTTP/1.1 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJItQjWXJpyAF4mRiajs7DqOV1jVkKqSlQMzHImkpJAoMlxB2tmdS2LN_WvmthxMGyQW8pWy8jX463l-TDgNS0gxSQ6nA5B03VJoZLSNCYJJ5whyFBAOah4ru1uNOC9IJd0pHsfPf0SJhfrMbI7ml560pyz1O8OMhx8bFexk8G2zs5qo Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 77ca11f2fea54cb8a557fea24a312ea1 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBackupRestore-2052735289 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77ca11f2fea54cb8a557fea24a312ea1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77ca11f2fea54cb8a557fea24a312ea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77ca11f2fea54cb8a557fea24a312ea1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77ca11f2fea54cb8a557fea24a312ea1"}]}] Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBackupRestore-2052735289 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 77ca11f2fea54cb8a557fea24a312ea1 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2052735289 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBackupRestore-2052735289-project Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 6060e3241b8942248f10d858ee63efa7 Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBackupRestore-2052735289-project Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 08194719-560d-4b8b-a524-6fb2908f6a18 could not be found. Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '08194719-560d-4b8b-a524-6fb2908f6a18'} Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08194719-560d-4b8b-a524-6fb2908f6a18 could not be found. Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08194719-560d-4b8b-a524-6fb2908f6a18 could not be found. Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:46:28.773747 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08194719-560d-4b8b-a524-6fb2908f6a18 could not be found. Sep 16 14:46:28.779965 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:28.780999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Returning 404 to user: Instance 08194719-560d-4b8b-a524-6fb2908f6a18 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:46:28.781475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-81000fb2-b6de-4ced-ac69-c9b0c35b58e2 tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18" status: 404 len: 111 microversion: 2.1 time: 0.045346 Sep 16 14:46:28.782292 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3265/6524] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:28 2022] GET /compute/v2.1/servers/08194719-560d-4b8b-a524-6fb2908f6a18 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:46:28.978928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4560c2d5-5237-4ba5-a4e6-848be2d0890f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] Calling method '.version_select at 0x7f724d7d25e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:29.002159 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4560c2d5-5237-4ba5-a4e6-848be2d0890f tempest-TestVolumeBackupRestore-2052735289 tempest-TestVolumeBackupRestore-2052735289-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-866804544" status: 202 len: 0 microversion: 2.1 time: 0.027535 Sep 16 14:46:29.018486 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3260/6525] 10.222.0.60 () {58 vars in 1266 bytes} [Fri Sep 16 14:46:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-866804544 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:46:29.412135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:29.414280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:29.445816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:29.448876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:29.451237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:29.453953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:29.454995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:29.455715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:29.807589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:29.820409 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f505ba9f-502d-411e-901c-5f0dee68b40a tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.420056 Sep 16 14:46:29.822477 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3266/6526] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:29 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:30.841941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:30.845149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:30.851985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:30.852551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:30.868606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:30.869118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:30.869563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:30.870287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:30.870820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:30.871203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:31.013173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4bcf6448-b27d-493e-8133-f70e71c8662f req-17aa857a-e7c1-4655-8f9b-05cdbdbe4603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89698173-dc48-43a0-8151-6c0b93095d8e", "name": "network-vif-plugged", "status": "completed", "tag": "6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:31.035450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4bcf6448-b27d-493e-8133-f70e71c8662f req-17aa857a-e7c1-4655-8f9b-05cdbdbe4603 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:31.036023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4bcf6448-b27d-493e-8133-f70e71c8662f req-17aa857a-e7c1-4655-8f9b-05cdbdbe4603 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:31.041679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4bcf6448-b27d-493e-8133-f70e71c8662f req-17aa857a-e7c1-4655-8f9b-05cdbdbe4603 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:31.065880 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4bcf6448-b27d-493e-8133-f70e71c8662f req-17aa857a-e7c1-4655-8f9b-05cdbdbe4603 service nova] Creating event network-vif-plugged:6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e for instance 89698173-dc48-43a0-8151-6c0b93095d8e on n-h1-858129-2 Sep 16 14:46:31.080304 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4bcf6448-b27d-493e-8133-f70e71c8662f req-17aa857a-e7c1-4655-8f9b-05cdbdbe4603 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071293 Sep 16 14:46:31.084726 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3267/6527] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:46:31.212377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:31.224186 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3f79ec7a-a162-4885-9cf2-e94ed8478107 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.383994 Sep 16 14:46:31.238435 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3261/6528] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:30 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:32.255874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:32.256268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:32.263711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:32.264304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:32.264789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:32.265556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:32.266076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:32.266537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:32.429980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:32.439078 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-589f29ad-67e2-4b95-8ab9-9d8cb9b7e28d tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1393 microversion: 2.1 time: 0.190003 Sep 16 14:46:32.440225 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3268/6529] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:32 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:33.461778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:33.463146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:33.471534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:33.472298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:33.472960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:33.473901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:33.474626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:33.475537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:33.665547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:33.677540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d7f2c27-44ac-4141-a6f9-75cdb10506ac tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1565 microversion: 2.1 time: 0.219807 Sep 16 14:46:33.679717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3262/6530] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:33 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1565 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:33.704585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:33.704585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:33.717108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:33.717615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:33.718052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:33.718799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:33.719260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:33.719687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:33.892922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:33.901140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8310a58e-af83-449f-ade2-288db1aa8202 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1565 microversion: 2.1 time: 0.201198 Sep 16 14:46:33.901727 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3269/6531] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:33 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1565 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:36.506083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:36.507116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-19976b86-caa2-43b1-a4e0-7e93d43faf70 req-abe0c20b-cf75-4a7c-96cc-3a1814c1acb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89698173-dc48-43a0-8151-6c0b93095d8e", "tag": "6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:36.510198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:36.514942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:36.538113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:36.543671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:36.543671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:36.543671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:36.548374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-19976b86-caa2-43b1-a4e0-7e93d43faf70 req-abe0c20b-cf75-4a7c-96cc-3a1814c1acb1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:36.549394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:36.552403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:36.553975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-19976b86-caa2-43b1-a4e0-7e93d43faf70 req-abe0c20b-cf75-4a7c-96cc-3a1814c1acb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:36.554868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-19976b86-caa2-43b1-a4e0-7e93d43faf70 req-abe0c20b-cf75-4a7c-96cc-3a1814c1acb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:36.555148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:36.617283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-19976b86-caa2-43b1-a4e0-7e93d43faf70 req-abe0c20b-cf75-4a7c-96cc-3a1814c1acb1 service nova] Creating event network-changed:6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e for instance 89698173-dc48-43a0-8151-6c0b93095d8e on n-h1-858129-2 Sep 16 14:46:36.639694 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-19976b86-caa2-43b1-a4e0-7e93d43faf70 req-abe0c20b-cf75-4a7c-96cc-3a1814c1acb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145174 Sep 16 14:46:36.641216 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3270/6532] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:46:37.298692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:37.332955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f136320-b37c-46da-969e-85197fa08b2b tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1565 microversion: 2.1 time: 0.840618 Sep 16 14:46:37.337510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3263/6533] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:36 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1565 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:51.294807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=82 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:51.300777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:51.303477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:51.310800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:51.311399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:51.312028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:51.313104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:51.313638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:51.314136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:51.389434 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-88c3ffd7-4c07-4e57-b02e-fd967fa7ccf5 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "POST /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3/action" status: 200 len: 32641 microversion: 2.1 time: 0.096913 Sep 16 14:46:51.390188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3271/6534] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:46:51 2022] POST /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3/action => generated 32641 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 14:46:52.551381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:52.552628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:52.556205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:52.557069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:46:52.564546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:52.565247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:52.565970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:52.566650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:52.567260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:52.567746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:52.602150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:46:52.719955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53011421-1186-49ff-b1d4-ebbc8db93edc tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 204 len: 0 microversion: 2.1 time: 0.172187 Sep 16 14:46:52.726118 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3264/6535] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:46:52 2022] DELETE /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:46:52.734106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:52.734790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:52.743230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:52.743861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:52.744397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:52.745225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:52.745811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:52.746500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:52.907998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3db9c1cb-2671-4fb0-a522-bde3136805f1 req-21a60744-05fb-4e3c-9bd3-8db11990db45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1058f54d-8b10-4bcc-ad48-30669c8861f3", "tag": "339b2afd-97d8-4ffb-8d51-1448e44a7b6a"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:52.920932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:52.921447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3db9c1cb-2671-4fb0-a522-bde3136805f1 req-21a60744-05fb-4e3c-9bd3-8db11990db45 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:52.922075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3db9c1cb-2671-4fb0-a522-bde3136805f1 req-21a60744-05fb-4e3c-9bd3-8db11990db45 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:52.922667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3db9c1cb-2671-4fb0-a522-bde3136805f1 req-21a60744-05fb-4e3c-9bd3-8db11990db45 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:52.931439 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-51e7d4ce-5bc0-4e1a-9ec1-6a521845adbe tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1667 microversion: 2.1 time: 0.203730 Sep 16 14:46:52.942506 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3db9c1cb-2671-4fb0-a522-bde3136805f1 req-21a60744-05fb-4e3c-9bd3-8db11990db45 service nova] Creating event network-changed:339b2afd-97d8-4ffb-8d51-1448e44a7b6a for instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 on n-h1-858129-2 Sep 16 14:46:52.948013 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3db9c1cb-2671-4fb0-a522-bde3136805f1 req-21a60744-05fb-4e3c-9bd3-8db11990db45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391329 Sep 16 14:46:52.948406 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3265/6536] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:52 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1667 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:52.948905 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3272/6537] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:46:53.957801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:53.958487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:53.965463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:53.965947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:53.966382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:53.967097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:53.967550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:53.967973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:54.146833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:54.155725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0f114d5-5e57-446a-821d-0dd1173e952c tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1667 microversion: 2.1 time: 0.202241 Sep 16 14:46:54.156329 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3266/6538] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:53 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1667 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:46:55.184348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:55.186446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:55.198860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:55.199368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:55.200023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:55.201139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:55.201773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:55.202515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:55.435690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eddb0f0a09b64efc880c28290991fd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ac59d69df04ee5993d89d4c6d43c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:46:55.445717 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0b621b4a-780f-4b36-a2a0-f75600504870 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 200 len: 1549 microversion: 2.1 time: 0.269384 Sep 16 14:46:55.446524 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3273/6539] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:55 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 1549 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:46:55.565264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9a7f7f17-0b9b-48a8-8d1d-61ed802a3747 req-1bc4c3f8-fbf9-4903-bc83-261b16999e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1058f54d-8b10-4bcc-ad48-30669c8861f3", "name": "network-vif-deleted", "tag": "339b2afd-97d8-4ffb-8d51-1448e44a7b6a"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:46:55.585134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9a7f7f17-0b9b-48a8-8d1d-61ed802a3747 req-1bc4c3f8-fbf9-4903-bc83-261b16999e10 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:55.587009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9a7f7f17-0b9b-48a8-8d1d-61ed802a3747 req-1bc4c3f8-fbf9-4903-bc83-261b16999e10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:55.587497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9a7f7f17-0b9b-48a8-8d1d-61ed802a3747 req-1bc4c3f8-fbf9-4903-bc83-261b16999e10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:55.601606 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9a7f7f17-0b9b-48a8-8d1d-61ed802a3747 req-1bc4c3f8-fbf9-4903-bc83-261b16999e10 service nova] Creating event network-vif-deleted:339b2afd-97d8-4ffb-8d51-1448e44a7b6a for instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 on n-h1-858129-2 Sep 16 14:46:55.606542 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9a7f7f17-0b9b-48a8-8d1d-61ed802a3747 req-1bc4c3f8-fbf9-4903-bc83-261b16999e10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045732 Sep 16 14:46:55.607202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3267/6540] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:46:56.469510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:56.470276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] [instance: 1058f54d-8b10-4bcc-ad48-30669c8861f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:46:56.478259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:56.478789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:56.479227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:56.480806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:46:56.481533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:46:56.482359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:46:56.501076 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] HTTP exception thrown: Instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 could not be found. Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Request method failure captured: Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 HTTP/1.1 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJIs_p0NV9eKl8RbiJPKPdksjEFebL4F40_tq7H3FaYiW85tpaeRUhkUZ_obJwYvWtsaL9lVlU3uPYfzG4Ko3yVbJnRxAopya4o8GbIF8Un5st7znyRJKjgM4wyeVXDKhvyiO27cCO-JL_WWB6TT60w4Vu89zWKamIVfzsbMTpCQgHuI Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: c3ac59d69df04ee5993d89d4c6d43c89 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c3ac59d69df04ee5993d89d4c6d43c89", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3ac59d69df04ee5993d89d4c6d43c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c3ac59d69df04ee5993d89d4c6d43c89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c3ac59d69df04ee5993d89d4c6d43c89"}]}] Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: c3ac59d69df04ee5993d89d4c6d43c89 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkBasicOps-1626025916 Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkBasicOps-1626025916-project Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: eddb0f0a09b64efc880c28290991fd0b Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkBasicOps-1626025916-project Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 could not be found. Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1058f54d-8b10-4bcc-ad48-30669c8861f3'} Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 could not be found. Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 could not be found. Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:46:56.503851 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 could not be found. Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Returning 404 to user: Instance 1058f54d-8b10-4bcc-ad48-30669c8861f3 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5a7ebd0b-dd62-48ab-8006-3f29fccb0494 tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3" status: 404 len: 111 microversion: 2.1 time: 0.039984 Sep 16 14:46:56.507793 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3274/6541] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:46:56 2022] GET /compute/v2.1/servers/1058f54d-8b10-4bcc-ad48-30669c8861f3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:46:56.702823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e076142-353b-4d92-9432-8e1a23e93dff tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] Calling method '.version_select at 0x7f724c3f4040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:46:56.735932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e076142-353b-4d92-9432-8e1a23e93dff tempest-TestNetworkBasicOps-1626025916 tempest-TestNetworkBasicOps-1626025916-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-823889277" status: 202 len: 0 microversion: 2.1 time: 0.037209 Sep 16 14:46:56.740457 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3268/6542] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Sep 16 14:46:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-823889277 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:47:08.827540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:08.828323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=14 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:09.188566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:09.191549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:09.198764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:09.199159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:09.199598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:09.200359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:09.200815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:09.201239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:09.277796 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-626d3ce0-88e6-45f9-b081-f9f06ecec5c1 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e/action" status: 200 len: 24565 microversion: 2.1 time: 0.455638 Sep 16 14:47:09.278481 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3275/6543] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:47:08 2022] POST /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e/action => generated 24565 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:47:25.437618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:25.440802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:25.586048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-54e5d568-de60-4635-b7b7-b58a6ebba696 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-692522123", "availability_zone": "foo_zone"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:25.607002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.aggregate [None req-54e5d568-de60-4635-b7b7-b58a6ebba696 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Generated uuid 5d5407c8-e9c5-406f-95c0-a947ab066f8a for aggregate {{(pid=128642) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 16 14:47:25.643395 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-54e5d568-de60-4635-b7b7-b58a6ebba696 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.211933 Sep 16 14:47:25.644144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3269/6544] 10.222.0.60 () {60 vars in 1164 bytes} [Fri Sep 16 14:47:25 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:47:25.661229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-83300c12-b002-490d-a92b-53b01f51d222 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:25.667016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:25.667701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:25.694944 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-83300c12-b002-490d-a92b-53b01f51d222 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.041720 Sep 16 14:47:25.696035 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3276/6545] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 14:47:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:25.707659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:25.711567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:25.712085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:25.712568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:25.713323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:25.713799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:25.714214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:25.741768 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3ff883c-d765-4f82-9ed0-f92ef76f9d03 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038081 Sep 16 14:47:25.749075 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3270/6546] 10.222.0.60 () {58 vars in 1176 bytes} [Fri Sep 16 14:47:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:25.755078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fd37d7b-4acb-40c4-bb5f-21db72656325 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:25.762826 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fd37d7b-4acb-40c4-bb5f-21db72656325 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.012319 Sep 16 14:47:25.763408 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3277/6547] 10.222.0.60 () {58 vars in 1143 bytes} [Fri Sep 16 14:47:25 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:25.776596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f6a1cf2b-1e84-4997-bc6f-ba56ae86458c tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858129-2"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:25.789014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6a1cf2b-1e84-4997-bc6f-ba56ae86458c tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:25.789506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6a1cf2b-1e84-4997-bc6f-ba56ae86458c tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:25.789940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f6a1cf2b-1e84-4997-bc6f-ba56ae86458c tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:26.049467 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f6a1cf2b-1e84-4997-bc6f-ba56ae86458c tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.276668 Sep 16 14:47:26.050091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3271/6548] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 14:47:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:26.061452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93ccec65-2a83-4513-a07f-0072f3bb34ab tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:26.070481 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93ccec65-2a83-4513-a07f-0072f3bb34ab tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.012714 Sep 16 14:47:26.071028 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3278/6549] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:47:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:26.082865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99ae7b39-cb4e-4263-813d-7fbed14cb0da tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1375686149", "availability_zone": "foo_zone"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:26.130744 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99ae7b39-cb4e-4263-813d-7fbed14cb0da tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.052112 Sep 16 14:47:26.131685 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3272/6550] 10.222.0.60 () {60 vars in 1173 bytes} [Fri Sep 16 14:47:26 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:26.143547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0d14d445-2231-42f0-9ec8-c3f785b734c6 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:26.175192 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0d14d445-2231-42f0-9ec8-c3f785b734c6 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.035877 Sep 16 14:47:26.176054 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3279/6551] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 14:47:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:26.187422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64599f89-9668-49b7-8e5d-7d88e6dd1b44 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:26.195639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-64599f89-9668-49b7-8e5d-7d88e6dd1b44 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.012025 Sep 16 14:47:26.196222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3273/6552] 10.222.0.60 () {58 vars in 1152 bytes} [Fri Sep 16 14:47:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:47:26.208051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3cb62d54-a3a3-4b0f-8b2c-3a5b48017a9e tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858129-2"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:26.219128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cb62d54-a3a3-4b0f-8b2c-3a5b48017a9e tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:26.220334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cb62d54-a3a3-4b0f-8b2c-3a5b48017a9e tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:26.220808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3cb62d54-a3a3-4b0f-8b2c-3a5b48017a9e tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:26.426051 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3cb62d54-a3a3-4b0f-8b2c-3a5b48017a9e tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.222282 Sep 16 14:47:26.426978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3280/6553] 10.222.0.60 () {60 vars in 1194 bytes} [Fri Sep 16 14:47:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:47:26.438652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1e5e33ff-5029-4307-8a2e-391b1cce89b4 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:26.463430 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1e5e33ff-5029-4307-8a2e-391b1cce89b4 tempest-TestAggregatesBasicOps-226882880 tempest-TestAggregatesBasicOps-226882880-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.028655 Sep 16 14:47:26.464134 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3274/6554] 10.222.0.60 () {58 vars in 1155 bytes} [Fri Sep 16 14:47:26 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 16 14:47:39.561685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:39.562409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:39.566630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:39.569502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:39.576651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:39.577132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:39.577571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:39.578812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:39.579263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:39.579685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:39.868776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:47:39.869201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:47:39.869677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:47:39.870092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:47:39.870537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:47:39.932130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:39.938577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:39.939076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:39.939517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:39.940230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:39.940688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:39.941119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:39.971249 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-405f2918-550d-466b-84d5-081855aa2f41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e/action" status: 202 len: 1138 microversion: 2.1 time: 0.411356 Sep 16 14:47:39.971911 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3281/6555] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:47:39 2022] POST /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e/action => generated 1138 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 16 14:47:39.992633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:39.993473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:39.996455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:39.997153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:39.997871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:47:40.004903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:40.005430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:40.005952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:40.006722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:40.007185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:40.007611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:40.159008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:40.167029 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cad88585-3ddd-4001-9357-f609e39816c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.178487 Sep 16 14:47:40.167635 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3275/6556] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:39 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:41.191546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:41.192199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:41.199074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:41.199549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:41.199978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:41.200659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:41.201105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:41.201521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:41.333692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:41.341342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df792318-c46f-46b1-a4c1-e56215d57524 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.153731 Sep 16 14:47:41.341921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3282/6557] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:41 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:42.364735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:42.365382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:42.372345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:42.372836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:42.373275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:42.373974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:42.374457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:42.375424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:42.510093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:42.518043 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea91cfad-6121-4a0c-be13-ba11dd4f34e4 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.157225 Sep 16 14:47:42.518652 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3276/6558] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:42 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:43.541196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:43.541829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:43.548868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:43.549362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:43.549791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:43.550508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:43.550969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:43.551392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:43.686333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:43.695342 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ac51ecb1-575f-46b6-a612-b3b39f3990ef tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.158028 Sep 16 14:47:43.695935 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3283/6559] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:43 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:44.719874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:44.720495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:44.727970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:44.728464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:44.728905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:44.729616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:44.730081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:44.730545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:44.871284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:44.879184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76de61e4-17b1-4254-86b7-84d5d9b8a4c3 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.163953 Sep 16 14:47:44.879756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3277/6560] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:44 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:45.902855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:45.903455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:45.910307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:45.910891 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:45.911317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:45.912005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:45.912451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:45.912870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:46.045826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:46.053493 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c97126ad-59df-4f29-8a1e-dcdf89e64629 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.154516 Sep 16 14:47:46.054066 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3284/6561] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:45 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:47.076960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:47.077564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:47.086678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:47.087161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:47.087589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:47.088281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:47.088729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:47.089151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:47.220150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:47.228263 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d3e26ef-b2d2-4ce1-b64f-d05e3eead823 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.155211 Sep 16 14:47:47.228839 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3278/6562] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:47 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:48.251591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:48.252207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:48.258771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:48.259256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:48.259693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:48.260393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:48.260848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:48.261271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:48.396700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:48.404426 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-449625bf-c926-4cc9-a5f3-1d06c09fdbcd tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.156876 Sep 16 14:47:48.405003 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3285/6563] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:48 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:49.429453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:49.430061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:49.437251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:49.437734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:49.438165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:49.438887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:49.439339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:49.439759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:49.587594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:49.595526 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e3492db-4d16-49d3-be7c-fd029003c61c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.170634 Sep 16 14:47:49.596101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3279/6564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:49 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:47:50.618887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:50.619499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:50.627107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:50.627594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:50.628031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:50.628725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:50.629183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:50.629607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:50.767131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:50.774855 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-620b8ba5-2e02-4eb8-91d3-9121f9ffb943 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1693 microversion: 2.1 time: 0.159856 Sep 16 14:47:50.775446 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3286/6565] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:50 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:51.798316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:51.798959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:51.806209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:51.806737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:51.807170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:51.807875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:51.808360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:51.808794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:51.944898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:51.952740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-22ba8397-924a-4db0-9498-411fb411aaa8 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1711 microversion: 2.1 time: 0.158977 Sep 16 14:47:51.953320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3280/6566] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:51 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:52.977837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:52.978466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:52.985076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:52.985560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:52.985988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:52.986706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:52.987157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:52.987664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:53.120178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:53.128515 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ddd7607d-2165-4df4-8b35-0dd49deaa9e5 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1699 microversion: 2.1 time: 0.154757 Sep 16 14:47:53.130032 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3287/6567] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:52 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:47:54.153053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:54.153666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:54.161203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:54.161694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:54.162132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:54.162964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:54.163427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:54.163852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:54.310484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:54.319413 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0ef5b305-1e35-4ceb-a54c-4e0465a63b9c tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1699 microversion: 2.1 time: 0.170200 Sep 16 14:47:54.320002 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3281/6568] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:54 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:47:55.343107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:55.343753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:55.350935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:55.351424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:55.351853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:55.352550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:55.353028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:55.353455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:55.489770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:55.497621 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b39a39f-54e9-4a7d-be1c-bf5fccb2b6ab tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1699 microversion: 2.1 time: 0.158297 Sep 16 14:47:55.498178 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3288/6569] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:55 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:56.520790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:47:56.521576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:47:56.528698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:56.529183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:56.529623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:56.530328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:56.531434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:56.531935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:56.669071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:47:56.677498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1fa1fc2-9ec6-4f82-8b31-5765196aab60 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1684 microversion: 2.1 time: 0.160583 Sep 16 14:47:56.678091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3282/6570] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:47:56 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:47:57.520476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1bab76f1-1cc4-449e-9817-58b8f260ee44 req-c6e8e0c1-6dd0-4bed-b514-35e9b557a269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89698173-dc48-43a0-8151-6c0b93095d8e", "name": "network-vif-plugged", "status": "completed", "tag": "6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:47:57.533307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1bab76f1-1cc4-449e-9817-58b8f260ee44 req-c6e8e0c1-6dd0-4bed-b514-35e9b557a269 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:47:57.534150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1bab76f1-1cc4-449e-9817-58b8f260ee44 req-c6e8e0c1-6dd0-4bed-b514-35e9b557a269 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:47:57.534698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1bab76f1-1cc4-449e-9817-58b8f260ee44 req-c6e8e0c1-6dd0-4bed-b514-35e9b557a269 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:47:57.547846 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1bab76f1-1cc4-449e-9817-58b8f260ee44 req-c6e8e0c1-6dd0-4bed-b514-35e9b557a269 service nova] Creating event network-vif-plugged:6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e for instance 89698173-dc48-43a0-8151-6c0b93095d8e on n-h1-858129-2 Sep 16 14:47:57.553381 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1bab76f1-1cc4-449e-9817-58b8f260ee44 req-c6e8e0c1-6dd0-4bed-b514-35e9b557a269 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037327 Sep 16 14:47:57.554591 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3289/6571] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:48:30.919420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:48:30.921862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:48:30.923986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:48:30.924656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=48 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:48:30.931650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:48:30.932144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:48:30.932589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:48:30.933300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:48:30.933760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:48:30.934198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:48:31.011652 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86592caf-1f8b-4a07-a433-1a29de74d4b0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "POST /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e/action" status: 200 len: 24569 microversion: 2.1 time: 0.096325 Sep 16 14:48:31.012342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3283/6572] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:48:30 2022] POST /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e/action => generated 24569 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 14:49:02.639389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=22 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:02.640850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:02.643369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3747e2d6-abe2-4506-93ba-5a06d791960f req-9af49cf5-490b-4131-acab-3bafe489e10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89698173-dc48-43a0-8151-6c0b93095d8e", "tag": "6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:02.646343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:02.646967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:02.649731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:02.650534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:02.654701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:02.655632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:02.656074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:02.657002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:02.657390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3747e2d6-abe2-4506-93ba-5a06d791960f req-9af49cf5-490b-4131-acab-3bafe489e10f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:02.657877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3747e2d6-abe2-4506-93ba-5a06d791960f req-9af49cf5-490b-4131-acab-3bafe489e10f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:02.657993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:02.658313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3747e2d6-abe2-4506-93ba-5a06d791960f req-9af49cf5-490b-4131-acab-3bafe489e10f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:02.658973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:02.670449 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3747e2d6-abe2-4506-93ba-5a06d791960f req-9af49cf5-490b-4131-acab-3bafe489e10f service nova] Creating event network-changed:6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e for instance 89698173-dc48-43a0-8151-6c0b93095d8e on n-h1-858129-2 Sep 16 14:49:02.676312 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3747e2d6-abe2-4506-93ba-5a06d791960f req-9af49cf5-490b-4131-acab-3bafe489e10f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037423 Sep 16 14:49:02.676935 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3284/6573] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:49:02.694577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:49:02.780447 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7874b816-32d3-4423-8395-86cc6bf85d61 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 204 len: 0 microversion: 2.1 time: 0.143656 Sep 16 14:49:02.786493 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3290/6574] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:49:02 2022] DELETE /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:49:02.791201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:02.791897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:02.799552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:02.800037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:02.800511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:02.801165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:02.801625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:02.802044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:02.999891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:49:03.007698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-beb98cee-440c-4987-b594-055c7ea501d0 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1690 microversion: 2.1 time: 0.221255 Sep 16 14:49:03.008271 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3285/6575] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:02 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:04.032084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:04.032792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:04.039641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:04.040134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:04.040571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:04.041267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:04.041719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:04.042140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:04.179957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:49:04.188093 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8a822d2-b2ab-485b-9bab-77e72effdce7 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1690 microversion: 2.1 time: 0.160290 Sep 16 14:49:04.189400 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3291/6576] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:04 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:04.901567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-946491af-2baa-4133-b3da-b32392b96023 req-21074ca1-9f8b-478c-8c48-988695bd18dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89698173-dc48-43a0-8151-6c0b93095d8e", "name": "network-vif-deleted", "tag": "6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:04.912739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-946491af-2baa-4133-b3da-b32392b96023 req-21074ca1-9f8b-478c-8c48-988695bd18dc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:04.913216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-946491af-2baa-4133-b3da-b32392b96023 req-21074ca1-9f8b-478c-8c48-988695bd18dc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:04.913652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-946491af-2baa-4133-b3da-b32392b96023 req-21074ca1-9f8b-478c-8c48-988695bd18dc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:04.927902 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-946491af-2baa-4133-b3da-b32392b96023 req-21074ca1-9f8b-478c-8c48-988695bd18dc service nova] Creating event network-vif-deleted:6e206cf0-e0b4-4d01-8eb1-7622c6f01d8e for instance 89698173-dc48-43a0-8151-6c0b93095d8e on n-h1-858129-2 Sep 16 14:49:04.932850 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-946491af-2baa-4133-b3da-b32392b96023 req-21074ca1-9f8b-478c-8c48-988695bd18dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034932 Sep 16 14:49:04.933556 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3286/6577] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:49:05.212002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:05.212623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:05.220364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:05.220861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:05.221297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:05.222040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:05.222679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:05.223260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:05.261231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:05.261722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:05.262161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:05.263882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lazy-loading 'fault' on Instance uuid 89698173-dc48-43a0-8151-6c0b93095d8e {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:49:05.315559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf53133b4d94387b8bb277f44c5f780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da7c684cd0c42e1904ea60b02e60465', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:49:05.323371 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-37cf028f-bf33-452c-904f-90294918dd41 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 200 len: 1357 microversion: 2.1 time: 0.115246 Sep 16 14:49:05.323890 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3292/6578] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:05 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:06.349543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:06.350263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] [instance: 89698173-dc48-43a0-8151-6c0b93095d8e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:06.356515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:06.357002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:06.357440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:06.358134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:06.358620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:06.359050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:06.372374 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] HTTP exception thrown: Instance 89698173-dc48-43a0-8151-6c0b93095d8e could not be found. Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Request method failure captured: Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e HTTP/1.1 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIntDKRZ4QqUPjM5AB-8_Gwg-dOv23461hiXyb_tXnwb5dvj9M0pQQqn0sQjUMlAyiTUssIlJMZkO9pWU44eRrFMjR0bpaXHP-8S_1X0DuKcmEy4bYZQYoZG4OQyOrunKl4SFLWOj5xXkGXRWINY5Q5rucW9wVD8Fojj3TAMYGSZis8 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9da7c684cd0c42e1904ea60b02e60465", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9da7c684cd0c42e1904ea60b02e60465"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9da7c684cd0c42e1904ea60b02e60465"}]}] Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 9da7c684cd0c42e1904ea60b02e60465 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-643666184 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: ccf53133b4d94387b8bb277f44c5f780 Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestNetworkAdvancedServerOps-643666184-project Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 89698173-dc48-43a0-8151-6c0b93095d8e could not be found. Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '89698173-dc48-43a0-8151-6c0b93095d8e'} Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89698173-dc48-43a0-8151-6c0b93095d8e could not be found. Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89698173-dc48-43a0-8151-6c0b93095d8e could not be found. Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:06.373993 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89698173-dc48-43a0-8151-6c0b93095d8e could not be found. Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Returning 404 to user: Instance 89698173-dc48-43a0-8151-6c0b93095d8e could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cfffcb87-7a24-497e-836c-1b7a710e0817 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e" status: 404 len: 111 microversion: 2.1 time: 0.031916 Sep 16 14:49:06.377659 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3287/6579] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:06 2022] GET /compute/v2.1/servers/89698173-dc48-43a0-8151-6c0b93095d8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:49:09.393038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a45c5540-bbc5-48f0-9a1d-271f33fed988 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] Calling method '.version_select at 0x7f724c0ba0d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:09.416575 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a45c5540-bbc5-48f0-9a1d-271f33fed988 tempest-TestNetworkAdvancedServerOps-643666184 tempest-TestNetworkAdvancedServerOps-643666184-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1482921314" status: 202 len: 0 microversion: 2.1 time: 0.027286 Sep 16 14:49:09.417246 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3293/6580] 10.222.0.60 () {58 vars in 1284 bytes} [Fri Sep 16 14:49:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1482921314 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:49:20.595442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:20.596410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:20.725956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:20.727726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:20.728217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:20.728651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:20.729423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:20.729879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:20.730321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:20.755301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99636e63-5658-48c0-9ab6-64667978bdaa tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.166618 Sep 16 14:49:20.755913 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3288/6581] 10.222.0.60 () {58 vars in 1185 bytes} [Fri Sep 16 14:49:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:49:20.862307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-363040584", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "availability_zone": "nova:n-h1-858129-2", "networks": [{"uuid": "d946f272-782f-4c07-9ce6-cfa88cda2762"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:20.875356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:20.876081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:20.937919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] validate_networks() for [('d946f272-782f-4c07-9ce6-cfa88cda2762', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:49:21.493001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:49:21.493435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:49:21.493920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:49:21.494368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:49:21.495219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:49:21.508479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:21.508976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:21.509422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:21.510160 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:21.510649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:21.511079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:21.529708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Getting quotas for project 3ea40015e13c4124ab0426a3f5ea24f5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:49:21.536283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Getting quotas for user 7658c4bd9c3549abafd71146ade587cc and project 3ea40015e13c4124ab0426a3f5ea24f5. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:49:21.558724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:49:21.563998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:49:21.627284 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9a2d5f9-314a-4afe-9269-1ee340c3e777 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767818 Sep 16 14:49:21.628605 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3294/6582] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:49:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:49:21.645855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea1e45fb-30cd-41f7-bb24-c55d52d897a6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:21.646528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea1e45fb-30cd-41f7-bb24-c55d52d897a6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:21.734294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea1e45fb-30cd-41f7-bb24-c55d52d897a6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1328 microversion: 2.1 time: 0.094043 Sep 16 14:49:21.734919 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3289/6583] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:21 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:22.760497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:22.761157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:22.769201 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:22.769706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:22.770142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:22.770900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:22.771356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:22.771786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:22.839924 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52e07180-090d-4c9e-9f87-842df953c21b tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1415 microversion: 2.1 time: 0.084135 Sep 16 14:49:22.840542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3295/6584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:22 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1415 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:23.864416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:23.865933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:23.873440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:23.874202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:23.874680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:23.875443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:23.875909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:23.876339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:24.109203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42a8262e-69e9-4b37-b937-ae80355249d1 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.249664 Sep 16 14:49:24.109976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3290/6585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:23 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:24.250007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3d6e53d9-5153-487c-8de5-240ffc1d8474 req-4cb9c9d3-8eb4-47b2-a66f-3c690b58c138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13bb89b-61e8-4096-8f16-090a7e258362", "tag": "00934d37-47c9-45bd-9950-89426992d6c6"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:24.263584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3d6e53d9-5153-487c-8de5-240ffc1d8474 req-4cb9c9d3-8eb4-47b2-a66f-3c690b58c138 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:24.264458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3d6e53d9-5153-487c-8de5-240ffc1d8474 req-4cb9c9d3-8eb4-47b2-a66f-3c690b58c138 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:24.267209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3d6e53d9-5153-487c-8de5-240ffc1d8474 req-4cb9c9d3-8eb4-47b2-a66f-3c690b58c138 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:24.280889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3d6e53d9-5153-487c-8de5-240ffc1d8474 req-4cb9c9d3-8eb4-47b2-a66f-3c690b58c138 service nova] Creating event network-changed:00934d37-47c9-45bd-9950-89426992d6c6 for instance c13bb89b-61e8-4096-8f16-090a7e258362 on n-h1-858129-2 Sep 16 14:49:24.286223 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3d6e53d9-5153-487c-8de5-240ffc1d8474 req-4cb9c9d3-8eb4-47b2-a66f-3c690b58c138 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041629 Sep 16 14:49:24.287247 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3296/6586] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:49:25.139082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:25.139082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:25.142240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:25.142714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:25.143160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:25.143881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:25.144345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:25.144779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:25.286345 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bb337449-3ff8-4534-bc0a-6c8acf252093 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.156657 Sep 16 14:49:25.287091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3291/6587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:25 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:26.313077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:26.314650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:26.321689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:26.322192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:26.322661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:26.323386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:26.323852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:26.324276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:26.456522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8225c18a-4521-4764-a102-6b87111f8fa0 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.151001 Sep 16 14:49:26.457110 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3297/6588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:26 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:27.479996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:27.480675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:27.488384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:27.488874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:27.489311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:27.490016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:27.490500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:27.490930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:27.631935 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e277067-8605-4e47-8bff-002fef0559b8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.155729 Sep 16 14:49:27.632522 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3292/6589] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:27 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:28.654615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:28.655154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:28.662263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:28.662786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:28.663224 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:28.663937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:28.664389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:28.664814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:28.791735 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-69ca45d3-df38-43d3-ba2d-08de1c33d29d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.140557 Sep 16 14:49:28.791908 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3298/6590] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:28 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:29.814472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:29.815093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:29.822326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:29.822855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:29.823296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:29.824007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:29.824464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:29.824888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:29.956216 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a7305e26-ec5b-497e-a1bc-0e83548229f4 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.145535 Sep 16 14:49:29.956822 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3293/6591] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:29 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:29.984778 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bace77b1-78b8-49a1-8d57-f265c26096d6 req-1f1d92ea-f0df-4407-85ce-eea0b808f98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13bb89b-61e8-4096-8f16-090a7e258362", "name": "network-vif-plugged", "status": "completed", "tag": "00934d37-47c9-45bd-9950-89426992d6c6"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:29.995580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bace77b1-78b8-49a1-8d57-f265c26096d6 req-1f1d92ea-f0df-4407-85ce-eea0b808f98b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:29.996031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bace77b1-78b8-49a1-8d57-f265c26096d6 req-1f1d92ea-f0df-4407-85ce-eea0b808f98b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:29.996437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bace77b1-78b8-49a1-8d57-f265c26096d6 req-1f1d92ea-f0df-4407-85ce-eea0b808f98b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:30.010094 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bace77b1-78b8-49a1-8d57-f265c26096d6 req-1f1d92ea-f0df-4407-85ce-eea0b808f98b service nova] Creating event network-vif-plugged:00934d37-47c9-45bd-9950-89426992d6c6 for instance c13bb89b-61e8-4096-8f16-090a7e258362 on n-h1-858129-2 Sep 16 14:49:30.015268 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bace77b1-78b8-49a1-8d57-f265c26096d6 req-1f1d92ea-f0df-4407-85ce-eea0b808f98b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034313 Sep 16 14:49:30.015879 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3299/6592] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:49:30.979348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:30.979965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:30.981898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:30.989188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:30.989686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:30.990135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:30.990875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:30.991339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:30.991773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:31.121939 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cb20eab-e031-4d1c-a7c0-5942668b09af tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1463 microversion: 2.1 time: 0.146624 Sep 16 14:49:31.122546 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3294/6593] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:30 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:32.144993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:32.145776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:32.149990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:32.150946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:32.158269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:32.158782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:32.159213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:32.159902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:32.160351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:32.160769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:32.296609 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb53e7f4-3917-4e7a-9f0a-1de6846a7aea tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1648 microversion: 2.1 time: 0.153361 Sep 16 14:49:32.297254 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3300/6594] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:32 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1648 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:49:32.319302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:32.319879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:32.321740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:32.328505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:32.329005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:32.329451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:32.330149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:32.330652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:32.331086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:32.454392 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74ef215a-157a-4338-8ef3-d8536ff9af2e tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1648 microversion: 2.1 time: 0.138829 Sep 16 14:49:32.454998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3295/6595] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:32 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1648 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:32.477095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:32.477983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:32.484125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:32.484613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:32.485631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:32.486328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:32.486814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:32.487246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:32.619787 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c7c91c2d-9cb2-4e62-a9c6-39faf9c5df73 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1648 microversion: 2.1 time: 0.147031 Sep 16 14:49:32.620384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3301/6596] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:32 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1648 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:32.681563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1823112912", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "availability_zone": "nova:n-h2-858129-2", "networks": [{"uuid": "d946f272-782f-4c07-9ce6-cfa88cda2762"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:32.741684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] validate_networks() for [('d946f272-782f-4c07-9ce6-cfa88cda2762', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:49:33.163296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:49:33.163724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:49:33.164209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:49:33.164631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:49:33.165082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:49:33.179081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:33.179569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:33.180010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:33.180735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:33.181192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:33.181625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:33.198828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Getting quotas for project 3ea40015e13c4124ab0426a3f5ea24f5. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:49:33.204744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Getting quotas for user 7658c4bd9c3549abafd71146ade587cc and project 3ea40015e13c4124ab0426a3f5ea24f5. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:49:33.216965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:49:33.219360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:49:33.266752 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f9fc85e-f0ce-4e1c-8986-b126bf402e56 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588293 Sep 16 14:49:33.267423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3296/6597] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:49:33.279107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3082e04-d5dd-4aab-8a4c-5158e4ccf966 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:33.279904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3082e04-d5dd-4aab-8a4c-5158e4ccf966 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:33.342133 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3082e04-d5dd-4aab-8a4c-5158e4ccf966 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1329 microversion: 2.1 time: 0.067253 Sep 16 14:49:33.342769 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3302/6598] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:33 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1329 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:34.368230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:34.370482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:34.379336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:34.380220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:34.380788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:34.381503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:34.381965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:34.382432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:34.461082 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-382a46df-3602-4b9d-8241-3f1bed0a590d tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1416 microversion: 2.1 time: 0.099252 Sep 16 14:49:34.462050 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3297/6599] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:34 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1416 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:35.485821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:35.486468 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:35.494328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:35.494849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:35.495281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:35.495978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:35.496428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:35.496848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:35.631954 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be3e94a4-b361-455d-8148-eb3db0f3b5dd tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.150289 Sep 16 14:49:35.632553 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3303/6600] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:35 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:35.807712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c99dfb34-2ae1-4992-bb69-53a8f30731dc req-e93f8310-25dd-483f-a69d-92e08d265cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1424883f-4c9b-475c-86e1-7381075eef16", "tag": "f1f1b588-0165-4ed9-aaca-b19f7f1b6be9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:35.819319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c99dfb34-2ae1-4992-bb69-53a8f30731dc req-e93f8310-25dd-483f-a69d-92e08d265cf9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:35.819814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c99dfb34-2ae1-4992-bb69-53a8f30731dc req-e93f8310-25dd-483f-a69d-92e08d265cf9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:35.820239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c99dfb34-2ae1-4992-bb69-53a8f30731dc req-e93f8310-25dd-483f-a69d-92e08d265cf9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:35.832536 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c99dfb34-2ae1-4992-bb69-53a8f30731dc req-e93f8310-25dd-483f-a69d-92e08d265cf9 service nova] Creating event network-changed:f1f1b588-0165-4ed9-aaca-b19f7f1b6be9 for instance 1424883f-4c9b-475c-86e1-7381075eef16 on n-h2-858129-2 Sep 16 14:49:35.837491 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c99dfb34-2ae1-4992-bb69-53a8f30731dc req-e93f8310-25dd-483f-a69d-92e08d265cf9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034309 Sep 16 14:49:35.838302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3298/6601] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:49:36.655285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:36.655825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:36.662799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:36.663281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:36.663714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:36.664402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:36.664856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:36.665273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:36.795420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c38fb73-ca97-4799-8ca9-bc0c38efb3c5 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.143874 Sep 16 14:49:36.796009 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3304/6602] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:36 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:37.822419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:37.823154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:37.829720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:37.830213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:37.830685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:37.831389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:37.831852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:37.832283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:37.963559 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-120b5786-75a9-4c11-b658-3f3e416e3c03 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.147655 Sep 16 14:49:37.964153 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3299/6603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:37 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:38.987797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:38.990158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:39.001227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:39.001858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:39.002393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:39.003246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:39.003718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:39.004147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:39.148624 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6c9ff782-e057-4317-9170-879b8e636238 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.166479 Sep 16 14:49:39.149223 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3305/6604] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:38 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:40.171828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:40.172500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:40.179479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:40.179971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:40.180452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:40.181152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:40.181615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:40.182070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:40.319822 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba53e7f1-5025-433e-8946-689ec75e3d7f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.151733 Sep 16 14:49:40.320426 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3300/6605] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:40 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:41.343691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:41.344775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:41.352403 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:41.353004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:41.353450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:41.354342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:41.354837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:41.355362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:41.497790 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d473105-da5f-49a8-ae13-15b6f7996a01 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.157786 Sep 16 14:49:41.498704 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3306/6606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:41 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:42.523105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:42.523755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:42.531689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:42.532266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:42.532705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:42.533457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:42.533974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:42.534433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:42.674240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91545286-18ea-4b99-8956-ccc3bb483564 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.154839 Sep 16 14:49:42.674881 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3301/6607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:42 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:43.004574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-002fa74b-87e3-443b-a779-1a4152a584bd req-9f952b3f-d834-4640-b027-e6afabd054ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424883f-4c9b-475c-86e1-7381075eef16", "name": "network-vif-plugged", "status": "completed", "tag": "f1f1b588-0165-4ed9-aaca-b19f7f1b6be9"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:43.018319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-002fa74b-87e3-443b-a779-1a4152a584bd req-9f952b3f-d834-4640-b027-e6afabd054ae service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:43.018847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-002fa74b-87e3-443b-a779-1a4152a584bd req-9f952b3f-d834-4640-b027-e6afabd054ae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:43.019278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-002fa74b-87e3-443b-a779-1a4152a584bd req-9f952b3f-d834-4640-b027-e6afabd054ae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:43.030919 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-002fa74b-87e3-443b-a779-1a4152a584bd req-9f952b3f-d834-4640-b027-e6afabd054ae service nova] Creating event network-vif-plugged:f1f1b588-0165-4ed9-aaca-b19f7f1b6be9 for instance 1424883f-4c9b-475c-86e1-7381075eef16 on n-h2-858129-2 Sep 16 14:49:43.037058 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-002fa74b-87e3-443b-a779-1a4152a584bd req-9f952b3f-d834-4640-b027-e6afabd054ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036142 Sep 16 14:49:43.037726 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3307/6608] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:49:43.697923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:43.698589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:43.700612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:43.701593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:43.710052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:43.710569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:43.711001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:43.711818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:43.712335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:43.712787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:43.853167 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0f97201-4c8f-4d33-8942-320216f19ae7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1464 microversion: 2.1 time: 0.158899 Sep 16 14:49:43.853759 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3302/6609] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:43 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:44.873284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:44.878146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:44.878927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:44.885692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:44.886185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:44.886653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:44.887362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:44.887819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:44.888244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.025466 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e8317de0-be8e-432b-8ddf-f3df01c25282 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1648 microversion: 2.1 time: 0.153028 Sep 16 14:49:45.026078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3308/6610] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:44 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1648 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:45.047750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:45.048364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:45.055498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.055989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.056430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.057143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.057604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.058031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.196788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c0c69d8-a2df-4048-adb1-63befdb105c6 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1648 microversion: 2.1 time: 0.152783 Sep 16 14:49:45.197379 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3303/6611] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:45 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1648 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:45.218574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:45.219183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:45.225404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.225983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.226430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.227114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.227558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.227975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.371289 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec5c7cf8-6981-4a23-bba3-6ae1667bf2a7 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1648 microversion: 2.1 time: 0.156293 Sep 16 14:49:45.371883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3309/6612] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:45 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1648 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:45.404451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:45.404865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:45.411478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.411978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.412410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.413105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.413553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.413974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.440985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:49:45.525220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af68d0bb-3cf6-4932-9744-018a9ff011df tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 204 len: 0 microversion: 2.1 time: 0.129629 Sep 16 14:49:45.525981 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3304/6613] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:49:45 2022] DELETE /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:49:45.534174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:45.534805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:45.542741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.543235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.543969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.544741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:45.545326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:45.545753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:45.680794 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93cdd9d3-15b2-429a-8bd8-be9f8fc5a116 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1654 microversion: 2.1 time: 0.150305 Sep 16 14:49:45.681380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3310/6614] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:45 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:46.705865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:46.706519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:46.713157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:46.713643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:46.714074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:46.714790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:46.715250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:46.715678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:46.840592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:46.845857 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e91a05ca-cbb6-4ab0-8bd0-f207faaff253 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1654 microversion: 2.1 time: 0.144816 Sep 16 14:49:46.846455 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3305/6615] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:46 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1654 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:47.874000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:47.876444 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:47.904940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:47.905694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:47.915255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:47.916413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:47.917056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:47.917653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:47.921686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-94a1fd2c-e8b1-4b6f-bd4f-7313339461aa req-c6cae052-d51a-436b-b81f-2c6dc4cbdf26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1424883f-4c9b-475c-86e1-7381075eef16", "name": "network-vif-deleted", "tag": "f1f1b588-0165-4ed9-aaca-b19f7f1b6be9"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:47.945057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-94a1fd2c-e8b1-4b6f-bd4f-7313339461aa req-c6cae052-d51a-436b-b81f-2c6dc4cbdf26 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:47.945557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-94a1fd2c-e8b1-4b6f-bd4f-7313339461aa req-c6cae052-d51a-436b-b81f-2c6dc4cbdf26 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:47.946009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-94a1fd2c-e8b1-4b6f-bd4f-7313339461aa req-c6cae052-d51a-436b-b81f-2c6dc4cbdf26 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:47.964941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-94a1fd2c-e8b1-4b6f-bd4f-7313339461aa req-c6cae052-d51a-436b-b81f-2c6dc4cbdf26 service nova] Creating event network-vif-deleted:f1f1b588-0165-4ed9-aaca-b19f7f1b6be9 for instance 1424883f-4c9b-475c-86e1-7381075eef16 on n-h2-858129-2 Sep 16 14:49:47.971193 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-94a1fd2c-e8b1-4b6f-bd4f-7313339461aa req-c6cae052-d51a-436b-b81f-2c6dc4cbdf26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053807 Sep 16 14:49:47.976896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3306/6616] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:49:48.028565 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-01651a0c-4eef-4cb0-bcc4-fb75f0438d3c tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 200 len: 1612 microversion: 2.1 time: 0.162154 Sep 16 14:49:48.029835 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3311/6617] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:47 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 1612 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:49.056047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:49.056873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: 1424883f-4c9b-475c-86e1-7381075eef16] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:49.064780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:49.065271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:49.065708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:49.066426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:49.066974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:49.067401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:49.081061 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] HTTP exception thrown: Instance 1424883f-4c9b-475c-86e1-7381075eef16 could not be found. Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Request method failure captured: Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 HTTP/1.1 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIzwNjbegf1aAyh4V32gj8ENHneilBcUU76Gg5t-CdLTP-rEtH7u4U2x7V5tAIsQNYdDfoNpAmckySNm1KljqCqzefhIpuWzSZci7e4aRzoaRKDeazzakf2dV0u1FL6IJSw3iC3uYt1T-e7Fr3Zwa9dMl_xRI_nGQq6u8gGdwITaapM Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3ea40015e13c4124ab0426a3f5ea24f5 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestServerMultinode-953198898 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ea40015e13c4124ab0426a3f5ea24f5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ea40015e13c4124ab0426a3f5ea24f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ea40015e13c4124ab0426a3f5ea24f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ea40015e13c4124ab0426a3f5ea24f5"}]}] Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestServerMultinode-953198898 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3ea40015e13c4124ab0426a3f5ea24f5 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestServerMultinode-953198898 Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestServerMultinode-953198898-project-admin Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7658c4bd9c3549abafd71146ade587cc Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestServerMultinode-953198898-project-admin Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 1424883f-4c9b-475c-86e1-7381075eef16 could not be found. Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '1424883f-4c9b-475c-86e1-7381075eef16'} Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1424883f-4c9b-475c-86e1-7381075eef16 could not be found. Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1424883f-4c9b-475c-86e1-7381075eef16 could not be found. Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:49:49.082752 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1424883f-4c9b-475c-86e1-7381075eef16 could not be found. Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Returning 404 to user: Instance 1424883f-4c9b-475c-86e1-7381075eef16 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b31bf082-7895-4542-96e5-12eef3584407 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16" status: 404 len: 111 microversion: 2.1 time: 0.032264 Sep 16 14:49:49.086775 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3307/6618] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:49 2022] GET /compute/v2.1/servers/1424883f-4c9b-475c-86e1-7381075eef16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:49:49.094232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:49.094836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:49.105779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:49.106285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:49.106761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:49.107478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:49.107933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:49.108364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:49.136216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:49:49.185212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:49.217680 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80660584-9254-42db-a908-bc50be9616b3 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 204 len: 0 microversion: 2.1 time: 0.128026 Sep 16 14:49:49.218388 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3312/6619] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:49:49 2022] DELETE /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:49:49.227077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:49.227623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:49.233915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:49.238820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:49.239461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:49.240231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:49.241083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:49.241516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:49.376102 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4e96cb4a-9f2a-4ef7-88b0-172a015e382f tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1654 microversion: 2.1 time: 0.152951 Sep 16 14:49:49.376712 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3308/6620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:49 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:49:50.399818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:50.400597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:50.407591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:50.408083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:50.408556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:50.409239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:50.409689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:50.410118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:50.542135 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6d870df1-9d41-42aa-aba5-08c7be3ad8ca tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1654 microversion: 2.1 time: 0.146402 Sep 16 14:49:50.542843 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3313/6621] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:50 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:51.248966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d38b4c3a-290f-4078-8fa0-f4dd9482a870 req-e8c835f9-460a-42f6-8e00-859942bab94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13bb89b-61e8-4096-8f16-090a7e258362", "name": "network-vif-deleted", "tag": "00934d37-47c9-45bd-9950-89426992d6c6"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:49:51.256526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:51.262990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d38b4c3a-290f-4078-8fa0-f4dd9482a870 req-e8c835f9-460a-42f6-8e00-859942bab94a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:51.263475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d38b4c3a-290f-4078-8fa0-f4dd9482a870 req-e8c835f9-460a-42f6-8e00-859942bab94a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:51.263918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d38b4c3a-290f-4078-8fa0-f4dd9482a870 req-e8c835f9-460a-42f6-8e00-859942bab94a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:51.278182 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d38b4c3a-290f-4078-8fa0-f4dd9482a870 req-e8c835f9-460a-42f6-8e00-859942bab94a service nova] Creating event network-vif-deleted:00934d37-47c9-45bd-9950-89426992d6c6 for instance c13bb89b-61e8-4096-8f16-090a7e258362 on n-h1-858129-2 Sep 16 14:49:51.284746 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d38b4c3a-290f-4078-8fa0-f4dd9482a870 req-e8c835f9-460a-42f6-8e00-859942bab94a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039493 Sep 16 14:49:51.285951 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3309/6622] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:49:51.565152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:51.565767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:51.568665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:49:51.574140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:51.574669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:51.575109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:51.575822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:51.576280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:51.576708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:51.611000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:51.611486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:51.611924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:51.612374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lazy-loading 'fault' on Instance uuid c13bb89b-61e8-4096-8f16-090a7e258362 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:49:51.663970 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7fc7d998-6ac0-466f-9a03-727303ccc016 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 200 len: 1453 microversion: 2.1 time: 0.102542 Sep 16 14:49:51.664576 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3314/6623] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:51 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:49:52.689264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:49:52.689871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] [instance: c13bb89b-61e8-4096-8f16-090a7e258362] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:49:52.696352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:52.696837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:52.697271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:52.697968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:49:52.698436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:49:52.698868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:49:52.714009 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] HTTP exception thrown: Instance c13bb89b-61e8-4096-8f16-090a7e258362 could not be found. Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Request method failure captured: Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 HTTP/1.1 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJIzwNjbegf1aAyh4V32gj8ENHneilBcUU76Gg5t-CdLTP-rEtH7u4U2x7V5tAIsQNYdDfoNpAmckySNm1KljqCqzefhIpuWzSZci7e4aRzoaRKDeazzakf2dV0u1FL6IJSw3iC3uYt1T-e7Fr3Zwa9dMl_xRI_nGQq6u8gGdwITaapM Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3ea40015e13c4124ab0426a3f5ea24f5 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestServerMultinode-953198898 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ea40015e13c4124ab0426a3f5ea24f5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ea40015e13c4124ab0426a3f5ea24f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ea40015e13c4124ab0426a3f5ea24f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ea40015e13c4124ab0426a3f5ea24f5"}]}] Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestServerMultinode-953198898 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3ea40015e13c4124ab0426a3f5ea24f5 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestServerMultinode-953198898 Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestServerMultinode-953198898-project-admin Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 7658c4bd9c3549abafd71146ade587cc Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestServerMultinode-953198898-project-admin Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c13bb89b-61e8-4096-8f16-090a7e258362 could not be found. Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c13bb89b-61e8-4096-8f16-090a7e258362'} Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13bb89b-61e8-4096-8f16-090a7e258362 could not be found. Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13bb89b-61e8-4096-8f16-090a7e258362 could not be found. Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:49:52.715768 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13bb89b-61e8-4096-8f16-090a7e258362 could not be found. Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] Returning 404 to user: Instance c13bb89b-61e8-4096-8f16-090a7e258362 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e2fcc2d-a81b-4e68-aba9-032f07bc9dc8 tempest-TestServerMultinode-953198898 tempest-TestServerMultinode-953198898-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362" status: 404 len: 111 microversion: 2.1 time: 0.033189 Sep 16 14:49:52.720126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3310/6624] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:49:52 2022] GET /compute/v2.1/servers/c13bb89b-61e8-4096-8f16-090a7e258362 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:50:22.216978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-741588610", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "895c841d-a3bd-4ca3-ad3e-8b129ea45efd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2d73f19-dcf6-4e6b-b995-4ae28b29b873"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:50:22.227519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:22.228176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:22.524058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] validate_networks() for [('a2d73f19-dcf6-4e6b-b995-4ae28b29b873', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:50:22.928554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:50:22.928987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:50:22.929462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:50:22.929874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:50:22.930354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:50:22.939510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:22.940004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:22.940498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:22.941285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:22.941627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:22.942051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:22.961979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:50:22.967930 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for user 030a4498f4be4ca3b1f95e741ec6b385 and project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:50:23.026820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:50:23.029036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='895c841d-a3bd-4ca3-ad3e-8b129ea45efd',volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:50:23.169562 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d49aa75-b28f-45e7-84bd-591a5f95b760 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956770 Sep 16 14:50:23.170437 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3315/6625] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:50:23.181961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-453c34e6-8863-48b5-83be-6968e264feb2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:23.186774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-453c34e6-8863-48b5-83be-6968e264feb2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:23.193935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:23.195228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=14 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:23.467448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-453c34e6-8863-48b5-83be-6968e264feb2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:23.475866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-453c34e6-8863-48b5-83be-6968e264feb2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1056 microversion: 2.1 time: 0.297939 Sep 16 14:50:23.476751 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3311/6626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:23 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1056 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:24.499512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:24.500699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:24.516208 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:24.517066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:24.517833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:24.518737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:24.519354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:24.519929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:24.621533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:24.634353 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a131b6ff-49f0-4437-b3b1-02a16b00da1c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1172 microversion: 2.1 time: 0.137773 Sep 16 14:50:24.638821 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3316/6627] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:24 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1172 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:50:25.659463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:25.660109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:25.669033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:25.669439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:25.669877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:25.671191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:25.671651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:25.672077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:25.918682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:25.927015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bddf13d1-0955-473a-a061-3b6ff2cacfcc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1214 microversion: 2.1 time: 0.271708 Sep 16 14:50:25.942544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3312/6628] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:25 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:26.126170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-c3b18961-c285-43c0-b6e3-519537777059 req-40f3eef1-5ded-4652-9d50-22758ad1831e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57b8e99-8310-4ba7-8e26-a3021b299d13", "tag": "3a0bffd0-154b-4a78-9e33-bc434ea67651"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:50:26.142471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c3b18961-c285-43c0-b6e3-519537777059 req-40f3eef1-5ded-4652-9d50-22758ad1831e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:26.143516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c3b18961-c285-43c0-b6e3-519537777059 req-40f3eef1-5ded-4652-9d50-22758ad1831e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:26.144246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-c3b18961-c285-43c0-b6e3-519537777059 req-40f3eef1-5ded-4652-9d50-22758ad1831e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:26.159403 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-c3b18961-c285-43c0-b6e3-519537777059 req-40f3eef1-5ded-4652-9d50-22758ad1831e service nova] Creating event network-changed:3a0bffd0-154b-4a78-9e33-bc434ea67651 for instance a57b8e99-8310-4ba7-8e26-a3021b299d13 on n-h1-858129-2 Sep 16 14:50:26.168874 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-c3b18961-c285-43c0-b6e3-519537777059 req-40f3eef1-5ded-4652-9d50-22758ad1831e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044609 Sep 16 14:50:26.170291 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3317/6629] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:50:26.949284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:26.949928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:26.957391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:26.958139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:26.958621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:26.959351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:26.959810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:26.960238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:27.187268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:27.196439 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8ec0fe93-14ee-47ba-ba0c-f943b27a68f6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1214 microversion: 2.1 time: 0.250800 Sep 16 14:50:27.197637 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3313/6630] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:26 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:28.221410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:28.222034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:28.228674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:28.229159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:28.229595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:28.230316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:28.230833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:28.231315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:28.364164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:28.371996 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31e4b5de-3812-4a99-8e48-4993cfef1338 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1214 microversion: 2.1 time: 0.155834 Sep 16 14:50:28.372580 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3318/6631] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:28 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:29.395755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:29.396453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:29.403873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:29.404373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:29.404841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:29.405536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:29.405999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:29.406497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:29.558177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:29.566886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7412d1fa-ab54-4f5a-9988-7a3944c5ff4f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1214 microversion: 2.1 time: 0.174961 Sep 16 14:50:29.567478 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3314/6632] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:29 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:30.589207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:30.589817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:30.597484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:30.597969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:30.598696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:30.599399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:30.599850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:30.600271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:30.744024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:30.754390 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3911b5b9-7ce7-4ce3-abbb-57b2fc76ffc0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.168998 Sep 16 14:50:30.755199 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3319/6633] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:30 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:31.778783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:31.779554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:31.787069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:31.787553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:31.787994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:31.788693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:31.789147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:31.789573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:31.917772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:31.925585 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02900abb-c860-474c-818e-733b1414a596 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.151128 Sep 16 14:50:31.926172 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3315/6634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:31 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:32.948532 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:32.949131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:32.951994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:32.957327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:32.957815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:32.958250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:32.958969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:32.959425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:32.959849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:32.975435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:33.090641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:33.099089 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6a373180-aef5-4ec9-bd4e-33b2152a1a72 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.154529 Sep 16 14:50:33.099672 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3320/6635] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:32 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:34.122275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:34.122974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:34.126299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:34.131797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:34.132309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:34.132742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:34.133429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:34.133882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:34.134306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:34.267353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:34.275238 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fd312184-f0da-4903-9f9e-4808add79d7c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.156905 Sep 16 14:50:34.275822 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3316/6636] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:34 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:35.298025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:35.298665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:35.305623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:35.306107 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:35.306573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:35.307276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:35.307728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:35.308156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:35.443896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:35.451759 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3757fb79-2163-4e92-9b1f-087356fae64e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.157686 Sep 16 14:50:35.452333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3321/6637] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:35 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:36.475394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:36.476070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:36.483878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:36.484958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:36.485524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:36.486251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:36.486749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:36.487179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:36.647500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:36.655514 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d59a63c-209c-48ec-880c-d43211d21522 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.184407 Sep 16 14:50:36.657668 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3317/6638] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:36 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:37.680222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:37.680752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:37.687894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:37.688887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:37.689327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:37.690034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:37.690524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:37.690951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:37.844135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:37.852583 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b90f6535-cb8b-4e0d-8660-7f8dbb06f426 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.176350 Sep 16 14:50:37.853198 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3322/6639] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:37 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:50:38.877424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:38.878099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:38.885957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:38.886628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:38.887032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:38.887743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:38.888202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:38.888631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:39.316312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:39.324283 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1578321-fd0a-432c-a480-3fa10c185090 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.452203 Sep 16 14:50:39.324863 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3318/6640] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:38 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:40.330171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-99c79634-dc25-4916-804a-3fd2ca10c5b6 req-c50e3c19-0c44-4220-af34-74d77ff80b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57b8e99-8310-4ba7-8e26-a3021b299d13", "name": "network-vif-plugged", "status": "completed", "tag": "3a0bffd0-154b-4a78-9e33-bc434ea67651"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:50:40.342682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-99c79634-dc25-4916-804a-3fd2ca10c5b6 req-c50e3c19-0c44-4220-af34-74d77ff80b38 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:40.343181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-99c79634-dc25-4916-804a-3fd2ca10c5b6 req-c50e3c19-0c44-4220-af34-74d77ff80b38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:40.343845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-99c79634-dc25-4916-804a-3fd2ca10c5b6 req-c50e3c19-0c44-4220-af34-74d77ff80b38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:40.347302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:40.347934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:40.356364 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-99c79634-dc25-4916-804a-3fd2ca10c5b6 req-c50e3c19-0c44-4220-af34-74d77ff80b38 service nova] Creating event network-vif-plugged:3a0bffd0-154b-4a78-9e33-bc434ea67651 for instance a57b8e99-8310-4ba7-8e26-a3021b299d13 on n-h1-858129-2 Sep 16 14:50:40.360188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:40.361189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:40.361643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:40.362386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:40.362726 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-99c79634-dc25-4916-804a-3fd2ca10c5b6 req-c50e3c19-0c44-4220-af34-74d77ff80b38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036290 Sep 16 14:50:40.362965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:40.363390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:40.363658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3323/6641] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:50:40.529774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:40.538208 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13be92d2-46d8-4e0b-ad2b-a1a8b7f991f3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.194696 Sep 16 14:50:40.538829 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3319/6642] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:40 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:50:41.562231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:41.562964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:41.569977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:41.570484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:41.570913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:41.571595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:41.572039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:41.572461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:41.700574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:41.709157 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-afc6b48f-336e-474f-bbf0-b1a78479ffac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1202 microversion: 2.1 time: 0.151196 Sep 16 14:50:41.709749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3324/6643] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:41 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:42.731763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:42.732300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:42.739901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:42.740393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:42.740836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:42.741534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:42.741995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:42.742447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:42.875350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:42.883282 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7f51f07-380c-4f71-8593-3492fcdd560b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1390 microversion: 2.1 time: 0.155663 Sep 16 14:50:42.883869 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3320/6644] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:42 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:50:42.905031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:42.905647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:42.913329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:42.913807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:42.914240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:42.914954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:42.915401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:42.915815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.044129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:43.051914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-430c90a5-c2f1-48ca-98c4-d27c6533b185 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1390 microversion: 2.1 time: 0.150810 Sep 16 14:50:43.052488 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3325/6645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:42 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:43.073601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:43.074227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:43.080851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:43.081342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:43.081785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.082520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:43.082983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:43.083413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.212879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:43.221431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a85e9401-a6bb-4e85-95e4-58fa83bf1677 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1390 microversion: 2.1 time: 0.151738 Sep 16 14:50:43.222009 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3321/6646] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:43 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:43.243048 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:43.243482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:43.249511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:43.249993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:43.250479 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.251204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:43.251656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:43.252080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.276406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:50:43.352009 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dd35ed5f-c4aa-45f9-8739-3abe410985ad tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 204 len: 0 microversion: 2.1 time: 0.112598 Sep 16 14:50:43.352797 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3326/6647] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:50:43 2022] DELETE /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:50:43.361257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:43.361938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:43.367958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:43.368446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:43.368883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.369578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:43.370029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:43.370497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:43.503423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:43.511183 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28b1e6bc-fde1-4df2-ad56-92a69d5c13db tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1396 microversion: 2.1 time: 0.153873 Sep 16 14:50:43.511758 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3322/6648] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:43 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:44.535074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:44.535808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:44.543580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:44.544120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:44.544497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:44.545197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:44.545653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:44.546084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:44.685378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:44.696711 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-da9ffb87-a638-43d0-95bf-bb3eda0772a4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1396 microversion: 2.1 time: 0.165481 Sep 16 14:50:44.697720 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3327/6649] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:44 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:45.663158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-20d113ec-1f36-4624-b721-153e1df87753 req-d4fd263a-bf2c-4952-9165-f12a8e2f4eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57b8e99-8310-4ba7-8e26-a3021b299d13", "name": "network-vif-deleted", "tag": "3a0bffd0-154b-4a78-9e33-bc434ea67651"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:50:45.675991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-20d113ec-1f36-4624-b721-153e1df87753 req-d4fd263a-bf2c-4952-9165-f12a8e2f4eb1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:45.676477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-20d113ec-1f36-4624-b721-153e1df87753 req-d4fd263a-bf2c-4952-9165-f12a8e2f4eb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:45.676913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-20d113ec-1f36-4624-b721-153e1df87753 req-d4fd263a-bf2c-4952-9165-f12a8e2f4eb1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:45.693467 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-20d113ec-1f36-4624-b721-153e1df87753 req-d4fd263a-bf2c-4952-9165-f12a8e2f4eb1 service nova] Creating event network-vif-deleted:3a0bffd0-154b-4a78-9e33-bc434ea67651 for instance a57b8e99-8310-4ba7-8e26-a3021b299d13 on n-h1-858129-2 Sep 16 14:50:45.698731 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-20d113ec-1f36-4624-b721-153e1df87753 req-d4fd263a-bf2c-4952-9165-f12a8e2f4eb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111953 Sep 16 14:50:45.699741 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3323/6650] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:50:45.720762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:45.721586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:45.729711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:45.730209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:45.730675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:45.731389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:45.731830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:45.732250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:45.795943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:45.804012 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-22ff5bc9-e9e8-4b7c-be30-4d2b4cd385cc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1187 microversion: 2.1 time: 0.087858 Sep 16 14:50:45.804530 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3328/6651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:45 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:46.828897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:46.829642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:46.836610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:46.837101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:46.837538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:46.838238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:46.838725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:46.839152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:46.902305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:46.910510 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de4b0143-e1c3-45c4-8b76-d2b256d339e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1187 microversion: 2.1 time: 0.086756 Sep 16 14:50:46.911084 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3324/6652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:46 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:47.933210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:47.933824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:47.940606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:47.941091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:47.941520 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:47.942218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:47.942701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:47.943122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:48.012975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:48.021382 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c83beb5-eb40-4f8c-a8f3-961064e23b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1187 microversion: 2.1 time: 0.091998 Sep 16 14:50:48.021990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3329/6653] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:47 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:49.044928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:49.045552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:49.052495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:49.052996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:49.053433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:49.054136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:49.054640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:49.055076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:49.118024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:49.126846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6ff615f-9e13-4b3e-821f-84968ebb2f51 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1187 microversion: 2.1 time: 0.085815 Sep 16 14:50:49.127430 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3325/6654] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:49 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:50.149029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:50.149638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:50.157353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:50.157842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:50.158368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:50.159099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:50.159605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:50.160069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:50.194128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:50.194640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:50.195072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:50.195516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lazy-loading 'fault' on Instance uuid a57b8e99-8310-4ba7-8e26-a3021b299d13 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:50:50.249900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:50.257743 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ffc02426-1dae-4684-b7ce-ccedba239f19 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 200 len: 1146 microversion: 2.1 time: 0.112477 Sep 16 14:50:50.270612 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3330/6655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:50 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 1146 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:51.283113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:51.284083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: a57b8e99-8310-4ba7-8e26-a3021b299d13] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:51.291304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:51.291796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:51.292240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:51.292971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:51.293425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:51.293900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:51.308797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance a57b8e99-8310-4ba7-8e26-a3021b299d13 could not be found. Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 HTTP/1.1 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a57b8e99-8310-4ba7-8e26-a3021b299d13 could not be found. Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a57b8e99-8310-4ba7-8e26-a3021b299d13'} Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57b8e99-8310-4ba7-8e26-a3021b299d13 could not be found. Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57b8e99-8310-4ba7-8e26-a3021b299d13 could not be found. Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:50:51.310509 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57b8e99-8310-4ba7-8e26-a3021b299d13 could not be found. Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance a57b8e99-8310-4ba7-8e26-a3021b299d13 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f0b02f1-aa58-459c-a586-6420056db270 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13" status: 404 len: 111 microversion: 2.1 time: 0.033457 Sep 16 14:50:51.314522 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3326/6656] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:51 2022] GET /compute/v2.1/servers/a57b8e99-8310-4ba7-8e26-a3021b299d13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:50:56.304270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-351586705", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "68916a1b-edf7-4432-bc31-ce72106e199a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2d73f19-dcf6-4e6b-b995-4ae28b29b873"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:50:56.315601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:56.367191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] validate_networks() for [('a2d73f19-dcf6-4e6b-b995-4ae28b29b873', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:50:56.743104 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:50:56.743531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:50:56.744018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:50:56.744480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:50:56.744882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:50:56.756401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:56.756881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:56.757310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:56.758030 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:56.758506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:56.758922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:56.764638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:56.778951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:50:56.784439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for user 030a4498f4be4ca3b1f95e741ec6b385 and project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:50:56.842792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:50:56.844868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68916a1b-edf7-4432-bc31-ce72106e199a',volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:50:56.970876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-19e7a9e6-ccbb-4069-8aed-53ab48af5bbe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670481 Sep 16 14:50:56.971775 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3331/6657] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:50:56.983375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57baeb56-b276-473d-8442-1ea07ab9a611 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:56.984017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57baeb56-b276-473d-8442-1ea07ab9a611 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:56.987775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=35 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:57.042837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-57baeb56-b276-473d-8442-1ea07ab9a611 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:57.050379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57baeb56-b276-473d-8442-1ea07ab9a611 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1056 microversion: 2.1 time: 0.071002 Sep 16 14:50:57.050985 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3327/6658] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:56 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:58.076171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:58.076921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:58.085276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:58.085276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:58.085829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:58.086465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:58.087074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:58.087651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:58.180312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:58.191689 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fcb8e5b2-aab0-4d1f-98af-a7f9367a931c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1162 microversion: 2.1 time: 0.122469 Sep 16 14:50:58.192592 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3332/6659] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:58 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1162 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:59.216536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:50:59.217833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:50:59.225871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:59.226358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:59.226822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:59.227551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:59.228003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:59.228425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:59.232703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=83 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:50:59.467956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:50:59.478553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c31b15be-7adf-41da-80ce-946ab0bdfdea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1214 microversion: 2.1 time: 0.265960 Sep 16 14:50:59.479875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3328/6660] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:50:59 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:50:59.713567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1d6c0f49-dfc0-440a-8aa6-5e2d34c77eb9 req-b5273a63-50e0-4db0-b396-dfd928adcb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c", "tag": "7ca0a323-fee1-4424-91f7-ea5e79ab60c3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:50:59.732637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1d6c0f49-dfc0-440a-8aa6-5e2d34c77eb9 req-b5273a63-50e0-4db0-b396-dfd928adcb02 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:50:59.732637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1d6c0f49-dfc0-440a-8aa6-5e2d34c77eb9 req-b5273a63-50e0-4db0-b396-dfd928adcb02 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:50:59.732637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1d6c0f49-dfc0-440a-8aa6-5e2d34c77eb9 req-b5273a63-50e0-4db0-b396-dfd928adcb02 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:50:59.745939 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1d6c0f49-dfc0-440a-8aa6-5e2d34c77eb9 req-b5273a63-50e0-4db0-b396-dfd928adcb02 service nova] Creating event network-changed:7ca0a323-fee1-4424-91f7-ea5e79ab60c3 for instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c on n-h1-858129-2 Sep 16 14:50:59.753437 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1d6c0f49-dfc0-440a-8aa6-5e2d34c77eb9 req-b5273a63-50e0-4db0-b396-dfd928adcb02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043257 Sep 16 14:50:59.754391 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3333/6661] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:51:00.506737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:00.507974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:00.515744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:00.516223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:00.516669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:00.517416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:00.517894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:00.518337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:00.600045 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:51:00.600045 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 14:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c (ip 10.222.0.60) !!! Sep 16 14:51:00.744264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:00.753816 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cfb64b03-f325-4ed2-b3d2-d247d0198075 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1214 microversion: 2.1 time: 0.251091 Sep 16 14:51:00.754616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3329/6662] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:00 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:01.779130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:01.779941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:01.787767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:01.788626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:01.789138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:01.789940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:01.790502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:01.791097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:01.940291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:01.949901 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cadf085f-552a-428b-8c3f-6f9f405ce880 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1214 microversion: 2.1 time: 0.176295 Sep 16 14:51:01.951208 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3334/6663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:01 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:02.973606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:02.974256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:02.981485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:02.981976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:02.982430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:02.983137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:02.983600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:02.984017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:03.117843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:03.126198 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c63199d-f89a-4bba-8617-1d54c46e5bdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1214 microversion: 2.1 time: 0.156765 Sep 16 14:51:03.126825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3330/6664] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:02 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:04.150051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:04.150685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:04.157616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:04.158099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:04.158563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:04.159264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:04.159712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:04.160132 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:04.291553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:04.300708 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c009c43-63d8-4493-abd3-2972c304b05d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.154518 Sep 16 14:51:04.301309 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3335/6665] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:04 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:05.324822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:05.325446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:05.333201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:05.333727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:05.334139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:05.334865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:05.335325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:05.335753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:05.489465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:05.497689 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30466b58-a33f-4f6b-a1bc-2898c679bd4c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.176806 Sep 16 14:51:05.498294 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3331/6666] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:05 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:06.521073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:06.521687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:06.528725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:06.529211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:06.529651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:06.530354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:06.530837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:06.531320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:06.668262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:06.676720 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bc71e102-3355-4ff3-8b49-47e4f8a80619 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.159593 Sep 16 14:51:06.677328 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3336/6667] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:06 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:07.699581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:07.700111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:07.702873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:07.709281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:07.709828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:07.710288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:07.711090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:07.711510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:07.711934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:07.850277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:07.859417 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-929ee6b0-06cd-452d-8534-b1c47b61902d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.163732 Sep 16 14:51:07.860009 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3332/6668] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:07 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:08.882181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:08.882805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:08.884764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:08.885423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:08.892141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:08.892621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:08.893051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:08.893741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:08.894197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:08.894633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:09.029340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:09.038167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d8ff627-dd2c-4f44-9d5f-b67b41898c9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.159837 Sep 16 14:51:09.038828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3337/6669] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:08 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:10.061931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:10.062579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:10.069595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:10.070094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:10.070572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:10.071301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:10.071765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:10.072199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:10.207511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:10.215325 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-872a120c-e353-4879-b385-13b9e553b73a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.157347 Sep 16 14:51:10.215892 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3333/6670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:10 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:11.237933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:11.238618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:11.245517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:11.245999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:11.246453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:11.247145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:11.247598 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:11.248018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:11.379677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:11.387497 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39887137-7104-41d8-9dc2-502e39b5f949 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.153438 Sep 16 14:51:11.388078 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3338/6671] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:11 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:12.410734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:12.411357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:12.418371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:12.418902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:12.419355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:12.420053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:12.420516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:12.420945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:12.564940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:12.573398 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0b8c418-3730-49a9-9d10-37aec70e6314 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.166636 Sep 16 14:51:12.574015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3334/6672] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:12 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:13.596843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:13.597525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:13.605549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:13.606024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:13.606554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:13.607268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:13.607725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:13.608152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:13.759517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:13.771466 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e83af172-678f-4ba5-8df8-b93b49702324 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.179006 Sep 16 14:51:13.772497 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3339/6673] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:13 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:14.582871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1d1af4de-f1bc-4ade-8246-f864ef7f3190 req-a8252849-d25e-4e49-9600-4c82653b1e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c", "name": "network-vif-plugged", "status": "completed", "tag": "7ca0a323-fee1-4424-91f7-ea5e79ab60c3"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:51:14.593150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1d1af4de-f1bc-4ade-8246-f864ef7f3190 req-a8252849-d25e-4e49-9600-4c82653b1e88 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:14.593732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1d1af4de-f1bc-4ade-8246-f864ef7f3190 req-a8252849-d25e-4e49-9600-4c82653b1e88 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:14.594232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1d1af4de-f1bc-4ade-8246-f864ef7f3190 req-a8252849-d25e-4e49-9600-4c82653b1e88 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:14.606965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1d1af4de-f1bc-4ade-8246-f864ef7f3190 req-a8252849-d25e-4e49-9600-4c82653b1e88 service nova] Creating event network-vif-plugged:7ca0a323-fee1-4424-91f7-ea5e79ab60c3 for instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c on n-h1-858129-2 Sep 16 14:51:14.612932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1d1af4de-f1bc-4ade-8246-f864ef7f3190 req-a8252849-d25e-4e49-9600-4c82653b1e88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087456 Sep 16 14:51:14.613664 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3335/6674] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:51:14.796011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:14.796667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:14.804100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:14.804667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:14.805028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:14.805730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:14.806187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:14.806652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:14.941736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:14.949696 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d49e765b-d069-4696-9c6a-7dd0372cd3a3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.157725 Sep 16 14:51:14.950277 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3340/6675] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:14 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:15.974812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:15.975697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:15.982573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:15.983068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:15.983511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:15.984214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:15.984683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:15.985624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:16.118032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:16.126550 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa71997e-6878-48e2-bec8-9f7328ba3013 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1202 microversion: 2.1 time: 0.156456 Sep 16 14:51:16.127140 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3336/6676] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:15 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:17.149512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:17.150129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:17.157469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.157962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.158421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.159140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.159596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.160033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.308677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:17.317137 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b3bbfc25-191e-4d25-92e3-05647162cb16 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1389 microversion: 2.1 time: 0.171685 Sep 16 14:51:17.317750 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3341/6677] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:17 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:17.340989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:17.341606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:17.355470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.355963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.356399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.357127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.357583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.358006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.495493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:17.506230 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff5fdc6b-4219-4c9e-9e71-11edc3f66f59 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1389 microversion: 2.1 time: 0.170254 Sep 16 14:51:17.506858 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3337/6678] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:17 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:17.529881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:17.530517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:17.537304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.537792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.538239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.538967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.539436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.539866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.670732 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:17.678733 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4f31c7df-91a7-4067-9d8c-fc26ec2bf4fe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1389 microversion: 2.1 time: 0.152706 Sep 16 14:51:17.679327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3342/6679] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:17 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:17.700893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:17.701310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:17.710458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.710952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.711387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.712077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.712532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.712956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.742125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:51:17.817923 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-244a83e1-cbf2-45eb-a925-3204141945e5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 204 len: 0 microversion: 2.1 time: 0.120817 Sep 16 14:51:17.818580 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3338/6680] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:51:17 2022] DELETE /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:51:17.827218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:17.827960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:17.834508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.835000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.835435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.836136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:17.836593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:17.837017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:17.971097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:17.979207 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-73781557-9b00-4579-a726-c6780e58eaed tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1395 microversion: 2.1 time: 0.156029 Sep 16 14:51:17.979796 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3343/6681] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:17 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:19.003577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:19.004289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:19.011407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:19.011929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:19.012363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:19.013060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:19.013513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:19.013991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:19.144870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:19.152962 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dfaa978c-a43e-44b9-b5cb-c0d80495190f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1395 microversion: 2.1 time: 0.154272 Sep 16 14:51:19.153565 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3339/6682] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:18 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:20.084338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-186818dd-bb8d-4a8f-97ea-39501f7484a6 req-96adb1c0-5068-4966-a9bd-ba17c01dc842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c", "name": "network-vif-deleted", "tag": "7ca0a323-fee1-4424-91f7-ea5e79ab60c3"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:51:20.096298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-186818dd-bb8d-4a8f-97ea-39501f7484a6 req-96adb1c0-5068-4966-a9bd-ba17c01dc842 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:20.096820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-186818dd-bb8d-4a8f-97ea-39501f7484a6 req-96adb1c0-5068-4966-a9bd-ba17c01dc842 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:20.097256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-186818dd-bb8d-4a8f-97ea-39501f7484a6 req-96adb1c0-5068-4966-a9bd-ba17c01dc842 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:20.110208 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-186818dd-bb8d-4a8f-97ea-39501f7484a6 req-96adb1c0-5068-4966-a9bd-ba17c01dc842 service nova] Creating event network-vif-deleted:7ca0a323-fee1-4424-91f7-ea5e79ab60c3 for instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c on n-h1-858129-2 Sep 16 14:51:20.116390 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-186818dd-bb8d-4a8f-97ea-39501f7484a6 req-96adb1c0-5068-4966-a9bd-ba17c01dc842 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Sep 16 14:51:20.117067 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3344/6683] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:51:20.176231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:20.176928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:20.184259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:20.184841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:20.185379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:20.186247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:20.186678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:20.187130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:20.253981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:20.262261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82f81a80-79fe-4e17-9d43-41cc2e3bba9b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1187 microversion: 2.1 time: 0.090580 Sep 16 14:51:20.262870 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3340/6684] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:20 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:21.286635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:21.287411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:21.297121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:21.298177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:21.298642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:21.299351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:21.299804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:21.300227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:21.362528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:21.370571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-12ecdadf-659a-4cb4-aa75-fe6cbef784b2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1187 microversion: 2.1 time: 0.089128 Sep 16 14:51:21.371136 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3345/6685] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:21 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:22.393155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:22.393799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:22.401017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:22.401510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:22.401951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:22.402693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:22.403146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:22.403572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:22.465832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:22.475091 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2223267a-b72d-4450-b0bb-8b4ad0df0e2b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1187 microversion: 2.1 time: 0.085804 Sep 16 14:51:22.475676 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3341/6686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:22 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:23.499691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:23.500343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:23.507096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:23.507569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:23.508000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:23.508705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:23.509158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:23.509579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:23.576786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:23.585321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-02f7f922-d6cc-4990-9654-2fafaff2000c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1187 microversion: 2.1 time: 0.090122 Sep 16 14:51:23.585911 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3346/6687] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:23 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:24.609055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:24.609673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:24.616555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:24.617043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:24.617602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:24.618259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:24.618752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:24.619176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:24.653250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:24.653733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:24.654169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:24.654668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lazy-loading 'fault' on Instance uuid c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:51:24.697307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:24.706648 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28e2b89a-a056-4b25-a333-dbe56c543a06 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 200 len: 1192 microversion: 2.1 time: 0.101456 Sep 16 14:51:24.707223 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3342/6688] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:24 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:25.730035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:25.730611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:25.737502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:25.737989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:25.738450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:25.739158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:25.739611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:25.740034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:25.753691 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c could not be found. Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c HTTP/1.1 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c could not be found. Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c'} Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c could not be found. Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c could not be found. Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:51:25.755374 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c could not be found. Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af0ee8b8-1664-4d8b-b657-cc3c092f874a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c" status: 404 len: 111 microversion: 2.1 time: 0.030904 Sep 16 14:51:25.759430 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3347/6689] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:25 2022] GET /compute/v2.1/servers/c8d4f9e1-c2b1-46f8-aa8a-d894c5cc920c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:51:46.766522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1969267598", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7e2645df-11fc-44dc-854f-9872b22d2624", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a2d73f19-dcf6-4e6b-b995-4ae28b29b873"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:51:46.777636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:46.778357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:46.858695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] validate_networks() for [('a2d73f19-dcf6-4e6b-b995-4ae28b29b873', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:51:47.294512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:51:47.294981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:51:47.295506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:51:47.295931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:51:47.296357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:51:47.308411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:47.308905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:47.309347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:47.310082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:47.310569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:47.311003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:47.330497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:51:47.335924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for user 030a4498f4be4ca3b1f95e741ec6b385 and project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:51:47.349347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:51:47.351440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7e2645df-11fc-44dc-854f-9872b22d2624',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:51:47.425336 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94a4a8f9-6d04-47b0-85e9-4dd141cb8da1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662652 Sep 16 14:51:47.426039 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3343/6690] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:51:47.437470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ee9fe129-fc51-4b4e-9431-1c28798d6beb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:47.438192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ee9fe129-fc51-4b4e-9431-1c28798d6beb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:47.441157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:47.441882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=85 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:47.497440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ee9fe129-fc51-4b4e-9431-1c28798d6beb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:47.507124 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ee9fe129-fc51-4b4e-9431-1c28798d6beb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1057 microversion: 2.1 time: 0.073567 Sep 16 14:51:47.507712 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3348/6691] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:47 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1057 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:48.531479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:48.532367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:48.539188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:48.539671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:48.540103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:48.540787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:48.541239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:48.541662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:48.615518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:48.623671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f634010f-8ea0-428a-945a-ebf807c6b7ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1109 microversion: 2.1 time: 0.096945 Sep 16 14:51:48.624312 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3344/6692] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:48 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1109 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:49.654272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:49.656971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:49.669007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:49.670570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:49.671396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:49.672787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:49.673490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:49.674032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:49.951280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:49.960012 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a43a2404-8e54-4c85-8b00-159e9475a219 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.316166 Sep 16 14:51:49.965783 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3349/6693] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:49 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:51:50.609911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-3df23cfe-d2a9-4649-9198-cd61a2ac5bfe req-6bd9b898-8b03-462c-9e0e-697ebd576eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2aab036-4146-405a-a4a3-d4243cc13bbe", "tag": "78d92e6e-1472-47df-b77d-f00ddc11ce5e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:51:50.620413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3df23cfe-d2a9-4649-9198-cd61a2ac5bfe req-6bd9b898-8b03-462c-9e0e-697ebd576eb5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:50.621001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3df23cfe-d2a9-4649-9198-cd61a2ac5bfe req-6bd9b898-8b03-462c-9e0e-697ebd576eb5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:50.621511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-3df23cfe-d2a9-4649-9198-cd61a2ac5bfe req-6bd9b898-8b03-462c-9e0e-697ebd576eb5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:50.635304 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-3df23cfe-d2a9-4649-9198-cd61a2ac5bfe req-6bd9b898-8b03-462c-9e0e-697ebd576eb5 service nova] Creating event network-changed:78d92e6e-1472-47df-b77d-f00ddc11ce5e for instance c2aab036-4146-405a-a4a3-d4243cc13bbe on n-h1-858129-2 Sep 16 14:51:50.641888 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-3df23cfe-d2a9-4649-9198-cd61a2ac5bfe req-6bd9b898-8b03-462c-9e0e-697ebd576eb5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088713 Sep 16 14:51:50.642893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3345/6694] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:51:51.001955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:51.006499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:51.016918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:51.017448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:51.017883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:51.018608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:51.019230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:51.019798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:51.260025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:51.268241 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-837836b3-beaf-4660-8d05-0c798a98dc76 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.276076 Sep 16 14:51:51.268823 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3350/6695] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:50 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:52.291972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:52.292835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:52.300650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:52.301149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:52.301784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:52.302832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:52.303460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:52.304436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:52.489413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:52.498979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c885ba0f-1ef6-42f5-b6f9-964e7456fc45 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.211361 Sep 16 14:51:52.499713 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3346/6696] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:52 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:53.530382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:53.536626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:53.540969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:53.541512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:53.542135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:53.542666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:53.543119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:53.543551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:53.729571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:53.738317 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1f4f4007-4d6c-481b-8c58-e6c959e639e1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.218115 Sep 16 14:51:53.739457 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3351/6697] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:53 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:51:54.769801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:54.771583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:54.784141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:54.785043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:54.785748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:54.787109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:54.787694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:54.788199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:54.963991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:54.972754 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3684dcb6-de39-4036-bd95-6b007f1e8bea tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.209326 Sep 16 14:51:54.973910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3347/6698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:54 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:56.001711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:56.002457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:56.010576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:56.011077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:56.011515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:56.012238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:56.012700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:56.013234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:56.172650 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:56.183449 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7b93a7fb-2551-4e18-b71e-e91e628cf276 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.185749 Sep 16 14:51:56.184384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3352/6699] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:55 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:57.208235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:57.208776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:57.216837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:57.217734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:57.218573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:57.220437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:57.221139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:57.221584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:57.322144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:57.343221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:57.358490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:57.366879 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4456c87-6bfd-49fc-801c-a5bf790ec9a7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.163215 Sep 16 14:51:57.367467 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3348/6700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:57 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:58.390341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:58.391594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:58.395605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:51:58.399810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:58.400301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:58.401351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:58.401581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:58.402043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:58.402499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:58.540752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:58.549022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a032fd9c-c6c6-43f7-9334-c6472055a728 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.162699 Sep 16 14:51:58.549621 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3353/6701] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:58 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:51:59.572611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:51:59.573920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:51:59.580759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:59.581274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:59.581711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:59.582514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:51:59.582974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:51:59.583401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:51:59.716697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:51:59.725016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-289ec14b-ee41-44e9-beb8-a4641f5f6b80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.156509 Sep 16 14:51:59.725593 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3349/6702] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:51:59 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:00.747871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:00.748480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:00.756059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:00.756546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:00.756975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:00.757675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:00.758127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:00.758571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:00.893453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:00.901525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d911dbc3-7eb9-4642-9a54-6aacdcc02429 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.157423 Sep 16 14:52:00.902123 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3354/6703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:00 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:01.925007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:01.925645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:01.932586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:01.933071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:01.933506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:01.934196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:01.934673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:01.935097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:02.067307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:02.075331 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a80f9dcb-8b91-4396-8e7d-72290af8a6d2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1169 microversion: 2.1 time: 0.154817 Sep 16 14:52:02.076011 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3350/6704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:01 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:03.098755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:03.099374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:03.106191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:03.106711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:03.107155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:03.107858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:03.108402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:03.108841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:03.255731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:03.263962 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a021e174-4c0d-4d07-9da2-74f8f6333203 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1215 microversion: 2.1 time: 0.169893 Sep 16 14:52:03.264778 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3355/6705] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:03 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:04.288669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:04.289228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:04.296584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:04.297077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:04.297523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:04.298269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:04.298865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:04.299303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:04.443772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:04.452376 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-358440ce-f639-420b-b8ba-88eca9c823d3 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.167659 Sep 16 14:52:04.452984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3351/6706] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:04 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:05.475760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:05.476368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:05.483361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:05.483838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:05.484809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:05.485471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:05.485916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:05.486332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:05.620193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:05.628604 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1084f39a-56a9-47d2-8e29-5b6fc12e2e30 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.156959 Sep 16 14:52:05.629183 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3356/6707] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:05 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:06.651531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:06.652052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:06.659089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:06.659588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:06.660026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:06.660729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:06.661195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:06.661847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:06.792108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:06.799857 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fd893774-0e35-4c37-bc8f-ee71961ebad7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.152406 Sep 16 14:52:06.800442 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3352/6708] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:06 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:07.822120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:07.822765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:07.830304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:07.830816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:07.831253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:07.831947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:07.832404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:07.832842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:07.966882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:07.974839 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ad8cfd13-bd79-48c7-856c-90e516d75175 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.156595 Sep 16 14:52:07.975422 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3357/6709] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:07 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:08.997813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:08.998493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:09.006493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:09.006927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:09.007368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:09.008077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:09.008539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:09.008969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:09.139818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:09.148209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dafcf6d2-90b8-4e11-98ca-d2597535ea12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.154323 Sep 16 14:52:09.148995 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3353/6710] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:08 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:10.171280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:10.172448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:10.179393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:10.179868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:10.180294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:10.180975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:10.181417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:10.181831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:10.314054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:10.321789 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5db4e2cb-8472-45e3-bf93-cdcba154b037 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.154365 Sep 16 14:52:10.322380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3358/6711] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:10 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:11.344715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:11.345335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:11.352488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:11.352969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:11.353405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:11.354093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:11.354573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:11.355000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:11.488169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:11.496059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-609c58a9-d75b-41cf-be9e-cae8d7170329 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.155256 Sep 16 14:52:11.496629 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3354/6712] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:11 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:12.519872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:12.520483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:12.527397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:12.527884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:12.528314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:12.529016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:12.529475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:12.529900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:12.665800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:12.673657 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5949dc3b-ad5c-4fb7-befe-16d29a58eef5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.158205 Sep 16 14:52:12.674339 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3359/6713] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:12 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:13.697238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:13.698171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:13.708799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:13.709299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:13.709746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:13.710485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:13.710950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:13.711387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:13.849063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:13.857225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2073da0c-c717-44c5-b831-4ad55038fc67 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.163929 Sep 16 14:52:13.857814 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3355/6714] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:13 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:14.829830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2042a935-ee84-440a-99eb-c79163b70faa req-453b491e-13e2-400d-ab05-812d7de609bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2aab036-4146-405a-a4a3-d4243cc13bbe", "name": "network-vif-plugged", "status": "completed", "tag": "78d92e6e-1472-47df-b77d-f00ddc11ce5e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:52:14.841310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2042a935-ee84-440a-99eb-c79163b70faa req-453b491e-13e2-400d-ab05-812d7de609bb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:14.841790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2042a935-ee84-440a-99eb-c79163b70faa req-453b491e-13e2-400d-ab05-812d7de609bb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:14.842214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2042a935-ee84-440a-99eb-c79163b70faa req-453b491e-13e2-400d-ab05-812d7de609bb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:14.854211 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2042a935-ee84-440a-99eb-c79163b70faa req-453b491e-13e2-400d-ab05-812d7de609bb service nova] Creating event network-vif-plugged:78d92e6e-1472-47df-b77d-f00ddc11ce5e for instance c2aab036-4146-405a-a4a3-d4243cc13bbe on n-h1-858129-2 Sep 16 14:52:14.859522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2042a935-ee84-440a-99eb-c79163b70faa req-453b491e-13e2-400d-ab05-812d7de609bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Sep 16 14:52:14.861044 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3360/6715] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:52:14.880451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:14.881089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:14.888136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:14.888629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:14.889161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:14.889865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:14.890319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:14.890952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:15.094699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:15.102914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-923c4080-dbc3-4eb0-851a-ab31e56e3e62 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.226514 Sep 16 14:52:15.103492 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3356/6716] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:14 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:16.128081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:16.128786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:16.137217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:16.137702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:16.138141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:16.138875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:16.139331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:16.139757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:16.280291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:16.288736 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a02f8739-b485-4f3c-8e54-24c2ad759a6d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1203 microversion: 2.1 time: 0.166412 Sep 16 14:52:16.289462 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3361/6717] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:16 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:17.312473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:17.313105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:17.315833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:17.321061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.321546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.321985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.322708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.323213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.323641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.327088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=77 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:17.458308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:17.466242 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c15b8816-5e38-49a0-8243-1752e3bfaf9f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1390 microversion: 2.1 time: 0.157709 Sep 16 14:52:17.466883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3357/6718] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:17 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:17.488840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:17.489446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:17.492289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=31 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:17.497568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.498054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.498510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.499210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.499658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.500082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.502886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=75 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:17.631846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:17.639771 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62054687-96af-4af8-884d-df818b524b18 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1390 microversion: 2.1 time: 0.154668 Sep 16 14:52:17.640310 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3362/6719] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:17 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:17.662687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:17.663327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:17.669592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.670077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.670572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.671261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.671747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.672194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.800217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:17.808447 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1a7bcf9-2b30-4ef8-a023-02fe7e1f3b03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1390 microversion: 2.1 time: 0.149805 Sep 16 14:52:17.809035 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3358/6720] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:17 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:17.889029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:17.889549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:17.897839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.898324 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.898788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.899481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:17.899938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:17.900362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:17.926724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:52:18.008964 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8810292b-30f4-40a9-a590-e1e1424227fc tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 204 len: 0 microversion: 2.1 time: 0.123439 Sep 16 14:52:18.009690 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3363/6721] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:52:17 2022] DELETE /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:52:18.018129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:18.018935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:18.025100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:18.025591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:18.026020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:18.026746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:18.027199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:18.027632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:18.159265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:18.167458 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba939a16-c743-462b-8798-65eeab07dd8e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1396 microversion: 2.1 time: 0.153261 Sep 16 14:52:18.168062 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3359/6722] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:18 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:19.192517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:19.193227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:19.200312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:19.200802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:19.201237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:19.201946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:19.202430 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:19.202857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:19.344593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:19.352702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de0e4775-d34a-47f0-ae9e-77bf62aa5e9d tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1396 microversion: 2.1 time: 0.165088 Sep 16 14:52:19.353277 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3364/6723] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:19 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:20.258895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-428b5eb7-b40e-4ade-9d52-6f7ee31c1033 req-ba6efe17-0038-475f-a653-48b2d47eee0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2aab036-4146-405a-a4a3-d4243cc13bbe", "name": "network-vif-deleted", "tag": "78d92e6e-1472-47df-b77d-f00ddc11ce5e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:52:20.272962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-428b5eb7-b40e-4ade-9d52-6f7ee31c1033 req-ba6efe17-0038-475f-a653-48b2d47eee0b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:20.273443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-428b5eb7-b40e-4ade-9d52-6f7ee31c1033 req-ba6efe17-0038-475f-a653-48b2d47eee0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:20.274741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-428b5eb7-b40e-4ade-9d52-6f7ee31c1033 req-ba6efe17-0038-475f-a653-48b2d47eee0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:20.288749 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-428b5eb7-b40e-4ade-9d52-6f7ee31c1033 req-ba6efe17-0038-475f-a653-48b2d47eee0b service nova] Creating event network-vif-deleted:78d92e6e-1472-47df-b77d-f00ddc11ce5e for instance c2aab036-4146-405a-a4a3-d4243cc13bbe on n-h1-858129-2 Sep 16 14:52:20.299754 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-428b5eb7-b40e-4ade-9d52-6f7ee31c1033 req-ba6efe17-0038-475f-a653-48b2d47eee0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044170 Sep 16 14:52:20.301352 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3360/6724] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:52:20.375562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:20.376159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:20.386581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:20.387079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:20.387726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:20.388485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:20.388943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:20.389368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:20.465907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:20.474829 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06c32009-e66a-40a6-800d-53a6bdd36f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1188 microversion: 2.1 time: 0.103339 Sep 16 14:52:20.475677 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3365/6725] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:20 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:21.499280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:21.499903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:21.507120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:21.507606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:21.508035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:21.508764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:21.509212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:21.509967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:21.575251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:21.584015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67d3d021-4b1a-461c-a5af-fc3fb837db09 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1188 microversion: 2.1 time: 0.090046 Sep 16 14:52:21.584609 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3361/6726] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:21 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:22.607453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:22.608004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:22.614927 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:22.615417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:22.615850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:22.616557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:22.617014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:22.617441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:22.682191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:22.691773 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d54966f9-51ae-433c-996c-a66878a0fd12 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1188 microversion: 2.1 time: 0.088269 Sep 16 14:52:22.692383 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3366/6727] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:22 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:23.714875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:23.715507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:23.723992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:23.724485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:23.724924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:23.725641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:23.726100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:23.726571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:23.792128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:23.800302 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f339aef4-d743-4a57-b84c-826c4049e6b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1188 microversion: 2.1 time: 0.089393 Sep 16 14:52:23.800973 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3362/6728] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:23 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:24.823680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:24.824227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:24.838884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:24.839370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:24.839806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:24.840533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:24.840988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:24.841439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:24.874359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:24.874871 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:24.875329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:24.875776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lazy-loading 'fault' on Instance uuid c2aab036-4146-405a-a4a3-d4243cc13bbe {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:52:24.929213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:24.937175 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d2d991a-ced9-416e-8495-6a0e076809ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 200 len: 1193 microversion: 2.1 time: 0.117446 Sep 16 14:52:24.937771 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3367/6729] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:24 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 1193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:25.972321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:25.973220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:25.980652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:25.981156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:25.981606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:25.982338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:25.982875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:25.983311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:25.999555 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe HTTP/1.1 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c2aab036-4146-405a-a4a3-d4243cc13bbe'} Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:52:26.001070 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-578c655e-07c5-4b8e-be89-86a7114f123f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 404 len: 111 microversion: 2.1 time: 0.035049 Sep 16 14:52:26.009268 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3363/6730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:25 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:52:28.194597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:28.195159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:28.202568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:28.203071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:28.203575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:28.204298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:28.204780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:28.205215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:28.220007 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe HTTP/1.1 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'c2aab036-4146-405a-a4a3-d4243cc13bbe'} Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:52:28.221803 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e37c92b-6388-41fe-8953-730b0bb21b70 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 404 len: 111 microversion: 2.1 time: 0.033591 Sep 16 14:52:28.225907 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3368/6731] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:52:28 2022] DELETE /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:52:28.236139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:28.236800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: c2aab036-4146-405a-a4a3-d4243cc13bbe] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:28.244187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:28.244688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:28.245133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:28.245855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:28.246320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:28.246788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:28.262694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe HTTP/1.1 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'c2aab036-4146-405a-a4a3-d4243cc13bbe'} Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:52:28.264261 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance c2aab036-4146-405a-a4a3-d4243cc13bbe could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-357f1701-0948-4f7d-9a39-8dd2a0023410 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe" status: 404 len: 111 microversion: 2.1 time: 0.034354 Sep 16 14:52:28.268881 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3364/6732] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:28 2022] GET /compute/v2.1/servers/c2aab036-4146-405a-a4a3-d4243cc13bbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:52:49.272367 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1565566500", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "10d5d6d4-a83f-49fb-9389-9c8f23c0c6b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a2d73f19-dcf6-4e6b-b995-4ae28b29b873"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:52:49.284518 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:52:49.284759 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 14:52:49.285818 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:49.286603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:49.346353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] validate_networks() for [('a2d73f19-dcf6-4e6b-b995-4ae28b29b873', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:52:49.743091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:52:49.743554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:52:49.744028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:52:49.744436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:52:49.744931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:52:49.754651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:49.755141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:49.755578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:49.756319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:49.756821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:49.757246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:49.778037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:52:49.784228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for user 030a4498f4be4ca3b1f95e741ec6b385 and project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:52:49.845432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:52:49.847615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10d5d6d4-a83f-49fb-9389-9c8f23c0c6b4',volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:52:49.989315 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80000834-c96a-4bf6-9694-d5cee2b3c636 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721030 Sep 16 14:52:49.990224 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3369/6733] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:52:50.002235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-263ea3c8-addc-4e87-9607-f0c63c781afe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:50.002894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-263ea3c8-addc-4e87-9607-f0c63c781afe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:50.005713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=15 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:50.006386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=35 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:50.064059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-263ea3c8-addc-4e87-9607-f0c63c781afe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:50.072268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-263ea3c8-addc-4e87-9607-f0c63c781afe tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1071 microversion: 2.1 time: 0.074481 Sep 16 14:52:50.072948 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3365/6734] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:49 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1071 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:52:51.101244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:51.103339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:51.112384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:51.112888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:51.113329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:51.114067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:51.114641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:51.115072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:51.194828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:51.204332 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-68fcc585-0442-438b-8149-f466ddf0eba0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1169 microversion: 2.1 time: 0.112149 Sep 16 14:52:51.205334 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3370/6735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:51 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1169 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:52.256211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:52.258328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:52.275312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:52.276202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:52.276988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:52.278325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:52.279230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:52.280015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:52.612003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:52.626961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91440320-d082-41ca-9368-e7d40f1f67d8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1229 microversion: 2.1 time: 0.382896 Sep 16 14:52:52.628447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3366/6736] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:52 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1229 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:53.339715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-5996cd09-6873-4955-ab7a-4265ad124415 req-1b7936fc-7e45-4b81-b115-27cbfd77e6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815daafd-52f3-4b5e-850d-9461974ccce4", "tag": "287e53bd-1703-4552-9a0a-da028931cbdf"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:52:53.355874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5996cd09-6873-4955-ab7a-4265ad124415 req-1b7936fc-7e45-4b81-b115-27cbfd77e6dc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:53.356823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5996cd09-6873-4955-ab7a-4265ad124415 req-1b7936fc-7e45-4b81-b115-27cbfd77e6dc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:53.357678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-5996cd09-6873-4955-ab7a-4265ad124415 req-1b7936fc-7e45-4b81-b115-27cbfd77e6dc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:53.385520 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-5996cd09-6873-4955-ab7a-4265ad124415 req-1b7936fc-7e45-4b81-b115-27cbfd77e6dc service nova] Creating event network-changed:287e53bd-1703-4552-9a0a-da028931cbdf for instance 815daafd-52f3-4b5e-850d-9461974ccce4 on n-h1-858129-2 Sep 16 14:52:53.396264 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-5996cd09-6873-4955-ab7a-4265ad124415 req-1b7936fc-7e45-4b81-b115-27cbfd77e6dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063413 Sep 16 14:52:53.398118 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3371/6737] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:52:53.652367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:53.653772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:53.664451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:53.665346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:53.666165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:53.667508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:53.668352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:53.669634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:53.927075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:53.943256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58e6c456-c390-4c4a-9b2f-5822332c90be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1229 microversion: 2.1 time: 0.294551 Sep 16 14:52:53.944327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3367/6738] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:53 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1229 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:54.968567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:54.969266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:54.976284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:54.976771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:54.977198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:54.977892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:54.978348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:54.978801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:55.126277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:55.136838 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fb5a0129-7e03-455e-b39d-383b7820f9b8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1229 microversion: 2.1 time: 0.172982 Sep 16 14:52:55.137893 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3372/6739] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:54 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1229 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:56.167065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:56.167697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:56.175920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:56.176426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:56.176868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:56.177599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:56.178066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:56.178562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:56.357578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:56.371980 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e369ccfe-9e9b-4ee5-b0d8-44e8a04c14ca tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1229 microversion: 2.1 time: 0.208570 Sep 16 14:52:56.373023 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3368/6740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:56 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1229 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:57.397232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:57.397861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:57.405323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:57.405824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:57.406299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:57.407721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:57.408197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:57.408631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:57.560703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:57.569907 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e1c9056-c5a9-493f-a769-991e3f740a5e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.176683 Sep 16 14:52:57.570793 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3373/6741] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:57 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:58.594764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:58.595319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:58.602718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:58.603217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:58.603664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:58.604382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:58.604847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:58.605280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:58.749462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:58.757664 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6822112c-8dab-4760-8b00-09f07f8903f0 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.167729 Sep 16 14:52:58.758264 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3369/6742] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:58 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:52:59.781311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:52:59.782531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:52:59.785434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:59.791249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:59.792781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:59.793020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:59.793747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:52:59.794219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:52:59.794667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:52:59.795320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:52:59.930003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:52:59.937951 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-38b1030b-b974-4702-b8c6-72b33eb6c4c1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.160588 Sep 16 14:52:59.938553 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3374/6743] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:52:59 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:00.962429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:00.963045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:00.965774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:00.971210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:00.971700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:00.972137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:00.973083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:00.973548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:00.973970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:01.105142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:01.113737 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94931b27-a6d3-4a62-b425-cd81c67eadb8 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.155437 Sep 16 14:53:01.114325 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3370/6744] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:00 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:02.137281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:02.137814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:02.148627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:02.148627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:02.148627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:02.148627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:02.148627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:02.148627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:02.291558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:02.304596 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-28936b17-2a6a-4811-b2e0-1e652378b52e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.170998 Sep 16 14:53:02.305532 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3375/6745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:02 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:03.329421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:03.330023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:03.336993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:03.337479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:03.337909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:03.338618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:03.339068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:03.339485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:03.470806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:03.479312 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3fb887ab-438d-4917-8b94-bf4843d69d80 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.153675 Sep 16 14:53:03.480049 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3371/6746] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:03 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:04.515583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:04.516243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:04.523911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:04.524497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:04.525026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:04.525830 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:04.526340 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:04.526910 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:04.677357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:04.686021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-20e72ff0-4cb5-46e0-88ab-3d7c9b5a309a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.174686 Sep 16 14:53:04.686653 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3376/6747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:04 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:05.711003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:05.711536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:05.718459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:05.718956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:05.719396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:05.720725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:05.721192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:05.721624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:05.856887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:05.864768 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0a3ef9d7-3b88-45bd-8e9a-02923f2352aa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.157757 Sep 16 14:53:05.865350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3372/6748] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:05 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:06.888425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:06.889169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:06.896814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:06.897312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:06.897751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:06.898491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:06.899069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:06.899375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:07.053168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:07.062602 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-073e430a-a4eb-4ba2-824e-1d940fc1cc8c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.177988 Sep 16 14:53:07.063109 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3377/6749] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:06 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:07.104887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-49b7a0f8-52fa-4768-9c9e-7551b9c09412 req-cabc7ea8-9e41-439b-aef4-ab14d6f2dfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815daafd-52f3-4b5e-850d-9461974ccce4", "name": "network-vif-plugged", "status": "completed", "tag": "287e53bd-1703-4552-9a0a-da028931cbdf"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:07.116341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-49b7a0f8-52fa-4768-9c9e-7551b9c09412 req-cabc7ea8-9e41-439b-aef4-ab14d6f2dfcf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:07.116717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-49b7a0f8-52fa-4768-9c9e-7551b9c09412 req-cabc7ea8-9e41-439b-aef4-ab14d6f2dfcf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:07.117147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-49b7a0f8-52fa-4768-9c9e-7551b9c09412 req-cabc7ea8-9e41-439b-aef4-ab14d6f2dfcf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:07.130318 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-49b7a0f8-52fa-4768-9c9e-7551b9c09412 req-cabc7ea8-9e41-439b-aef4-ab14d6f2dfcf service nova] Creating event network-vif-plugged:287e53bd-1703-4552-9a0a-da028931cbdf for instance 815daafd-52f3-4b5e-850d-9461974ccce4 on n-h1-858129-2 Sep 16 14:53:07.136518 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-49b7a0f8-52fa-4768-9c9e-7551b9c09412 req-cabc7ea8-9e41-439b-aef4-ab14d6f2dfcf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 Sep 16 14:53:07.137190 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3373/6750] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:53:08.085380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:08.085984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:08.093020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:08.093498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:08.093953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:08.094675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:08.095639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:08.096052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:08.234668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:08.243586 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d3627900-4e61-41f4-b45e-56c8144f6239 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1217 microversion: 2.1 time: 0.162063 Sep 16 14:53:08.244189 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3378/6751] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:08 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:09.267511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:09.268215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:09.275368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:09.275859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:09.276581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:09.277289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:09.277749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:09.278181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:09.413473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:09.421543 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1f9c837-a431-4f3d-918b-5c413c469faa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1404 microversion: 2.1 time: 0.158415 Sep 16 14:53:09.422126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3374/6752] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:09 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:09.444685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:09.445325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:09.452126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:09.452608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:09.453040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:09.453728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:09.454182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:09.454636 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:09.584749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:09.592771 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-bf9e2398-65e1-4d64-95f5-9832bd26b638 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1404 microversion: 2.1 time: 0.151978 Sep 16 14:53:09.593362 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3379/6753] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:09 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:09.616486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1486145866"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:09.618899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:09.625179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:09.625562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:09.626032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:09.626866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:09.627327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:09.627768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:09.729771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Attempting to quiesce instance before volume snapshot. Sep 16 14:53:09.795376 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 16 14:53:09.866853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Creating snapshot from volume 10d5d6d4-a83f-49fb-9389-9c8f23c0c6b4. {{(pid=128642) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 16 14:53:10.836002 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-427a0bc4-3e53-43c5-92f3-5f96ab6ebafa tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4/action" status: 202 len: 0 microversion: 2.1 time: 1.223413 Sep 16 14:53:10.836842 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3375/6754] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:53:09 2022] POST /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 14:53:11.994023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1107589517", "imageRef": "9deae645-2956-4402-b097-e7e742d4f527", "flavorRef": "452", "networks": [{"uuid": "a2d73f19-dcf6-4e6b-b995-4ae28b29b873"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:12.055669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] validate_networks() for [('a2d73f19-dcf6-4e6b-b995-4ae28b29b873', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:53:12.543621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:53:12.544039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:53:12.544506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:53:12.544941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:53:12.545350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:53:12.554086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:12.554599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:12.555029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:12.555744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:12.556189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:12.556607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:12.573653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:53:12.578890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for user 030a4498f4be4ca3b1f95e741ec6b385 and project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:53:12.591499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:53:12.594027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a393f7a5-f029-4f18-9554-1255d61ad349',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:53:12.671186 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-51fd6c3a-d3c3-49dd-9f2b-cb4f057372e2 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681158 Sep 16 14:53:12.671847 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3380/6755] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:53:12.684688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1a1db3c-16f5-4d8c-9799-c32da099f845 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:12.685396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1a1db3c-16f5-4d8c-9799-c32da099f845 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:12.742776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1a1db3c-16f5-4d8c-9799-c32da099f845 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:12.749826 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1a1db3c-16f5-4d8c-9799-c32da099f845 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1230 microversion: 2.1 time: 0.070242 Sep 16 14:53:12.750438 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3376/6756] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:12 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:13.773373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:13.773948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:13.783149 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:13.783635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:13.784067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:13.784777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:13.785215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:13.785634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:13.862091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:13.870744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b2743e9e-1f73-4d0a-9508-9b5e50a5e903 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1290 microversion: 2.1 time: 0.101576 Sep 16 14:53:13.873048 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3381/6757] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:13 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:14.896651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:14.897434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:14.904690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:14.905315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:14.905841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:14.906684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:14.907297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:14.907814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:15.060877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:15.070293 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5bdd7a6a-84a3-4d80-ab94-2b1485131764 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.178741 Sep 16 14:53:15.071045 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3377/6758] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:14 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:15.605441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d1395489-207b-4531-bcca-83186124f671 req-2eab63b1-ae0c-44a2-8672-3a644a291a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3", "tag": "89f799b4-4279-465a-b9ad-770bb5cf8a44"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:15.618597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d1395489-207b-4531-bcca-83186124f671 req-2eab63b1-ae0c-44a2-8672-3a644a291a79 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:15.619350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d1395489-207b-4531-bcca-83186124f671 req-2eab63b1-ae0c-44a2-8672-3a644a291a79 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:15.619917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d1395489-207b-4531-bcca-83186124f671 req-2eab63b1-ae0c-44a2-8672-3a644a291a79 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:15.632333 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d1395489-207b-4531-bcca-83186124f671 req-2eab63b1-ae0c-44a2-8672-3a644a291a79 service nova] Creating event network-changed:89f799b4-4279-465a-b9ad-770bb5cf8a44 for instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 on n-h2-858129-2 Sep 16 14:53:15.637509 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d1395489-207b-4531-bcca-83186124f671 req-2eab63b1-ae0c-44a2-8672-3a644a291a79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088240 Sep 16 14:53:15.638480 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3382/6759] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:53:16.093229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:16.094178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:16.101902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:16.102591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:16.103326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:16.104275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:16.104880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:16.105429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:16.276527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:16.286907 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-98078a3e-b553-426f-9d68-671c2110a67b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.197538 Sep 16 14:53:16.288252 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3378/6760] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:16 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:17.317362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:17.318492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:17.329169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:17.330109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:17.330912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:17.332196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:17.333004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:17.334044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:17.492099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:17.501014 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ced7a944-7901-4d93-8593-e0b845039e39 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.191774 Sep 16 14:53:17.501758 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3383/6761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:17 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:18.531289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:18.531289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:18.546325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:18.546801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:18.547294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:18.548018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:18.548706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:18.549490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:18.781279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:18.796745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8285f5f-20a0-4c05-980d-8de7f9654d64 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.269188 Sep 16 14:53:18.797453 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3379/6762] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:18 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:19.837221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:19.838542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:19.841008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:19.845971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:19.846506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:19.848672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:19.849173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:19.850018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:19.851059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:19.855964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=75 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:20.312440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:20.323194 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-be86adf0-2b30-455f-8b19-3f55f5b443d4 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.490805 Sep 16 14:53:20.324142 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3384/6763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:19 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:21.348625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:21.349274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:21.352465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=35 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:21.358386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:21.359336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:21.359804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:21.361061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:21.361527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:21.361977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:21.381852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:21.505862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:21.514127 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1c28439d-0902-4a27-a1dd-09f581938780 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.169610 Sep 16 14:53:21.527408 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3380/6764] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:21 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:22.537363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:22.537885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:22.544469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:22.544952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:22.545389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:22.546077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:22.546564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:22.546990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:22.565590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:22.586285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:22.685222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:22.695372 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43b1e998-e104-4afe-8a5e-696da9b6c1ac tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.162212 Sep 16 14:53:22.695959 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3385/6765] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:22 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:23.718868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:23.719503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:23.723250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:23.729175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:23.729678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:23.730200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:23.730885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:23.731359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:23.731801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:23.912395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:23.920745 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-045e4b53-43b5-4957-abf8-22206128b7cb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.206181 Sep 16 14:53:23.921380 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3381/6766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:23 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:24.944073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:24.944698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:24.951842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:24.952331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:24.952764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:24.953533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:24.954007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:24.954353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:25.096146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:25.104950 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b5871ae0-3a62-4892-9b74-31c88641d27b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.164845 Sep 16 14:53:25.105534 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3386/6767] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:24 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:26.128091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:26.128931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:26.139083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:26.140001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:26.142171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:26.144268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:26.145256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:26.146044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:26.303897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:26.312543 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00ad0abd-3d7f-4fec-976f-c0cf7c55256e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.189053 Sep 16 14:53:26.313493 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3382/6768] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:26 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:27.339634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:27.340401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:27.349724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:27.350321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:27.350756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:27.351477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:27.351942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:27.352368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:27.500264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:27.507096 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-258abd47-92f4-45c8-8d19-9ad6047fb421 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.172085 Sep 16 14:53:27.507689 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3387/6769] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:27 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:28.530496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:28.531144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:28.538866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:28.539385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:28.539848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:28.540599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:28.541061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:28.541508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:28.688300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:28.696489 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-153ae1c8-de37-44c7-baf8-2bc1425a1545 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1342 microversion: 2.1 time: 0.169980 Sep 16 14:53:28.697076 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3383/6770] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:28 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:29.725767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:29.726300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:29.737620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:29.738421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:29.739230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:29.740465 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:29.741150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:29.741882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:29.874463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:29.882575 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-89650145-4fca-430b-8d13-3632cb09b3c6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.163498 Sep 16 14:53:29.883156 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3388/6771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:29 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:30.906258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:30.906927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:30.914328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:30.915016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:30.915555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:30.916395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:30.916923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:30.917369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:31.065014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:31.073255 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9b2cb02b-96f9-493c-803b-28bf7cae8b17 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.170796 Sep 16 14:53:31.073837 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3384/6772] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:30 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:32.097795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:32.098632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:32.107318 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:32.107563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:32.107937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:32.108743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:32.109165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:32.110007 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:32.254712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:32.263800 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e61aed9f-7fe5-4c17-9246-c81cca24447f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.170856 Sep 16 14:53:32.264390 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3389/6773] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:32 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:33.297319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:33.299205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:33.307113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:33.307640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:33.308127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:33.308865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:33.309340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:33.309822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:33.471369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:33.480287 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-177f7734-0443-4b7f-ba32-d1052903baeb tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.189516 Sep 16 14:53:33.481000 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3385/6774] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:33 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:34.504314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:34.505153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:34.513148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:34.513960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:34.514712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:34.515749 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:34.516436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:34.517872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:34.676467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:34.688847 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7974762-9ea6-4225-9011-2c9d118840b7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.188878 Sep 16 14:53:34.690101 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3390/6775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:34 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:35.715688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:35.716246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:35.724837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:35.725338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:35.725784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:35.726534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:35.727002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:35.727441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:35.870257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:35.878517 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58aecf80-713d-4e96-b0a4-bfc581bb27be tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.167200 Sep 16 14:53:35.879128 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3386/6776] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:35 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:36.902034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:36.902668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:36.910762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:36.911316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:36.911799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:36.912562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:36.913065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:36.913620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:37.084868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:37.093807 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb68813b-c3f9-40d1-b7e4-b161976b1558 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.195761 Sep 16 14:53:37.094419 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3391/6777] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:36 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:38.120777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:38.121717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:38.128589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:38.129182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:38.129702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:38.130608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:38.131125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:38.131579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:38.294036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:38.302842 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3d26513a-2ed7-4b90-b5f8-05c8d7dea094 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.186361 Sep 16 14:53:38.303443 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3387/6778] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:38 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:39.330251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:39.331221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:39.346184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:39.347040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:39.348188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:39.349448 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:39.349994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:39.350823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:39.527434 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:39.538391 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df36bbab-7e4a-49cd-9ecc-031c3b5774dd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.214841 Sep 16 14:53:39.539218 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3392/6779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:39 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:40.057083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-420a38b6-a97e-4f1d-ab9c-239e51f09fce req-97bb5e7a-ae9c-4afa-99cd-1b1ae0819bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3", "name": "network-vif-plugged", "status": "completed", "tag": "89f799b4-4279-465a-b9ad-770bb5cf8a44"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:40.069163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-420a38b6-a97e-4f1d-ab9c-239e51f09fce req-97bb5e7a-ae9c-4afa-99cd-1b1ae0819bd5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:40.069677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-420a38b6-a97e-4f1d-ab9c-239e51f09fce req-97bb5e7a-ae9c-4afa-99cd-1b1ae0819bd5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:40.070164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-420a38b6-a97e-4f1d-ab9c-239e51f09fce req-97bb5e7a-ae9c-4afa-99cd-1b1ae0819bd5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:40.083633 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-420a38b6-a97e-4f1d-ab9c-239e51f09fce req-97bb5e7a-ae9c-4afa-99cd-1b1ae0819bd5 service nova] Creating event network-vif-plugged:89f799b4-4279-465a-b9ad-770bb5cf8a44 for instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 on n-h2-858129-2 Sep 16 14:53:40.089018 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-420a38b6-a97e-4f1d-ab9c-239e51f09fce req-97bb5e7a-ae9c-4afa-99cd-1b1ae0819bd5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035644 Sep 16 14:53:40.089895 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3388/6780] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:53:40.564197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:40.564864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:40.572202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:40.572748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:40.573202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:40.573925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:40.574387 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:40.574849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:40.764889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:40.781965 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3dda6574-f330-4614-b76b-a6557ff96f4e tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1376 microversion: 2.1 time: 0.222266 Sep 16 14:53:40.783744 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3393/6781] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:40 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1376 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:41.810516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:41.811330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:41.820132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:41.820960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:41.821502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:41.822369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:41.822971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:41.823582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:41.967654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:41.977081 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8f2a6d1-54de-4597-b7fa-8a812dd39c8a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1564 microversion: 2.1 time: 0.173278 Sep 16 14:53:41.977700 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3389/6782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:41 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:42.016787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:42.017374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:42.024624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:42.025119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:42.025556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:42.026266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:42.026748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:42.027180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:42.195317 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:42.204822 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2654df0b-fb6b-4cd3-97b1-b2c6a194739c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1564 microversion: 2.1 time: 0.191303 Sep 16 14:53:42.205460 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3394/6783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:42 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:42.310175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:42.310755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:42.319154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:42.319662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:42.320126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:42.320873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:42.321351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:42.321802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:42.358559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:53:42.455826 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2df29e83-c996-4e9e-92fe-9c0e65c15069 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 204 len: 0 microversion: 2.1 time: 0.150840 Sep 16 14:53:42.456455 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3390/6784] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:53:42 2022] DELETE /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:53:42.465232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:42.465979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:42.473969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:42.474694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:42.475035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:42.475773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:42.476341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:42.476826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:42.661388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:42.669887 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d741a3ce-09d1-43ba-8111-e71b27afdfcd tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1570 microversion: 2.1 time: 0.208710 Sep 16 14:53:42.670519 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3395/6785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:42 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:43.697030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:43.697672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:43.705310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:43.705815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:43.706284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:43.707044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:43.707515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:43.707966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:43.871296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:43.879919 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49d4e851-f716-40db-ba23-f050104c1b57 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1570 microversion: 2.1 time: 0.187299 Sep 16 14:53:43.880536 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3391/6786] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:43 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:44.829146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9cde6e9a-13f4-41c0-9339-084ca186b279 req-1d84535a-2190-4707-af23-d572cb755a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3", "name": "network-vif-deleted", "tag": "89f799b4-4279-465a-b9ad-770bb5cf8a44"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:44.858515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9cde6e9a-13f4-41c0-9339-084ca186b279 req-1d84535a-2190-4707-af23-d572cb755a38 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:44.859070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9cde6e9a-13f4-41c0-9339-084ca186b279 req-1d84535a-2190-4707-af23-d572cb755a38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:44.859617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9cde6e9a-13f4-41c0-9339-084ca186b279 req-1d84535a-2190-4707-af23-d572cb755a38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:44.878355 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9cde6e9a-13f4-41c0-9339-084ca186b279 req-1d84535a-2190-4707-af23-d572cb755a38 service nova] Creating event network-vif-deleted:89f799b4-4279-465a-b9ad-770bb5cf8a44 for instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 on n-h2-858129-2 Sep 16 14:53:44.885033 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9cde6e9a-13f4-41c0-9339-084ca186b279 req-1d84535a-2190-4707-af23-d572cb755a38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061356 Sep 16 14:53:44.886232 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3396/6787] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:53:44.905270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:44.908000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:44.916048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:44.916906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:44.917562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:44.918529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:44.919199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:44.920099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:44.995916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:45.008292 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f1557eed-a773-443c-8007-64373d32fc66 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1361 microversion: 2.1 time: 0.106353 Sep 16 14:53:45.009164 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3392/6788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:44 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1361 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:46.033734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:46.034476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:46.042475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:46.043018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:46.043826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:46.044561 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:46.045028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:46.045461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:46.115447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:46.123603 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9725edd-c6ed-4469-8ce5-5bce970b410b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1361 microversion: 2.1 time: 0.095161 Sep 16 14:53:46.124198 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3397/6789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:46 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:47.147126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:47.147770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:47.155738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:47.156258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:47.156718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:47.157483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:47.157990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:47.158454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:47.248066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:47.260017 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af917693-ea20-44b3-a66a-f32b98650a85 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1361 microversion: 2.1 time: 0.117513 Sep 16 14:53:47.266458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3393/6790] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:47 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1361 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:48.284825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:48.285731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:48.296611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:48.297127 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:48.297610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:48.298383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:48.299034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:48.299843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:48.383425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:48.393495 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d40e799a-5803-4703-a3ee-c7a875795e10 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1361 microversion: 2.1 time: 0.112644 Sep 16 14:53:48.394471 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3398/6791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:48 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1361 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:49.429304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:49.430858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:49.444613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:49.445540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:49.446378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:49.447784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:49.448657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:49.449463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:49.556872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:49.567900 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6dffd117-f579-4669-b27d-962fe179afdf tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 200 len: 1361 microversion: 2.1 time: 0.152784 Sep 16 14:53:49.569206 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3394/6792] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:49 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:50.598074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:50.598967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:50.601987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=30 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:50.609033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:50.609530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:50.609975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:50.611419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:50.611879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:50.612295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:50.615613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=86 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:50.634173 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 HTTP/1.1 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3'} Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:53:50.635966 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f7a726aa-b793-46ba-a3d0-0ecc6f9ae9c5 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 404 len: 111 microversion: 2.1 time: 0.044541 Sep 16 14:53:50.642516 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3399/6793] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:50 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:53:55.042924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:55.043521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:55.047011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:55.053100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:55.053620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:55.054083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:55.054949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:55.055521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:55.056003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:55.060038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:53:55.088544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:53:55.182252 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14bce2af-83fe-460b-8e14-895a77f0df49 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 204 len: 0 microversion: 2.1 time: 0.143228 Sep 16 14:53:55.182915 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3395/6794] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:53:55 2022] DELETE /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 14:53:55.191759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:55.192476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:55.199761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:55.200243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:55.200679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:55.201398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:55.201853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:55.202278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:55.375912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:55.385188 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d0aa15a-8870-4c1c-a150-d8e2d97d0f2f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1410 microversion: 2.1 time: 0.197645 Sep 16 14:53:55.385827 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3400/6795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:55 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1410 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:56.410646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:56.411390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:56.419526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:56.420048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:56.420517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:56.421277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:56.421774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:56.422220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:56.589165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:56.598739 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de4b5d68-5ffb-4fed-871f-fe3c4f27cf03 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1410 microversion: 2.1 time: 0.192795 Sep 16 14:53:56.599345 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3396/6796] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:56 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1410 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:57.521772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-8c149d18-5798-4e77-b975-d0d69b0e973f req-c20b1aa0-f766-4e30-b7e4-660a6fb8e7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815daafd-52f3-4b5e-850d-9461974ccce4", "name": "network-vif-deleted", "tag": "287e53bd-1703-4552-9a0a-da028931cbdf"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:53:57.535681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8c149d18-5798-4e77-b975-d0d69b0e973f req-c20b1aa0-f766-4e30-b7e4-660a6fb8e7fc service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:57.536369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8c149d18-5798-4e77-b975-d0d69b0e973f req-c20b1aa0-f766-4e30-b7e4-660a6fb8e7fc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:57.536812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-8c149d18-5798-4e77-b975-d0d69b0e973f req-c20b1aa0-f766-4e30-b7e4-660a6fb8e7fc service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:57.549886 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-8c149d18-5798-4e77-b975-d0d69b0e973f req-c20b1aa0-f766-4e30-b7e4-660a6fb8e7fc service nova] Creating event network-vif-deleted:287e53bd-1703-4552-9a0a-da028931cbdf for instance 815daafd-52f3-4b5e-850d-9461974ccce4 on n-h1-858129-2 Sep 16 14:53:57.557226 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-8c149d18-5798-4e77-b975-d0d69b0e973f req-c20b1aa0-f766-4e30-b7e4-660a6fb8e7fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040522 Sep 16 14:53:57.557923 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3401/6797] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:53:57.626756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:57.627974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:57.639898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:57.640553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:57.641102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:57.642027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:57.642675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:57.643249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:57.736048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:57.745262 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0225f5bb-5911-46b9-ab27-5644f024f31a tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1202 microversion: 2.1 time: 0.125436 Sep 16 14:53:57.745911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3397/6798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:57 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1202 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:53:58.777798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:58.779020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:58.792015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:58.792887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:58.793578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:58.794692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:58.795292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:58.795731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:58.868308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:53:58.877816 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e24f214a-cfb8-4b30-bff9-4137499b9b7b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1202 microversion: 2.1 time: 0.106898 Sep 16 14:53:58.878545 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3402/6799] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:58 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1202 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:53:59.901970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:53:59.902643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:53:59.911194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:59.911709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:59.912163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:53:59.912943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:53:59.913411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:53:59.913879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:00.003466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:54:00.014331 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a66313fd-0fe3-4d9c-9614-e62f10420937 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1202 microversion: 2.1 time: 0.116213 Sep 16 14:54:00.014983 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3398/6800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:53:59 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:54:01.038864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:01.040263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:01.047383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:01.047911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:01.048374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:01.049199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:01.049726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:01.050214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:01.130733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:54:01.140167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c729caf5-06d5-45a7-952d-a2cdfdfd745c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1202 microversion: 2.1 time: 0.105363 Sep 16 14:54:01.140768 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3403/6801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:54:01 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1202 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:54:02.163737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:02.165077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:02.173896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:02.174428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:02.174892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:02.175632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:02.176107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:02.176545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:02.252707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030a4498f4be4ca3b1f95e741ec6b385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb03507d37c24fe3b53fc6a50ac7829c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:54:02.262322 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b719acd-d9bf-4b5f-8a8c-7b39f8e2a685 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 200 len: 1202 microversion: 2.1 time: 0.102369 Sep 16 14:54:02.262946 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3399/6802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:54:02 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:54:03.303306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:03.303923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:03.310844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:03.311331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:03.311772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:03.312470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:03.313868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:03.314498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:03.331522 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 HTTP/1.1 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '815daafd-52f3-4b5e-850d-9461974ccce4'} Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:03.333189 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:54:03.337472 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a4f332da-2c6a-44bc-b6e6-9d2932cbf25f tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 404 len: 111 microversion: 2.1 time: 0.035303 Sep 16 14:54:03.338665 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3404/6803] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:54:03 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:54:05.506319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:05.507063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:05.514220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:05.514862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:05.515408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:05.516856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:05.517401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:05.517922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:05.532579 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 HTTP/1.1 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3'} Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:54:05.534296 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d38b984-eb5e-4cd6-b86f-989d76009f50 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 404 len: 111 microversion: 2.1 time: 0.033417 Sep 16 14:54:05.539080 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3400/6804] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:54:05 2022] DELETE /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:54:05.545319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:05.546458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:05.553870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:05.554352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:05.554820 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:05.555526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:05.556047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:05.556450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:05.571322 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 HTTP/1.1 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3'} Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:05.572895 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance 3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:54:05.577191 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ba95e247-7806-4cca-9cd5-a357370cbf6b tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3" status: 404 len: 111 microversion: 2.1 time: 0.032952 Sep 16 14:54:05.577933 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3405/6805] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:54:05 2022] GET /compute/v2.1/servers/3f9c3f34-9a0d-4a7c-8f42-b7af7752e5f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:54:05.981731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:05.982325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:05.990486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:05.990919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:05.991375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:05.992111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:05.992588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:05.993320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:06.008551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 HTTP/1.1 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '815daafd-52f3-4b5e-850d-9461974ccce4'} Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:54:06.010140 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8cf3de3-8d15-49f9-85be-4ebb9d8a7af1 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 404 len: 111 microversion: 2.1 time: 0.034002 Sep 16 14:54:06.014360 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3401/6806] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:54:05 2022] DELETE /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:54:06.020745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:54:06.021360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [instance: 815daafd-52f3-4b5e-850d-9461974ccce4] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:54:06.028000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:06.028488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:06.028921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:06.029627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:54:06.030086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:54:06.030549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:54:06.044748 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] HTTP exception thrown: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Request method failure captured: Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 HTTP/1.1 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJI0n4t1xmRt_zORJ0d8G-QlMEjRF6mjJ6I-tcT9yqE46A5kDD2wmp8rcSalFof4gjwnzTfE2rvGUhzQEXvj_tBLpW9hBYCTCrWzZhjUHheInByGm4hvfUk2-HCl1oy2gzFL_yjMY3cFkvJK0b7ZlkzWEPYo826KJhH0L_oRcdNWKRAA Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fb03507d37c24fe3b53fc6a50ac7829c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fb03507d37c24fe3b53fc6a50ac7829c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fb03507d37c24fe3b53fc6a50ac7829c"}]}] Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: fb03507d37c24fe3b53fc6a50ac7829c Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826600963 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 030a4498f4be4ca3b1f95e741ec6b385 Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestVolumeBootPattern-1826600963-project Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '815daafd-52f3-4b5e-850d-9461974ccce4'} Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:54:06.046321 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 404 to user: Instance 815daafd-52f3-4b5e-850d-9461974ccce4 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d75fd6a-a2fd-41c8-a56a-93a143fdab5c tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4" status: 404 len: 111 microversion: 2.1 time: 0.031866 Sep 16 14:54:06.051693 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3406/6807] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:54:06 2022] GET /compute/v2.1/servers/815daafd-52f3-4b5e-850d-9461974ccce4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:54:06.128763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6d602765-f175-4a27-9542-3c43d120baa7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: .version_select at 0x7f7247fc6550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1841844392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa+A56KjWTqWuYZoyk8R5ueybAZFbg/0ZrHPSEAjAOhWDVl1VywLRgWiZpBtbE02k1N+/MqaDeQ3egZ1bEbyw5BslWpan3DPf/dHsqSbXR/AfeI1hDxq+e2AKfO0eN8+A=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:54:06.144936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6d602765-f175-4a27-9542-3c43d120baa7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:54:06.150879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-6d602765-f175-4a27-9542-3c43d120baa7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Getting quotas for user 030a4498f4be4ca3b1f95e741ec6b385 and project fb03507d37c24fe3b53fc6a50ac7829c. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:54:06.167115 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d602765-f175-4a27-9542-3c43d120baa7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [60e5b4d7-67ac-409f-a1ef-145ac803fecd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 14:54:07.175042 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d602765-f175-4a27-9542-3c43d120baa7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] [60e5b4d7-67ac-409f-a1ef-145ac803fecd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42218. Sep 16 14:54:07.190916 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6d602765-f175-4a27-9542-3c43d120baa7 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.066113 Sep 16 14:54:07.191542 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3402/6808] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:54:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:54:23.519804 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1192070912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1841844392", "security_groups": [{"name": "tempest-secgroup-smoke-1871781571"}], "block_device_mapping_v2": [{"uuid": "6426c630-e944-4b34-a8d5-8a3f42868ce8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2d73f19-dcf6-4e6b-b995-4ae28b29b873"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:54:23.530332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=15 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:54:23.531003 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=27 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:54:23.641427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] validate_networks() for [('a2d73f19-dcf6-4e6b-b995-4ae28b29b873', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:54:33.543469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:26.114253 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 14:55:26.115642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:26.117921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:26.119154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:26.120508 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:55:26.120880 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 14:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1841844392 (ip 10.222.0.60) !!! Sep 16 14:55:26.133812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d71d9ec-39c8-4b0b-8121-0fde8aff2fb9 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Calling method '.version_select at 0x7f724c0725e0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:26.181421 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d71d9ec-39c8-4b0b-8121-0fde8aff2fb9 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1841844392" status: 202 len: 0 microversion: 2.1 time: 0.069726 Sep 16 14:55:26.182187 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3403/6809] 10.222.0.60 () {58 vars in 1263 bytes} [Fri Sep 16 14:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1841844392 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:55:44.680691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:44.691536 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 42486. Sep 16 14:55:44.831285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1950484029", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:45.028903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] validate_networks() for None {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:55:45.307119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:55:45.307563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:55:45.308061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:55:45.308671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:55:45.309045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:55:45.319176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:45.319690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:45.320144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:45.320913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:45.321375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:45.321823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:45.341433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Getting quotas for project f5af29f9d78a4e12962cddfde2c63411. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:55:45.347352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Getting quotas for user 98312603aff64bafae467b650dcf1552 and project f5af29f9d78a4e12962cddfde2c63411. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:55:45.360589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:55:45.363035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:55:45.410819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74398dda-bc8a-4819-9a67-ac4edc6de9e1 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731993 Sep 16 14:55:45.411619 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3404/6810] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:55:45.424295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe735ff4-3b2d-496f-b843-994cfea99368 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:45.424926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe735ff4-3b2d-496f-b843-994cfea99368 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:45.485648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe735ff4-3b2d-496f-b843-994cfea99368 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:45.493895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe735ff4-3b2d-496f-b843-994cfea99368 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1222 microversion: 2.1 time: 0.073610 Sep 16 14:55:45.494506 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3405/6811] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:45 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:46.518002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:46.518676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:46.529303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:46.529807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:46.530978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:46.531696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:46.532165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:46.532602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:46.600844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:46.609774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-11b1af9a-bfe3-405e-b002-7e119bff9cb9 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1274 microversion: 2.1 time: 0.096085 Sep 16 14:55:46.614606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3406/6812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:46 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:47.634250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:47.635121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:47.648932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:47.650393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:47.651191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:47.652076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:47.652867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:47.656737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:47.883210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:47.893119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9326417b-616b-4547-9344-f7d6c8602920 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.263154 Sep 16 14:55:47.893727 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3407/6813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:47 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:48.559476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-55739c78-0429-43e4-af4e-9a5326585ef7 req-6060413b-4fb7-44f7-a946-0ce80b794b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71f0cbb-6567-4a13-af04-c9cd86215ec0", "tag": "c20971c5-efca-4f79-b94f-2c94287f15ac"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:48.575259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-55739c78-0429-43e4-af4e-9a5326585ef7 req-6060413b-4fb7-44f7-a946-0ce80b794b17 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:48.576094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-55739c78-0429-43e4-af4e-9a5326585ef7 req-6060413b-4fb7-44f7-a946-0ce80b794b17 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:48.576548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-55739c78-0429-43e4-af4e-9a5326585ef7 req-6060413b-4fb7-44f7-a946-0ce80b794b17 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:48.594086 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-55739c78-0429-43e4-af4e-9a5326585ef7 req-6060413b-4fb7-44f7-a946-0ce80b794b17 service nova] Creating event network-changed:c20971c5-efca-4f79-b94f-2c94287f15ac for instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 on n-h1-858129-2 Sep 16 14:55:48.601079 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-55739c78-0429-43e4-af4e-9a5326585ef7 req-6060413b-4fb7-44f7-a946-0ce80b794b17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045610 Sep 16 14:55:48.601717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3408/6814] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:55:48.925457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:48.926193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:48.939392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:48.940126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:48.940956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:48.942798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:48.943957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:48.945275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:49.213349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:49.222224 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b516e133-196e-48f0-96ba-4eda19b80a33 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.301594 Sep 16 14:55:49.222865 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3409/6815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:48 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:50.246215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:50.246923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:50.254418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:50.254943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:50.255430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:50.256185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:50.256668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:50.257115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:50.391383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:50.403752 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a51d59c2-b649-4428-8c60-916bd68494dd tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.161381 Sep 16 14:55:50.404368 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3410/6816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:50 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:51.426699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:51.427394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:51.434830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:51.435346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:51.435814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:51.437099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:51.437575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:51.438044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:51.697494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:51.705768 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2c76649-f43a-40c1-965e-ed921888d8ca tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.283048 Sep 16 14:55:51.706385 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3411/6817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:51 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:52.730988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:52.732315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:52.740793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:52.741315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:52.741778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:52.742571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:52.743058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:52.743509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:52.890754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:52.898968 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9af6c963-0831-45fb-a10e-4b74d6f1bdf7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.173002 Sep 16 14:55:52.899555 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3412/6818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:52 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:53.923501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:53.924536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:53.931485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:53.931994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:53.932447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:53.933177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:53.933651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:53.934099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:54.071830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:54.080503 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4b13f62-47af-448e-b5e2-a369d66c6822 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.161166 Sep 16 14:55:54.081100 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3413/6819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:53 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:55.104297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:55.104982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:55.111951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:55.112497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:55.112946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:55.113660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:55.114202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:55.114736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:55.254698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:55.262784 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-845f5079-a5db-4457-ae91-4a60f50c3e0a tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.162265 Sep 16 14:55:55.263386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3414/6820] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:55 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:55.746669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d5f5f6d1-3ba9-4c0f-9987-e4a940b61270 req-553fa124-4bbd-40ec-867a-f6a7977e9f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71f0cbb-6567-4a13-af04-c9cd86215ec0", "name": "network-vif-plugged", "status": "completed", "tag": "c20971c5-efca-4f79-b94f-2c94287f15ac"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:55.753723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:55.754614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:55.763092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d5f5f6d1-3ba9-4c0f-9987-e4a940b61270 req-553fa124-4bbd-40ec-867a-f6a7977e9f3f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:55.763597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d5f5f6d1-3ba9-4c0f-9987-e4a940b61270 req-553fa124-4bbd-40ec-867a-f6a7977e9f3f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:55.764053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d5f5f6d1-3ba9-4c0f-9987-e4a940b61270 req-553fa124-4bbd-40ec-867a-f6a7977e9f3f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:55.776492 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d5f5f6d1-3ba9-4c0f-9987-e4a940b61270 req-553fa124-4bbd-40ec-867a-f6a7977e9f3f service nova] Creating event network-vif-plugged:c20971c5-efca-4f79-b94f-2c94287f15ac for instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 on n-h1-858129-2 Sep 16 14:55:55.783028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d5f5f6d1-3ba9-4c0f-9987-e4a940b61270 req-553fa124-4bbd-40ec-867a-f6a7977e9f3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040214 Sep 16 14:55:55.783679 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3415/6821] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:55:56.289418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:56.290186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:56.297806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:56.298612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:56.299356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:56.300499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:56.301254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:56.301990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:56.442278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:56.450504 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d40d4255-10b8-4f58-8d94-28f2f50926c7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1322 microversion: 2.1 time: 0.166788 Sep 16 14:55:56.451032 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3416/6822] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:56 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:57.475625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:57.476368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:57.486947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:57.487856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:57.488682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:57.490019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:57.490935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:57.491794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:57.663943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:57.673629 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e3272b4-eaae-410b-a2a4-5217624760e6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1472 microversion: 2.1 time: 0.202507 Sep 16 14:55:57.674257 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3417/6823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:57 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1472 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:57.754802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37cc1b97-2da8-4662-bcf3-f44f1cb4216b tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Calling method '.version_select at 0x7f7247efb040>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:57.826333 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37cc1b97-2da8-4662-bcf3-f44f1cb4216b tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/3dd68f4f8fd14020823976098fc0312c" status: 200 len: 371 microversion: 2.1 time: 0.128634 Sep 16 14:55:57.826990 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3418/6824] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 14:55:57 2022] GET /compute/v2.1/os-quota-sets/3dd68f4f8fd14020823976098fc0312c => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:55:57.839724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e02f325b-0768-459f-93ad-9e3f4718b3b4 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1102350726", "id": 1046911455, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:57.864236 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e02f325b-0768-459f-93ad-9e3f4718b3b4 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028183 Sep 16 14:55:57.864976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3419/6825] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:55:57 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:55:57.879550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1046911455"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:57.882087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:57.889653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:57.890180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:57.890677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:57.891543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:57.892074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:57.892531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:57.987515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'df4d114ec7c04498ac86392eee3ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd68f4f8fd14020823976098fc0312c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:57.994110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1102350726 {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:55:58.002333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.002867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.003312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.004051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.004517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.004952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.026823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Getting quotas for project f5af29f9d78a4e12962cddfde2c63411. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:55:58.032810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Getting quotas for user 98312603aff64bafae467b650dcf1552 and project f5af29f9d78a4e12962cddfde2c63411. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:55:58.047137 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] ram quota exceeded for 3dd68f4f8fd14020823976098fc0312c, tried to resize instance. Sep 16 14:55:58.047692 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Request method failure captured: Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0/action HTTP/1.1 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 39 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI5wU-MawtwvnuPMubv386HYO_qye0WaYs2YDvY-vtrMtQsL4MGxm4O6EX7PxTY_2DZ3Njn0ati9OEEeQonWoihN5YlZtL5gV9PIlI8E0t7ZoDNPnbAT4BoN944wdADxktf_ls5gu-1b-g6_jWxF5nkmA7v2FQuUNmXpZOekAo8lWJc Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3dd68f4f8fd14020823976098fc0312c Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-112762404 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dd68f4f8fd14020823976098fc0312c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dd68f4f8fd14020823976098fc0312c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dd68f4f8fd14020823976098fc0312c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dd68f4f8fd14020823976098fc0312c"}]}] Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminNegativeTestJSON-112762404 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3dd68f4f8fd14020823976098fc0312c Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-112762404 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminNegativeTestJSON-112762404-project-admin Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: df4d114ec7c04498ac86392eee3ae5d6 Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminNegativeTestJSON-112762404-project-admin Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: {"resize": {"flavorRef": "1046911455"}} Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a71f0cbb-6567-4a13-af04-c9cd86215ec0', 'body': {'resize': {'flavorRef': '1046911455'}}} Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:55:58.049820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-44ac2c05-9cd4-4a6d-a491-27181827b6ee tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0/action" status: 403 len: 118 microversion: 2.1 time: 0.175928 Sep 16 14:55:58.054310 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3420/6826] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:55:57 2022] POST /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0/action => generated 118 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:55:58.060656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a952aadb-8cb5-4807-93c3-2a101d48bcc9 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.080041 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a952aadb-8cb5-4807-93c3-2a101d48bcc9 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1046911455" status: 202 len: 0 microversion: 2.1 time: 0.023035 Sep 16 14:55:58.080628 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3421/6827] 10.222.0.60 () {58 vars in 1161 bytes} [Fri Sep 16 14:55:58 2022] DELETE /compute/v2.1/flavors/1046911455 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:55:58.088687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4445501-8a62-4708-b48d-e2d855c4c813 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.110994 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4445501-8a62-4708-b48d-e2d855c4c813 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025893 Sep 16 14:55:58.111620 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3422/6828] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:55:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:58.133202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5a616f7a-252d-4818-ac1a-ff57eed5197d tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Calling method '.version_select at 0x7f7247eef550>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.202534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5a616f7a-252d-4818-ac1a-ff57eed5197d tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/3dd68f4f8fd14020823976098fc0312c" status: 200 len: 371 microversion: 2.1 time: 0.073236 Sep 16 14:55:58.203148 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3423/6829] 10.222.0.60 () {58 vars in 1242 bytes} [Fri Sep 16 14:55:58 2022] GET /compute/v2.1/os-quota-sets/3dd68f4f8fd14020823976098fc0312c => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:55:58.215477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d192a110-2579-4fde-a530-e3d198674a75 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-85960295", "id": 845712554, "os-flavor-access:is_public": "True"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:58.236979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d192a110-2579-4fde-a530-e3d198674a75 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.025308 Sep 16 14:55:58.237609 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3424/6830] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:55:58 2022] POST /compute/v2.1/flavors => generated 432 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:55:58.250799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "845712554"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:55:58.253142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:58.260395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.260919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.261382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.262120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.262642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.263092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.294282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'df4d114ec7c04498ac86392eee3ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd68f4f8fd14020823976098fc0312c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:58.302591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-85960295 {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:55:58.310221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.310776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.311293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.312058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.312931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.313380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.335439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Getting quotas for project f5af29f9d78a4e12962cddfde2c63411. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:55:58.341577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Getting quotas for user 98312603aff64bafae467b650dcf1552 and project f5af29f9d78a4e12962cddfde2c63411. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:55:58.355982 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] cores quota exceeded for 3dd68f4f8fd14020823976098fc0312c, tried to resize instance. Sep 16 14:55:58.356547 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Request method failure captured: Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0/action HTTP/1.1 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 38 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI5wU-MawtwvnuPMubv386HYO_qye0WaYs2YDvY-vtrMtQsL4MGxm4O6EX7PxTY_2DZ3Njn0ati9OEEeQonWoihN5YlZtL5gV9PIlI8E0t7ZoDNPnbAT4BoN944wdADxktf_ls5gu-1b-g6_jWxF5nkmA7v2FQuUNmXpZOekAo8lWJc Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 3dd68f4f8fd14020823976098fc0312c Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-112762404 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Role: admin,reader,member Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: admin,reader,member Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3dd68f4f8fd14020823976098fc0312c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dd68f4f8fd14020823976098fc0312c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3dd68f4f8fd14020823976098fc0312c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3dd68f4f8fd14020823976098fc0312c"}]}] Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminNegativeTestJSON-112762404 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 3dd68f4f8fd14020823976098fc0312c Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-112762404 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminNegativeTestJSON-112762404-project-admin Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: df4d114ec7c04498ac86392eee3ae5d6 Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminNegativeTestJSON-112762404-project-admin Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: {"resize": {"flavorRef": "845712554"}} Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a71f0cbb-6567-4a13-af04-c9cd86215ec0', 'body': {'resize': {'flavorRef': '845712554'}}} Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:55:58.359186 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d999c8e-c999-4c7d-a950-c94f6f5d2acc tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0/action" status: 403 len: 113 microversion: 2.1 time: 0.113997 Sep 16 14:55:58.367950 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3425/6831] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:55:58 2022] POST /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0/action => generated 113 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:55:58.371066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55cdef37-fd5e-4946-a955-a19ea3a629e9 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.384749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:58.392896 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55cdef37-fd5e-4946-a955-a19ea3a629e9 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/845712554" status: 202 len: 0 microversion: 2.1 time: 0.026147 Sep 16 14:55:58.393675 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3426/6832] 10.222.0.60 () {58 vars in 1158 bytes} [Fri Sep 16 14:55:58 2022] DELETE /compute/v2.1/flavors/845712554 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:55:58.402430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ba644d8-c202-4078-a324-e024c7c7b494 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.424716 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ba644d8-c202-4078-a324-e024c7c7b494 tempest-ServersAdminNegativeTestJSON-112762404 tempest-ServersAdminNegativeTestJSON-112762404-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026195 Sep 16 14:55:58.425468 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3427/6833] 10.222.0.60 () {58 vars in 1146 bytes} [Fri Sep 16 14:55:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:58.447400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.447933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:58.455181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.455703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.456165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.456911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.457393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.457844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.487154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:55:58.503420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:55:58.582694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab8de22d-3da5-4d62-a64c-e08c54f67b82 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 204 len: 0 microversion: 2.1 time: 0.139216 Sep 16 14:55:58.583556 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3428/6834] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:55:58 2022] DELETE /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:55:58.593246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:58.593976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:58.600832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.601340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.601791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.602555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:58.603023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:58.603469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:58.750220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:58.758625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8e471dc5-9a3b-43e6-861f-71a76f5b6317 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1478 microversion: 2.1 time: 0.170277 Sep 16 14:55:58.759233 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3429/6835] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:58 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:55:59.784486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:55:59.785529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:55:59.793450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:59.793969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:59.794468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:59.795220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:55:59.796301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:55:59.796782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:55:59.958190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:55:59.966527 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be160060-d4dd-4a69-ae80-104f710f6db6 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1478 microversion: 2.1 time: 0.186975 Sep 16 14:55:59.967213 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3430/6836] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:55:59 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1478 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:00.650740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-dc568226-d3c0-4110-91d9-c56da3a778ab req-ab9e95a6-839f-4a3c-b4ae-626ac591694f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71f0cbb-6567-4a13-af04-c9cd86215ec0", "name": "network-vif-deleted", "tag": "c20971c5-efca-4f79-b94f-2c94287f15ac"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:00.665263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dc568226-d3c0-4110-91d9-c56da3a778ab req-ab9e95a6-839f-4a3c-b4ae-626ac591694f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:00.665771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dc568226-d3c0-4110-91d9-c56da3a778ab req-ab9e95a6-839f-4a3c-b4ae-626ac591694f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:00.666235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dc568226-d3c0-4110-91d9-c56da3a778ab req-ab9e95a6-839f-4a3c-b4ae-626ac591694f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:00.680580 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-dc568226-d3c0-4110-91d9-c56da3a778ab req-ab9e95a6-839f-4a3c-b4ae-626ac591694f service nova] Creating event network-vif-deleted:c20971c5-efca-4f79-b94f-2c94287f15ac for instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 on n-h1-858129-2 Sep 16 14:56:00.687056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-dc568226-d3c0-4110-91d9-c56da3a778ab req-ab9e95a6-839f-4a3c-b4ae-626ac591694f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040332 Sep 16 14:56:00.687999 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3431/6837] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:56:00.991826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:00.992557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:01.000837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:01.001421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:01.001877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:01.002716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:01.003194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:01.003641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:01.039277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:01.039696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:01.040159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:01.040634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lazy-loading 'fault' on Instance uuid a71f0cbb-6567-4a13-af04-c9cd86215ec0 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 14:56:01.094301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98312603aff64bafae467b650dcf1552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5af29f9d78a4e12962cddfde2c63411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:01.102928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b382f11a-7230-47b3-a9e4-e4a1c75078b7 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 200 len: 1312 microversion: 2.1 time: 0.115471 Sep 16 14:56:01.103815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3432/6838] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:00 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:02.129263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:02.129945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] [instance: a71f0cbb-6567-4a13-af04-c9cd86215ec0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:02.137692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:02.138214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:02.138722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:02.139474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:02.139959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:02.140410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:02.155754 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] HTTP exception thrown: Instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 could not be found. Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Request method failure captured: Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 HTTP/1.1 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI5vPwOQiDy4XFaCNE9_DlvYIMeLsAAaKTkNYjmiEyBKSnLU_POzGvskjJtFNikLn26Hv2lPiWimdCkgSHvd9vlgAsXBfq2p82Q5BFhSDGGvIp43jGieBOWjUh-yIR7XLTSGQVm_tN6-yp3FLnUe9WpeMXKLVU4kO9ov2NeoBJDcl2A Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: f5af29f9d78a4e12962cddfde2c63411 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1509607344 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f5af29f9d78a4e12962cddfde2c63411", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f5af29f9d78a4e12962cddfde2c63411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f5af29f9d78a4e12962cddfde2c63411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f5af29f9d78a4e12962cddfde2c63411"}]}] Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1509607344 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: f5af29f9d78a4e12962cddfde2c63411 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1509607344 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersAdminNegativeTestJSON-1509607344-project Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 98312603aff64bafae467b650dcf1552 Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1509607344-project Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 could not be found. Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a71f0cbb-6567-4a13-af04-c9cd86215ec0'} Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 could not be found. Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 could not be found. Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:56:02.157485 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 could not be found. Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] Returning 404 to user: Instance a71f0cbb-6567-4a13-af04-c9cd86215ec0 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd492f10-2eb0-44d8-b600-02043cf811d8 tempest-ServersAdminNegativeTestJSON-1509607344 tempest-ServersAdminNegativeTestJSON-1509607344-project] 10.222.0.60 "GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0" status: 404 len: 111 microversion: 2.1 time: 0.034192 Sep 16 14:56:02.164985 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3433/6839] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:02 2022] GET /compute/v2.1/servers/a71f0cbb-6567-4a13-af04-c9cd86215ec0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:56:09.303427 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:56:09.303846 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 14:56:09.317027 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:56:09.317414 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 14:56:09.985016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:09.986587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:10.146147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-940942828", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "2939d9b9-6edd-40c2-a123-09be56b44641"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:10.235897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] validate_networks() for [('2939d9b9-6edd-40c2-a123-09be56b44641', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:56:10.700823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:56:10.702530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:56:10.704006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:56:10.704919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:56:10.705669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:56:10.719371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:10.719885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:10.720347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:10.721120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:10.723601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:10.724335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:10.753607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Getting quotas for project ee2d31d6000147c78049b65d4d3e2cec. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:56:10.763553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Getting quotas for user 1ed3f457e0f14576bb1dc57876064ea3 and project ee2d31d6000147c78049b65d4d3e2cec. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:56:10.783008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:56:10.785461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:56:10.853826 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc03c2f0-cb5f-4c0a-b6c1-a364909aa0f9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876719 Sep 16 14:56:10.854891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3434/6840] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:56:10.876699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-90a0f380-eece-48bf-92d7-4412245727e8 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:10.877560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-90a0f380-eece-48bf-92d7-4412245727e8 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:10.963888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-90a0f380-eece-48bf-92d7-4412245727e8 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:10.971941 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-90a0f380-eece-48bf-92d7-4412245727e8 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1214 microversion: 2.1 time: 0.106215 Sep 16 14:56:10.972711 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3435/6841] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:10 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:56:11.996180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:11.996824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:12.003893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:12.004392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:12.004842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:12.005575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:12.006050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:12.006597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:12.096696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:12.110103 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e62593f-549c-42d4-adee-7da512468b4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1266 microversion: 2.1 time: 0.117347 Sep 16 14:56:12.114699 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3436/6842] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:11 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:13.136553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:13.137503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:13.146725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:13.147245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:13.147705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:13.148457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:13.148946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:13.149386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:13.509148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:13.521135 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c58fff91-0664-46cc-91c8-e1183371d48d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.388407 Sep 16 14:56:13.521740 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3437/6843] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:13 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:14.303614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-defe46d2-6d84-4fec-806f-cc6216347e2f req-6297722b-d816-4ee4-a7b7-086bfeba5851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9590d5-f63b-4e19-a259-7d2db9a9eb85", "tag": "5f573198-6a3c-4166-9525-aafae9cd3e0d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:14.321963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-defe46d2-6d84-4fec-806f-cc6216347e2f req-6297722b-d816-4ee4-a7b7-086bfeba5851 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:14.322694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-defe46d2-6d84-4fec-806f-cc6216347e2f req-6297722b-d816-4ee4-a7b7-086bfeba5851 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:14.323848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-defe46d2-6d84-4fec-806f-cc6216347e2f req-6297722b-d816-4ee4-a7b7-086bfeba5851 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:14.338018 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-defe46d2-6d84-4fec-806f-cc6216347e2f req-6297722b-d816-4ee4-a7b7-086bfeba5851 service nova] Creating event network-changed:5f573198-6a3c-4166-9525-aafae9cd3e0d for instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 on n-h1-858129-2 Sep 16 14:56:14.354942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-defe46d2-6d84-4fec-806f-cc6216347e2f req-6297722b-d816-4ee4-a7b7-086bfeba5851 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065616 Sep 16 14:56:14.356801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3438/6844] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:56:14.565558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:14.568430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:14.580592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:14.581767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:14.582542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:14.583538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:14.584252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:14.584951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:14.859923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:14.868088 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-39bf432b-2704-47d1-8d19-a7ae06c2bcda tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.321463 Sep 16 14:56:14.868684 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3439/6845] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:14 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:56:15.891817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:15.892483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:15.899559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:15.900063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:15.900510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:15.901224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:15.901699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:15.902134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:16.039180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:16.047818 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7b11c34e-7d38-457f-97ac-fc85b18b9e10 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.159898 Sep 16 14:56:16.048408 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3440/6846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:15 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:17.071280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:17.072153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:17.079893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:17.080394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:17.080856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:17.081591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:17.082321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:17.082538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:17.297332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:17.312916 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1870df5-5330-4378-8eef-26a6426e7534 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.245274 Sep 16 14:56:17.314175 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3441/6847] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:17 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:18.346509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:18.347646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:18.360520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:18.361361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:18.362185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:18.363492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:18.364312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:18.365103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:18.510496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:18.519572 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40664100-b095-43b5-9cad-396ab1b152e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.180144 Sep 16 14:56:18.520327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3442/6848] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:18 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:19.543438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:19.544131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:19.551134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:19.551640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:19.552092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:19.552807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:19.553284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:19.553730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:19.714286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:19.725406 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c2b8db5-ed7f-4374-943a-a0274a1a4c9b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.185716 Sep 16 14:56:19.726024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3443/6849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:19 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:19.992885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-25157446-81b3-48bd-9a48-cc78f55c3b34 req-823a7ad2-0de0-4dd8-9e25-2452df9eb063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9590d5-f63b-4e19-a259-7d2db9a9eb85", "name": "network-vif-plugged", "status": "completed", "tag": "5f573198-6a3c-4166-9525-aafae9cd3e0d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:20.005699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-25157446-81b3-48bd-9a48-cc78f55c3b34 req-823a7ad2-0de0-4dd8-9e25-2452df9eb063 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:20.006202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-25157446-81b3-48bd-9a48-cc78f55c3b34 req-823a7ad2-0de0-4dd8-9e25-2452df9eb063 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:20.006692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-25157446-81b3-48bd-9a48-cc78f55c3b34 req-823a7ad2-0de0-4dd8-9e25-2452df9eb063 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:20.020187 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-25157446-81b3-48bd-9a48-cc78f55c3b34 req-823a7ad2-0de0-4dd8-9e25-2452df9eb063 service nova] Creating event network-vif-plugged:5f573198-6a3c-4166-9525-aafae9cd3e0d for instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 on n-h1-858129-2 Sep 16 14:56:20.025671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-25157446-81b3-48bd-9a48-cc78f55c3b34 req-823a7ad2-0de0-4dd8-9e25-2452df9eb063 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112195 Sep 16 14:56:20.026699 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3444/6850] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:56:20.751195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:20.751846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:20.754845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:20.760631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:20.761145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:20.761642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:20.762567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:20.763044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:20.764102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:20.908332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:20.916863 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-959aee63-d82d-4983-819f-0fb3bbc11580 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1314 microversion: 2.1 time: 0.171118 Sep 16 14:56:20.917461 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3445/6851] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:20 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:21.940168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:21.940861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:21.942742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:21.949444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:21.949954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:21.950430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:21.951672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:21.952144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:21.952591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:22.097404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:22.105841 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46f42250-ec5c-40a8-848e-d7384f6997a9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1501 microversion: 2.1 time: 0.169601 Sep 16 14:56:22.106457 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3446/6852] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:21 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:22.141022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:22.143857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:22.150555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:22.151071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:22.151530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:22.152258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:22.152740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:22.153181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:22.183566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:22.190428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:56:22.197828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:56:22.198269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:56:22.198786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:56:22.199252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:56:22.199682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:56:22.216748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:22.279732 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c35178c-a889-4e1d-95f2-57431dc4a9e3 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "POST /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85/action" status: 202 len: 0 microversion: 2.1 time: 0.143815 Sep 16 14:56:22.280547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3447/6853] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:56:22 2022] POST /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 14:56:22.289059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:22.289609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:22.296711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:22.297224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:22.297680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:22.307003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:22.307003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:22.307003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:22.496310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:22.508038 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fd287f0c-cd07-4c01-9ed1-27c21cafa1c2 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1510 microversion: 2.1 time: 0.222934 Sep 16 14:56:22.508647 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3448/6854] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:22 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:23.532761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:23.533489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:23.541252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:23.541786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:23.542245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:23.543021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:23.543493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:23.543935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:23.720460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:23.730819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75b0ba92-a384-446b-87ad-b0e7f4c3160c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1510 microversion: 2.1 time: 0.203081 Sep 16 14:56:23.731424 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3449/6855] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:23 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:24.769226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:24.769901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:24.777061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:24.777620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:24.778021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:24.778777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:24.779910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:24.780723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:24.970564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:24.979050 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f9555bfb-3b8e-4e63-9de0-821508991abf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1510 microversion: 2.1 time: 0.213640 Sep 16 14:56:24.979618 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3450/6856] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:24 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:26.003429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:26.004109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:26.011485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:26.011998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:26.012456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:26.013180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:26.013669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:26.014110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:26.153877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:26.163219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f523f5b-7c45-4407-aea4-d4f1578a49ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.163605 Sep 16 14:56:26.163821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3451/6857] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:25 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:27.188667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:27.189395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:27.196385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:27.196916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:27.197368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:27.198088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:27.198599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:27.199041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:27.332973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:27.340924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4145b9e-383c-44cc-b5c8-d6897d982767 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.156910 Sep 16 14:56:27.342028 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3452/6858] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:27 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:28.365176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:28.365820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:28.372540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:28.373649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:28.374102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:28.374833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:28.375307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:28.375749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:28.502711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:28.510519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3a605b6-b96d-4b1e-b0b1-35fc3bad27cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.149193 Sep 16 14:56:28.511074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3453/6859] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:28 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:29.534237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:29.535380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:29.539661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:29.545096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:29.545600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:29.546055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:29.546802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:29.547272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:29.547720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:29.682751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:29.691161 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4c1d8ed6-26b7-4331-b318-1cd0c2e05c12 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.161760 Sep 16 14:56:29.691748 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3454/6860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:29 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:30.715819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:30.716495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:30.725811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:30.726312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:30.726795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:30.727514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:30.727982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:30.728420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:30.874757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:30.882684 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-29f15396-858b-4e21-826d-903ee8413b7e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.170776 Sep 16 14:56:30.883276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3455/6861] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:30 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:31.906827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:31.907479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:31.914326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:31.914852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:31.915299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:31.915997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:31.916461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:31.916897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:32.047815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:32.055665 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f461dc3a-adb8-4b26-ae40-58b0caf8a7cc tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.153295 Sep 16 14:56:32.056250 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3456/6862] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:31 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:33.080359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:33.081063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:33.089354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:33.089861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:33.090314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:33.091067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:33.091541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:33.091983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:33.223964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:33.231827 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d72fd920-24ef-4747-9e5e-d0299d14eeaf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.156367 Sep 16 14:56:33.232923 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3457/6863] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:33 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:34.260399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:34.261484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:34.269946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:34.270512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:34.270969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:34.271684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:34.272163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:34.272612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:34.419821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:34.427846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76904bb2-7dc9-43bd-97bf-00095b074985 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.174424 Sep 16 14:56:34.428437 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3458/6864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:34 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:35.451178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:35.451934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:35.464193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:35.465752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:35.466231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:35.467624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:35.468116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:35.468568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:35.610097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:35.618120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0722366d-f15c-4fb4-b2ce-6f1e74689816 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.170835 Sep 16 14:56:35.618750 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3459/6865] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:35 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:36.641253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:36.641904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:36.648835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:36.649334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:36.649781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:36.650516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:36.650985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:36.651424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:36.788031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:36.796557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6273fbf7-9036-4f76-ba45-847219977a0d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.159276 Sep 16 14:56:36.797156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3460/6866] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:36 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:37.820755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:37.821387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:37.829511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:37.830011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:37.830502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:37.831214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:37.831680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:37.832114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:37.968484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:37.976602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8c0c217-845d-42c3-a030-1a983b9e380f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.159750 Sep 16 14:56:37.977195 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3461/6867] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:37 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:38.999353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:39.000034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:39.006966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:39.007473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:39.007928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:39.008644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:39.009120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:39.009566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:39.145109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:39.153247 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-201b33f6-285e-45e5-9888-8c40b8f9dd26 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.157723 Sep 16 14:56:39.154485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3462/6868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:38 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:40.181186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:40.181869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:40.189014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:40.189526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:40.189983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:40.190739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:40.191216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:40.191664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:40.210724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:40.330431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:40.338339 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a7053c15-515a-4056-93c5-0d9cd42e642e tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.161065 Sep 16 14:56:40.338952 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3463/6869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:40 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:41.362744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:41.363387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:41.370326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:41.370854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:41.371305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:41.372010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:41.373040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:41.373482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:41.504814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:41.512932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1952aae-7088-4171-acd9-bcf3bce56dcf tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.154034 Sep 16 14:56:41.513502 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3464/6870] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:41 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:42.537169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:42.537789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:42.544807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:42.545259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:42.545704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:42.546417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:42.546890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:42.547324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:42.676006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:42.683852 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04554816-c626-4149-aff4-3902d1417d37 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.150562 Sep 16 14:56:42.684432 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3465/6871] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:42 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:43.707693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:43.708450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:43.715384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:43.715891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:43.717044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:43.717791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:43.718266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:43.718768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:43.852271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:43.859961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-763b022d-5ed9-4f43-bece-6ddd97a43c4f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.156224 Sep 16 14:56:43.860553 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3466/6872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:43 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:44.883312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:44.883987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:44.891114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:44.891612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:44.892063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:44.892762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:44.893228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:44.893662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:45.027051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:45.035585 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4063dd51-7d29-42bb-9a5e-abf9520db13f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.156313 Sep 16 14:56:45.036173 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3467/6873] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:44 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:46.059132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:46.059855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:46.067182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:46.067689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:46.068146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:46.068857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:46.069332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:46.069775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:46.207208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:46.215212 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eafff2d4-3758-4488-bbc1-4aebfd6207ef tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.160073 Sep 16 14:56:46.215803 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3468/6874] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:46 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:47.238301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:47.239005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:47.245820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:47.246312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:47.246785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:47.247478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:47.247946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:47.248378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:47.383897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:47.392646 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4733481-32af-4eeb-a390-c43d520103ea tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.158188 Sep 16 14:56:47.393249 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3469/6875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:47 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:48.416818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:48.417449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:48.424319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:48.424821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:48.425267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:48.425976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:48.426469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:48.426913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:48.579482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:48.587481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b29c4ad3-dc95-445c-a588-04081442a7d4 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.174640 Sep 16 14:56:48.588091 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3470/6876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:48 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:49.611289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:49.611942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:49.619062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:49.619588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:49.620163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:49.620977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:49.621449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:49.621891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:49.764943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:49.772937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d0feb3b-d9c0-47cd-b18c-2ae047317353 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.165766 Sep 16 14:56:49.773511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3471/6877] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:49 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:50.798069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:50.798815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:50.804781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:50.805259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:50.805702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:50.806428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:50.806892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:50.807323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:50.940795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:50.948634 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-70889628-a681-4f84-b933-84bd3745202f tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.155943 Sep 16 14:56:50.949221 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3472/6878] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:50 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:51.972716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:51.973639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:51.982552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:51.983238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:51.983702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:51.984434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:51.984907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:51.985352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:52.140821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:52.151940 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21134e8f-3999-45ba-9439-6e6228cc70d1 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1515 microversion: 2.1 time: 0.183211 Sep 16 14:56:52.152876 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3473/6879] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:51 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:52.684391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9590d5-f63b-4e19-a259-7d2db9a9eb85", "name": "network-vif-unplugged", "status": "completed", "tag": "5f573198-6a3c-4166-9525-aafae9cd3e0d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:52.694600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:52.695098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:52.695552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:52.710500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] Creating event network-vif-unplugged:5f573198-6a3c-4166-9525-aafae9cd3e0d for instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 on n-h2-858129-2 Sep 16 14:56:52.718391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:56:52.731028 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d29ccb5b-c7f5-4c91-9d5d-ce0ee3ebcfb4 req-54f06e58-a25a-4233-a611-39ee21f701f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050477 Sep 16 14:56:52.731705 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3474/6880] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:56:53.183189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:53.184205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:53.191151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:53.191657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:53.192114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:53.192846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:53.193325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:53.193766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:53.344272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:53.353154 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a729bc77-8822-4839-9e37-98842642d723 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1514 microversion: 2.1 time: 0.178190 Sep 16 14:56:53.353756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3475/6881] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:53 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:56:54.378969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:54.379675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:54.386575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:54.387072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:54.387513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:54.388793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:54.389254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:54.389689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:54.522046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:54.529829 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-69e2964e-2e30-46c3-857e-a8de90c4332a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1512 microversion: 2.1 time: 0.154790 Sep 16 14:56:54.530423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3476/6882] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:54 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:54.775680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9590d5-f63b-4e19-a259-7d2db9a9eb85", "tag": "5f573198-6a3c-4166-9525-aafae9cd3e0d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:54.785335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:54.785835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:54.786286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:54.798582 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] Creating event network-changed:5f573198-6a3c-4166-9525-aafae9cd3e0d for instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 on n-h2-858129-2 Sep 16 14:56:54.804086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:56:54.815622 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4d403453-9bd5-437a-9bcd-12e821574791 req-32b55401-82be-41c8-8f5f-832574b222c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043684 Sep 16 14:56:54.816229 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3477/6883] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:56:55.554760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:55.555398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:55.561669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:55.562177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:55.562659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:55.563363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:55.563835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:55.564274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:55.696348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:55.705735 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fc2564fa-a68d-47f3-8db3-f39a6f16baa5 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1512 microversion: 2.1 time: 0.156150 Sep 16 14:56:55.706362 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3478/6884] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:55 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:56.730190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:56.730894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:56.738424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:56.739043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:56.739503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:56.740221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:56.740699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:56.741139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:56.881161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:56.891385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df729965-731f-479e-ac00-c72cdbcaf14b tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1512 microversion: 2.1 time: 0.165298 Sep 16 14:56:56.902470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3479/6885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:56 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:57.917016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:57.917717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:57.925186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:57.925695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:57.926147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:57.926956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:57.927361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:57.927798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:58.062529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:58.066103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:58.071093 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a33308b-2efe-4aa1-833b-3532dbd6a16d tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1509 microversion: 2.1 time: 0.158005 Sep 16 14:56:58.071694 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3480/6886] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:57 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:56:58.094941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:58.095457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:58.101934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:58.102469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:58.102929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:58.103639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:58.104120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:58.104564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:58.130697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:56:58.183742 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Found an unconfirmed migration during delete, id: 16, status: finished Sep 16 14:56:59.712666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=56 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:56:59.730163 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7601648-ae1e-4352-90b1-f2afc148a31c tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 204 len: 0 microversion: 2.1 time: 1.639148 Sep 16 14:56:59.731101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3481/6887] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:56:58 2022] DELETE /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 0 bytes in 1641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:56:59.735831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8422c310-7bb0-4522-8338-8ee7ef15d65d req-401ae485-995f-431e-af17-3385fbb53ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9590d5-f63b-4e19-a259-7d2db9a9eb85", "name": "network-vif-plugged", "status": "completed", "tag": "5f573198-6a3c-4166-9525-aafae9cd3e0d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:56:59.745476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8422c310-7bb0-4522-8338-8ee7ef15d65d req-401ae485-995f-431e-af17-3385fbb53ce0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:59.745962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8422c310-7bb0-4522-8338-8ee7ef15d65d req-401ae485-995f-431e-af17-3385fbb53ce0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:59.746451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8422c310-7bb0-4522-8338-8ee7ef15d65d req-401ae485-995f-431e-af17-3385fbb53ce0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:59.757949 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8422c310-7bb0-4522-8338-8ee7ef15d65d req-401ae485-995f-431e-af17-3385fbb53ce0 service nova] Creating event network-vif-plugged:5f573198-6a3c-4166-9525-aafae9cd3e0d for instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 on n-h2-858129-2 Sep 16 14:56:59.763520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8422c310-7bb0-4522-8338-8ee7ef15d65d req-401ae485-995f-431e-af17-3385fbb53ce0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030632 Sep 16 14:56:59.764112 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3482/6888] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:56:59.769009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:56:59.769711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:56:59.776202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:59.776691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:59.777133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:59.777826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:56:59.778291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:56:59.778757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:56:59.917867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:56:59.926285 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-47cfa86b-309c-43ed-b049-dcb3af8cbc0a tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1501 microversion: 2.1 time: 0.161066 Sep 16 14:56:59.926886 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3483/6889] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:56:59 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:00.950789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:00.951799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:00.961409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:00.961919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:00.962374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:00.963125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:00.963597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:00.964077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:01.098603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed3f457e0f14576bb1dc57876064ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d31d6000147c78049b65d4d3e2cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:01.106427 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-515bebee-5e17-45ff-b5df-e351b41a19df tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 200 len: 1501 microversion: 2.1 time: 0.160154 Sep 16 14:57:01.107041 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3484/6890] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:00 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:01.817903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2cff4446-1c31-4233-a264-3c83d429c105 req-0dcf0bcf-85bf-4c07-8916-e4841132686b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9590d5-f63b-4e19-a259-7d2db9a9eb85", "name": "network-vif-deleted", "tag": "5f573198-6a3c-4166-9525-aafae9cd3e0d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:01.828511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2cff4446-1c31-4233-a264-3c83d429c105 req-0dcf0bcf-85bf-4c07-8916-e4841132686b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:01.828930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2cff4446-1c31-4233-a264-3c83d429c105 req-0dcf0bcf-85bf-4c07-8916-e4841132686b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:01.829371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2cff4446-1c31-4233-a264-3c83d429c105 req-0dcf0bcf-85bf-4c07-8916-e4841132686b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:01.844425 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2cff4446-1c31-4233-a264-3c83d429c105 req-0dcf0bcf-85bf-4c07-8916-e4841132686b service nova] Creating event network-vif-deleted:5f573198-6a3c-4166-9525-aafae9cd3e0d for instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 on n-h2-858129-2 Sep 16 14:57:01.850711 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2cff4446-1c31-4233-a264-3c83d429c105 req-0dcf0bcf-85bf-4c07-8916-e4841132686b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036442 Sep 16 14:57:01.851557 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3485/6891] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:57:02.130006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:02.130684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:02.138243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:02.138874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:02.139329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:02.140051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:02.140522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:02.140963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:02.155791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] HTTP exception thrown: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Request method failure captured: Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 HTTP/1.1 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI6J-aK6q4OB5iitCcNwPiJUEgZzsykgkfJ7Zc-DGvVbn2EyVOa7tLWTEHxMRiyXV1-vo842CLVgQ5Jk1ZKxA3tpr-A4FIODz7lxbTlnIIO-RXXbaRG2RoIoGLjgXd41aDO5MUyIBDkwI98Mrb_nn1AoA09sUt3jJFmd1aleE62dipA Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ee2d31d6000147c78049b65d4d3e2cec Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee2d31d6000147c78049b65d4d3e2cec", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee2d31d6000147c78049b65d4d3e2cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee2d31d6000147c78049b65d4d3e2cec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee2d31d6000147c78049b65d4d3e2cec"}]}] Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ee2d31d6000147c78049b65d4d3e2cec Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-1098947215-project Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1ed3f457e0f14576bb1dc57876064ea3 Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-1098947215-project Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ee9590d5-f63b-4e19-a259-7d2db9a9eb85'} Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:57:02.157456 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Returning 404 to user: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8af51232-6760-4e9a-b4b0-ac4fd4bc7bf0 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 404 len: 111 microversion: 2.1 time: 0.033391 Sep 16 14:57:02.162708 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3486/6892] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:02 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:57:02.174964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:02.175482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:02.181584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:02.182081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:02.182575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:02.183286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:02.183764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:02.184208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:02.197916 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] HTTP exception thrown: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Request method failure captured: Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 HTTP/1.1 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI6J-aK6q4OB5iitCcNwPiJUEgZzsykgkfJ7Zc-DGvVbn2EyVOa7tLWTEHxMRiyXV1-vo842CLVgQ5Jk1ZKxA3tpr-A4FIODz7lxbTlnIIO-RXXbaRG2RoIoGLjgXd41aDO5MUyIBDkwI98Mrb_nn1AoA09sUt3jJFmd1aleE62dipA Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ee2d31d6000147c78049b65d4d3e2cec Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee2d31d6000147c78049b65d4d3e2cec", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee2d31d6000147c78049b65d4d3e2cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee2d31d6000147c78049b65d4d3e2cec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee2d31d6000147c78049b65d4d3e2cec"}]}] Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ee2d31d6000147c78049b65d4d3e2cec Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-1098947215-project Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1ed3f457e0f14576bb1dc57876064ea3 Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-1098947215-project Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ee9590d5-f63b-4e19-a259-7d2db9a9eb85'} Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:57:02.199518 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Returning 404 to user: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2021ecb3-1337-4afd-9d39-7cc83cb95ec9 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 404 len: 111 microversion: 2.1 time: 0.030449 Sep 16 14:57:02.204602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3487/6893] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:57:02 2022] DELETE /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:57:02.209985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:02.210653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] [instance: ee9590d5-f63b-4e19-a259-7d2db9a9eb85] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:02.217327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:02.217830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:02.218290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:02.219154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:02.219634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:02.220081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:02.236624 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] HTTP exception thrown: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Request method failure captured: Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 HTTP/1.1 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI6J-aK6q4OB5iitCcNwPiJUEgZzsykgkfJ7Zc-DGvVbn2EyVOa7tLWTEHxMRiyXV1-vo842CLVgQ5Jk1ZKxA3tpr-A4FIODz7lxbTlnIIO-RXXbaRG2RoIoGLjgXd41aDO5MUyIBDkwI98Mrb_nn1AoA09sUt3jJFmd1aleE62dipA Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: ee2d31d6000147c78049b65d4d3e2cec Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ee2d31d6000147c78049b65d4d3e2cec", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee2d31d6000147c78049b65d4d3e2cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ee2d31d6000147c78049b65d4d3e2cec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ee2d31d6000147c78049b65d4d3e2cec"}]}] Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: ee2d31d6000147c78049b65d4d3e2cec Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098947215 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-DeleteServersTestJSON-1098947215-project Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 1ed3f457e0f14576bb1dc57876064ea3 Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-DeleteServersTestJSON-1098947215-project Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'ee9590d5-f63b-4e19-a259-7d2db9a9eb85'} Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:57:02.238182 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] Returning 404 to user: Instance ee9590d5-f63b-4e19-a259-7d2db9a9eb85 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fee3025-776f-45c3-9e1f-01c4c8c3aa64 tempest-DeleteServersTestJSON-1098947215 tempest-DeleteServersTestJSON-1098947215-project] 10.222.0.60 "GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85" status: 404 len: 111 microversion: 2.1 time: 0.033639 Sep 16 14:57:02.242571 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3488/6894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:02 2022] GET /compute/v2.1/servers/ee9590d5-f63b-4e19-a259-7d2db9a9eb85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:57:11.110033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-762145170", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4ba4dfac-c3dd-416e-bc0d-dcec94f94e3a"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:11.167058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] validate_networks() for [('4ba4dfac-c3dd-416e-bc0d-dcec94f94e3a', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:57:11.615293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:57:11.615742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:57:11.616244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:57:11.616672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:57:11.617141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:57:11.626987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:11.627497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:11.627953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:11.628698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:11.629171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:11.629612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:11.648938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Getting quotas for project 0e811ec42e0143f88a872a5cef5eb059. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:57:11.654963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Getting quotas for user 5dd772c3e55a477aa2c9a41bc77d06d9 and project 0e811ec42e0143f88a872a5cef5eb059. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:57:11.667887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:57:11.670348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:57:11.726621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2c4e385e-f42f-45bc-b3b4-4b6d686cb692 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740822 Sep 16 14:57:11.729135 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3489/6895] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 14:57:11.740685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8790b212-8ed7-49b3-8942-d5cb7b944ff9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:11.740923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8790b212-8ed7-49b3-8942-d5cb7b944ff9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:11.801057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8790b212-8ed7-49b3-8942-d5cb7b944ff9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:11.811635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8790b212-8ed7-49b3-8942-d5cb7b944ff9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1217 microversion: 2.1 time: 0.075251 Sep 16 14:57:11.812454 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3490/6896] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:11 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:12.837245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:12.837908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:12.847061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:12.847559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:12.848008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:12.848996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:12.849455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:12.849889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:12.918197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:12.927983 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a8251e1f-750c-43cd-a91b-57dcee307e4b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1269 microversion: 2.1 time: 0.094792 Sep 16 14:57:12.928491 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3491/6897] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:12 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:13.954165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:13.955134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:13.973164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:13.974169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:13.974686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:13.977249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:13.977774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:13.978228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:14.352997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:14.366889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-14958d84-e442-423b-93be-6f764bf875a5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.417405 Sep 16 14:57:14.370389 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3492/6898] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:13 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:14.858729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f10c450d-faac-4eec-a745-9e5cc4454002 req-9e437397-f8e7-4541-9689-0f756525aa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c41f9b-e1b4-4ed9-938c-4ec841413ac0", "tag": "6bb17bfa-e698-4e65-a2be-2ffbacc029b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:14.869392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f10c450d-faac-4eec-a745-9e5cc4454002 req-9e437397-f8e7-4541-9689-0f756525aa0d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:14.870091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f10c450d-faac-4eec-a745-9e5cc4454002 req-9e437397-f8e7-4541-9689-0f756525aa0d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:14.870572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f10c450d-faac-4eec-a745-9e5cc4454002 req-9e437397-f8e7-4541-9689-0f756525aa0d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:14.884441 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f10c450d-faac-4eec-a745-9e5cc4454002 req-9e437397-f8e7-4541-9689-0f756525aa0d service nova] Creating event network-changed:6bb17bfa-e698-4e65-a2be-2ffbacc029b5 for instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 on n-h1-858129-2 Sep 16 14:57:14.890520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f10c450d-faac-4eec-a745-9e5cc4454002 req-9e437397-f8e7-4541-9689-0f756525aa0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137896 Sep 16 14:57:14.891520 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3493/6899] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:57:15.395114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:15.395794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:15.402169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:15.403322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:15.403775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:15.404552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:15.405039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:15.405975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:15.541140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:15.549664 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d52663f9-c573-4586-91f3-c9ff646a00e7 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.160165 Sep 16 14:57:15.550241 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3494/6900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:15 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:16.572352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:16.572976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:16.580421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:16.580924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:16.581378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:16.582089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:16.582599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:16.583048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:16.713102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:16.721646 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac9deb68-01c3-44cb-880f-a808fe17abc0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.153159 Sep 16 14:57:16.722229 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3495/6901] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:16 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:17.744479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:17.745157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:17.752134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:17.752640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:17.753125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:17.753843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:17.754347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:17.754821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:17.890590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:17.898379 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68288f4c-ec1e-4e76-a30a-3fe2f226a720 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.157809 Sep 16 14:57:17.898966 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3496/6902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:17 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:18.921640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:18.922254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:18.928949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:18.929439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:18.929884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:18.930613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:18.931078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:18.931541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:19.058677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:19.066272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1c85bc5-6580-4f30-9ccb-c990f2b6d6c5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.149038 Sep 16 14:57:19.066885 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3497/6903] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:18 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:20.089736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:20.090385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:20.097675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:20.098189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:20.098932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:20.099658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:20.100137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:20.100578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:20.237116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:20.246036 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a594c5f-6550-4153-8ff8-d22c0970eaf3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.160479 Sep 16 14:57:20.247326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3498/6904] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:20 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:20.251954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-664829ca-ee1e-46fb-b0f6-74519f137ce6 req-4e095c95-4677-4be4-8347-09603d10bf6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c41f9b-e1b4-4ed9-938c-4ec841413ac0", "name": "network-vif-plugged", "status": "completed", "tag": "6bb17bfa-e698-4e65-a2be-2ffbacc029b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:20.262436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-664829ca-ee1e-46fb-b0f6-74519f137ce6 req-4e095c95-4677-4be4-8347-09603d10bf6a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:20.262946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-664829ca-ee1e-46fb-b0f6-74519f137ce6 req-4e095c95-4677-4be4-8347-09603d10bf6a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:20.263406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-664829ca-ee1e-46fb-b0f6-74519f137ce6 req-4e095c95-4677-4be4-8347-09603d10bf6a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:20.274902 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-664829ca-ee1e-46fb-b0f6-74519f137ce6 req-4e095c95-4677-4be4-8347-09603d10bf6a service nova] Creating event network-vif-plugged:6bb17bfa-e698-4e65-a2be-2ffbacc029b5 for instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 on n-h1-858129-2 Sep 16 14:57:20.283315 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-664829ca-ee1e-46fb-b0f6-74519f137ce6 req-4e095c95-4677-4be4-8347-09603d10bf6a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034785 Sep 16 14:57:20.283983 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3499/6905] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:57:21.271828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:21.272514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:21.279274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:21.279769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:21.280213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:21.280906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:21.281369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:21.281805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:21.413224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:21.421660 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6cde3543-86b1-4bfd-a634-3782530d681b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1317 microversion: 2.1 time: 0.155020 Sep 16 14:57:21.422231 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3500/6906] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:21 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:22.443999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:22.444636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:22.446559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:57:22.447290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:57:22.454363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.454883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.455333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.456041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.456510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.456953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.476555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:57:22.591389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:22.599425 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43ab2b1e-157a-4862-90e3-ceb9c476dddc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1506 microversion: 2.1 time: 0.159371 Sep 16 14:57:22.600018 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3501/6907] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:22 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:22.621708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:22.622367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:22.628625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.629129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.629584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.630295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.630803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.631249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.762880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:22.770747 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab629ff5-31ae-4392-bb8f-a34a6a06642f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1506 microversion: 2.1 time: 0.152699 Sep 16 14:57:22.771348 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3502/6908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:22 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:22.795618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:22.797994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:22.804008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.804513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.804962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.805669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.806139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.806625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.869072 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b5fce41f-bf3b-4636-b8fe-414aeb474c50 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "PUT /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1078 microversion: 2.1 time: 0.077780 Sep 16 14:57:22.869706 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3503/6909] 10.222.0.60 () {60 vars in 1256 bytes} [Fri Sep 16 14:57:22 2022] PUT /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:22.887831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:22.888471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:22.894395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.894931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.895389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:22.896097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:22.896571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:22.897015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.024920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:23.033417 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4083736d-077d-4eb4-beda-2cae51da2d3e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1504 microversion: 2.1 time: 0.149253 Sep 16 14:57:23.034024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3504/6910] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:22 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:23.055598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:23.056223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:23.061966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:23.062491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:23.062951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.063664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:23.064139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:23.064582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.198661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:23.206915 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ee7e371-77ec-4434-b9d5-d77e245f4f3f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1504 microversion: 2.1 time: 0.154885 Sep 16 14:57:23.207492 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3505/6911] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:23 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:23.229281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:23.231470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:23.237187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:23.237686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:23.238132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.238858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:23.239323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:23.239752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.267725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:23.273341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:57:23.280566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:57:23.280999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:57:23.281485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:57:23.281908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:57:23.282324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:57:23.346841 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-19ff1ee9-80e6-4e8d-8910-7f6a6b75b38a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.121145 Sep 16 14:57:23.347451 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3506/6912] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:57:23 2022] POST /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:57:23.355622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:23.356249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:23.362345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:23.362880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:23.363329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.364035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:23.364498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:23.364929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:23.523019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:23.531694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df6ab793-0c7b-4dbf-9b36-83e476a111dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1515 microversion: 2.1 time: 0.179383 Sep 16 14:57:23.532018 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3507/6913] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:23 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:24.564646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:24.565297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:24.572253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:24.572693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:24.573144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:24.573844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:24.574311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:24.574779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:25.404354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:25.412435 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9cf883c3-b5b8-4b0f-b5bd-9e24241888bc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1515 microversion: 2.1 time: 0.851640 Sep 16 14:57:25.413015 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3508/6914] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:24 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1515 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:26.436767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:26.437506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:26.444473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:26.444979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:26.445444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:26.446151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:26.446647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:26.447092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:26.576029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:26.583965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4a653787-a712-4e99-bc3d-76cf38bb3a01 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.151762 Sep 16 14:57:26.584544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3509/6915] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:26 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:27.608930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:27.609559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:27.616139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:27.616644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:27.617100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:27.617812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:27.618286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:27.618758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:27.751829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:27.759679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf705227-841b-4146-80a6-8b7ac9cdc755 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.155387 Sep 16 14:57:27.760254 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3510/6916] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:27 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:28.784204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:28.784849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:28.791623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:28.792121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:28.792568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:28.793870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:28.794337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:28.794801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:28.924479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:28.932300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-032ea704-35fc-432d-aef0-7eac9296e7e9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.151985 Sep 16 14:57:28.932871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3511/6917] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:28 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:29.956855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:29.957548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:29.960151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:57:29.966280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:29.966818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:29.967276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:29.967988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:29.968467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:29.968914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:30.101182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:30.109670 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b7b9f98d-38ea-4c75-bcce-02037ef111af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.156878 Sep 16 14:57:30.110247 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3512/6918] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:29 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:31.133334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:31.134008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:31.141239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:31.141751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:31.142210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:31.142993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:31.143474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:31.143926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:31.274211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:31.282765 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99bcde0f-e486-4ef4-a112-9940fc2a0136 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.153329 Sep 16 14:57:31.283336 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3513/6919] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:31 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:32.306428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:32.307077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:32.315443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:32.315977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:32.316413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:32.317143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:32.317621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:32.318071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:32.450701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:32.458068 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e65bc334-3bb2-4097-aa11-77ff4423fad5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.155637 Sep 16 14:57:32.458684 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3514/6920] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:32 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:33.481306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:33.482494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:33.489440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:33.489938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:33.490388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:33.491122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:33.491587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:33.492025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:33.623478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:33.631271 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8101a77d-6e84-494f-86d9-3e63da742bbb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.153955 Sep 16 14:57:33.631856 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3515/6921] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:33 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:34.655218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:34.655838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:34.662762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:34.663267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:34.663728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:34.664440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:34.664918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:34.665361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:34.669401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:57:34.799311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:34.807121 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13894faa-c8a1-4e9a-91db-f63dafca5584 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.155874 Sep 16 14:57:34.807627 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3516/6922] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:34 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:35.833682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:35.834379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:35.841249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:35.841760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:35.842909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:35.843627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:35.844102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:35.844546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:35.975582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:35.984219 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-08d1a7ce-709d-442f-abbe-ca74f5ea7ec2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.154485 Sep 16 14:57:35.984900 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3517/6923] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:35 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:37.008808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:37.009451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:37.017040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:37.017546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:37.018004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:37.018985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:37.019533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:37.020116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:37.149393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:37.157416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96680d92-9516-491d-8c16-d9a8dc9c378d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.153766 Sep 16 14:57:37.158007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3518/6924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:37 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:38.180554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:38.181208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:38.188820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:38.189318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:38.189772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:38.190510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:38.190986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:38.191427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:38.321021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:38.328763 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92c46a5e-f4fe-4bea-9684-0b0562d9d3f4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.152379 Sep 16 14:57:38.329350 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3519/6925] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:38 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:39.352070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:39.352700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:39.360531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:39.361023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:39.361494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:39.362219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:39.362731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:39.363181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:39.498294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:39.506116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-06c8e8f8-281f-46d1-b44b-989649dfc596 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.158243 Sep 16 14:57:39.506740 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3520/6926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:39 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:40.530280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:40.530975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:40.540033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:40.540540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:40.540997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:40.541715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:40.542191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:40.542680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:40.685195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:40.693633 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-35f2563a-c57c-4dfc-9e4e-1b32bfbccfc9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.168056 Sep 16 14:57:40.694223 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3521/6927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:40 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:41.717155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:41.717781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:41.724785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:41.725278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:41.725723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:41.726435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:41.726906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:41.727341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:41.865975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:41.875142 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01942a78-4c79-419d-9ff1-33abb02e17d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.161942 Sep 16 14:57:41.875724 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3522/6928] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:41 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:42.898611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:42.899266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:42.906195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:42.906745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:42.907202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:42.907914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:42.908394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:42.908842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:43.038659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:43.047040 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ebe69869-ead5-459a-aa41-497db36b34a1 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.152511 Sep 16 14:57:43.047616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3523/6929] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:42 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:44.070903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:44.071573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:44.079021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:44.079531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:44.079990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:44.080707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:44.081185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:44.081635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:44.220389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:44.228700 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-183b6b3e-843e-4398-931b-b81c695c3afb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.161699 Sep 16 14:57:44.229291 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3524/6930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:44 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:45.253081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:45.253741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:45.260195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:45.260699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:45.261157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:45.261904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:45.262390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:45.262863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:45.392518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:45.400294 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63ca6191-9917-4c4c-a480-01f42eb2a51e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.151376 Sep 16 14:57:45.400870 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3525/6931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:45 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:46.424361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:46.425049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:46.431984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:46.432491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:46.432956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:46.433689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:46.434149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:46.434625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:46.566368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:46.574350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6772fb42-aeab-443c-9cd2-08db1915d0d2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.153980 Sep 16 14:57:46.574967 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3526/6932] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:46 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:47.599016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:47.599661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:47.606786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:47.607953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:47.608427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:47.609146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:47.609644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:47.610084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:47.748042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:47.756091 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-87c8db15-4789-4582-ab02-73477ba209aa tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.161282 Sep 16 14:57:47.757268 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3527/6933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:47 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:48.779279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:48.779968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:48.787617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:48.788242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:48.788724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:48.789607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:48.790118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:48.790789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:48.930938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:48.940258 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27f468a0-a663-4416-843b-839bc10646af tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.164860 Sep 16 14:57:48.940851 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3528/6934] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:48 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:49.964244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:49.964937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:49.972298 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:49.972798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:49.973249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:49.974224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:49.974716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:49.975161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:50.112025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:50.119914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8cc05538-1b34-4889-ad79-89b31950bd85 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.159612 Sep 16 14:57:50.120490 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3529/6935] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:49 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:51.143787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:51.144447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:51.151532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:51.152046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:51.152506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:51.153230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:51.153708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:51.154782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:51.299999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:51.308018 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a4d5be28-e5b8-4fc5-9273-85b0cf5a8b59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.168188 Sep 16 14:57:51.308599 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3530/6936] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:51 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:52.331384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:52.332085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:52.338928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:52.339439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:52.339881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:52.340588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:52.341057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:52.342133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:52.518941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:52.526856 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d477fbe-1a49-47d3-8573-f442ac5cdb80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1520 microversion: 2.1 time: 0.199433 Sep 16 14:57:52.527472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3531/6937] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:52 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:57:53.072430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c41f9b-e1b4-4ed9-938c-4ec841413ac0", "name": "network-vif-unplugged", "status": "completed", "tag": "6bb17bfa-e698-4e65-a2be-2ffbacc029b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:53.082442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:53.082912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:53.083456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:53.095656 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] Creating event network-vif-unplugged:6bb17bfa-e698-4e65-a2be-2ffbacc029b5 for instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 on n-h2-858129-2 Sep 16 14:57:53.101604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:57:53.114470 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-52d0ddcf-4e4e-4109-8106-5a33a918f702 req-7cbbbf7c-e2f9-4a60-b76b-de353b13c494 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045873 Sep 16 14:57:53.115275 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3532/6938] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:57:53.553515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:53.554397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:53.560672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:53.561186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:53.561635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:53.562353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:53.562849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:53.563288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:53.567698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:57:53.703896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:53.712099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac4778bd-c619-4bbd-a615-4872faa735b4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1519 microversion: 2.1 time: 0.163872 Sep 16 14:57:53.712719 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3533/6939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:53 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:54.737643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:54.738315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:54.745256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:54.745763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:54.746219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:54.746961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:54.747441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:54.748548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:54.880378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:54.888838 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d6b17a8-fa6b-4e1c-85f9-042cc26245e4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1517 microversion: 2.1 time: 0.155169 Sep 16 14:57:54.889436 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3534/6940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:54 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:55.140744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c41f9b-e1b4-4ed9-938c-4ec841413ac0", "tag": "6bb17bfa-e698-4e65-a2be-2ffbacc029b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:55.150055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:55.150587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:55.151032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:55.163759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] Creating event network-changed:6bb17bfa-e698-4e65-a2be-2ffbacc029b5 for instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 on n-h2-858129-2 Sep 16 14:57:55.169358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:57:55.180943 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cd7615ab-0594-47a7-9fc3-7430c58db34d req-3c15fa33-674d-4a26-849a-0136077c7fa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043893 Sep 16 14:57:55.181561 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3535/6941] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:57:55.912994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:55.913716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:55.920654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:55.921149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:55.921597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:55.922299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:55.922792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:55.923234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:56.057414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:56.065288 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e3e62165-1102-41f9-96dc-a5cd3c6836d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1517 microversion: 2.1 time: 0.157413 Sep 16 14:57:56.065877 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3536/6942] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:55 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:57.089052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:57.090099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:57.097958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:57.098316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:57.099061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:57.100246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:57.100734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:57.101564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:57.259063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:57.269500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb0e3c6c-c713-47f7-8e6e-217b7d7604d9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1514 microversion: 2.1 time: 0.184088 Sep 16 14:57:57.270124 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3537/6943] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:57 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:57.294324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:57.295656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:57.302148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:57.302683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:57.303138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:57.303949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:57.304321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:57.304759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:57.366269 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-755ce134-ec68-49a2-bc5b-a007c4e3d7cd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0/action" status: 204 len: 0 microversion: 2.1 time: 0.075589 Sep 16 14:57:57.367222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3538/6944] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:57:57 2022] POST /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:57:57.376058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:57.376983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:57.383894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:57.384470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:57.384915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:57.385705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:57.386228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:57.386856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:57.613365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:57.622628 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46f68745-2762-4570-b4b6-2ff2a8a394b2 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1514 microversion: 2.1 time: 0.250731 Sep 16 14:57:57.623226 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3539/6945] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:57 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:58.647064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:58.647688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:58.655311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:58.655821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:58.656276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:58.657006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:58.657477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:58.657922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:58.800231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:58.808952 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e88750fc-8160-4855-9e6b-6d767128d895 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1514 microversion: 2.1 time: 0.165833 Sep 16 14:57:58.809616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3540/6946] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:58 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:57:59.080270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-06e13e29-07d9-4d63-bb37-524d64a0e6f6 req-6f8751dd-5b8e-4e80-be81-36332fca0ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c41f9b-e1b4-4ed9-938c-4ec841413ac0", "name": "network-vif-plugged", "status": "completed", "tag": "6bb17bfa-e698-4e65-a2be-2ffbacc029b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:57:59.090507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-06e13e29-07d9-4d63-bb37-524d64a0e6f6 req-6f8751dd-5b8e-4e80-be81-36332fca0ccb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:59.091016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-06e13e29-07d9-4d63-bb37-524d64a0e6f6 req-6f8751dd-5b8e-4e80-be81-36332fca0ccb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:59.092227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-06e13e29-07d9-4d63-bb37-524d64a0e6f6 req-6f8751dd-5b8e-4e80-be81-36332fca0ccb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:59.104062 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-06e13e29-07d9-4d63-bb37-524d64a0e6f6 req-6f8751dd-5b8e-4e80-be81-36332fca0ccb service nova] Creating event network-vif-plugged:6bb17bfa-e698-4e65-a2be-2ffbacc029b5 for instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 on n-h2-858129-2 Sep 16 14:57:59.109252 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-06e13e29-07d9-4d63-bb37-524d64a0e6f6 req-6f8751dd-5b8e-4e80-be81-36332fca0ccb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Sep 16 14:57:59.109861 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3541/6947] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:57:59.834275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:57:59.835043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:57:59.841202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:59.841698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:59.842146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:59.842871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:57:59.843337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:57:59.843800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:57:59.971857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:57:59.979937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e5d95cd-8b0e-4e8d-8f09-abc6fc47e026 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1506 microversion: 2.1 time: 0.150995 Sep 16 14:57:59.980510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3542/6948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:59 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:00.002938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:00.003570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:00.005492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=62 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:00.011179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:00.011686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:00.012141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:00.012858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:00.013444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:00.013894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:00.144832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:00.153040 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ce72ed94-24dd-4590-80b5-4a33a7f55749 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1506 microversion: 2.1 time: 0.153754 Sep 16 14:58:00.153641 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3543/6949] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:57:59 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:00.180209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a150a430-a776-496c-a781-ee56845670dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'create', calling method: .version_select at 0x7f724c206af0>, body: {"keypair": {"name": "tempest-keypair-2065552587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbhZrP1haGelUHWtBFzc584H832Yl7w7uDOfiX4nTf823bEQ+q/JxE431uZmEyN4uwxMrZs3HcDGHvcfwamkfaoCjP2sA6Qm6mZcjkkP7XdtX9FzvBaAU3WAsVpVCX4xw=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:00.196317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a150a430-a776-496c-a781-ee56845670dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Getting quotas for project 0e811ec42e0143f88a872a5cef5eb059. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:58:00.201543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a150a430-a776-496c-a781-ee56845670dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Getting quotas for user 5dd772c3e55a477aa2c9a41bc77d06d9 and project 0e811ec42e0143f88a872a5cef5eb059. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:58:00.226928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a150a430-a776-496c-a781-ee56845670dd tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050495 Sep 16 14:58:00.227466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3544/6950] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:58:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:01.408065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:01.408818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:01.415855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:01.416358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:01.416832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:01.417518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:01.417993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:01.418462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:01.545610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:01.553553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ceb8d73e-b6e7-4992-ac5b-1daa97e9f86c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 200 len: 1506 microversion: 2.1 time: 0.151105 Sep 16 14:58:01.554136 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3545/6951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:01 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:01.576163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:01.576683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:01.582665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:01.583173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:01.583630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:01.584342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:01.584820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:01.585267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:01.610912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:58:01.687284 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8391a2a7-c684-4b58-907d-da5ce5c69d59 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "DELETE /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 204 len: 0 microversion: 2.1 time: 0.114980 Sep 16 14:58:01.687875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3546/6952] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:58:01 2022] DELETE /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:58:01.746116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-556498403", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "4ba4dfac-c3dd-416e-bc0d-dcec94f94e3a"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:01.802250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] validate_networks() for [('4ba4dfac-c3dd-416e-bc0d-dcec94f94e3a', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:58:02.170204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:58:02.170675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:58:02.171164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:58:02.171584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:58:02.172009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:58:02.180991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:02.181486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:02.181932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:02.182708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:02.183174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:02.183611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:02.201091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Getting quotas for project 0e811ec42e0143f88a872a5cef5eb059. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:58:02.206461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Getting quotas for user 5dd772c3e55a477aa2c9a41bc77d06d9 and project 0e811ec42e0143f88a872a5cef5eb059. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:58:02.219413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:58:02.221859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:58:02.266704 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b739ac07-aad7-449a-bf8a-ad9a62e99ef3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524733 Sep 16 14:58:02.267317 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3547/6953] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:58:02.278297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a2de4319-b920-4e20-a125-e1ecfe42468a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:02.278972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a2de4319-b920-4e20-a125-e1ecfe42468a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:02.340537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a2de4319-b920-4e20-a125-e1ecfe42468a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:02.347848 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a2de4319-b920-4e20-a125-e1ecfe42468a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1217 microversion: 2.1 time: 0.073255 Sep 16 14:58:02.348705 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3548/6954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:02 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:03.371645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:03.372325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:03.379740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:03.380618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:03.380618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:03.381409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:03.381890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:03.382547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:03.445160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:03.454228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b9c4a83d-f6e2-400f-abc9-ffcc2601066b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1269 microversion: 2.1 time: 0.086723 Sep 16 14:58:03.454965 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3549/6955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:03 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:04.412653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-630a38e3-da67-4929-a945-2b7cfc8478a4 req-e2037b09-71c3-4cd7-a17e-df563f32c65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c41f9b-e1b4-4ed9-938c-4ec841413ac0", "name": "network-vif-deleted", "tag": "6bb17bfa-e698-4e65-a2be-2ffbacc029b5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:04.425349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-630a38e3-da67-4929-a945-2b7cfc8478a4 req-e2037b09-71c3-4cd7-a17e-df563f32c65d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:04.426115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-630a38e3-da67-4929-a945-2b7cfc8478a4 req-e2037b09-71c3-4cd7-a17e-df563f32c65d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:04.427142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-630a38e3-da67-4929-a945-2b7cfc8478a4 req-e2037b09-71c3-4cd7-a17e-df563f32c65d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:04.440416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-630a38e3-da67-4929-a945-2b7cfc8478a4 req-e2037b09-71c3-4cd7-a17e-df563f32c65d service nova] Creating event network-vif-deleted:6bb17bfa-e698-4e65-a2be-2ffbacc029b5 for instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 on n-h2-858129-2 Sep 16 14:58:04.446300 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-630a38e3-da67-4929-a945-2b7cfc8478a4 req-e2037b09-71c3-4cd7-a17e-df563f32c65d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037126 Sep 16 14:58:04.447433 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3550/6956] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:04.487183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:04.488677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:04.496515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:04.497420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:04.498529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:04.499221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:04.499726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:04.500187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:04.520262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:04.765633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:04.775831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0881333-fe37-42d1-9950-26cea9054d1b tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.299643 Sep 16 14:58:04.777385 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3551/6957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:04 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:58:05.332599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6db695d1-36ab-473b-ae5f-5e9f09f4ce35 req-156b3c28-f765-4db2-89bf-f3f8fe7d6856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97e9c85-1ca1-4b2f-9040-603c4826e03a", "tag": "d0ccbdb3-39f1-4766-aab9-9503ee30881c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:05.346489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6db695d1-36ab-473b-ae5f-5e9f09f4ce35 req-156b3c28-f765-4db2-89bf-f3f8fe7d6856 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:05.347084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6db695d1-36ab-473b-ae5f-5e9f09f4ce35 req-156b3c28-f765-4db2-89bf-f3f8fe7d6856 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:05.347632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6db695d1-36ab-473b-ae5f-5e9f09f4ce35 req-156b3c28-f765-4db2-89bf-f3f8fe7d6856 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:05.370090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6db695d1-36ab-473b-ae5f-5e9f09f4ce35 req-156b3c28-f765-4db2-89bf-f3f8fe7d6856 service nova] Creating event network-changed:d0ccbdb3-39f1-4766-aab9-9503ee30881c for instance e97e9c85-1ca1-4b2f-9040-603c4826e03a on n-h2-858129-2 Sep 16 14:58:05.375595 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6db695d1-36ab-473b-ae5f-5e9f09f4ce35 req-156b3c28-f765-4db2-89bf-f3f8fe7d6856 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049191 Sep 16 14:58:05.376387 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3552/6958] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:05.803612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:05.804412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:05.811501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:05.812013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:05.812519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:05.813282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:05.813762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:05.814210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:05.948536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:05.956631 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f4ccfb4-4c43-4722-97ac-29462ad8882c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.158506 Sep 16 14:58:05.957214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3553/6959] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:05 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:06.979517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:06.980169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:06.987135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:06.987642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:06.988108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:06.988820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:06.989304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:06.989754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:07.125643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:07.133515 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e5b8b8e7-1d04-4e59-9de6-e0693119ee2c tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.158061 Sep 16 14:58:07.134094 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3554/6960] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:06 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:08.157620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:08.158224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:08.165156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:08.165668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:08.166127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:08.166903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:08.167382 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:08.167833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:08.374883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:08.391998 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a93584f7-307c-4ceb-af71-a3e8450c83db tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.238951 Sep 16 14:58:08.392597 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3555/6961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:08 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:09.416164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:09.416831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:09.424565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:09.425069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:09.425527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:09.426244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:09.426752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:09.427198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:09.556879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:09.564793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-357edcda-d272-4d1c-99cd-8b9680b58cfe tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.152831 Sep 16 14:58:09.565363 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3556/6962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:09 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:10.587746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:10.588376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:10.595682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:10.596193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:10.596659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:10.597381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:10.597858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:10.598303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:10.729743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:10.738209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e99bd68-58a3-42e9-a982-9679d20dbe8d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.154411 Sep 16 14:58:10.738816 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3557/6963] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:10 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:11.155300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-36223371-0158-4171-abde-b34540111c7e req-bf8fe330-3fa1-4308-9d9b-82ac8138f6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e9c85-1ca1-4b2f-9040-603c4826e03a", "name": "network-vif-plugged", "status": "completed", "tag": "d0ccbdb3-39f1-4766-aab9-9503ee30881c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:11.165133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-36223371-0158-4171-abde-b34540111c7e req-bf8fe330-3fa1-4308-9d9b-82ac8138f6e9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:11.165658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-36223371-0158-4171-abde-b34540111c7e req-bf8fe330-3fa1-4308-9d9b-82ac8138f6e9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:11.166215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-36223371-0158-4171-abde-b34540111c7e req-bf8fe330-3fa1-4308-9d9b-82ac8138f6e9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:11.178591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-36223371-0158-4171-abde-b34540111c7e req-bf8fe330-3fa1-4308-9d9b-82ac8138f6e9 service nova] Creating event network-vif-plugged:d0ccbdb3-39f1-4766-aab9-9503ee30881c for instance e97e9c85-1ca1-4b2f-9040-603c4826e03a on n-h2-858129-2 Sep 16 14:58:11.183659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-36223371-0158-4171-abde-b34540111c7e req-bf8fe330-3fa1-4308-9d9b-82ac8138f6e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 Sep 16 14:58:11.184450 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3558/6964] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:11.762689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:11.763493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:11.770389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:11.770909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:11.771359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:11.772058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:11.772525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:11.773249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:11.903143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:11.910958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9420d6f7-58f0-4f67-a6ab-2250aca114e5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1317 microversion: 2.1 time: 0.153525 Sep 16 14:58:11.911537 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3559/6965] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:11 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:12.934699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:12.935371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:12.937276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:12.938021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:12.945302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:12.945807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:12.946263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:12.947008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:12.947483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:12.947931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.384352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:13.393008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b283acc4-8fd7-47f0-9f45-d0a76979362a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1507 microversion: 2.1 time: 0.462363 Sep 16 14:58:13.393607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3560/6966] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:12 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:13.416641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:13.417202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:13.423425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:13.423936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:13.424393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.425119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:13.425602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:13.426053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.560235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:13.568636 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e78b7533-e272-4f2f-ad83-f31416acb8fc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1507 microversion: 2.1 time: 0.155810 Sep 16 14:58:13.569236 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3561/6967] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:13 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:13.593627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:13.596431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:13.603517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:13.604076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:13.604505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.605329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:13.605863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:13.606278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.640897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:13.646822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 14:58:13.653677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:58:13.654797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:58:13.655292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:58:13.655716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:58:13.656139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:58:13.725340 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-024d1ce2-5079-4ecc-9873-731fd5149c39 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a/action" status: 202 len: 0 microversion: 2.1 time: 0.137280 Sep 16 14:58:13.726224 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3562/6968] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:58:13 2022] POST /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:58:13.734610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:13.735389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:13.741994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:13.742535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:13.742994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.743741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:13.744835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:13.744835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:13.920453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:13.934007 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6fdfe8a3-9c18-4c1b-8891-18e1407555d8 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1514 microversion: 2.1 time: 0.203500 Sep 16 14:58:13.943322 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3563/6969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:13 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:14.957316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:14.957942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:14.964774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:14.965275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:14.965729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:14.966510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:14.966989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:14.967433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:15.112105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:15.120313 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4db78d8-4c0d-4058-82ed-76ea24e13c5d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1514 microversion: 2.1 time: 0.166944 Sep 16 14:58:15.120998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3564/6970] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:14 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:16.145362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:16.146025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:16.153052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:16.153562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:16.154024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:16.154783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:16.155261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:16.155711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:16.289877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:16.298482 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17e2b8d5-20e5-41d1-a5ea-c860fedbc076 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.157072 Sep 16 14:58:16.299319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3565/6971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:16 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:17.323570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:17.324208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:17.331671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:17.332172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:17.332635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:17.333344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:17.333821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:17.334270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:17.467665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:17.475717 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d3c9586-02eb-42cd-b6c6-952788d89acc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156080 Sep 16 14:58:17.476296 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3566/6972] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:17 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:18.499495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:18.500191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:18.507399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:18.507900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:18.508347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:18.509060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:18.509531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:18.509966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:18.646727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:18.654623 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1650311d-7c6c-4f46-8469-2bbb30aeb10a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.159600 Sep 16 14:58:18.655205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3567/6973] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:18 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:19.677931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:19.678742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:19.686718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:19.687256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:19.687712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:19.688435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:19.688908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:19.689352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:19.692022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:19.824524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:19.833060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d9d3c23-9550-449a-96e2-f55a7f4c7396 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.159280 Sep 16 14:58:19.833642 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3568/6974] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:19 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:20.857027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:20.857646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:20.864719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:20.865230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:20.865708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:20.866440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:20.866922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:20.867368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:20.999675 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:21.010023 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2edcb9ce-66cd-4862-a331-5e487c3f1a89 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156964 Sep 16 14:58:21.010663 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3569/6975] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:20 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:22.034706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:22.035357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:22.042271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:22.042865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:22.043269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:22.043984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:22.044464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:22.044912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:22.176896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:22.184758 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e5f3aa3-9f3b-4494-88c0-8a9692cad49d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.154821 Sep 16 14:58:22.185342 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3570/6976] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:22 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:58:23.208992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:23.209664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:23.216592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:23.217083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:23.217532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:23.218234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:23.218741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:23.219182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:23.347757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:23.355795 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09fc045f-30e1-4872-bace-c62c0e275e80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.150810 Sep 16 14:58:23.356375 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3571/6977] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:23 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:24.380116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:24.380761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:24.388020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:24.388525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:24.388992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:24.389737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:24.390221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:24.390696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:24.523800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:24.532575 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d8d9c070-2c84-4262-850a-dea6109f279a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156791 Sep 16 14:58:24.533176 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3572/6978] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:24 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:25.555867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:25.556548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:25.564202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:25.564706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:25.565163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:25.565881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:25.566355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:25.566835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:25.700566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:25.709305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4af5f703-dcf0-4417-b1a1-0a598eb913d3 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156943 Sep 16 14:58:25.709596 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3573/6979] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:25 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:26.733894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:26.734610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:26.742073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:26.742633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:26.743102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:26.743820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:26.744295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:26.744743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:26.880020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:26.888256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fa8cf9c4-4c08-4bd5-8afc-adb77c09460f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.159016 Sep 16 14:58:26.888849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3574/6980] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:26 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:27.911771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:27.912454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:27.914827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:27.920044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:27.920553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:27.921039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:27.921755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:27.922229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:27.922704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:28.055640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:28.063627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59739650-b33d-416a-b66a-7118f6fcca1f tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.155942 Sep 16 14:58:28.064214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3575/6981] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:27 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:29.087007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:29.087693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:29.095049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:29.095554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:29.096012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:29.096721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:29.097195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:29.097638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:29.232974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:29.241558 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7c2bdd81-3ec3-44fa-858b-3da95584ca79 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.158516 Sep 16 14:58:29.242144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3576/6982] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:29 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:30.265794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:30.266505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:30.273479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:30.274016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:30.274505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:30.275249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:30.275727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:30.276178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:30.410144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:30.418123 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6da0a789-fdae-4547-ae2d-0b15b63e02ce tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156778 Sep 16 14:58:30.418745 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3577/6983] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:30 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:31.443265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:31.444358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:31.451744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:31.452916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:31.453367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:31.454081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:31.454584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:31.455020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:31.583988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:31.591928 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c3b569e-5d3c-449e-b52a-bf49987eb578 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.153628 Sep 16 14:58:31.592509 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3578/6984] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:31 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:32.615022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:32.615730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:32.622901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:32.623434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:32.624437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:32.625157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:32.625636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:32.626079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:32.773554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:32.782795 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76829c14-4eb3-44b4-9881-6c7cf86f6164 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.171656 Sep 16 14:58:32.783706 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3579/6985] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:32 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:33.807093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:33.807784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:33.814771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:33.815281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:33.815740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:33.816456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:33.816930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:33.817375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:33.949130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:33.957515 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9db0aa40-1a70-489d-b67d-6c2d594acdf0 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.154569 Sep 16 14:58:33.958095 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3580/6986] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:33 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:34.981258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:34.981886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:34.989544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:34.990050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:34.990544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:34.991261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:34.991739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:34.992186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:35.129682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:35.137583 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-86c8e20f-c04e-4b3e-9e69-e53697fb30bb tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.160337 Sep 16 14:58:35.138165 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3581/6987] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:34 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:36.162227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:36.162927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:36.169863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:36.170376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:36.171489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:36.172214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:36.172693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:36.173141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:36.306216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:36.314228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa2088a9-5075-409a-bbc9-046f00128683 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156011 Sep 16 14:58:36.314837 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3582/6988] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:36 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:37.337534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:37.338151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:37.345117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:37.345619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:37.346061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:37.346804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:37.347283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:37.347724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:37.483753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:37.491806 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-223f5f99-bd33-4990-900e-3b242fd650b5 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.158175 Sep 16 14:58:37.492402 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3583/6989] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:37 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:38.515058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:38.515717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:38.522662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:38.523176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:38.523638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:38.524362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:38.524852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:38.525301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:38.658754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:38.660987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:38.667924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53c0406e-9e11-4ae0-9f68-3f57b6b3a2ea tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.156802 Sep 16 14:58:38.668509 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3584/6990] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:38 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:39.691775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:39.692437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:39.699642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:39.700153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:39.700617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:39.701360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:39.702374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:39.702861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:39.840058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:39.848468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b22b013-1999-4105-8cb5-739989a23b31 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.160650 Sep 16 14:58:39.849321 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3585/6991] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:39 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:40.871868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:40.872503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:40.879754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:40.880252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:40.880700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:40.881402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:40.881869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:40.882305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:41.015619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:41.023380 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1f45191-7a0b-4abe-af89-9d124edf3a40 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.155560 Sep 16 14:58:41.023956 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3586/6992] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:40 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:42.046229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:42.047024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:42.053924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:42.054496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:42.054954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:42.055676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:42.056153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:42.056599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:42.187135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:42.194970 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0998ab8-a2b5-4afc-a4fd-bec28f825df9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1519 microversion: 2.1 time: 0.152719 Sep 16 14:58:42.195581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3587/6993] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:42 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:43.218420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:43.219040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:43.226258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:43.226783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:43.227235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:43.227945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:43.228412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:43.228849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:43.456452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:43.464337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-426a35b8-94fa-4493-a156-fe6e0d20ffa9 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1518 microversion: 2.1 time: 0.249866 Sep 16 14:58:43.464924 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3588/6994] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:43 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1518 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:43.469932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e9c85-1ca1-4b2f-9040-603c4826e03a", "name": "network-vif-unplugged", "status": "completed", "tag": "d0ccbdb3-39f1-4766-aab9-9503ee30881c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:43.479566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:43.480358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:43.480551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:43.495060 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] Creating event network-vif-unplugged:d0ccbdb3-39f1-4766-aab9-9503ee30881c for instance e97e9c85-1ca1-4b2f-9040-603c4826e03a on n-h1-858129-2 Sep 16 14:58:43.500794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:58:43.512521 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0ee7fe45-e38a-4275-bae6-7097a259527a req-a9cfd1de-9d42-4041-b68b-96116e68a5f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046228 Sep 16 14:58:43.513501 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3589/6995] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 14:58:44.493357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:44.494083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:44.501183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:44.501694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:44.502154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:44.502900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:44.503381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:44.503830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:44.639409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:44.647750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d84c872-d0f9-4342-b01f-0caa20ee930e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1516 microversion: 2.1 time: 0.159975 Sep 16 14:58:44.648338 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3590/6996] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:44 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:58:45.538783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97e9c85-1ca1-4b2f-9040-603c4826e03a", "tag": "d0ccbdb3-39f1-4766-aab9-9503ee30881c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:45.548939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:45.549369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:45.549837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:45.561564 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] Creating event network-changed:d0ccbdb3-39f1-4766-aab9-9503ee30881c for instance e97e9c85-1ca1-4b2f-9040-603c4826e03a on n-h1-858129-2 Sep 16 14:58:45.568414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:58:45.580468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8510b649-78f5-4ce0-813d-82c3a87b90ae req-cb576817-7860-4e19-9a45-d28c80009024 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045499 Sep 16 14:58:45.581086 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3591/6997] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:45.672439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:45.673158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:45.679558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:45.680193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:45.680748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:45.681490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:45.682113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:45.682666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:45.885744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:45.894340 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-75cb86f8-6139-4963-8d0f-9b270a602367 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1516 microversion: 2.1 time: 0.226739 Sep 16 14:58:45.894978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3592/6998] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:45 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:46.918397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:46.919063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:46.926907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:46.927446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:46.927904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:46.928627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:46.929102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:46.929549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:47.108556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:47.117644 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-859a4018-1d80-409a-8e20-0e6672c1cb10 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1516 microversion: 2.1 time: 0.203226 Sep 16 14:58:47.118233 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3593/6999] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:46 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:48.141618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:48.142299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:48.149738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:48.150393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:48.150881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:48.151616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:48.152101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:48.152552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:48.289226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:48.297220 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59d41a9f-e0bf-488a-94a0-b7ba54081f6a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1513 microversion: 2.1 time: 0.160201 Sep 16 14:58:48.297813 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3594/7000] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:48 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:48.319518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:48.320091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:48.326155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:48.326719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:48.327177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:48.327884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:48.328358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:48.329336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:48.387269 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f64e98c9-effb-4d86-9b62-b7c6fff147d4 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "POST /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a/action" status: 204 len: 0 microversion: 2.1 time: 0.071161 Sep 16 14:58:48.388064 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3595/7001] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 14:58:48 2022] POST /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:58:48.397340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:48.398086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:48.404454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:48.404965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:48.405416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:48.406139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:48.407281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:48.407734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:48.612657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:48.620680 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-02c6a7ca-e867-41fc-9d56-3b9161d3506e tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1513 microversion: 2.1 time: 0.227535 Sep 16 14:58:48.621268 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3596/7002] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:48 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:49.008541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e9c85-1ca1-4b2f-9040-603c4826e03a", "name": "network-vif-plugged", "status": "completed", "tag": "d0ccbdb3-39f1-4766-aab9-9503ee30881c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:49.019213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:49.019716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:49.020166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:49.034350 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] Creating event network-vif-plugged:d0ccbdb3-39f1-4766-aab9-9503ee30881c for instance e97e9c85-1ca1-4b2f-9040-603c4826e03a on n-h1-858129-2 Sep 16 14:58:49.040114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 14:58:49.051730 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2ec8db1c-d32f-4925-a619-24b3e78785b2 req-ba793703-c344-453e-815f-c7da2b0b41a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047197 Sep 16 14:58:49.052514 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3597/7003] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:49.646220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:49.646876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:49.653552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:49.654073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:49.654570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:49.655324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:49.655797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:49.656245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:49.803421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:49.812762 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-78092b45-07b3-49aa-b2ed-16747062c664 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1513 microversion: 2.1 time: 0.172377 Sep 16 14:58:49.813368 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3598/7004] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:49 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:50.837372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:50.838061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:50.845755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:50.846164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:50.846670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:50.847399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:50.847879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:50.848329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:50.980131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:50.988769 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be87d0a5-f837-4a97-8194-1e37448a3a28 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1505 microversion: 2.1 time: 0.155391 Sep 16 14:58:50.989354 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3599/7005] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:50 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:51.010860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:51.011490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:51.017915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.018439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.018898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.019608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.020084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.020532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.154145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:51.162931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df5364ae-6c45-4cb8-a10d-aaa8e310ef00 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1505 microversion: 2.1 time: 0.155635 Sep 16 14:58:51.163521 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3600/7006] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:51 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:51.189039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:51.189676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:51.195844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.196375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.196831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.197573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.198054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.198530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.202749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:58:51.330149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:51.338035 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d2c8053-5c4d-44a7-a9dd-b617a09fd40a tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1505 microversion: 2.1 time: 0.154824 Sep 16 14:58:51.338645 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3601/7007] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:51 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:51.360400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:51.360836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:51.366609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.367102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.367552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.368247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.368715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.369153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.395151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:58:51.479691 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7b3dffd0-adb0-44b7-bfe8-0fca2bd4651d tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 204 len: 0 microversion: 2.1 time: 0.123004 Sep 16 14:58:51.480346 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3602/7008] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:58:51 2022] DELETE /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:58:51.497722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:51.498333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:51.508273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.508859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.509365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.510142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.510756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.511331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.538306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 14:58:51.587752 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.compute.api [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Instance is already in deleting state, ignoring this request Sep 16 14:58:51.588612 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-15be66a2-feb2-40c4-94cd-33fa2da35f80 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 204 len: 0 microversion: 2.1 time: 0.095182 Sep 16 14:58:51.589190 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3603/7009] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:58:51 2022] DELETE /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 14:58:51.597567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:51.598192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:51.604151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.604657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.605114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.605839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:51.606304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:51.606778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:51.741131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:51.749016 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-67cbc596-1b7d-452c-bcc3-a0c15cd38f63 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1511 microversion: 2.1 time: 0.155724 Sep 16 14:58:51.749597 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3604/7010] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:51 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:52.772186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:52.772863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:52.779669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:52.780172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:52.780629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:52.781340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:52.782018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:52.782485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:52.919474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd772c3e55a477aa2c9a41bc77d06d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e811ec42e0143f88a872a5cef5eb059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:58:52.928085 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7de40d6-4169-48fd-8bc3-070189bb0af6 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 200 len: 1511 microversion: 2.1 time: 0.159870 Sep 16 14:58:52.928660 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3605/7011] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:52 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:58:53.574347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0a261018-840e-45e6-8f61-4441a3671146 req-6001c1ba-739a-4633-bd4c-bcfb39b44f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e9c85-1ca1-4b2f-9040-603c4826e03a", "name": "network-vif-deleted", "tag": "d0ccbdb3-39f1-4766-aab9-9503ee30881c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:58:53.585654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0a261018-840e-45e6-8f61-4441a3671146 req-6001c1ba-739a-4633-bd4c-bcfb39b44f65 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:53.586304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0a261018-840e-45e6-8f61-4441a3671146 req-6001c1ba-739a-4633-bd4c-bcfb39b44f65 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:53.586783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0a261018-840e-45e6-8f61-4441a3671146 req-6001c1ba-739a-4633-bd4c-bcfb39b44f65 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:53.600565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0a261018-840e-45e6-8f61-4441a3671146 req-6001c1ba-739a-4633-bd4c-bcfb39b44f65 service nova] Creating event network-vif-deleted:d0ccbdb3-39f1-4766-aab9-9503ee30881c for instance e97e9c85-1ca1-4b2f-9040-603c4826e03a on n-h1-858129-2 Sep 16 14:58:53.606533 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0a261018-840e-45e6-8f61-4441a3671146 req-6001c1ba-739a-4633-bd4c-bcfb39b44f65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 Sep 16 14:58:53.607196 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3606/7012] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:58:53.952699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:53.953934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: e97e9c85-1ca1-4b2f-9040-603c4826e03a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:53.960356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:53.960878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:53.961326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:53.962021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:53.962517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:53.962954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:53.976647 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] HTTP exception thrown: Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a could not be found. Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Request method failure captured: Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a HTTP/1.1 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI7G7BO-uZI3ePjFO5rblE_bAtsQuqNHesqAMkgTOnfFNAtR4BNAKStVG0wSnNDaC8Y7zGTPvcDu2wspNBIyLOZ0AK5OFOXqSU3eNC8au1rplcTYEjQO4_h8GspIEAWKh6exhRUg1Z-dI7SWjXub-EQMjEFNwXD6SeRlDXvzJts9YEg Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0e811ec42e0143f88a872a5cef5eb059 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e811ec42e0143f88a872a5cef5eb059", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e811ec42e0143f88a872a5cef5eb059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e811ec42e0143f88a872a5cef5eb059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e811ec42e0143f88a872a5cef5eb059"}]}] Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0e811ec42e0143f88a872a5cef5eb059 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1301367219-project Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 5dd772c3e55a477aa2c9a41bc77d06d9 Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1301367219-project Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a could not be found. Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'e97e9c85-1ca1-4b2f-9040-603c4826e03a'} Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a could not be found. Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a could not be found. Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:58:53.978291 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a could not be found. Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Returning 404 to user: Instance e97e9c85-1ca1-4b2f-9040-603c4826e03a could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7917538e-f31a-42a4-9774-019de22c1429 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a" status: 404 len: 111 microversion: 2.1 time: 0.032438 Sep 16 14:58:53.982977 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3607/7013] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:53 2022] GET /compute/v2.1/servers/e97e9c85-1ca1-4b2f-9040-603c4826e03a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 14:58:53.988012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a0a2ede0-8604-40ad-bd28-4b230212addc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '.version_select at 0x7f7247eefaf0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:54.009239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a0a2ede0-8604-40ad-bd28-4b230212addc tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065552587" status: 202 len: 0 microversion: 2.1 time: 0.024585 Sep 16 14:58:54.009825 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3608/7014] 10.222.0.60 () {58 vars in 1221 bytes} [Fri Sep 16 14:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065552587 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 14:58:54.613448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:54.613997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:54.621396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:54.621898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:54.622352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:54.623104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:54.623577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:54.624050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:54.637218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] HTTP exception thrown: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Request method failure captured: Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 HTTP/1.1 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI7G7BO-uZI3ePjFO5rblE_bAtsQuqNHesqAMkgTOnfFNAtR4BNAKStVG0wSnNDaC8Y7zGTPvcDu2wspNBIyLOZ0AK5OFOXqSU3eNC8au1rplcTYEjQO4_h8GspIEAWKh6exhRUg1Z-dI7SWjXub-EQMjEFNwXD6SeRlDXvzJts9YEg Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0e811ec42e0143f88a872a5cef5eb059 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e811ec42e0143f88a872a5cef5eb059", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e811ec42e0143f88a872a5cef5eb059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e811ec42e0143f88a872a5cef5eb059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e811ec42e0143f88a872a5cef5eb059"}]}] Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0e811ec42e0143f88a872a5cef5eb059 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1301367219-project Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 5dd772c3e55a477aa2c9a41bc77d06d9 Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1301367219-project Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '27c41f9b-e1b4-4ed9-938c-4ec841413ac0'} Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:58:54.638848 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Returning 404 to user: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf02cfdf-7f3c-49ab-afdc-7b98ecbfed72 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "DELETE /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 404 len: 111 microversion: 2.1 time: 0.031509 Sep 16 14:58:54.644587 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3609/7015] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 14:58:54 2022] DELETE /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:58:54.648559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:58:54.649185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] [instance: 27c41f9b-e1b4-4ed9-938c-4ec841413ac0] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:58:54.655172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:54.655678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:54.656145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:54.657369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:58:54.657841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:58:54.658283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:58:54.671643 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] HTTP exception thrown: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Request method failure captured: Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 HTTP/1.1 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI7G7BO-uZI3ePjFO5rblE_bAtsQuqNHesqAMkgTOnfFNAtR4BNAKStVG0wSnNDaC8Y7zGTPvcDu2wspNBIyLOZ0AK5OFOXqSU3eNC8au1rplcTYEjQO4_h8GspIEAWKh6exhRUg1Z-dI7SWjXub-EQMjEFNwXD6SeRlDXvzJts9YEg Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0e811ec42e0143f88a872a5cef5eb059 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e811ec42e0143f88a872a5cef5eb059", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e811ec42e0143f88a872a5cef5eb059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e811ec42e0143f88a872a5cef5eb059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e811ec42e0143f88a872a5cef5eb059"}]}] Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0e811ec42e0143f88a872a5cef5eb059 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1301367219 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerDiskConfigTestJSON-1301367219-project Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 5dd772c3e55a477aa2c9a41bc77d06d9 Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerDiskConfigTestJSON-1301367219-project Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '27c41f9b-e1b4-4ed9-938c-4ec841413ac0'} Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 14:58:54.673811 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] Returning 404 to user: Instance 27c41f9b-e1b4-4ed9-938c-4ec841413ac0 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ccb032b-0974-4544-a2b9-320d333b1810 tempest-ServerDiskConfigTestJSON-1301367219 tempest-ServerDiskConfigTestJSON-1301367219-project] 10.222.0.60 "GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0" status: 404 len: 111 microversion: 2.1 time: 0.030295 Sep 16 14:58:54.678751 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3610/7016] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:58:54 2022] GET /compute/v2.1/servers/27c41f9b-e1b4-4ed9-938c-4ec841413ac0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 14:59:03.434303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ed21393-cfeb-4408-bef1-922007eff688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'create', calling method: .version_select at 0x7f724c072280>, body: {"keypair": {"name": "tempest-keypair-848027665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdAbkLq4EDA4guBzeamawxb08ru/mqXvbgfSA6rn+wfVpBXU65CD2LWAqZ32W+DHpjoa2MICEdqNh5cUXMIznDD5LxkNG0w+kE25uSHSACH+3aqkja7HlRXXUfovML/mA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:59:03.440043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:59:03.454140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9ed21393-cfeb-4408-bef1-922007eff688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:59:03.460199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9ed21393-cfeb-4408-bef1-922007eff688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:59:03.493893 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ed21393-cfeb-4408-bef1-922007eff688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182355 Sep 16 14:59:03.498559 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3611/7017] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 14:59:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:59:04.759882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1935730319", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa0fd5eb-a331-4d0b-8412-424197c74892"}], "security_groups": [{"name": "tempest-securitygroup--341516162"}], "key_name": "tempest-keypair-848027665", "user_data": "}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:59:04.770758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:59:04.872832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] validate_networks() for [('fa0fd5eb-a331-4d0b-8412-424197c74892', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 14:59:05.272446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 14:59:05.272902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 14:59:05.273401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 14:59:05.273834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 14:59:05.274271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 14:59:05.285176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:05.286240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:05.286667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:05.288243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:05.288733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:05.289686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:05.311341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 14:59:05.317215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 14:59:05.330779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 14:59:05.333387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 14:59:05.385930 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79b095fe-bcb0-4e48-8329-9feaee02be9d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.630671 Sep 16 14:59:05.393631 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3612/7018] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:59:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 14:59:05.399019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d42ee5ca-ac03-40cb-9f3f-8df557855a9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:05.399577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d42ee5ca-ac03-40cb-9f3f-8df557855a9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:05.472976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d42ee5ca-ac03-40cb-9f3f-8df557855a9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:05.481899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d42ee5ca-ac03-40cb-9f3f-8df557855a9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1238 microversion: 2.1 time: 0.086999 Sep 16 14:59:05.482855 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3613/7019] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:05 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 14:59:05.557609 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:59:05.558085 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 14:59:06.505661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:06.506498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:06.513926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:06.514903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:06.514903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:06.515668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:06.516151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:06.516751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:06.629562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:06.647222 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a78b8c0f-1b0a-49a6-8670-076a3b5dea44 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1298 microversion: 2.1 time: 0.145130 Sep 16 14:59:06.648886 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3614/7020] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:06 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:07.675106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:07.675860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:07.686187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:07.686738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:07.687209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:07.688526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:07.689015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:07.689473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:07.897887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:07.905732 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74c67978-06d2-49e9-bc13-56c0227ce635 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.235607 Sep 16 14:59:07.906337 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3615/7021] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:07 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:08.261236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f9276f11-87a2-4ed6-8702-91de55108184 req-9e8fa94f-a88b-4cf8-a16a-b90a12e3bc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:59:08.273032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f9276f11-87a2-4ed6-8702-91de55108184 req-9e8fa94f-a88b-4cf8-a16a-b90a12e3bc30 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:08.273529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f9276f11-87a2-4ed6-8702-91de55108184 req-9e8fa94f-a88b-4cf8-a16a-b90a12e3bc30 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:08.273981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f9276f11-87a2-4ed6-8702-91de55108184 req-9e8fa94f-a88b-4cf8-a16a-b90a12e3bc30 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:08.285895 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f9276f11-87a2-4ed6-8702-91de55108184 req-9e8fa94f-a88b-4cf8-a16a-b90a12e3bc30 service nova] Creating event network-changed:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h1-858129-2 Sep 16 14:59:08.291438 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f9276f11-87a2-4ed6-8702-91de55108184 req-9e8fa94f-a88b-4cf8-a16a-b90a12e3bc30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034005 Sep 16 14:59:08.292688 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3616/7022] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:59:08.930522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:08.931268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:08.937475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:08.937976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:08.938456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:08.939163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:08.939634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:08.940078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:09.074335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:09.082886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ee6c6be-aff0-42c2-8572-130c12fad07a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.157430 Sep 16 14:59:09.083482 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3617/7023] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:08 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:10.106505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:10.107166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:10.114512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:10.115022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:10.115474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:10.116179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:10.116649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:10.117089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:10.251674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:10.259553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a14756b8-2c18-44c9-8cb1-5feab6d5c33b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.157005 Sep 16 14:59:10.260139 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3618/7024] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:10 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:11.282381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:11.283055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:11.290515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:11.291034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:11.291503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:11.292231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:11.292712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:11.293165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:11.490249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:11.498211 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac07eaa4-1d89-400b-84e8-ab864034085c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.219852 Sep 16 14:59:11.498916 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3619/7025] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:11 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:12.521797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:12.522457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:12.529480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:12.529992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:12.530475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:12.531203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:12.531711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:12.532165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:12.663372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:12.671359 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-95cf47ce-b101-4dfd-a574-16936e5142f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.153662 Sep 16 14:59:12.671946 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3620/7026] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:12 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:13.696125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:13.696850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:13.704538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:13.705002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:13.705427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:13.706275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:13.706818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:13.707275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:13.865388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:13.873721 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66c425b0-5111-4d3c-852f-bfd0385f2ae2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.181557 Sep 16 14:59:13.874446 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3621/7027] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:13 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:14.897596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:14.898222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:14.905150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:14.905661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:14.906126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:14.906877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:14.907413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:14.907860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:15.042230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:15.050268 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3badf3e1-b86b-47b5-94bb-13fda012747b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.156702 Sep 16 14:59:15.050889 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3622/7028] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:14 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:15.089404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c87da983-b407-4491-89dd-8d184587f4d9 req-6e87523d-e0c5-4882-8e08-1eaffda97b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "name": "network-vif-plugged", "status": "completed", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:59:15.099881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c87da983-b407-4491-89dd-8d184587f4d9 req-6e87523d-e0c5-4882-8e08-1eaffda97b6d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:15.100388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c87da983-b407-4491-89dd-8d184587f4d9 req-6e87523d-e0c5-4882-8e08-1eaffda97b6d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:15.100891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c87da983-b407-4491-89dd-8d184587f4d9 req-6e87523d-e0c5-4882-8e08-1eaffda97b6d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:15.114903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c87da983-b407-4491-89dd-8d184587f4d9 req-6e87523d-e0c5-4882-8e08-1eaffda97b6d service nova] Creating event network-vif-plugged:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h1-858129-2 Sep 16 14:59:15.120169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c87da983-b407-4491-89dd-8d184587f4d9 req-6e87523d-e0c5-4882-8e08-1eaffda97b6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034951 Sep 16 14:59:15.120974 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3623/7029] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:59:16.070361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:59:16.071283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 14:59:16.076122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:16.076846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:16.084582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:16.085084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:16.085541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:16.086258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:16.086757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:16.087210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:16.217245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:16.226125 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d163eebe-5659-4899-8bda-9f68204e4efa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1363 microversion: 2.1 time: 0.156693 Sep 16 14:59:16.226750 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3624/7030] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:16 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:17.249342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:17.250027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:17.256960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:17.257464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:17.257921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:17.258661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:17.259176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:17.259599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:17.390436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 14:59:17.398866 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d90fea97-c9e1-42bc-8600-2e5cc1a061b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1549 microversion: 2.1 time: 0.153443 Sep 16 14:59:17.399458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3625/7031] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 14:59:17 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 14:59:17.421759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 14:59:17.422272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 14:59:17.428563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:17.429066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:17.429523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:17.430238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:17.430745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:17.431191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:17.511188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-828dd35f-84db-461b-b44e-0d9ec6571241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093216 Sep 16 14:59:17.511797 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3626/7032] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 14:59:17 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:59:18.735841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-0e7a20da-1145-4d54-8358-b90e71fcf5fc req-8d4c4a05-a756-42c1-959f-862a7bbbd66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 14:59:18.745902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0e7a20da-1145-4d54-8358-b90e71fcf5fc req-8d4c4a05-a756-42c1-959f-862a7bbbd66b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 14:59:18.746425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0e7a20da-1145-4d54-8358-b90e71fcf5fc req-8d4c4a05-a756-42c1-959f-862a7bbbd66b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 14:59:18.746905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-0e7a20da-1145-4d54-8358-b90e71fcf5fc req-8d4c4a05-a756-42c1-959f-862a7bbbd66b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 14:59:18.758502 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-0e7a20da-1145-4d54-8358-b90e71fcf5fc req-8d4c4a05-a756-42c1-959f-862a7bbbd66b service nova] Creating event network-changed:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h1-858129-2 Sep 16 14:59:18.763497 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-0e7a20da-1145-4d54-8358-b90e71fcf5fc req-8d4c4a05-a756-42c1-959f-862a7bbbd66b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032576 Sep 16 14:59:18.764125 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3627/7033] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 14:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 14:59:29.317798 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:59:29.318284 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 14:59:29.330559 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 14:59:29.330708 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 14:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:00:23.515224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:00:23.516035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=72 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:00:23.521798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:23.522558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:23.531162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:23.531673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:23.532135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:23.532871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:23.533352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:23.533818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:23.676534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:23.685950 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d932786e-2d7e-457a-8004-efaecdced010 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1668 microversion: 2.1 time: 0.173715 Sep 16 15:00:23.686579 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3628/7034] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:23 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:23.710828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:23.711475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:23.717820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:23.718333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:23.718822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:23.719558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:23.720036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:23.720485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:23.867782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:23.876408 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-468d1eca-8d00-4034-8acb-c7a14d05a1e9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1668 microversion: 2.1 time: 0.170183 Sep 16 15:00:23.876799 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3629/7035] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:23 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:23.900130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:23.900758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:23.907233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:23.907749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:23.908224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:23.908947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:23.909430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:23.909875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:24.060979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:24.075158 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa330f9a-12ec-46df-94ac-8f8c38097447 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1668 microversion: 2.1 time: 0.179196 Sep 16 15:00:24.076202 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3630/7036] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:23 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:24.098910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:24.101501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:24.107752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:24.108288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:24.108754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:24.109521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:24.110114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:24.110478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:24.154112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:24.161765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 15:00:24.169999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:00:24.170492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:00:24.171002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:00:24.171440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:00:24.171878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:00:24.244663 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e30c096f-d4af-43db-8fdb-bef972fa3541 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d/action" status: 202 len: 0 microversion: 2.1 time: 0.150020 Sep 16 15:00:24.245344 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3631/7037] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:00:24 2022] POST /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:00:24.253898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:24.255232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:24.262354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:24.263065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:24.263635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:24.264980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:24.265488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:24.266170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:24.469429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:24.481490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d55584ed-879f-40ad-8453-d4d231068eb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1677 microversion: 2.1 time: 0.231176 Sep 16 15:00:24.482477 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3632/7038] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:24 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:25.508909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:25.509744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:25.517348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:25.517868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:25.518337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:25.519106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:25.519596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:25.520085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:25.694294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:25.706631 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ceac074d-5c50-4f8d-bfdf-8a6e2aad9e75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1677 microversion: 2.1 time: 0.202255 Sep 16 15:00:25.707710 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3633/7039] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:25 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:26.739621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:26.740309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:26.747942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:26.748457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:26.748916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:26.749653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:26.750132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:26.750627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:26.907569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:26.916190 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de86b995-f73d-41a6-965b-863dfa17f588 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.181024 Sep 16 15:00:26.917248 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3634/7040] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:26 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:27.941927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:27.942666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:27.949733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:27.950255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:27.950748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:27.951499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:27.951984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:27.952434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:28.111087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:28.119523 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2025f717-0daa-48d9-ae10-7439bfeb987d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.181622 Sep 16 15:00:28.120137 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3635/7041] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:27 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:29.144610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:29.145327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:29.153012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:29.153520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:29.153973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:29.154729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:29.155204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:29.155644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:29.298805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:29.306954 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f75bf7ec-d407-4d83-a283-75fad975f604 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.166247 Sep 16 15:00:29.307547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3636/7042] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:29 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:30.330851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:30.331541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:30.339101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:30.339626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:30.340087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:30.340815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:30.341294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:30.341744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:30.482741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:30.491187 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d98d4863-6eb4-4769-98c0-8801a6ffd8c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.164312 Sep 16 15:00:30.491784 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3637/7043] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:30 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:31.519926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:31.520630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:31.528463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:31.528972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:31.529428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:31.530158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:31.530658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:31.531104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:31.665103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:31.673079 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf36fafa-d021-4aa2-93dc-4b39b1ca5128 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.158222 Sep 16 15:00:31.673655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3638/7044] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:31 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:32.699323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:32.700000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:32.708372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:32.708882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:32.709333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:32.710059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:32.710559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:32.710998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:32.891285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:32.900213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df6074fa-77d2-4a13-96e3-4f3b1d573ab3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.205873 Sep 16 15:00:32.901102 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3639/7045] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:32 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:33.924628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:33.925290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:33.932834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:33.933338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:33.933797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:33.934536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:33.935018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:33.935466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:34.068385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:34.076256 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a10673c-c186-45e0-adca-d70cb823f743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.155589 Sep 16 15:00:34.076862 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3640/7046] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:33 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:35.099758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:35.100406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:35.107792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:35.108365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:35.108854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:35.109596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:35.110125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:35.110661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:35.246456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:35.255049 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62e54fc8-20be-4bef-bfa8-f93d0ca4fa49 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.158767 Sep 16 15:00:35.255544 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3641/7047] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:35 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:36.278690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:36.279348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:36.286671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:36.287214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:36.287698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:36.288450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:36.288923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:36.289365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:36.428837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:36.437051 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6e8acf0-bd66-44b2-aecd-4111492a7c66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.162302 Sep 16 15:00:36.437662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3642/7048] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:36 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:37.461809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:37.462508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:37.469702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:37.470214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:37.470705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:37.471436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:37.471921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:37.472374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:37.477022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:00:37.611431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:37.619992 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5eb97086-46df-4c19-991a-1d1252e67703 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1682 microversion: 2.1 time: 0.162744 Sep 16 15:00:37.620578 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3643/7049] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:37 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:38.644296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:38.646706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:38.653105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:38.653621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:38.654081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:38.655287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:38.655475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:38.655892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:38.876450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:38.885118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-952caa6f-c57c-4d8d-99ee-1098b9854738 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1681 microversion: 2.1 time: 0.245023 Sep 16 15:00:38.885718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3644/7050] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:38 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:39.110772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "name": "network-vif-unplugged", "status": "completed", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:39.121779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:39.122518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:39.123138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:39.136898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] Creating event network-vif-unplugged:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h2-858129-2 Sep 16 15:00:39.142663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:00:39.154622 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9cadcc89-b6de-4178-92ea-e45f3bf4c7f0 req-b2a5759f-accb-4b1c-98e6-c47bbbe240e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048948 Sep 16 15:00:39.155581 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3645/7051] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:00:39.912629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:39.913457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:39.921604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:39.922225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:39.922715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:39.923459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:39.923941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:39.924392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:40.170179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:40.178480 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58c93dbf-0018-4cc5-b9c8-ff83802cdfe0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1681 microversion: 2.1 time: 0.272649 Sep 16 15:00:40.179090 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3646/7052] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:39 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:41.196150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:41.206903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:41.208051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:41.208538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:41.220587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] Creating event network-changed:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h2-858129-2 Sep 16 15:00:41.226560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:00:41.237193 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5b47574c-d55a-4ebb-b721-1e3b2199fadb req-7974e979-4518-45c0-a272-3129b3af510b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045416 Sep 16 15:00:41.237817 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3647/7053] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:00:41.243635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:41.244358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:41.250585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:41.251096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:41.251553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:41.252283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:41.252761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:41.253204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:41.496380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:41.505826 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-17a2d8ba-38fa-4d94-8adb-c92f5713cd30 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1679 microversion: 2.1 time: 0.266123 Sep 16 15:00:41.506447 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3648/7054] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:41 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:00:42.529260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:42.529929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:42.536963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:42.537476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:42.537942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:42.538712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:42.539196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:42.539646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:42.681493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:42.690275 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c554ecc-51cc-4520-83b5-863101a4ef46 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1679 microversion: 2.1 time: 0.164422 Sep 16 15:00:42.691108 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3649/7055] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:42 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:43.714924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:43.715610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:43.722534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:43.723688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:43.724403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:43.725161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:43.725641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:43.726098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:43.856563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:43.864352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e90c241-79b5-428e-909a-3cd2dbbf3185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1676 microversion: 2.1 time: 0.153342 Sep 16 15:00:43.864935 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3650/7056] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:43 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:43.887121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:43.887676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:43.893496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:43.893997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:43.894473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:43.895802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:43.896278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:43.896752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:43.954774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b999006-061b-4ec9-aa62-99c13f3f0426 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d/action" status: 204 len: 0 microversion: 2.1 time: 0.071102 Sep 16 15:00:43.955324 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3651/7057] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:00:43 2022] POST /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:00:43.966159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:43.967294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:43.974646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:43.975233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:43.975653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:43.976434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:43.976948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:43.977391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:44.529213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:44.537235 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-affb8fa3-4925-49f9-9887-cfe10a05d07b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1676 microversion: 2.1 time: 0.576860 Sep 16 15:00:44.537819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3652/7058] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:43 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1676 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:45.562247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:45.563655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:45.572015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:45.572795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:45.573412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:45.574310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:45.574969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:45.575576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:45.722162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:45.732266 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-74cd22d8-a4cf-47b0-b39c-4f6ec07bff3a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1676 microversion: 2.1 time: 0.174492 Sep 16 15:00:45.746957 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3653/7059] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:45 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:46.757347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:46.758177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:46.765501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:46.766013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:46.766518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:46.767246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:46.767728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:46.768179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:46.899052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:46.906924 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1a054dd7-1869-424f-9538-cd7172aad3a9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1668 microversion: 2.1 time: 0.153508 Sep 16 15:00:46.907503 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3654/7060] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:46 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:46.929023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:46.929571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:46.935640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:46.936148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:46.936599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:46.937347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:46.937967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:46.938253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.069910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:47.077887 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5be3fec8-9d13-4682-ae9b-6d8b112a6916 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1668 microversion: 2.1 time: 0.152680 Sep 16 15:00:47.078487 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3655/7061] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:46 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:47.100653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:47.101288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:47.107044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:47.107550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:47.108008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.108721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:47.109199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:47.109646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.245982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:47.255385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6baca776-08b8-41b6-8aee-ebbd65b502da tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1668 microversion: 2.1 time: 0.158754 Sep 16 15:00:47.255987 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3656/7062] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:47 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:47.280616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:47.281125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:47.287311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:47.287817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:47.288270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.288984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:47.289456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:47.289900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.318037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:00:47.370670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:00:47.400089 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f8f0b973-ccf5-4c28-a5fc-19e214777566 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 204 len: 0 microversion: 2.1 time: 0.123081 Sep 16 15:00:47.400869 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3657/7063] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:00:47 2022] DELETE /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:00:47.409427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:47.410161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:47.416138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:47.416648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:47.417110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.419163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:47.419163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:47.419163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:47.552957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:47.560881 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ee1feb2-ef73-4b15-849f-9c0f1cf529e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1674 microversion: 2.1 time: 0.155622 Sep 16 15:00:47.561471 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3658/7064] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:47 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:48.012805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-591629b3-77f1-459c-a7f1-a9f22c1ee12d req-5589d380-2ecc-47be-862a-66101c15bb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "name": "network-vif-plugged", "status": "completed", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:48.023992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-591629b3-77f1-459c-a7f1-a9f22c1ee12d req-5589d380-2ecc-47be-862a-66101c15bb42 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:48.025602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-591629b3-77f1-459c-a7f1-a9f22c1ee12d req-5589d380-2ecc-47be-862a-66101c15bb42 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:48.025602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-591629b3-77f1-459c-a7f1-a9f22c1ee12d req-5589d380-2ecc-47be-862a-66101c15bb42 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:48.037557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-591629b3-77f1-459c-a7f1-a9f22c1ee12d req-5589d380-2ecc-47be-862a-66101c15bb42 service nova] Creating event network-vif-plugged:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h2-858129-2 Sep 16 15:00:48.042608 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-591629b3-77f1-459c-a7f1-a9f22c1ee12d req-5589d380-2ecc-47be-862a-66101c15bb42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Sep 16 15:00:48.043413 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3659/7065] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:00:48.586224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:48.586889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:48.593176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:48.593678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:48.594134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:48.594884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:48.595356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:48.595800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:48.733424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:48.742059 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89ec9374-1e60-4844-819b-847072c38eba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1674 microversion: 2.1 time: 0.160743 Sep 16 15:00:48.742663 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3660/7066] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:48 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:49.767531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:49.769197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:49.777166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:49.777984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:49.778667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:49.779435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:49.779911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:49.780345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:49.853404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:49.861739 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1fbafa71-2721-41ce-8ad7-d7f7b132d750 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 200 len: 1607 microversion: 2.1 time: 0.098244 Sep 16 15:00:49.862805 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3661/7067] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:49 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:00:49.867874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-603115a4-dc6b-4223-aab3-cd33410643cf req-845e9c8f-1548-4a46-bbfe-79ae439ca338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d", "name": "network-vif-deleted", "tag": "af0aa65e-632a-4e7d-b51a-23980c661ffd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:49.881531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-603115a4-dc6b-4223-aab3-cd33410643cf req-845e9c8f-1548-4a46-bbfe-79ae439ca338 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:49.882116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-603115a4-dc6b-4223-aab3-cd33410643cf req-845e9c8f-1548-4a46-bbfe-79ae439ca338 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:49.882738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-603115a4-dc6b-4223-aab3-cd33410643cf req-845e9c8f-1548-4a46-bbfe-79ae439ca338 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:49.895843 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-603115a4-dc6b-4223-aab3-cd33410643cf req-845e9c8f-1548-4a46-bbfe-79ae439ca338 service nova] Creating event network-vif-deleted:af0aa65e-632a-4e7d-b51a-23980c661ffd for instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d on n-h2-858129-2 Sep 16 15:00:49.901691 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-603115a4-dc6b-4223-aab3-cd33410643cf req-845e9c8f-1548-4a46-bbfe-79ae439ca338 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037286 Sep 16 15:00:49.902322 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3662/7068] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:00:50.888409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:50.889184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:50.895569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:50.896084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:50.896535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:50.897260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:50.897739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:50.898179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:50.915187 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d HTTP/1.1 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d'} Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:00:50.916887 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-62c38ebf-09bf-4ac6-b83e-a4af53c220dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 404 len: 111 microversion: 2.1 time: 0.035143 Sep 16 15:00:50.921225 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3663/7069] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:50 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:00:50.932431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:50.933053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:50.939208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:50.939721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:50.940176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:50.940893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:50.941371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:50.941851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:50.956423 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d HTTP/1.1 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d'} Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:00:50.958646 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cee603d0-e02d-4fee-a407-3d9a198cf95b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 404 len: 111 microversion: 2.1 time: 0.031456 Sep 16 15:00:50.963476 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3664/7070] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:50 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:00:51.010779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1446740149", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "fa0fd5eb-a331-4d0b-8412-424197c74892"}], "security_groups": [{"name": "tempest-securitygroup--341516162"}], "key_name": "tempest-keypair-848027665", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:51.123123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] validate_networks() for [('fa0fd5eb-a331-4d0b-8412-424197c74892', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:00:51.521664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:00:51.522117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:00:51.522680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:00:51.523146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:00:51.523669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:00:51.534773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:51.535801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:51.536268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:51.537040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:51.537517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:51.537970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:51.559330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:00:51.565548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:00:51.580238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:00:51.582716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:00:51.595419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:00:51.637844 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9675d918-57d3-424e-9f58-a44a22555079 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.630979 Sep 16 15:00:51.641357 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3665/7071] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:00:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 15:00:51.652322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b062f461-e6bb-40b6-ac4b-f9f0419f6df8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:51.652972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b062f461-e6bb-40b6-ac4b-f9f0419f6df8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:51.722213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b062f461-e6bb-40b6-ac4b-f9f0419f6df8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:51.734065 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b062f461-e6bb-40b6-ac4b-f9f0419f6df8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1238 microversion: 2.1 time: 0.086362 Sep 16 15:00:51.735050 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3666/7072] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:51 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:52.772435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:52.773241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:52.782365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:52.783033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:52.783536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:52.785247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:52.785247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:52.785247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:52.866878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:52.877883 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-407862f8-7505-4b44-abcd-ab828866ae06 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1290 microversion: 2.1 time: 0.109771 Sep 16 15:00:52.878485 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3667/7073] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:52 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:53.904437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:53.905181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:53.913776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:53.914318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:53.914902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:53.915985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:53.916994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:53.917437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:54.179088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:54.187482 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-993d3e1b-32e0-4190-afa1-c932ba396c10 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.287190 Sep 16 15:00:54.188096 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3668/7074] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:53 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:54.612241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-302a3a59-edf6-4f6a-b2c5-ae0d002d07c6 req-9c884f01-b356-410f-913c-7cabb2907a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:54.624192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-302a3a59-edf6-4f6a-b2c5-ae0d002d07c6 req-9c884f01-b356-410f-913c-7cabb2907a32 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:54.624872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-302a3a59-edf6-4f6a-b2c5-ae0d002d07c6 req-9c884f01-b356-410f-913c-7cabb2907a32 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:54.625595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-302a3a59-edf6-4f6a-b2c5-ae0d002d07c6 req-9c884f01-b356-410f-913c-7cabb2907a32 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:54.639982 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-302a3a59-edf6-4f6a-b2c5-ae0d002d07c6 req-9c884f01-b356-410f-913c-7cabb2907a32 service nova] Creating event network-changed:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h1-858129-2 Sep 16 15:00:54.646994 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-302a3a59-edf6-4f6a-b2c5-ae0d002d07c6 req-9c884f01-b356-410f-913c-7cabb2907a32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039742 Sep 16 15:00:54.648156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3669/7075] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:00:55.211830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:55.212559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:55.219730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:55.220234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:55.220689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:55.221411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:55.221885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:55.222336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:55.354718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:55.362616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a4d3e28-a7a6-4560-a558-19a13dc7bf41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.155023 Sep 16 15:00:55.363201 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3670/7076] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:55 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:56.386740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:56.387431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:56.395123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:56.395630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:56.396081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:56.396797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:56.397271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:56.397718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:56.528879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:56.537276 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0685f4b6-c07b-4c07-8fbc-2ed7a17d3688 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.154522 Sep 16 15:00:56.537854 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3671/7077] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:56 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:57.561434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:57.562122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:57.569631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:57.570156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:57.570651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:57.571389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:57.571876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:57.572459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:57.720915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:57.730184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f23db26a-9c7f-48d9-832d-dc04552611e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.173268 Sep 16 15:00:57.730908 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3672/7078] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:57 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:58.756348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:58.756998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:58.764021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:58.764526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:58.764983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:58.765698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:58.766174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:58.766652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:58.920548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:00:58.928285 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d1c5475-69f5-4052-884c-fc9867e9aaf6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.175953 Sep 16 15:00:58.928871 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3673/7079] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:58 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:00:59.722827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-348a330d-3855-40bd-b10b-d9c90b32e279 req-423dc5d7-93af-4f21-aa22-64bbc4133d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "name": "network-vif-plugged", "status": "completed", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:00:59.733847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-348a330d-3855-40bd-b10b-d9c90b32e279 req-423dc5d7-93af-4f21-aa22-64bbc4133d3b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:59.734284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-348a330d-3855-40bd-b10b-d9c90b32e279 req-423dc5d7-93af-4f21-aa22-64bbc4133d3b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:59.734780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-348a330d-3855-40bd-b10b-d9c90b32e279 req-423dc5d7-93af-4f21-aa22-64bbc4133d3b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:59.747561 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-348a330d-3855-40bd-b10b-d9c90b32e279 req-423dc5d7-93af-4f21-aa22-64bbc4133d3b service nova] Creating event network-vif-plugged:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h1-858129-2 Sep 16 15:00:59.752584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-348a330d-3855-40bd-b10b-d9c90b32e279 req-423dc5d7-93af-4f21-aa22-64bbc4133d3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Sep 16 15:00:59.753355 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3674/7080] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:00:59.953387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:00:59.954107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:00:59.961000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:59.961506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:59.961962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:00:59.962699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:00:59.963176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:00:59.963624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:00.098108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:01:00.106648 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0b7f163-d4b1-4d9a-ad9c-0f94dd999c74 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.158385 Sep 16 15:01:00.107225 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3675/7081] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:00:59 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:01:01.129181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:01:01.129815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:01:01.137261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:01.137766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:01.138232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:01.138977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:01.139459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:01.139904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:01.272085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:01:01.280931 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e84b032-9916-4e8f-9898-cdb52c0748dc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1363 microversion: 2.1 time: 0.155543 Sep 16 15:01:01.281533 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3676/7082] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:01:01 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:01:02.306189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:01:02.306852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:01:02.308897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:01:02.309566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:01:02.316543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:02.317051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:02.317567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:02.318296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:02.318888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:02.319335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:02.451974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:01:02.460782 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d12947f0-2e8d-43f4-a7e0-8da95a659d3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1549 microversion: 2.1 time: 0.158674 Sep 16 15:01:02.461371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3677/7083] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:01:02 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:01:02.484279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:01:02.484793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:01:02.490847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:02.491349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:02.491799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:02.492503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:02.492970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:02.493464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:02.572305 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a6a26656-d02d-4014-8127-2876d5394e3e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091799 Sep 16 15:01:02.572958 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3678/7084] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 15:01:02 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:01:03.822754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-95770d03-1ea8-4856-9f5f-c72f2cf2ce49 req-88292fe2-aaba-474c-ab2b-1949a4c480bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:01:03.832281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-95770d03-1ea8-4856-9f5f-c72f2cf2ce49 req-88292fe2-aaba-474c-ab2b-1949a4c480bb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:01:03.832791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-95770d03-1ea8-4856-9f5f-c72f2cf2ce49 req-88292fe2-aaba-474c-ab2b-1949a4c480bb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:01:03.833742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-95770d03-1ea8-4856-9f5f-c72f2cf2ce49 req-88292fe2-aaba-474c-ab2b-1949a4c480bb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:01:03.845508 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-95770d03-1ea8-4856-9f5f-c72f2cf2ce49 req-88292fe2-aaba-474c-ab2b-1949a4c480bb service nova] Creating event network-changed:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h1-858129-2 Sep 16 15:01:03.851353 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-95770d03-1ea8-4856-9f5f-c72f2cf2ce49 req-88292fe2-aaba-474c-ab2b-1949a4c480bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033195 Sep 16 15:01:03.851964 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3679/7085] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:02:16.176002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=30 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:16.177456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=92 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:16.178316 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:02:16.178473 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:02:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action (ip 10.222.0.60) !!! Sep 16 15:02:16.185101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aa71d468-eaca-4418-aae7-cba7394445ce tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:16.194897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa71d468-eaca-4418-aae7-cba7394445ce tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:16.195403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa71d468-eaca-4418-aae7-cba7394445ce tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:16.195862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aa71d468-eaca-4418-aae7-cba7394445ce tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:16.234370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aa71d468-eaca-4418-aae7-cba7394445ce tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Going to try to stop instance {{(pid=128642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 15:02:16.280337 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aa71d468-eaca-4418-aae7-cba7394445ce tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action" status: 202 len: 0 microversion: 2.1 time: 0.107007 Sep 16 15:02:16.280968 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3680/7086] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:02:16 2022] POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:02:16.290665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:16.291384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:16.298524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:16.298524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:16.301285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:16.301285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:16.301285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:16.301285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:16.451094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:16.461786 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c77a961f-f16b-4488-b550-c74c617ec9c4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.176236 Sep 16 15:02:16.462547 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3681/7087] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:16 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:17.491696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:17.492415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:17.499325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:17.499826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:17.500274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:17.500986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:17.501456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:17.501896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:17.640362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:17.649471 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-050a7d24-ec1b-4b50-93b6-37ecba668453 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.161722 Sep 16 15:02:17.650075 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3682/7088] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:17 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:18.672168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:18.672814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:18.679888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:18.680400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:18.680874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:18.681588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:18.682066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:18.682544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:18.818925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:18.827064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-46e4d05d-00ab-4455-a3e2-e8ef136e9527 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.158891 Sep 16 15:02:18.827662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3683/7089] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:18 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:19.851518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:19.852630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:19.859494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:19.860034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:19.860492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:19.861231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:19.861706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:19.862165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:20.003576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:20.012346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b68bf3d4-902c-472e-931f-01eaae78f5dd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.165256 Sep 16 15:02:20.012936 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3684/7090] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:19 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:21.036461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:21.037149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:21.046720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:21.047238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:21.047702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:21.048624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:21.048920 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:21.049655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:21.183185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:21.191606 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a4753ca4-0d3a-4792-aba7-5882cfd594d3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.159634 Sep 16 15:02:21.192195 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3685/7091] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:21 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:22.216173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:22.216807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:22.224347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:22.225112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:22.225568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:22.226286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:22.226829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:22.227279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:22.381602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:22.389947 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9c66374e-25f4-4e6f-accb-a0f531cc39f2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.177708 Sep 16 15:02:22.390587 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3686/7092] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:22 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:23.413596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:23.414274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:23.421424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:23.421937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:23.422393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:23.423163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:23.423640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:23.424089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:23.564130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:23.572552 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e42463b-2893-4006-8c6c-6755f9ce6ea7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.162929 Sep 16 15:02:23.573154 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3687/7093] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:23 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:02:24.596906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:24.597576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:24.605437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:24.605959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:24.606445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:24.607265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:24.607762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:24.608219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:24.762892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:24.771229 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e077f9d4-d99c-4f9a-8040-0a80ef2f6bcb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.178457 Sep 16 15:02:24.771846 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3688/7094] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:24 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:25.568207 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:02:25.568818 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:02:25.795289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:25.795984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:25.804980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:25.805491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:25.805982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:25.806808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:25.807238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:25.807682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:25.958073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:25.966957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43412633-5021-4fd9-a05c-813cd4b9fcc1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.175588 Sep 16 15:02:25.967764 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3689/7095] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:25 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:26.992889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:26.993576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:27.001007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:27.001513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:27.001978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:27.002757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:27.003244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:27.003693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:27.154272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:27.165530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-997cabd1-157d-4be5-bcdd-d88dc4da0c6c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1655 microversion: 2.1 time: 0.176553 Sep 16 15:02:27.166376 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3690/7096] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:26 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:27.189102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:27.191473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:27.197758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:27.198259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:27.198771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:27.199499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:27.199968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:27.200400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:27.232327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:27.238503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 15:02:27.247267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:02:27.247623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:02:27.248110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:02:27.248529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:02:27.248954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:02:27.330635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b32a4b8f-4ca4-4985-adfe-e8464e9cc9d8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action" status: 202 len: 0 microversion: 2.1 time: 0.145398 Sep 16 15:02:27.331500 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3691/7097] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:02:27 2022] POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:02:27.340092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:27.340744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:27.347952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:27.349017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:27.349482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:27.350514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:27.351006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:27.351456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:27.548933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:27.558079 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9d44395-73bf-4f11-af43-db13cd120c17 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.221947 Sep 16 15:02:27.558704 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3692/7098] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:27 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:02:28.586338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:28.587128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:28.594140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:28.594702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:28.595160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:28.596570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:28.597066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:28.597619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:28.781375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:28.790202 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-11804246-580e-457a-a658-f2bacbfd2145 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1678 microversion: 2.1 time: 0.208604 Sep 16 15:02:28.790867 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3693/7099] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:28 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:29.815762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:29.816620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:29.823700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:29.824219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:29.824680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:29.825418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:29.825896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:29.826342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:29.831048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:29.971815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:29.983713 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d21b59fc-8ce2-48a5-96ad-e82f1eb117bb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1683 microversion: 2.1 time: 0.171833 Sep 16 15:02:29.984297 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3694/7100] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:29 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:31.009125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:31.009769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:31.016691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:31.017201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:31.017660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:31.018376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:31.018883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:31.019330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:31.156527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:31.165958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0a8faae-7de1-4b2e-a462-586f89c9ab94 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1683 microversion: 2.1 time: 0.161303 Sep 16 15:02:31.166606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3695/7101] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:31 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:32.189823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:32.190513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:32.198041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:32.198587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:32.199071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:32.199795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:32.200336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:32.200789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:32.496526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:32.505249 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1f4fba7-ae97-4c32-b86d-c8567d929eb7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1682 microversion: 2.1 time: 0.318937 Sep 16 15:02:32.505863 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3696/7102] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:32 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1682 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:32.566864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "name": "network-vif-unplugged", "status": "completed", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:32.576525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:32.577032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:32.577491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:32.589821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] Creating event network-vif-unplugged:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h2-858129-2 Sep 16 15:02:32.596031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:02:32.608612 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-7fb4e7dc-5447-484e-9e4a-e417589b0a5b req-83db8954-8b7f-4ee5-abee-327bdcfd0be7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101493 Sep 16 15:02:32.609242 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3697/7103] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:02:33.532262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:33.533252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:33.541158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:33.541669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:33.542133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:33.542881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:33.543515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:33.543795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:33.730666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:33.739769 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1ab3412a-39f8-44a7-a596-5f18a2f7530c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1682 microversion: 2.1 time: 0.213605 Sep 16 15:02:33.740367 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3698/7104] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:33 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:34.624380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:34.635056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:34.635563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:34.636023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:34.650573 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] Creating event network-changed:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h2-858129-2 Sep 16 15:02:34.657966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:02:34.672191 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b8e1875a-6432-44a9-812e-5c2655721274 req-509b6b0c-3574-4bb7-8f96-2025b29dfea4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052319 Sep 16 15:02:34.672820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3699/7105] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:02:34.769666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:34.771612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:34.781095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:34.781752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:34.782078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:34.782865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:34.783443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:34.783899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:35.020844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:35.028898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12f6725a-de83-4430-b1e6-81ababd23440 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1680 microversion: 2.1 time: 0.268054 Sep 16 15:02:35.029720 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3700/7106] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:34 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:02:36.053303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:36.053988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:36.061099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:36.061607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:36.062067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:36.062832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:36.063310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:36.063756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:36.200912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:36.210073 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-672e6a39-4b4f-476b-b195-a6ca6f02823f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1680 microversion: 2.1 time: 0.160625 Sep 16 15:02:36.210714 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3701/7107] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:36 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:37.234457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:37.235338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:37.243143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:37.243654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:37.244113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:37.244839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:37.245314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:37.245762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:37.384812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:37.392899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a5212edb-f56e-46c1-9716-92c9115d4e57 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1676 microversion: 2.1 time: 0.162373 Sep 16 15:02:37.393500 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3702/7108] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:37 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:37.416946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:37.417483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:37.423729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:37.424246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:37.424700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:37.425432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:37.425910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:37.426352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:37.487301 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0179550-04f7-4755-9f5b-1904211f8aef tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action" status: 204 len: 0 microversion: 2.1 time: 0.074033 Sep 16 15:02:37.488205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3703/7109] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:02:37 2022] POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:02:37.496830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:37.497579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:37.504156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:37.504851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:37.505129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:37.505993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:37.506459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:37.506906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:37.727542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:37.735958 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-948ccab9-af07-4f78-a47f-61f8ab490c33 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1676 microversion: 2.1 time: 0.243210 Sep 16 15:02:37.736552 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3704/7110] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:37 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:38.760165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:38.760851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:38.768064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:38.768564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:38.769013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:38.769729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:38.770195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:38.770767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:38.926584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:38.935366 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ec60b459-d040-4628-a511-88e4776ade2b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1676 microversion: 2.1 time: 0.179222 Sep 16 15:02:38.936146 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3705/7111] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:38 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:02:39.959761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:39.960491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:39.967706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:39.968222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:39.968685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:39.969431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:39.969911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:39.970357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.105688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:40.114365 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93089ce9-afdd-4944-8b88-4bbad4ec37e2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1655 microversion: 2.1 time: 0.157924 Sep 16 15:02:40.114976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3706/7112] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:39 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:40.139361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:40.140009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:40.146356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:40.146901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:40.147358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.148085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:40.148560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:40.149005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.293221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:40.304679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31131000-82a3-449b-b17d-f738271b8024 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1655 microversion: 2.1 time: 0.171280 Sep 16 15:02:40.305276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3707/7113] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:40 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:40.327966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-68a2d5ab-3485-42cc-8ffb-404798f8f185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:40.334021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2d5ab-3485-42cc-8ffb-404798f8f185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:40.334569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2d5ab-3485-42cc-8ffb-404798f8f185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:40.335027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-68a2d5ab-3485-42cc-8ffb-404798f8f185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.357972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-68a2d5ab-3485-42cc-8ffb-404798f8f185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Going to try to start instance {{(pid=128642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 15:02:40.404132 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-68a2d5ab-3485-42cc-8ffb-404798f8f185 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action" status: 202 len: 0 microversion: 2.1 time: 0.079894 Sep 16 15:02:40.404918 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3708/7114] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:02:40 2022] POST /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:02:40.471771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-f8e29a44-5f90-4bf7-b3c4-7a2fd03dc2a0 req-faf5bd15-d7df-4fd7-8035-ab8cb3d2da0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "name": "network-vif-plugged", "status": "completed", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:40.482859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f8e29a44-5f90-4bf7-b3c4-7a2fd03dc2a0 req-faf5bd15-d7df-4fd7-8035-ab8cb3d2da0e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:40.483366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f8e29a44-5f90-4bf7-b3c4-7a2fd03dc2a0 req-faf5bd15-d7df-4fd7-8035-ab8cb3d2da0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:40.483814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-f8e29a44-5f90-4bf7-b3c4-7a2fd03dc2a0 req-faf5bd15-d7df-4fd7-8035-ab8cb3d2da0e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.496675 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-f8e29a44-5f90-4bf7-b3c4-7a2fd03dc2a0 req-faf5bd15-d7df-4fd7-8035-ab8cb3d2da0e service nova] Creating event network-vif-plugged:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h2-858129-2 Sep 16 15:02:40.501968 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-f8e29a44-5f90-4bf7-b3c4-7a2fd03dc2a0 req-faf5bd15-d7df-4fd7-8035-ab8cb3d2da0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095836 Sep 16 15:02:40.502633 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3709/7115] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:02:40.508027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:40.508835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:40.522814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:40.523338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:40.523787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.524519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:40.525016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:40.525459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:40.528517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:40.751039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:40.759542 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0e082a2-53e9-4966-8f96-d9ec428918a1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1664 microversion: 2.1 time: 0.255728 Sep 16 15:02:40.760135 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3710/7116] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:40 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1664 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:02:41.783569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:41.784273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:41.792074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:41.792598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:41.793056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:41.793809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:41.794289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:41.794782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:41.936447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:41.944421 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99c55bc7-866d-4564-8789-d498bc901163 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1668 microversion: 2.1 time: 0.164916 Sep 16 15:02:41.945007 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3711/7117] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:41 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:41.967386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:41.967917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:41.974347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:41.975177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:41.975599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:41.976316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:41.976792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:41.977280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:42.002123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:02:42.086120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e9753ac-8c35-49a3-9a9d-77e06822b713 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 204 len: 0 microversion: 2.1 time: 0.121958 Sep 16 15:02:42.086776 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3712/7118] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:02:41 2022] DELETE /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:02:42.095245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:42.095966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:42.102825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:42.103326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:42.103784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:42.104489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:42.104962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:42.105405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:42.237331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:42.245309 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af7270e4-4ed8-404a-8e90-5682f5905787 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1674 microversion: 2.1 time: 0.154168 Sep 16 15:02:42.245894 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3713/7119] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:42 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:43.269134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:43.269808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:43.276764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:43.277269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:43.277727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:43.278473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:43.278956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:43.279405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:43.416906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:43.424726 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65928346-8723-4b13-8e71-cbfc418b5f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1674 microversion: 2.1 time: 0.159570 Sep 16 15:02:43.425302 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3714/7120] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:43 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:44.448899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:44.449669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:44.456960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:44.457478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:44.458154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:44.458924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:44.459405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:44.460057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:44.537074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:44.548927 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8f41a9d-58c6-4bd5-aa3f-3dce7ce1c79b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 200 len: 1607 microversion: 2.1 time: 0.104024 Sep 16 15:02:44.549523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3715/7121] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:44 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 1607 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:44.555054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a08e9ba1-d126-4f39-a7be-d986d532d070 req-cce8607f-530d-4749-ba70-d2945ad0d1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9b423d-f9d1-45cf-91d4-13bfa289aef4", "name": "network-vif-deleted", "tag": "908fe793-d442-4b33-b0dc-c40c4249af38"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:44.565490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a08e9ba1-d126-4f39-a7be-d986d532d070 req-cce8607f-530d-4749-ba70-d2945ad0d1eb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:44.566375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a08e9ba1-d126-4f39-a7be-d986d532d070 req-cce8607f-530d-4749-ba70-d2945ad0d1eb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:44.567113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a08e9ba1-d126-4f39-a7be-d986d532d070 req-cce8607f-530d-4749-ba70-d2945ad0d1eb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:44.579002 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a08e9ba1-d126-4f39-a7be-d986d532d070 req-cce8607f-530d-4749-ba70-d2945ad0d1eb service nova] Creating event network-vif-deleted:908fe793-d442-4b33-b0dc-c40c4249af38 for instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 on n-h2-858129-2 Sep 16 15:02:44.584209 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a08e9ba1-d126-4f39-a7be-d986d532d070 req-cce8607f-530d-4749-ba70-d2945ad0d1eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033202 Sep 16 15:02:44.584841 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3716/7122] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:02:45.577426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:45.578142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:45.585552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:45.585854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:45.586315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:45.587027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:45.587515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:45.587954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:45.601876 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 HTTP/1.1 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '6c9b423d-f9d1-45cf-91d4-13bfa289aef4'} Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:02:45.603562 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f39915a-7607-4857-9a07-d1ff9e583f73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 404 len: 111 microversion: 2.1 time: 0.032814 Sep 16 15:02:45.608622 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3717/7123] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:45 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:02:45.621592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:45.622216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:45.628170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:45.628670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:45.629751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:45.630484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:45.630959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:45.631398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:45.647541 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 HTTP/1.1 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '6c9b423d-f9d1-45cf-91d4-13bfa289aef4'} Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:02:45.649075 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1adea2ca-1170-4ab7-afb9-80100d326bb3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 404 len: 111 microversion: 2.1 time: 0.032618 Sep 16 15:02:45.653911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3718/7124] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:45 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:02:45.701138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1099540598", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "fa0fd5eb-a331-4d0b-8412-424197c74892"}], "security_groups": [{"name": "tempest-securitygroup--341516162"}], "key_name": "tempest-keypair-848027665", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:45.810731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] validate_networks() for [('fa0fd5eb-a331-4d0b-8412-424197c74892', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:02:46.235667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:02:46.235993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:02:46.236520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:02:46.237083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:02:46.237528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:02:46.240270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:46.248787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:46.249291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:46.249779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:46.250567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:46.251048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:46.251495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:46.268936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:02:46.274242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:02:46.287301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:02:46.289717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:02:46.338116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dbbdacd5-af98-419b-b0a2-e627661f8634 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.640962 Sep 16 15:02:46.338833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3719/7125] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:02:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 15:02:46.351248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-782d4ae9-5f14-483e-b937-9aa862749d73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:46.351886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-782d4ae9-5f14-483e-b937-9aa862749d73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:46.414842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-782d4ae9-5f14-483e-b937-9aa862749d73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:46.422922 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-782d4ae9-5f14-483e-b937-9aa862749d73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1238 microversion: 2.1 time: 0.076581 Sep 16 15:02:46.426635 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3720/7126] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:46 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:47.446357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:47.447058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:47.455657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:47.456161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:47.456612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:47.457354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:47.457826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:47.458263 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:47.530144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:47.538810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a52ead07-1507-40ab-a10b-ef59a8e3642a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1298 microversion: 2.1 time: 0.096411 Sep 16 15:02:47.539593 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3721/7127] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:47 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:48.563457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:48.564120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:48.571893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:48.572411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:48.572872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:48.573643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:48.574129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:48.575193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:48.822351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:48.830603 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-931de985-9080-4d5c-88c2-16d2521859e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.271063 Sep 16 15:02:48.831195 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3722/7128] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:48 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:49.327922 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:02:49.328450 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:02:49.340026 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:02:49.340202 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:02:49.343715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b0fc57bf-c663-4d3b-89d9-fc234191244c req-d78fd0ce-0c6c-4323-9b2e-9573fffa88d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:49.359341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b0fc57bf-c663-4d3b-89d9-fc234191244c req-d78fd0ce-0c6c-4323-9b2e-9573fffa88d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:49.359761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b0fc57bf-c663-4d3b-89d9-fc234191244c req-d78fd0ce-0c6c-4323-9b2e-9573fffa88d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:49.360214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b0fc57bf-c663-4d3b-89d9-fc234191244c req-d78fd0ce-0c6c-4323-9b2e-9573fffa88d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:49.372100 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b0fc57bf-c663-4d3b-89d9-fc234191244c req-d78fd0ce-0c6c-4323-9b2e-9573fffa88d6 service nova] Creating event network-changed:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h1-858129-2 Sep 16 15:02:49.378416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b0fc57bf-c663-4d3b-89d9-fc234191244c req-d78fd0ce-0c6c-4323-9b2e-9573fffa88d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041320 Sep 16 15:02:49.379690 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3723/7129] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:02:49.855821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:49.856679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:49.866628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:49.867305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:49.867937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:49.868862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:49.869579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:49.870299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:50.005436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:50.013177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2835fb6e-d795-4362-8644-472d2ccc623d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.162281 Sep 16 15:02:50.013768 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3724/7130] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:49 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:51.036660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:51.037293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:51.044310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:51.044808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:51.045259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:51.045965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:51.046457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:51.046898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:51.181337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:51.189384 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a49c9097-a536-4286-98b4-e38bb8f937e6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.156737 Sep 16 15:02:51.189965 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3725/7131] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:51 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:52.213772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:52.214509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:52.221525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:52.222030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:52.222512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:52.223233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:52.223706 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:52.224153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:52.371945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:52.380720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ccbc9d7-624e-4360-9a07-52b9903f6ce6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.170782 Sep 16 15:02:52.381332 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3726/7132] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:52 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:53.404132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:53.404855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:53.413510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:53.414016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:53.414502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:53.415238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:53.415716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:53.416166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:53.552219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:53.560192 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f902ffa5-dd75-4d0f-bfae-604e226f9a11 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.159940 Sep 16 15:02:53.560806 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3727/7133] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:53 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:54.568558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-05c45bb5-6a38-4f26-ab51-77b0930dc084 req-11402a2a-10ff-4a56-af6f-8121150bf440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "name": "network-vif-plugged", "status": "completed", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:54.578990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-05c45bb5-6a38-4f26-ab51-77b0930dc084 req-11402a2a-10ff-4a56-af6f-8121150bf440 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:54.579489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-05c45bb5-6a38-4f26-ab51-77b0930dc084 req-11402a2a-10ff-4a56-af6f-8121150bf440 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:54.580233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-05c45bb5-6a38-4f26-ab51-77b0930dc084 req-11402a2a-10ff-4a56-af6f-8121150bf440 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:54.591718 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-05c45bb5-6a38-4f26-ab51-77b0930dc084 req-11402a2a-10ff-4a56-af6f-8121150bf440 service nova] Creating event network-vif-plugged:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h1-858129-2 Sep 16 15:02:54.596561 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-05c45bb5-6a38-4f26-ab51-77b0930dc084 req-11402a2a-10ff-4a56-af6f-8121150bf440 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Sep 16 15:02:54.597334 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3728/7134] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:02:54.603242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:54.604036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:54.610308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:54.610839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:54.611284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:54.611993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:54.612460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:54.612895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:54.796245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:54.804420 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f95473c-ebfd-4500-bc75-7e572f18a915 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.205506 Sep 16 15:02:54.805011 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3729/7135] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:54 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:02:55.828647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:55.829328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:55.836363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:55.836874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:55.837331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:55.838054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:55.838605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:55.839072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:55.841848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:55.975808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:55.983724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca047aaf-4aeb-41eb-a718-832e00be44e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1363 microversion: 2.1 time: 0.159083 Sep 16 15:02:55.984310 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3730/7136] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:55 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:57.008810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:57.009563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:57.011269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:57.012128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:02:57.019170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:57.020215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:57.020677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:57.021465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:57.021948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:57.022415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:57.151759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:02:57.159821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-223777f9-7b56-4ee9-9e1c-54ca66d9e216 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1550 microversion: 2.1 time: 0.155448 Sep 16 15:02:57.160979 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3731/7137] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:02:57 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:02:57.184879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:02:57.185389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:02:57.192048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:57.192550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:57.193004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:57.193718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:57.194210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:57.194672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:57.274132 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8a880c24-7138-45b9-970c-7fb0294ee57f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093127 Sep 16 15:02:57.274809 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3732/7138] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 15:02:57 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:02:58.234495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1f04ebd7-69f9-4000-9472-1e645d825d3d req-3be73e76-63bc-4cb2-b288-9a03f624be87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:02:58.244470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1f04ebd7-69f9-4000-9472-1e645d825d3d req-3be73e76-63bc-4cb2-b288-9a03f624be87 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:02:58.245011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1f04ebd7-69f9-4000-9472-1e645d825d3d req-3be73e76-63bc-4cb2-b288-9a03f624be87 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:02:58.245464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1f04ebd7-69f9-4000-9472-1e645d825d3d req-3be73e76-63bc-4cb2-b288-9a03f624be87 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:02:58.258757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1f04ebd7-69f9-4000-9472-1e645d825d3d req-3be73e76-63bc-4cb2-b288-9a03f624be87 service nova] Creating event network-changed:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h1-858129-2 Sep 16 15:02:58.264184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1f04ebd7-69f9-4000-9472-1e645d825d3d req-3be73e76-63bc-4cb2-b288-9a03f624be87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Sep 16 15:02:58.265077 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3733/7139] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:04:10.480220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:10.481010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=17 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:10.542579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:10.545203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:10.551553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:10.552568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:10.553038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:10.553755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:10.554236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:10.554729 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:10.587594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:10.593101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 15:04:10.599779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:04:10.600218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:04:10.600987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:04:10.601421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:04:10.601856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:04:10.666593 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4cc6c6eb-bb48-40d4-96c9-9643020b0cd1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238/action" status: 202 len: 0 microversion: 2.1 time: 0.189111 Sep 16 15:04:10.667232 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3734/7140] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:04:10 2022] POST /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:04:10.675219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:10.675850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:10.682670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:10.683186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:10.683650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:10.684375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:10.684851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:10.685307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:10.848315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:10.856944 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c22dbabe-6701-42da-a36c-0ed6b40eabd9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1678 microversion: 2.1 time: 0.185523 Sep 16 15:04:10.858434 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3735/7141] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:10 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:11.881881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:11.882596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:11.889503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:11.890002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:11.890475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:11.891185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:11.891654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:11.892096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:12.403064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:12.411119 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-43aecac8-6634-4f9d-97c6-1240c7b1397a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1678 microversion: 2.1 time: 0.533633 Sep 16 15:04:12.412407 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3736/7142] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:11 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1678 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:13.436270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:13.436889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:13.444485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:13.444998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:13.445461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:13.446187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:13.446692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:13.447145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:13.578104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:13.586419 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e38b824-f422-4486-883b-c1dbedf1ddd0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.154153 Sep 16 15:04:13.587029 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3737/7143] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:13 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:14.611131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:14.611885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:14.618515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:14.619011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:14.619456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:14.620155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:14.620647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:14.621088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:14.763805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:14.772319 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-823c25c0-47dc-4a53-ab32-8ba1c31c66c8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.165219 Sep 16 15:04:14.773238 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3738/7144] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:14 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:15.796484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:15.797153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:15.804656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:15.805163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:15.805622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:15.806356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:15.806843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:15.807293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:15.940065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:15.948188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1cb83c97-0b7d-42d2-b98d-34221de6fd6e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.155560 Sep 16 15:04:15.948768 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3739/7145] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:15 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:16.976498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:16.977180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:16.984279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:16.984792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:16.985253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:16.985974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:16.986478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:16.986927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:17.118413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:17.126259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c373342c-46b5-46bc-a56b-b3e4a55739bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.156937 Sep 16 15:04:17.126888 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3740/7146] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:16 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:18.149658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:18.150291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:18.157187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:18.157686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:18.158138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:18.158882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:18.159360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:18.159804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:18.293484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:18.304602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1f08fb0e-c23b-4364-b8cf-635c44888718 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.158829 Sep 16 15:04:18.305196 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3741/7147] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:18 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:19.327869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:19.328494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:19.335407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:19.335937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:19.336389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:19.337102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:19.337577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:19.338021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:19.467655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:19.475845 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9a69458-356f-4aaf-86a8-c3ffbe30c4ec tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.151601 Sep 16 15:04:19.476437 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3742/7148] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:19 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:20.499943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:20.500615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:20.508215 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:20.508722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:20.509182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:20.509899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:20.510380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:20.510858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:20.651847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:20.659665 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0e2dac56-4d24-43c9-a5a4-0f968559d25a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.163739 Sep 16 15:04:20.660234 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3743/7149] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:20 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:21.684196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:21.684830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:21.691642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:21.692144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:21.692604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:21.693310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:21.693790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:21.694235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:21.826620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:21.834482 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea9d79ee-8fc3-4def-8571-6aa3341c7b50 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.154346 Sep 16 15:04:21.835086 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3744/7150] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:21 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:22.857791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:22.858574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:22.865372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:22.865872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:22.866328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:22.867063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:22.867535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:22.867976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:23.002020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:23.010834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7e08e005-3448-4ada-bc15-a89a8d15256b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.157164 Sep 16 15:04:23.011448 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3745/7151] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:22 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:24.034598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:24.035328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:24.042860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:24.043364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:24.043821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:24.044538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:24.045018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:24.045473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:24.183591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:24.191412 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82c22dca-0fa7-425b-a800-cef56d7e5267 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.160849 Sep 16 15:04:24.191991 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3746/7152] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:24 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:25.214750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:25.215414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:25.222203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:25.222743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:25.223208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:25.223923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:25.224408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:25.224860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:25.356089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:25.363951 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-84147fa1-9fc3-401c-8948-257403b0d60c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.153249 Sep 16 15:04:25.364541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3747/7153] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:25 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:26.388099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:26.388744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:26.395654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:26.396753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:26.397218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:26.397933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:26.398428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:26.398874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:26.531599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:26.540030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97896d75-6f61-45da-b792-2e8b1a7208fa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.155901 Sep 16 15:04:26.540616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3748/7154] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:26 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:27.564621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:27.565252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:27.572783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:27.573271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:27.573728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:27.574469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:27.574947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:27.575393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:27.579403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:27.716006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:27.723998 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-efe4039a-2a7c-4f34-af2a-d79f03a454c6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.163387 Sep 16 15:04:27.724590 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3749/7155] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:27 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:28.748378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:28.749030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:28.755995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:28.756502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:28.756962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:28.757699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:28.758156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:28.758632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:28.891046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:28.899030 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d37d9c7-3ad0-4f6a-8215-145a0b23b645 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.155411 Sep 16 15:04:28.899613 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3750/7156] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:28 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:29.922659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:29.923351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:29.930288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:29.930827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:29.931792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:29.932502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:29.932974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:29.933419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:30.107723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:30.115942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7f4b42f-1afb-4cca-a8fb-ae10853ff824 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1683 microversion: 2.1 time: 0.197483 Sep 16 15:04:30.116532 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3751/7157] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:29 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:30.714590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "name": "network-vif-unplugged", "status": "completed", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:30.725246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:30.725855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:30.726150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:30.740492 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] Creating event network-vif-unplugged:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h2-858129-2 Sep 16 15:04:30.746186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] Instance 55d6f628-b998-49cb-bd56-2afe40d19238 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:04:30.757987 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-620428af-f2c4-4630-a509-7bb5fa2340c7 req-f229b34e-3750-4336-a62f-3e3a327cad20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047662 Sep 16 15:04:30.758655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3752/7158] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:04:31.142223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:31.143013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:31.152492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:31.152996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:31.153627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:31.154716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:31.155689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:31.156152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:31.396587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:31.405661 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7b8e9860-b663-410f-8593-437dcaf7655f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1682 microversion: 2.1 time: 0.268760 Sep 16 15:04:31.406331 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3753/7159] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:31 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1682 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:04:32.429347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:32.430021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:32.437121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:32.437908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:32.438370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:32.439125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:32.439598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:32.440041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:32.577616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:32.585587 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a1086a7d-b198-4082-bc83-33b3a458ff4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1680 microversion: 2.1 time: 0.160205 Sep 16 15:04:32.586186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3754/7160] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:32 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:04:32.800680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:32.815739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:32.816245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:32.816719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:32.830524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] Creating event network-changed:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h2-858129-2 Sep 16 15:04:32.836671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] Instance 55d6f628-b998-49cb-bd56-2afe40d19238 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:04:32.847876 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-17ce8775-a0b3-4229-98af-546a91941d4c req-b39b47bd-be99-4822-a64b-5339b2764ecd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054734 Sep 16 15:04:32.848506 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3755/7161] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:04:33.611955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:33.612858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:33.618813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:33.619319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:33.619778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:33.620487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:33.620960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:33.621405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:33.766745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:33.775343 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0c52131-f634-4599-a525-c43381b18b98 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1680 microversion: 2.1 time: 0.168086 Sep 16 15:04:33.775921 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3756/7162] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:33 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:04:34.803862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:34.806844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:34.819806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:34.820732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:34.821566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:34.822914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:34.824166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:34.824949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.077371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:35.085137 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f245dc44-b735-4cca-869f-643df63b52ba tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1677 microversion: 2.1 time: 0.289469 Sep 16 15:04:35.085736 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3757/7163] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:34 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:04:35.109749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:35.110479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:35.116534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:35.117050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:35.117507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.118272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:35.118724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:35.119176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.162610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:35.163129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:35.163572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.164308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:35.164772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:35.165852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.186621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:04:35.191746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:04:35.291386 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24d1a259-96e8-4f5f-976d-03442956fb6a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238/action" status: 202 len: 0 microversion: 2.1 time: 0.184976 Sep 16 15:04:35.292179 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3758/7164] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:04:35 2022] POST /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:04:35.300550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:35.301267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:35.307889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:35.308383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:35.308829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.309544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:35.310014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:35.310474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:35.532678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:35.540601 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ea007e0c-1e73-49a9-96d2-ad32f23abcfa tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.244155 Sep 16 15:04:35.541189 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3759/7165] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:35 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:36.563882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:36.564534 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:36.571343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:36.572446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:36.572898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:36.573608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:36.574078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:36.574549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:36.708118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:36.716411 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-313501cb-35c4-4e8d-b2bb-31d7b1cc9ad1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.156560 Sep 16 15:04:36.716994 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3760/7166] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:36 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:37.740443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:37.741120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:37.748573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:37.749075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:37.749531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:37.750240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:37.750742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:37.751186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:37.889210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:37.896993 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0fff9f8-8356-4e43-bb35-19e01ed60b1e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.160615 Sep 16 15:04:37.897577 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3761/7167] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:37 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:38.919949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:38.920731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:38.929228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:38.929836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:38.930574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:38.931926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:38.932496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:38.933017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:39.454465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:39.462983 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5810ca77-e447-424e-a652-3de063ab6069 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.547126 Sep 16 15:04:39.463583 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3762/7168] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:38 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:39.612594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:39.622493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:39.623255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:39.623409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:39.639418 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] Creating event network-changed:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h1-858129-2 Sep 16 15:04:39.642228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:39.645797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] Instance 55d6f628-b998-49cb-bd56-2afe40d19238 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:04:39.658431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ca3c657a-6503-47cb-b5da-c2f45717c259 req-6f3ae2f2-33d5-4050-981a-55825aa1be44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049410 Sep 16 15:04:39.659246 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3763/7169] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:04:40.492862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:40.494119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:40.496419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:40.503821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:40.504350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:40.504873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:40.505638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:40.506120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:40.506598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:40.647910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:40.655914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf8d11dd-d511-4f69-bfb3-1c1e1f1c505f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.171457 Sep 16 15:04:40.656416 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3764/7170] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:40 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:41.679731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:41.680373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:41.687838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:41.688348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:41.688808 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:41.689512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:41.690014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:41.690490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:41.822738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:41.830645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85ad6823-eca4-46af-b15d-e528c07f90c1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.154873 Sep 16 15:04:41.831233 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3765/7171] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:41 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:42.863945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:42.864692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:42.875634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:42.876211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:42.876680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:42.877489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:42.878020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:42.878499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:43.088217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:43.096683 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2dd27d0f-6dfb-4f30-8ace-8ec52d7d9e9a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1676 microversion: 2.1 time: 0.246590 Sep 16 15:04:43.097309 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3766/7172] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:42 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:44.121197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:44.121839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:44.128768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.129279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.129737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.130479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.130962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.131412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.261331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:44.269367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-42c5fa71-b3b0-4fbf-9322-27828f70ea80 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1669 microversion: 2.1 time: 0.152733 Sep 16 15:04:44.269953 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3767/7173] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:44 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:44.291553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:44.292183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:44.298233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.298857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.299308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.300045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.300516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.300965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.439857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:44.448540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9f39e04a-9fa0-4e05-8c8b-da59a7510841 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1669 microversion: 2.1 time: 0.160747 Sep 16 15:04:44.449134 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3768/7174] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:44 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:44.470311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:44.470975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:44.477192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.478202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.478683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.479401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.479875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.480319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.608190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:44.616029 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d419457c-21f8-4f48-aa12-d973e66899b3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1669 microversion: 2.1 time: 0.149442 Sep 16 15:04:44.616605 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3769/7175] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:44 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:44.638332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:44.638789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:44.644597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.645096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.645547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.646248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.646750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.647185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.675464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:04:44.754768 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1c89115-6969-4ab8-be85-376e4e280a90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 204 len: 0 microversion: 2.1 time: 0.119450 Sep 16 15:04:44.755523 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3770/7176] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:04:44 2022] DELETE /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:04:44.765801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:44.766745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:44.772759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.773899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.774891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.775753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.776354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.776812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.911539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:44.921018 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d30173b6-687e-4b33-9552-99246cb245a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1675 microversion: 2.1 time: 0.160710 Sep 16 15:04:44.921891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3771/7177] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:44 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:04:44.934169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-dc583b45-a6ad-46c4-a981-a978e5a8a776 req-56e3b57b-1500-4e96-9b98-1f33a0fcebc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "name": "network-vif-plugged", "status": "completed", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:44.943726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dc583b45-a6ad-46c4-a981-a978e5a8a776 req-56e3b57b-1500-4e96-9b98-1f33a0fcebc8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:44.944223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dc583b45-a6ad-46c4-a981-a978e5a8a776 req-56e3b57b-1500-4e96-9b98-1f33a0fcebc8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:44.944660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-dc583b45-a6ad-46c4-a981-a978e5a8a776 req-56e3b57b-1500-4e96-9b98-1f33a0fcebc8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:44.956659 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-dc583b45-a6ad-46c4-a981-a978e5a8a776 req-56e3b57b-1500-4e96-9b98-1f33a0fcebc8 service nova] Creating event network-vif-plugged:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h1-858129-2 Sep 16 15:04:44.962265 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-dc583b45-a6ad-46c4-a981-a978e5a8a776 req-56e3b57b-1500-4e96-9b98-1f33a0fcebc8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031677 Sep 16 15:04:44.962984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3772/7178] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:04:45.943364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:45.948956 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:45.949684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:45.956268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:45.956774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:45.957232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:45.957950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:45.958436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:45.958884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:46.099043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:46.107310 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-187cab3a-45fe-4018-bbfe-952e0ccd3bb4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1675 microversion: 2.1 time: 0.165436 Sep 16 15:04:46.107896 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3773/7179] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:45 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:47.130819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:47.131463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:47.139479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:47.139479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:47.139973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:47.140710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:47.141190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:47.141636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:47.217367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:47.228783 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-497b8a0f-9575-4b25-8edb-4ccb5a3d21f5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 200 len: 1608 microversion: 2.1 time: 0.100362 Sep 16 15:04:47.238967 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3774/7180] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:47 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 1608 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:47.302547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-23b60b59-fde6-426c-abd7-7811a3193b05 req-1238675e-e1ef-4b4a-827c-585c9d9bbdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d6f628-b998-49cb-bd56-2afe40d19238", "name": "network-vif-deleted", "tag": "a83a9838-7ea2-4c03-b606-e4185ed22ec4"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:47.313191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-23b60b59-fde6-426c-abd7-7811a3193b05 req-1238675e-e1ef-4b4a-827c-585c9d9bbdbe service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:47.313689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-23b60b59-fde6-426c-abd7-7811a3193b05 req-1238675e-e1ef-4b4a-827c-585c9d9bbdbe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:47.314164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-23b60b59-fde6-426c-abd7-7811a3193b05 req-1238675e-e1ef-4b4a-827c-585c9d9bbdbe service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:47.326225 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-23b60b59-fde6-426c-abd7-7811a3193b05 req-1238675e-e1ef-4b4a-827c-585c9d9bbdbe service nova] Creating event network-vif-deleted:a83a9838-7ea2-4c03-b606-e4185ed22ec4 for instance 55d6f628-b998-49cb-bd56-2afe40d19238 on n-h1-858129-2 Sep 16 15:04:47.331605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-23b60b59-fde6-426c-abd7-7811a3193b05 req-1238675e-e1ef-4b4a-827c-585c9d9bbdbe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033914 Sep 16 15:04:47.332539 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3775/7181] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:04:48.254927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:48.255676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:48.262198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:48.262673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:48.263135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:48.263866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:48.264345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:48.264816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:48.279096 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 HTTP/1.1 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '55d6f628-b998-49cb-bd56-2afe40d19238'} Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:04:48.280952 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:04:48.285846 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c62b43d-50e3-4554-a2c2-31feff131e66 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 404 len: 111 microversion: 2.1 time: 0.032810 Sep 16 15:04:48.286553 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3776/7182] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:48 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:04:48.302833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:48.304085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:48.310247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:48.311256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:48.311817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:48.312555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:48.313038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:48.313495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:48.327916 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 HTTP/1.1 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '55d6f628-b998-49cb-bd56-2afe40d19238'} Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:04:48.330185 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-38eced26-06ea-401b-a564-1874958b3f28 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 404 len: 111 microversion: 2.1 time: 0.033431 Sep 16 15:04:48.334791 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3777/7183] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:48 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:04:48.382368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-351533950", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "fa0fd5eb-a331-4d0b-8412-424197c74892"}], "security_groups": [{"name": "tempest-securitygroup--341516162"}], "key_name": "tempest-keypair-848027665", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:48.497577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] validate_networks() for [('fa0fd5eb-a331-4d0b-8412-424197c74892', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:04:48.871576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:04:48.872057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:04:48.872607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:04:48.873074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:04:48.873666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:04:48.882711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:48.883239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:48.884259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:48.885014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:48.885495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:48.885942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:48.903459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:04:48.908755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:04:48.921275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:04:48.923647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:04:48.971113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8499c0f9-898b-4207-bcc3-4d251a1c1a73 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.593363 Sep 16 15:04:48.971765 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3778/7184] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:04:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 15:04:48.983326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7bdfbe11-f071-40be-91d8-fe52d2649fd2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:48.983960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7bdfbe11-f071-40be-91d8-fe52d2649fd2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:49.039155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7bdfbe11-f071-40be-91d8-fe52d2649fd2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:49.046429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7bdfbe11-f071-40be-91d8-fe52d2649fd2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1237 microversion: 2.1 time: 0.066789 Sep 16 15:04:49.047032 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3779/7185] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:48 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:50.069271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:50.070011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:50.078707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:50.079245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:50.079886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:50.080885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:50.082045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:50.082526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:50.163475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:50.172539 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-869a9d3f-b98f-4626-b849-43848359a6a2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1297 microversion: 2.1 time: 0.107130 Sep 16 15:04:50.173347 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3780/7186] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:50 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:51.197790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:51.198477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:51.205767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:51.206286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:51.206776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:51.207503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:51.208174 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:51.208635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:51.433186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:51.442638 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d44e4626-4100-4054-ad59-df72294d7e05 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.249829 Sep 16 15:04:51.443251 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3781/7187] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:51 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:51.667042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b6c092d7-3a03-4c64-8565-518b4774d7be req-7fc3ea6f-8cfe-4b4f-9126-5518d0613d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:51.677975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b6c092d7-3a03-4c64-8565-518b4774d7be req-7fc3ea6f-8cfe-4b4f-9126-5518d0613d5c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:51.678542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b6c092d7-3a03-4c64-8565-518b4774d7be req-7fc3ea6f-8cfe-4b4f-9126-5518d0613d5c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:51.679205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b6c092d7-3a03-4c64-8565-518b4774d7be req-7fc3ea6f-8cfe-4b4f-9126-5518d0613d5c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:51.691938 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b6c092d7-3a03-4c64-8565-518b4774d7be req-7fc3ea6f-8cfe-4b4f-9126-5518d0613d5c service nova] Creating event network-changed:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:04:51.697137 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b6c092d7-3a03-4c64-8565-518b4774d7be req-7fc3ea6f-8cfe-4b4f-9126-5518d0613d5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034679 Sep 16 15:04:51.697801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3782/7188] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:04:52.467991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:52.468643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:52.475028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:52.475539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:52.476265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:52.476977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:52.477455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:52.477903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:52.620420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:52.624091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:52.629788 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96ed7475-c422-4ef4-aa01-2d7e74196fb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.167063 Sep 16 15:04:52.630373 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3783/7189] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:52 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:53.654299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:53.654993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:53.663142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:53.663648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:53.664106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:53.664819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:53.665804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:53.666247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:53.795937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:53.803785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5364656a-4c3a-47bc-a78d-772bb93748e4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.154464 Sep 16 15:04:53.804368 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3784/7190] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:53 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:54.831488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:54.832169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:54.839227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:54.839773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:54.840231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:54.840961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:54.841434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:54.841909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:55.052971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:55.062177 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-da23097e-edd3-41be-88a7-6d0ddab0d613 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.234765 Sep 16 15:04:55.063024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3785/7191] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:54 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:56.087010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:56.087701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:56.094632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:56.095136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:56.095591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:56.096303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:56.096778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:56.097225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:56.230739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:56.238584 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-970fe79b-2d51-427e-9df5-62cad1a81562 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.155487 Sep 16 15:04:56.239194 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3786/7192] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:56 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:57.262186 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:57.262876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:57.269765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:57.270261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:57.270738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:57.271447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:57.271908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:57.272344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:57.411943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:57.420021 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eb0a3936-6553-42dd-9dbe-2db3a7656466 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.161798 Sep 16 15:04:57.420838 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3787/7193] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:57 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:58.444635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:58.445276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:58.452684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:58.453199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:58.453656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:58.454381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:58.454883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:58.455332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:58.588221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:58.596197 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c8fa9901-46fc-4007-90dc-1d9a559b146d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.155810 Sep 16 15:04:58.596775 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3788/7194] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:58 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:04:59.029995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-db268ccf-8683-447a-84fe-671b6e70a01c req-689537c0-50bf-4fb0-9a2b-086d4509e3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "name": "network-vif-plugged", "status": "completed", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:04:59.035051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:59.041314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-db268ccf-8683-447a-84fe-671b6e70a01c req-689537c0-50bf-4fb0-9a2b-086d4509e3cf service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:59.041823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-db268ccf-8683-447a-84fe-671b6e70a01c req-689537c0-50bf-4fb0-9a2b-086d4509e3cf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:59.042276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-db268ccf-8683-447a-84fe-671b6e70a01c req-689537c0-50bf-4fb0-9a2b-086d4509e3cf service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:59.046870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:04:59.054671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-db268ccf-8683-447a-84fe-671b6e70a01c req-689537c0-50bf-4fb0-9a2b-086d4509e3cf service nova] Creating event network-vif-plugged:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:04:59.060218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-db268ccf-8683-447a-84fe-671b6e70a01c req-689537c0-50bf-4fb0-9a2b-086d4509e3cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Sep 16 15:04:59.060833 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3789/7195] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:04:59.621484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:04:59.622296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:04:59.629560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:59.630146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:59.630649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:59.631378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:04:59.631889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:04:59.632307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:04:59.767692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:04:59.775694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8046a6cb-6321-4cd6-81d8-36c7011517e3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1362 microversion: 2.1 time: 0.159454 Sep 16 15:04:59.776276 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3790/7196] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:04:59 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:05:00.799490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:05:00.800233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:05:00.807311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:05:00.807903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:05:00.808364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:05:00.809112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:05:00.809593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:05:00.810055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:05:00.943439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:05:00.951849 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4febc3d-c9cf-4d0b-a4a7-ee9910d1d568 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1548 microversion: 2.1 time: 0.156511 Sep 16 15:05:00.952428 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3791/7197] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:05:00 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:05:00.975222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:05:00.976159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:05:00.982246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:05:00.982797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:05:00.983258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:05:00.983971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:05:00.984448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:05:00.984892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:05:01.065942 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96978ac0-f73f-49ea-aa45-7e60f11f672c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094451 Sep 16 15:05:01.066592 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3792/7198] 10.222.0.60 () {58 vars in 1275 bytes} [Fri Sep 16 15:05:00 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:05:02.007860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-11f9d972-9972-4577-8356-9cf68cd2b792 req-367fd89e-59c7-4aa3-ba35-f8c396643ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:05:02.017697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-11f9d972-9972-4577-8356-9cf68cd2b792 req-367fd89e-59c7-4aa3-ba35-f8c396643ac7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:05:02.018193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-11f9d972-9972-4577-8356-9cf68cd2b792 req-367fd89e-59c7-4aa3-ba35-f8c396643ac7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:05:02.018661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-11f9d972-9972-4577-8356-9cf68cd2b792 req-367fd89e-59c7-4aa3-ba35-f8c396643ac7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:05:02.037582 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-11f9d972-9972-4577-8356-9cf68cd2b792 req-367fd89e-59c7-4aa3-ba35-f8c396643ac7 service nova] Creating event network-changed:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:05:02.045798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-11f9d972-9972-4577-8356-9cf68cd2b792 req-367fd89e-59c7-4aa3-ba35-f8c396643ac7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042396 Sep 16 15:05:02.046736 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3793/7199] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:05:45.580182 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:05:45.580816 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:06:09.337985 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:06:09.338825 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:06:09.350056 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:06:09.350224 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:06:17.113563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:06:17.114279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=50 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:06:17.115787 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:06:17.115945 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:06:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 (ip 10.222.0.60) !!! Sep 16 15:06:17.121276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:17.121981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:17.130964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:17.131476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:17.131935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:17.132652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:17.133136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:17.133586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:17.328336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:17.336166 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57cc318a-d565-4c19-9689-881d48b81702 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1667 microversion: 2.1 time: 0.225022 Sep 16 15:06:17.336759 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3794/7200] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:17 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1667 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:17.359847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "011a90e4-8bde-490e-a074-baff4af9f4c0"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:06:17.362145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:17.367949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:17.368451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:17.368897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:17.369598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:17.370065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:17.370541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:17.634191 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9dd6571-7711-4798-8485-3309772e8292 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277952 Sep 16 15:06:17.634976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3795/7201] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 15:06:17 2022] POST /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:06:28.371622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:06:28.372662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:06:28.377144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:06:28.379671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:28.387203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:28.387718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:28.388181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:28.388897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:28.389373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:28.389819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:28.431119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:28.437780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 15:06:28.444869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:06:28.445341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:06:28.445833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:06:28.446257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:06:28.446704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:06:28.511499 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-163e9047-9e59-4efb-a0ce-ec4193b49ed3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/action" status: 202 len: 0 microversion: 2.1 time: 0.142606 Sep 16 15:06:28.512177 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3796/7202] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:06:28 2022] POST /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:06:28.521104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:28.521756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:28.528535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:28.529065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:28.529528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:28.530254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:28.530779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:28.531229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:28.693915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:28.703450 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a5fb29d-1cba-4949-9963-a7aefd5b40df tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1722 microversion: 2.1 time: 0.186239 Sep 16 15:06:28.704047 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3797/7203] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:28 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:29.727626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:29.728320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:29.735547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:29.736063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:29.736523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:29.737252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:29.737730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:29.738176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:29.877159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:29.886524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-534df5df-7553-46c3-8ab1-4f28f31a53a5 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1722 microversion: 2.1 time: 0.163058 Sep 16 15:06:29.887678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3798/7204] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:29 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:30.912321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:30.913017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:30.920762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:30.921275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:30.921736 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:30.922510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:30.922991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:30.923440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:31.060052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:31.068490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0428abf2-acb1-4938-8ed6-3dd79019c0f6 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.160164 Sep 16 15:06:31.069210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3799/7205] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:30 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:06:32.093087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:32.093780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:32.100829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:32.101352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:32.102078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:32.102958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:32.103436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:32.103883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:32.239415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:32.248832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d5d0356-ed3f-4097-aea2-486596a0aacd tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.160211 Sep 16 15:06:32.249423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3800/7206] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:32 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:33.272563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:33.273209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:33.280695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:33.281191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:33.281636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:33.282343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:33.282836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:33.283275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:33.419950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:33.428403 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b2640839-f5e2-4003-9403-ceb739f621bf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.159798 Sep 16 15:06:33.428976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3801/7207] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:33 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:34.451905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:34.452592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:34.459487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:34.459988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:34.460438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:34.461178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:34.461640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:34.462080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:34.599730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:34.610574 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-003f08a7-96a6-4fb7-8947-44ea4ccbdc5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.162691 Sep 16 15:06:34.611172 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3802/7208] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:34 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:35.634238 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:35.634902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:35.641685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:35.642191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:35.642681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:35.643393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:35.643929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:35.644379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:35.775370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:35.784950 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb7958b8-d405-44c5-983f-a1bc90fedf4a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.153821 Sep 16 15:06:35.784950 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3803/7209] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:35 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:36.808807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:36.809489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:36.816795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:36.817340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:36.817851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:36.818630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:36.819103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:36.819551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:36.961801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:36.970567 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d8aa410-12fe-4d27-877d-d5b56c4db959 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.165898 Sep 16 15:06:36.971144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3804/7210] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:36 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:37.995376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:37.996059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:38.003546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:38.004047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:38.004497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:38.005209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:38.005683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:38.006128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:38.137686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:38.146431 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b938bd9-9b6b-4c09-942f-e12edf0f5c21 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.155093 Sep 16 15:06:38.147041 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3805/7211] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:37 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:39.170176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:39.170972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:39.178198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:39.178735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:39.179185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:39.179913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:39.180387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:39.180870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:39.319550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:39.328511 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ee17b19-4a63-4b8c-a470-382aa3becbb1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.162416 Sep 16 15:06:39.329088 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3806/7212] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:39 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:40.352456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:40.353111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:40.360585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:40.361090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:40.361543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:40.362253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:40.362823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:40.363269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:40.498120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:40.506541 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-00f78400-ca15-4926-b73c-b6f4e6324b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.158382 Sep 16 15:06:40.507123 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3807/7213] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:40 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:41.529465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:41.530146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:41.536921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:41.537412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:41.537859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:41.538591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:41.539061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:41.539499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:41.668435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:41.677397 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88ebeaff-84f8-4712-b3d6-dd68daf4df7a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.151851 Sep 16 15:06:41.677982 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3808/7214] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:41 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:42.702304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:42.703083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:42.709918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:42.710458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:42.710914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:42.711632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:42.712106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:42.712551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:43.152918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:43.161913 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61a18c46-705d-4655-938f-ff0f96ea59f9 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.464007 Sep 16 15:06:43.162729 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3809/7215] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:42 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:44.186038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:44.186738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:44.193649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:44.194148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:44.194621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:44.195327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:44.195792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:44.196224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:44.329900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:44.339323 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdb482ab-5e16-4406-906b-028c935030fc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1727 microversion: 2.1 time: 0.157275 Sep 16 15:06:44.340123 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3810/7216] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:44 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:45.363335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:45.363977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:45.370833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:45.371344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:45.371796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:45.372536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:45.372990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:45.373433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:45.377776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:06:45.582247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:45.591481 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58b075db-df88-45a6-a3a7-ca02aea2cb90 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1726 microversion: 2.1 time: 0.231534 Sep 16 15:06:45.592101 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3811/7217] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:45 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:45.639459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "name": "network-vif-unplugged", "status": "completed", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:06:45.649006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:45.649518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:45.650168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:45.663829 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] Creating event network-vif-unplugged:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h1-858129-2 Sep 16 15:06:45.669500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:06:45.680794 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ed706d8f-2ab8-4642-acfd-10f369e6a349 req-211040fc-a7d8-41a1-8d57-3b786cd97b75 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045673 Sep 16 15:06:45.681663 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3812/7218] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:06:46.616168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:46.616879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:46.623274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:46.623777 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:46.624260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:46.624954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:46.625427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:46.625872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:46.762947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:46.771562 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7beae45-b68f-431b-be81-6171982c7e68 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1726 microversion: 2.1 time: 0.160462 Sep 16 15:06:46.772152 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3813/7219] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:46 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:47.696142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:06:47.706615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:47.707123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:47.707576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:47.720591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] Creating event network-changed:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h1-858129-2 Sep 16 15:06:47.726910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:06:47.738625 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8a2c5c34-5a56-4f60-8912-b6a42ee6bb81 req-3075995a-3775-4d94-ad05-efbb69950287 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046156 Sep 16 15:06:47.739492 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3814/7220] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:06:47.805940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:47.806690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:47.814097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:47.814702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:47.815121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:47.815996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:47.816481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:47.816930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:48.117922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:48.127507 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3513305-a55e-4ba3-8ab0-8ed63a536d5a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.325712 Sep 16 15:06:48.128380 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3815/7221] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:47 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:06:49.151723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:49.152390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:49.159357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:49.159867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:49.160307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:49.161018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:49.161482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:49.161916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:49.303837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:49.313017 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-282cf302-2637-43b7-a56f-aca624c9b56c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.165165 Sep 16 15:06:49.313606 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3816/7222] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:49 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:50.336816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:50.337474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:50.344606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:50.345162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:50.345578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:50.355488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:50.355488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:50.355488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:50.491251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:50.502149 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f789ae2a-b878-43e3-b106-a7f6601bb15e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.168969 Sep 16 15:06:50.503270 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3817/7223] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:50 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:51.527916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:51.529193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:51.536131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:51.536636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:51.537089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:51.537800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:51.538270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:51.538745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:51.669145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:51.677463 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-078f4f5a-27de-4e44-8a86-d0008d33cc75 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.153461 Sep 16 15:06:51.678058 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3818/7224] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:51 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:52.701106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:52.701807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:52.709035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:52.709549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:52.710007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:52.710760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:52.711239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:52.711684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:52.845695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:52.854427 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-863000d4-4cca-4972-aa96-66064da7e1e1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.157450 Sep 16 15:06:52.855149 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3819/7225] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:52 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:53.877865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:53.878558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:53.885433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:53.885933 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:53.886391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:53.887128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:53.887606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:53.888055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:54.016978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:54.025424 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ebe8839-bef6-417a-95e2-06d602a33d64 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.151540 Sep 16 15:06:54.026013 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3820/7226] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:53 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:55.049360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:55.050055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:55.056997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:55.057499 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:55.057951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:55.058683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:55.059661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:55.060096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:55.193105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:55.201740 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a2b6f5fd-8c62-4995-b9c8-5abdb530bb3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.156296 Sep 16 15:06:55.202327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3821/7227] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:55 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:56.225329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:56.226104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:56.233327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:56.233843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:56.234299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:56.235123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:56.235596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:56.236041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:56.374982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:56.383388 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c87878b0-ccf5-4b7f-b783-c52e22787b41 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.162017 Sep 16 15:06:56.383976 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3822/7228] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:56 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:57.408620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:57.409268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:57.416359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:57.416859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:57.417309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:57.418014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:57.418514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:57.418958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:57.550981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:57.559363 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-191e2b19-c660-4413-a5d9-403099a9b928 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.154774 Sep 16 15:06:57.559945 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3823/7229] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:57 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:58.583816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:58.584498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:58.587027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=61 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:06:58.592715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:58.593227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:58.593689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:58.594441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:58.594939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:58.595367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:58.740463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:58.749532 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-702b0ad4-222a-480a-b6f9-b3ce772f1dde tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.170209 Sep 16 15:06:58.750128 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3824/7230] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:58 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:06:59.773890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:06:59.774603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:06:59.781562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:59.782066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:59.782545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:59.783252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:06:59.783726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:06:59.784165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:06:59.926040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:06:59.935289 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c40e41a6-ff7f-4cc8-9aa1-d99661927d45 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1724 microversion: 2.1 time: 0.165306 Sep 16 15:06:59.935849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3825/7231] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:06:59 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:00.958740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:00.959403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:00.967291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:00.967782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:00.968232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:00.968939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:00.969410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:00.969850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.098343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:01.107469 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ebc21a64-1bf0-4a0e-8c0f-f6ce05c5c9cf tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1721 microversion: 2.1 time: 0.152625 Sep 16 15:07:01.108055 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3826/7232] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:00 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:01.130978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:01.131449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:01.137474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.137982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.138447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.139154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.139622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.140056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.177404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.177914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.178341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.179107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.179578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.180013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.199257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:01.202564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:07:01.208227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Getting quotas for user 967ef01b62ee4395882fe8689c8db3ac and project b31a63c4ba74484b98e1e27b6320ed6d. Resources: {'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:07:01.311417 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8688528b-a41f-410f-8e03-f2755374dd24 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "POST /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/action" status: 202 len: 0 microversion: 2.1 time: 0.184222 Sep 16 15:07:01.312054 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3827/7233] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:07:01 2022] POST /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:07:01.320443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:01.321151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:01.327625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.328127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.328633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.329311 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.329779 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.330217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.532689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:01.541430 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fe1826f6-f8aa-4763-a638-f5df621192e0 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.225052 Sep 16 15:07:01.542035 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3828/7234] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:01 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:01.627141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "name": "network-vif-plugged", "status": "completed", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:01.639619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:01.640208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:01.640664 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:01.654054 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] Creating event network-vif-plugged:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h1-858129-2 Sep 16 15:07:01.659994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:07:01.672516 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-78dd49b9-ed99-4fe8-8f3c-b6a5d9d1d8b8 req-53b48232-d1e2-4d42-aad5-84d4ebaa0a5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048965 Sep 16 15:07:01.673359 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3829/7235] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:07:02.566373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:02.567149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:02.574579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:02.575690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:02.576147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:02.576867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:02.577341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:02.577783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:02.718575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:02.728322 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b06938cf-07d4-469f-8d75-861a4b5c369b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.166114 Sep 16 15:07:02.728911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3830/7236] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:02 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:03.753332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:03.753983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:03.761281 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:03.761802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:03.762878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:03.763592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:03.764063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:03.764505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:03.898940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:03.907674 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-721ef4d4-b90b-49d4-b3c2-6151b0243241 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.158234 Sep 16 15:07:03.908315 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3831/7237] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:03 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:04.931671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:04.932385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:04.940166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:04.940682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:04.941139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:04.941874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:04.942388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:04.942930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:05.103763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:05.113351 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e71b7c45-f24a-4e8c-aac0-b639c89f0472 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.185723 Sep 16 15:07:05.113954 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3832/7238] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:04 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:06.139973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:06.140661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:06.153200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:06.153721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:06.154201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:06.155001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:06.155479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:06.155934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:06.302007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:06.311821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2b7937c7-a183-4ce9-8bdd-8f8e669f1ad2 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.176006 Sep 16 15:07:06.312402 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3833/7239] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:06 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:06.925588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "name": "network-vif-unplugged", "status": "completed", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:06.935945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:06.936442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:06.940361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:06.951530 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] Creating event network-vif-unplugged:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:07:06.958676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:07:06.971962 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cbc47f49-a8e8-4d4d-91bc-20464c38f695 req-5f82361a-5dad-49a0-9142-c1d15a04402f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050662 Sep 16 15:07:06.972592 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3834/7240] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:07:07.337480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:07.338223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:07.346383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:07.346939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:07.347748 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:07.348135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:07.348613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:07.349488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:07.934228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:07.943484 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2635b620-7c85-47a4-b656-b5407302c75f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.610348 Sep 16 15:07:07.944287 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3835/7241] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:07 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:08.967751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:08.968430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:08.977031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:08.977589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:08.978056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:08.978852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:08.979330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:08.979806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:09.137709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:09.148602 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a25a40a3-b709-4588-9703-2bde60ca728e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.185327 Sep 16 15:07:09.149346 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3836/7242] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:08 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:09.154700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:09.166351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:09.166934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:09.167374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:09.184456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] Creating event network-changed:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:07:09.191002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:07:09.203237 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ea0da2e0-b40b-409f-8aec-5ddaf0e4d0bb req-404de765-8b22-4e47-9f57-bd9a0a53c2c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052440 Sep 16 15:07:09.204387 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3837/7243] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:07:10.174861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:10.175579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:10.182853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:10.183451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:10.183955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:10.184673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:10.185332 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:10.185774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:10.358055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:10.367147 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7a855f53-f9ac-4077-aa51-d0af1c843795 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.198247 Sep 16 15:07:10.367753 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3838/7244] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:10 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:11.391842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:11.392644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:11.395606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:11.401336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:11.401846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:11.402837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:11.403579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:11.404047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:11.404481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:11.558481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:11.576721 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-983baf6f-3888-4715-a6cc-6d67a77dde4f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.188736 Sep 16 15:07:11.577346 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3839/7245] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:11 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:12.619436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:12.620053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:12.627771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:12.628280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:12.628728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:12.629449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:12.629926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:12.630370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:12.773603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:12.783457 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-afbf94ec-7640-4ada-89ca-0fd618c5511b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.167983 Sep 16 15:07:12.784062 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3840/7246] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:12 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:13.808143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:13.809242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:13.816814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:13.817335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:13.817790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:13.818589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:13.819059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:13.819498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:13.974759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:13.984620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88693102-9293-4c43-87bf-b2a5dc721229 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.180526 Sep 16 15:07:13.985240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3841/7247] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:13 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:15.009514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:15.010210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:15.024179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:15.024704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:15.025169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:15.025906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:15.026396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:15.026899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:15.236333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:15.247421 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7e7802a-fff7-49c0-a1e7-8ca2b225763c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.242094 Sep 16 15:07:15.248053 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3842/7248] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:15 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:16.333530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:16.334569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:16.342899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:16.343520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:16.344036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:16.344914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:16.345447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:16.345941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:16.350914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:16.506704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:16.516852 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ec41501-d0d9-4c6a-937e-c0996cdd250f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.187303 Sep 16 15:07:16.517482 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3843/7249] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:16 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:17.544742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:17.545385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:17.555969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:17.556474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:17.556921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:17.557642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:17.558132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:17.558598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:17.706349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:17.715894 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92c6ad54-05da-44b9-a15f-3d375eaa56bc tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.175674 Sep 16 15:07:17.716505 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3844/7250] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:17 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:18.740472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:18.741149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:18.749156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:18.749671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:18.750132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:18.750905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:18.751384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:18.751834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:18.913617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:18.922726 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d3e44a9c-41ad-483f-b166-54fe21fad463 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.186210 Sep 16 15:07:18.923354 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3845/7251] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:18 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:19.947272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:19.947982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:19.955702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:19.956205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:19.956662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:19.957392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:19.957871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:19.958319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:20.099494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:20.108707 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-09bf179b-dd55-4eef-ae72-30685306f1a3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.165455 Sep 16 15:07:20.109308 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3846/7252] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:19 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:07:21.132577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:21.133260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:21.141063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:21.141595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:21.142047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:21.142785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:21.143282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:21.143735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:21.279002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:21.289421 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91da87a8-b31e-4373-ad12-659eca61f9a8 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1720 microversion: 2.1 time: 0.160705 Sep 16 15:07:21.290020 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3847/7253] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:21 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:22.317409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:22.318081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:22.326075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.326623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.327083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.327818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.328330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.329133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.470661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:22.479342 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1610f472-7e62-439b-aa37-27a30b1c26a7 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1713 microversion: 2.1 time: 0.166013 Sep 16 15:07:22.479932 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3848/7254] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:22 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1713 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:22.501900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:22.502555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:22.508457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.508967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.509428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.510137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.510769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.511640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.648577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:22.657281 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ba875673-d99d-43ac-92e5-9a315761d919 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1713 microversion: 2.1 time: 0.159028 Sep 16 15:07:22.657875 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3849/7255] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:22 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:22.679966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:22.680599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:22.687236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.687742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.688196 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.688912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.689741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.690192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.818228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:22.827275 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3c8a523-bd43-4874-a75b-9e8c55749368 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1713 microversion: 2.1 time: 0.151084 Sep 16 15:07:22.827858 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3850/7256] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:22 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:22.850048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:22.850507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:22.857277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.857788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.858246 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.858997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.859482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.859930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.887098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:07:22.970797 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-21e095fc-596f-40c9-8866-5ee465c8f6cb tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 204 len: 0 microversion: 2.1 time: 0.124199 Sep 16 15:07:22.971866 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3851/7257] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:07:22 2022] DELETE /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:07:22.981533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:22.982278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:22.992666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.993198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.993659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:22.994446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:22.994913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:22.995940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:23.136292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:23.144568 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff3f8263-f6bf-4f85-8c1c-4ba14d620e3d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1719 microversion: 2.1 time: 0.168380 Sep 16 15:07:23.145142 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3852/7258] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:22 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:23.728532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-24178baf-5572-4345-b8ee-658dcaafcb8a req-ca5a11d2-1a9a-40f9-9b6f-c1cc392d0427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "name": "network-vif-plugged", "status": "completed", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:23.739486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24178baf-5572-4345-b8ee-658dcaafcb8a req-ca5a11d2-1a9a-40f9-9b6f-c1cc392d0427 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:23.739981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24178baf-5572-4345-b8ee-658dcaafcb8a req-ca5a11d2-1a9a-40f9-9b6f-c1cc392d0427 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:23.740431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24178baf-5572-4345-b8ee-658dcaafcb8a req-ca5a11d2-1a9a-40f9-9b6f-c1cc392d0427 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:23.752184 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-24178baf-5572-4345-b8ee-658dcaafcb8a req-ca5a11d2-1a9a-40f9-9b6f-c1cc392d0427 service nova] Creating event network-vif-plugged:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:07:23.757443 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-24178baf-5572-4345-b8ee-658dcaafcb8a req-ca5a11d2-1a9a-40f9-9b6f-c1cc392d0427 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Sep 16 15:07:23.758071 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3853/7259] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:07:24.168661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:24.169373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:24.176707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:24.177212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:24.177655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:24.178372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:24.178868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:24.179308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:24.318846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:24.328201 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e8d9dfa9-378b-42db-8c64-dfdd205d3643 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1719 microversion: 2.1 time: 0.163816 Sep 16 15:07:24.328796 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3854/7260] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:24 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:25.355218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:25.355921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:25.363131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:25.363734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:25.364288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:25.365082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:25.365568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:25.366016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:25.577932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:25.586422 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f1dc381d-c2af-4048-8a77-c1727e39986f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1719 microversion: 2.1 time: 0.235428 Sep 16 15:07:25.587021 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3855/7261] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:25 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:25.992135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-2ebfdfba-b350-4f6e-be99-5a872ed77aad req-9ff27fc7-804b-49b7-adf3-1991a0e0e82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc7e36e-bcf7-4cf3-b12b-17e34dc5c890", "name": "network-vif-deleted", "tag": "05976c67-0374-4cc2-a029-b2a1b5f6522d"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:26.005807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2ebfdfba-b350-4f6e-be99-5a872ed77aad req-9ff27fc7-804b-49b7-adf3-1991a0e0e82f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:26.006804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2ebfdfba-b350-4f6e-be99-5a872ed77aad req-9ff27fc7-804b-49b7-adf3-1991a0e0e82f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:26.007612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-2ebfdfba-b350-4f6e-be99-5a872ed77aad req-9ff27fc7-804b-49b7-adf3-1991a0e0e82f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:26.021405 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-2ebfdfba-b350-4f6e-be99-5a872ed77aad req-9ff27fc7-804b-49b7-adf3-1991a0e0e82f service nova] Creating event network-vif-deleted:05976c67-0374-4cc2-a029-b2a1b5f6522d for instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 on n-h2-858129-2 Sep 16 15:07:26.029532 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-2ebfdfba-b350-4f6e-be99-5a872ed77aad req-9ff27fc7-804b-49b7-adf3-1991a0e0e82f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042181 Sep 16 15:07:26.030573 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3856/7262] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:07:26.611570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:26.612282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:26.619801 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:26.620300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:26.620755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:26.621476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:26.621945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:26.622380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:26.696479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:26.705932 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b7d76717-f5f3-4129-9103-83828ccc31c3 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1368 microversion: 2.1 time: 0.098568 Sep 16 15:07:26.706816 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3857/7263] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:26 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:27.731031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:27.731707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:27.739127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:27.739919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:27.740362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:27.741130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:27.741602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:27.742035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:27.810182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:27.819617 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-92f33921-baaf-415e-9e46-d8a840eb76ac tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1368 microversion: 2.1 time: 0.093091 Sep 16 15:07:27.820218 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3858/7264] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:27 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:28.845645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:28.846326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:28.849304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:28.856929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:28.857544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:28.858012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:28.858815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:28.859301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:28.859755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:28.880712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:28.930137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:28.938916 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dd3c69e1-39f0-4bd4-a6dc-86d4f7c3cc9e tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1368 microversion: 2.1 time: 0.097932 Sep 16 15:07:28.939660 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3859/7265] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:28 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:29.963096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:29.964487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:29.972049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:29.972589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:29.973063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:29.973795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:29.974272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:29.974756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:30.051179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '967ef01b62ee4395882fe8689c8db3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31a63c4ba74484b98e1e27b6320ed6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:30.060893 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d2ecc6a3-0476-41b1-962a-1b2bc4c2a20b tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 200 len: 1368 microversion: 2.1 time: 0.101673 Sep 16 15:07:30.061400 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3860/7266] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:29 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:07:31.084985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:31.085662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:31.093495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:31.094005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:31.094488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:31.095214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:31.095688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:31.096135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:31.110179 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 HTTP/1.1 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'abc7e36e-bcf7-4cf3-b12b-17e34dc5c890'} Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:31.111910 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a5520f3-8a0d-4016-ac48-22b175dd377d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 404 len: 111 microversion: 2.1 time: 0.032401 Sep 16 15:07:31.116663 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3861/7267] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:31 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:31.180363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:31.182565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:31.188678 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:31.189180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:31.189632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:31.190338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:31.190834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:31.191276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:31.204635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-volume_attachments HTTP/1.1 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': 'abc7e36e-bcf7-4cf3-b12b-17e34dc5c890'} Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:31.206201 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8441d61-a1bb-4a55-a00f-77232119c06d tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031431 Sep 16 15:07:31.211130 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3862/7268] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:07:31 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.534349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.535020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.542209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.542745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.543203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.543975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.544405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.544852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.559356 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 HTTP/1.1 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'abc7e36e-bcf7-4cf3-b12b-17e34dc5c890'} Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.560923 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-64dd20a9-1d53-443b-8e83-42209ab24743 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 404 len: 111 microversion: 2.1 time: 0.031906 Sep 16 15:07:34.566113 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3863/7269] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:07:34 2022] DELETE /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.570846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.571481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: abc7e36e-bcf7-4cf3-b12b-17e34dc5c890] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.578043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.578571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.579026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.579737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.580214 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.580659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.597965 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 HTTP/1.1 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'abc7e36e-bcf7-4cf3-b12b-17e34dc5c890'} Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.599602 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99ae6ec4-e413-4e1f-93fd-14d3c8989af4 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890" status: 404 len: 111 microversion: 2.1 time: 0.034274 Sep 16 15:07:34.604097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3864/7270] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:34 2022] GET /compute/v2.1/servers/abc7e36e-bcf7-4cf3-b12b-17e34dc5c890 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:07:34.610307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.610843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.617275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.617776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.618229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.618980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.619967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.620404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.638178 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 HTTP/1.1 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '55d6f628-b998-49cb-bd56-2afe40d19238'} Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.639826 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e05f76f7-0d18-4bd2-b289-087952bcac5f tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 404 len: 111 microversion: 2.1 time: 0.034925 Sep 16 15:07:34.643979 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3865/7271] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:07:34 2022] DELETE /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.650027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.650689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 55d6f628-b998-49cb-bd56-2afe40d19238] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.656922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.657423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.657870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.658612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.659082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.659518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.674496 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 HTTP/1.1 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '55d6f628-b998-49cb-bd56-2afe40d19238'} Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.676071 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 55d6f628-b998-49cb-bd56-2afe40d19238 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4846cd4d-89a7-4ac4-b1af-19c897c92114 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238" status: 404 len: 111 microversion: 2.1 time: 0.031330 Sep 16 15:07:34.680466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3866/7272] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:34 2022] GET /compute/v2.1/servers/55d6f628-b998-49cb-bd56-2afe40d19238 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.686466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.686980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.693225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.693836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.694301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.695055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.695533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.696112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.711172 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 HTTP/1.1 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '6c9b423d-f9d1-45cf-91d4-13bfa289aef4'} Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.712756 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e1b2190f-5dea-4663-9a5a-f7803715205a tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 404 len: 111 microversion: 2.1 time: 0.031467 Sep 16 15:07:34.720124 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3867/7273] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:07:34 2022] DELETE /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.723053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.723693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 6c9b423d-f9d1-45cf-91d4-13bfa289aef4] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.733006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.733006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.733006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.733360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.733957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.734425 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.750571 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 HTTP/1.1 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '6c9b423d-f9d1-45cf-91d4-13bfa289aef4'} Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.752152 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 6c9b423d-f9d1-45cf-91d4-13bfa289aef4 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4ced98e5-4b9a-4c56-acd6-9f7bbbb53790 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4" status: 404 len: 111 microversion: 2.1 time: 0.034583 Sep 16 15:07:34.756807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3868/7274] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:34 2022] GET /compute/v2.1/servers/6c9b423d-f9d1-45cf-91d4-13bfa289aef4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.762567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.763082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.769137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.769644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.770101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.770847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.771327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.771773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.785679 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d HTTP/1.1 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d'} Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.787323 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-741fe4d3-782a-4ab2-9d61-f24faacf4b9c tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 404 len: 111 microversion: 2.1 time: 0.030477 Sep 16 15:07:34.791189 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3869/7275] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:07:34 2022] DELETE /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.798020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.798628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] [instance: 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:34.804758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.805316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.805770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.807081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:34.807536 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:34.807977 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:34.823832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] HTTP exception thrown: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Request method failure captured: Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d HTTP/1.1 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJI83Ems1yTq7QzGXiBZEuzoTeRymC7HCpXCKv6PjX-fOsrlm0E9_koIaT4FAAfgYEXCaXd7CM4Ei80IqiZvlojmTwkEOJbC1_hfkQLq9KA4rbFTfJCBt-9gEnjteJfdcoOMJYod0ek4Mj82f9UiaBpg_l7e7crmGgVBeIvlnqZkRXgI Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b31a63c4ba74484b98e1e27b6320ed6d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b31a63c4ba74484b98e1e27b6320ed6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b31a63c4ba74484b98e1e27b6320ed6d"}]}] Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: b31a63c4ba74484b98e1e27b6320ed6d Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServerActionsTestJSON-542818173 Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 967ef01b62ee4395882fe8689c8db3ac Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServerActionsTestJSON-542818173-project Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d'} Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:07:34.825388 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Returning 404 to user: Instance 5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8f3c02b9-2f7f-430a-8f2e-cd825f93ec14 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d" status: 404 len: 111 microversion: 2.1 time: 0.032975 Sep 16 15:07:34.829909 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3870/7276] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:34 2022] GET /compute/v2.1/servers/5b6b891a-40ac-4b95-a8e2-c36d9c0bbd6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:07:34.836778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b29727c9-6b17-4723-9236-4070a6384ae1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] Calling method '.version_select at 0x7f724c2eeca0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:34.874736 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b29727c9-6b17-4723-9236-4070a6384ae1 tempest-ServerActionsTestJSON-542818173 tempest-ServerActionsTestJSON-542818173-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848027665" status: 202 len: 0 microversion: 2.1 time: 0.041537 Sep 16 15:07:34.875870 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3871/7277] 10.222.0.60 () {58 vars in 1218 bytes} [Fri Sep 16 15:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848027665 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:07:44.554350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-503899344", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "cf09123f-8f5b-4624-9076-221a4fcd3203"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:44.623328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] validate_networks() for [('cf09123f-8f5b-4624-9076-221a4fcd3203', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:07:44.816070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=28 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:45.034529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:07:45.035412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:07:45.036178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:07:45.036842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:07:45.037550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:07:45.062315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:45.063236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:45.064086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:45.065092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:45.066396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:45.067106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:45.086772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Getting quotas for project 16caca5c2a4c4fe4bfe5b91cca423c02. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:07:45.099055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Getting quotas for user 3313a9e7aa704f7cb912f061e78db114 and project 16caca5c2a4c4fe4bfe5b91cca423c02. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:07:45.114140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:07:45.116646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:07:45.170816 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a395b5b8-7915-4ad2-a198-86ee95bffe75 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758043 Sep 16 15:07:45.171713 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3872/7278] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 15:07:45.182951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-399f182b-6e71-48e6-bc63-fd4e9e762526 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:45.185792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-399f182b-6e71-48e6-bc63-fd4e9e762526 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:45.251860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-399f182b-6e71-48e6-bc63-fd4e9e762526 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:45.260218 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-399f182b-6e71-48e6-bc63-fd4e9e762526 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1216 microversion: 2.1 time: 0.081254 Sep 16 15:07:45.261284 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3873/7279] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:45 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:46.284552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:46.285279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:46.295121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:46.295494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:46.296134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:46.296996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:46.297685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:46.298448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:46.391797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:46.405708 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8eff7425-465e-47c5-bdcf-ac98b4cf40b5 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1276 microversion: 2.1 time: 0.125365 Sep 16 15:07:46.407800 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3874/7280] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:46 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:07:47.431272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:47.432726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:47.440574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:47.441185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:47.441709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:47.442592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:47.443139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:47.443655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:47.877482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:47.894203 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9d24b0c3-0755-4679-aa02-b44f63514bee tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.466888 Sep 16 15:07:47.910700 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3875/7281] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:47 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:48.345880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-cb4bbdbd-ee2f-4e2a-9306-601be517460d req-681d6cc1-74de-414a-9f5f-d2f9b3e96a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55dcd7-120c-441f-b647-0b6140f7759a", "tag": "55140101-a336-4257-9321-2e7ac6fbb1a5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:48.356925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cb4bbdbd-ee2f-4e2a-9306-601be517460d req-681d6cc1-74de-414a-9f5f-d2f9b3e96a2b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:48.357694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cb4bbdbd-ee2f-4e2a-9306-601be517460d req-681d6cc1-74de-414a-9f5f-d2f9b3e96a2b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:48.358151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-cb4bbdbd-ee2f-4e2a-9306-601be517460d req-681d6cc1-74de-414a-9f5f-d2f9b3e96a2b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:48.372729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-cb4bbdbd-ee2f-4e2a-9306-601be517460d req-681d6cc1-74de-414a-9f5f-d2f9b3e96a2b service nova] Creating event network-changed:55140101-a336-4257-9321-2e7ac6fbb1a5 for instance 0e55dcd7-120c-441f-b647-0b6140f7759a on n-h1-858129-2 Sep 16 15:07:48.378142 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-cb4bbdbd-ee2f-4e2a-9306-601be517460d req-681d6cc1-74de-414a-9f5f-d2f9b3e96a2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105203 Sep 16 15:07:48.379150 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3876/7282] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:07:48.920177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:48.920844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:48.927338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:48.927847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:48.928435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:48.929153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:48.929676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:48.930151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:49.070195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:49.078671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b0fb7c20-f5a8-471f-a7b4-bb8c94e7fb89 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.163707 Sep 16 15:07:49.079284 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3877/7283] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:48 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:07:50.101690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:50.102386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:50.109384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:50.109888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:50.110352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:50.111078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:50.111548 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:50.111988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:50.240350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:50.248886 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a30c715e-9e85-4da7-8d63-9dd95b733062 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.151465 Sep 16 15:07:50.249512 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3878/7284] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:50 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:51.272598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:51.273252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:51.280574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:51.281094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:51.281543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:51.282242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:51.282740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:51.283177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:51.411833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:51.420136 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89dc43bc-ffff-4421-a4aa-3c2bf66f539c tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.151459 Sep 16 15:07:51.420716 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3879/7285] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:51 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:52.443899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:52.444731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:52.452994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:52.453601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:52.454135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:52.454951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:52.455456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:52.455877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:52.590025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:52.597849 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f2d6fcaf-45d9-44cb-9301-b5ce0e534838 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.157937 Sep 16 15:07:52.598451 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3880/7286] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:52 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:53.621492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:53.622158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:53.629379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:53.629885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:53.630345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:53.631114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:53.631594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:53.632037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:53.763670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:53.771524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2bc038e0-9833-4300-bc14-2343dd9e86ae tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.154018 Sep 16 15:07:53.772095 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3881/7287] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:53 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:54.008817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-78d9dd15-d2f8-4b99-b928-92817bf13072 req-b0986360-3a67-4b91-adf6-7570e5ad6189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55dcd7-120c-441f-b647-0b6140f7759a", "name": "network-vif-plugged", "status": "completed", "tag": "55140101-a336-4257-9321-2e7ac6fbb1a5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:54.019652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-78d9dd15-d2f8-4b99-b928-92817bf13072 req-b0986360-3a67-4b91-adf6-7570e5ad6189 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:54.020258 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-78d9dd15-d2f8-4b99-b928-92817bf13072 req-b0986360-3a67-4b91-adf6-7570e5ad6189 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:54.020584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-78d9dd15-d2f8-4b99-b928-92817bf13072 req-b0986360-3a67-4b91-adf6-7570e5ad6189 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:54.031874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-78d9dd15-d2f8-4b99-b928-92817bf13072 req-b0986360-3a67-4b91-adf6-7570e5ad6189 service nova] Creating event network-vif-plugged:55140101-a336-4257-9321-2e7ac6fbb1a5 for instance 0e55dcd7-120c-441f-b647-0b6140f7759a on n-h1-858129-2 Sep 16 15:07:54.036813 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-78d9dd15-d2f8-4b99-b928-92817bf13072 req-b0986360-3a67-4b91-adf6-7570e5ad6189 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088299 Sep 16 15:07:54.037466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3882/7288] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:07:54.797579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:54.798302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:54.804661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:54.805161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:54.805620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:54.806367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:54.806869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:54.807316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:54.949898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:54.958743 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c1027114-b17b-4b74-930a-c9fcb81b0e6b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1316 microversion: 2.1 time: 0.166368 Sep 16 15:07:54.959348 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3883/7289] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:54 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:55.983072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:55.983709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:55.985693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:55.986435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:55.993742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:55.994244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:55.994785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:55.995585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:55.996063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:55.996506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:56.124691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:56.132593 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3acd258c-6600-4056-baf3-a5eb0a0b83a1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.153562 Sep 16 15:07:56.133179 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3884/7290] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:55 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:56.195439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1720554604", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "cf09123f-8f5b-4624-9076-221a4fcd3203"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:56.249202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] validate_networks() for [('cf09123f-8f5b-4624-9076-221a4fcd3203', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:07:56.675454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:07:56.675898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:07:56.676394 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:07:56.676826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:07:56.677261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:07:56.686445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:56.686889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:56.687350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:56.688111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:56.688581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:56.689028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:56.708116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Getting quotas for project 16caca5c2a4c4fe4bfe5b91cca423c02. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:07:56.713578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Getting quotas for user 3313a9e7aa704f7cb912f061e78db114 and project 16caca5c2a4c4fe4bfe5b91cca423c02. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:07:56.728697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:07:56.731114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:07:56.777454 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bdc24149-f568-44c9-9181-129d698a8c71 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585485 Sep 16 15:07:56.778122 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3885/7291] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 15:07:56.789163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0dc51145-a6d9-4948-aa7a-1a2bb21b7929 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:56.789773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0dc51145-a6d9-4948-aa7a-1a2bb21b7929 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:56.845249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0dc51145-a6d9-4948-aa7a-1a2bb21b7929 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:56.853643 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0dc51145-a6d9-4948-aa7a-1a2bb21b7929 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1217 microversion: 2.1 time: 0.068228 Sep 16 15:07:56.854247 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3886/7292] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:56 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:57.877190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:57.878013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:57.886903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:57.887753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:57.888446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:57.889175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:57.889641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:57.890079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:57.961638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:57.971981 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8d533de0-83ac-483d-94d4-c00fc2d434fa tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1269 microversion: 2.1 time: 0.098988 Sep 16 15:07:57.972579 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3887/7293] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:57 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:07:58.996848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:07:58.997490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:07:59.000356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:07:59.005846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:59.006342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:59.006815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:59.007563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:59.008029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:59.008589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:59.243828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:07:59.251898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-804cf05c-c478-4e2a-ad9d-52e7e6e31a48 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.259552 Sep 16 15:07:59.252511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3888/7294] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:07:58 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:07:59.453918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-a3ad454b-0647-4b19-8fe9-6e9ec5ba794a req-f244b3f7-4eaf-430c-97c8-d83c2bf95198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e6ac5f-6005-474b-9559-b8f431bca2af", "tag": "2d5bc88c-879f-45f1-93ad-259021dbf461"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:07:59.470569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a3ad454b-0647-4b19-8fe9-6e9ec5ba794a req-f244b3f7-4eaf-430c-97c8-d83c2bf95198 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:07:59.471075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a3ad454b-0647-4b19-8fe9-6e9ec5ba794a req-f244b3f7-4eaf-430c-97c8-d83c2bf95198 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:07:59.471733 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-a3ad454b-0647-4b19-8fe9-6e9ec5ba794a req-f244b3f7-4eaf-430c-97c8-d83c2bf95198 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:07:59.484631 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-a3ad454b-0647-4b19-8fe9-6e9ec5ba794a req-f244b3f7-4eaf-430c-97c8-d83c2bf95198 service nova] Creating event network-changed:2d5bc88c-879f-45f1-93ad-259021dbf461 for instance b0e6ac5f-6005-474b-9559-b8f431bca2af on n-h2-858129-2 Sep 16 15:07:59.505830 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-a3ad454b-0647-4b19-8fe9-6e9ec5ba794a req-f244b3f7-4eaf-430c-97c8-d83c2bf95198 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056845 Sep 16 15:07:59.507338 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3889/7295] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:08:00.282488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:00.283210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:00.289580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:00.290104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:00.290601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:00.291320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:00.292367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:00.292815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:00.425402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:00.433832 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d5590f87-d1b6-492b-89bb-dc9b8731dacd tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.156493 Sep 16 15:08:00.434433 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3890/7296] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:00 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:01.456734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:01.457405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:01.464288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:01.464783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:01.465236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:01.465939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:01.466439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:01.466873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:01.599937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:01.607738 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ebda831-df62-47a1-85cb-02092c21e406 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.155152 Sep 16 15:08:01.608310 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3891/7297] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:01 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:08:02.631974 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:02.632643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:02.639755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:02.640256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:02.640720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:02.641438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:02.641917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:02.642358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:02.772288 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:02.780031 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c7608bef-0a17-479f-b941-0d926394460a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.152282 Sep 16 15:08:02.780599 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3892/7298] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:02 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:03.804136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:03.804822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:03.812116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:03.812624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:03.813083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:03.813803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:03.814277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:03.814749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:03.950899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:03.954563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=100 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:08:03.959352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37c8149b-6ecc-47c5-8de8-39cbd8bf9f76 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.159130 Sep 16 15:08:03.960033 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3893/7299] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:03 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:04.983730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:04.984405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:04.991286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:04.991785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:04.992233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:04.992936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:04.993400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:04.993838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:05.127942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:05.135681 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d07b3815-bf80-47b4-8c95-4fc9e1fbf2e1 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.156934 Sep 16 15:08:05.136312 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3894/7300] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:04 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:05.909460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b97d09dc-879d-433e-81e2-00599b3c2202 req-a44b730f-52fe-44ec-a2bb-43fbd5dbaa48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e6ac5f-6005-474b-9559-b8f431bca2af", "name": "network-vif-plugged", "status": "completed", "tag": "2d5bc88c-879f-45f1-93ad-259021dbf461"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:05.921180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b97d09dc-879d-433e-81e2-00599b3c2202 req-a44b730f-52fe-44ec-a2bb-43fbd5dbaa48 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:05.921767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b97d09dc-879d-433e-81e2-00599b3c2202 req-a44b730f-52fe-44ec-a2bb-43fbd5dbaa48 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:05.922301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b97d09dc-879d-433e-81e2-00599b3c2202 req-a44b730f-52fe-44ec-a2bb-43fbd5dbaa48 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:05.936582 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b97d09dc-879d-433e-81e2-00599b3c2202 req-a44b730f-52fe-44ec-a2bb-43fbd5dbaa48 service nova] Creating event network-vif-plugged:2d5bc88c-879f-45f1-93ad-259021dbf461 for instance b0e6ac5f-6005-474b-9559-b8f431bca2af on n-h2-858129-2 Sep 16 15:08:05.942540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b97d09dc-879d-433e-81e2-00599b3c2202 req-a44b730f-52fe-44ec-a2bb-43fbd5dbaa48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036632 Sep 16 15:08:05.943179 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3895/7301] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:08:06.159085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:06.159809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:06.167028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:06.167531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:06.167985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:06.168694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:06.169164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:06.169606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:06.309475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:06.317361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e9a5656e-a004-4ad5-b342-6d408518c490 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.162659 Sep 16 15:08:06.317946 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3896/7302] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:06 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:07.341436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:07.342060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:07.344008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:08:07.344856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:08:07.351442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:07.351965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:07.352392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:07.353096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:07.353560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:07.353997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:07.489376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:07.499154 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4664d06d-ed78-41da-8304-6f17613d71db tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1317 microversion: 2.1 time: 0.162286 Sep 16 15:08:07.499773 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3897/7303] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:07 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:08.522031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:08.522783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:08.530108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:08.530660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:08.531144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:08.531901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:08.532377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:08.532824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:08.670035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:08.677970 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb9f3a78-f575-406b-908e-671c73925ae6 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1505 microversion: 2.1 time: 0.159806 Sep 16 15:08:08.678582 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3898/7304] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:08 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:08.700862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:08.701405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:08.707469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:08.707975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:08.708431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:08.709150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:08.709625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:08.710073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:08.736436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:08:08.811894 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-294c16c4-918e-40c3-b502-1f8e419c882e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 204 len: 0 microversion: 2.1 time: 0.114357 Sep 16 15:08:08.812522 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3899/7305] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:08:08 2022] DELETE /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:08:08.820772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:08.821497 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:08.827475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:08.827979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:08.828438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:08.829156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:08.829630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:08.830075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:08.962433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:08.970777 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49b0ea96-a2fd-47a4-baf5-267c60ff57d7 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1511 microversion: 2.1 time: 0.154050 Sep 16 15:08:08.971349 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3900/7306] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:08 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:09.998424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:09.999116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:10.005958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:10.006482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:10.006935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:10.007643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:10.008118 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:10.008558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:10.138886 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:10.146564 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e41ba79c-494e-410c-a19c-5d511cb497df tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1511 microversion: 2.1 time: 0.152665 Sep 16 15:08:10.147142 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3901/7307] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:09 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:10.952486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d37f2fdf-8dab-480c-bd18-a3e2b9de2376 req-084af980-5ca9-4792-9092-696675dc0f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e6ac5f-6005-474b-9559-b8f431bca2af", "name": "network-vif-deleted", "tag": "2d5bc88c-879f-45f1-93ad-259021dbf461"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:10.964783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d37f2fdf-8dab-480c-bd18-a3e2b9de2376 req-084af980-5ca9-4792-9092-696675dc0f41 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:10.965260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d37f2fdf-8dab-480c-bd18-a3e2b9de2376 req-084af980-5ca9-4792-9092-696675dc0f41 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:10.965654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d37f2fdf-8dab-480c-bd18-a3e2b9de2376 req-084af980-5ca9-4792-9092-696675dc0f41 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:10.985828 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d37f2fdf-8dab-480c-bd18-a3e2b9de2376 req-084af980-5ca9-4792-9092-696675dc0f41 service nova] Creating event network-vif-deleted:2d5bc88c-879f-45f1-93ad-259021dbf461 for instance b0e6ac5f-6005-474b-9559-b8f431bca2af on n-h2-858129-2 Sep 16 15:08:10.994066 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d37f2fdf-8dab-480c-bd18-a3e2b9de2376 req-084af980-5ca9-4792-9092-696675dc0f41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047807 Sep 16 15:08:10.995556 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3902/7308] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:08:11.170709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:11.171654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:11.178991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:11.179494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:11.179944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:11.180669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:11.181141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:11.181614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:11.217169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:11.217668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:11.218123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:11.218624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lazy-loading 'fault' on Instance uuid b0e6ac5f-6005-474b-9559-b8f431bca2af {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:08:11.262226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:11.270063 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-006c1777-7f72-4b59-8307-1f1a87be1a36 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 200 len: 1307 microversion: 2.1 time: 0.104518 Sep 16 15:08:11.270683 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3903/7309] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:11 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:08:12.293761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:12.294444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.301800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.302320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.302877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.303735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.304204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.304634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.319456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] HTTP exception thrown: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af HTTP/1.1 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'b0e6ac5f-6005-474b-9559-b8f431bca2af'} Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:12.321132 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 404 to user: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e0ca9a9d-405d-4ed0-9dc9-11dbf03b8a7f tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 404 len: 111 microversion: 2.1 time: 0.033362 Sep 16 15:08:12.326428 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3904/7310] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:12 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:08:12.331429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:12.332045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.337897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.338387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.338865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.339564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.340024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.340460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.472872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:12.481605 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab06ce60-28d3-4331-adcc-1a056f68848d tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.153691 Sep 16 15:08:12.482186 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3905/7311] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:12 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:08:12.504142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-325a5cb9-2eb2-417c-8df6-85c870b519b8 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:12.506395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-325a5cb9-2eb2-417c-8df6-85c870b519b8 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 5edd60b5-3f29-4acd-bf89-9ce78e42283e] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.511909 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-325a5cb9-2eb2-417c-8df6-85c870b519b8 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] HTTP exception thrown: Instance 5edd60b5-3f29-4acd-bf89-9ce78e42283e could not be found. Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-325a5cb9-2eb2-417c-8df6-85c870b519b8 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/5edd60b5-3f29-4acd-bf89-9ce78e42283e/action HTTP/1.1 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 32 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: {"resize": {"flavorRef": "452"}} Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 5edd60b5-3f29-4acd-bf89-9ce78e42283e could not be found. Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '5edd60b5-3f29-4acd-bf89-9ce78e42283e', 'body': {'resize': {'flavorRef': '452'}}} Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5edd60b5-3f29-4acd-bf89-9ce78e42283e could not be found. Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:08:12.513505 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5edd60b5-3f29-4acd-bf89-9ce78e42283e could not be found. Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5edd60b5-3f29-4acd-bf89-9ce78e42283e could not be found. Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-325a5cb9-2eb2-417c-8df6-85c870b519b8 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 404 to user: Instance 5edd60b5-3f29-4acd-bf89-9ce78e42283e could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-325a5cb9-2eb2-417c-8df6-85c870b519b8 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "POST /compute/v2.1/servers/5edd60b5-3f29-4acd-bf89-9ce78e42283e/action" status: 404 len: 111 microversion: 2.1 time: 0.014572 Sep 16 15:08:12.518771 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3906/7312] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:08:12 2022] POST /compute/v2.1/servers/5edd60b5-3f29-4acd-bf89-9ce78e42283e/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:08:12.522962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:12.523586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.530379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.530930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.531388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.532107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.532585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.533061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.661135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:12.669578 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dcf60feb-22bc-4a3d-8252-751c95489c6a tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.150056 Sep 16 15:08:12.670152 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3907/7313] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:12 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:12.692537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:12.693159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.699848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.700366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.700824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.701541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.702021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.702531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.834126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:12.842671 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3c1481e-75e1-4124-8829-e54dbba84311 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.153816 Sep 16 15:08:12.843255 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3908/7314] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:12 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:12.866388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f1f87bc5-2717-4c78-b8b4-fa0a594686ba"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:12.868614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.874633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.875136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.875592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.876297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.876770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.877211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.906189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:12.911553 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] HTTP exception thrown: Flavor f1f87bc5-2717-4c78-b8b4-fa0a594686ba could not be found. Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a/action HTTP/1.1 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 65 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: {"resize": {"flavorRef": "f1f87bc5-2717-4c78-b8b4-fa0a594686ba"}} Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: exception: Flavor f1f87bc5-2717-4c78-b8b4-fa0a594686ba could not be found. Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0e55dcd7-120c-441f-b647-0b6140f7759a', 'body': {'resize': {'flavorRef': 'f1f87bc5-2717-4c78-b8b4-fa0a594686ba'}}} Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:12.913409 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f1f87bc5-2717-4c78-b8b4-fa0a594686ba could not be found. Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f1f87bc5-2717-4c78-b8b4-fa0a594686ba could not be found. Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f1f87bc5-2717-4c78-b8b4-fa0a594686ba could not be found. Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 400 to user: Flavor f1f87bc5-2717-4c78-b8b4-fa0a594686ba could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bad6def5-2bf4-43c1-87ec-4fe844b7a146 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "POST /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a/action" status: 400 len: 107 microversion: 2.1 time: 0.052487 Sep 16 15:08:12.918776 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3909/7315] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:08:12 2022] POST /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 15:08:12.923897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:12.924526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:12.930638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.931144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.931596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:12.932365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:12.932834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:12.933279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.424738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:13.433619 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4fb9bd6a-e741-4bd9-a885-65cd1bd8cab2 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.513160 Sep 16 15:08:13.434235 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3910/7316] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:12 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:13.457279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:13.457907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:13.464084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.464593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.465053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.465770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.466244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.466719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.602618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:13.606331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:08:13.611724 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-906fd4a4-bf8d-4e23-b6f1-11c5630d1e3b tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.158307 Sep 16 15:08:13.612318 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3911/7317] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:13 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:08:13.634625 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80b732f4-c448-4406-ac27-5db504369976 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80b732f4-c448-4406-ac27-5db504369976 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: request: POST /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a/action HTTP/1.1 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 29 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: {"resize": {"flavorRef": ""}} Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0e55dcd7-120c-441f-b647-0b6140f7759a', 'body': {'resize': {'flavorRef': ''}}} Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise error Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi '' Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.638867 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-80b732f4-c448-4406-ac27-5db504369976 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-80b732f4-c448-4406-ac27-5db504369976 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "POST /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a/action" status: 400 len: 113 microversion: 2.1 time: 0.009819 Sep 16 15:08:13.643241 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3912/7318] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:08:13 2022] POST /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 15:08:13.649250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:13.649875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:13.657253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.657764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.658217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.658958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.659431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.659877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.799892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:13.809329 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1b0e4d2f-4a07-4e2a-b105-0c45cd0cf950 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1504 microversion: 2.1 time: 0.164090 Sep 16 15:08:13.812538 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3913/7319] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:13 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:13.835297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:13.835814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:13.841996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.842537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.842999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.843717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.844191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.844638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.859830 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] HTTP exception thrown: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af HTTP/1.1 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'b0e6ac5f-6005-474b-9559-b8f431bca2af'} Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:08:13.861414 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 404 to user: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82df2547-b05a-4983-97ea-d7813db48375 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 404 len: 111 microversion: 2.1 time: 0.031497 Sep 16 15:08:13.870297 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3914/7320] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:08:13 2022] DELETE /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:08:13.872271 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:13.872780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: b0e6ac5f-6005-474b-9559-b8f431bca2af] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:13.878860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.879362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.879812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.880519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.880995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.881440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.895272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] HTTP exception thrown: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af HTTP/1.1 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'b0e6ac5f-6005-474b-9559-b8f431bca2af'} Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:13.896820 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 404 to user: Instance b0e6ac5f-6005-474b-9559-b8f431bca2af could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ad79b1f6-87e0-483b-ac5c-a4103110ac73 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af" status: 404 len: 111 microversion: 2.1 time: 0.030363 Sep 16 15:08:13.901618 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3915/7321] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:13 2022] GET /compute/v2.1/servers/b0e6ac5f-6005-474b-9559-b8f431bca2af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:08:13.906880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:13.907390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:13.913365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.913861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.914312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.915050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:13.915522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:13.915963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:13.943016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:08:14.018917 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81e159c1-f8fd-4f81-91be-22a4145c6d63 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 204 len: 0 microversion: 2.1 time: 0.115205 Sep 16 15:08:14.022859 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3916/7322] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:08:13 2022] DELETE /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:08:14.028910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:14.029738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:14.036182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:14.036557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:14.037181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:14.037919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:14.038577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:14.039093 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:14.171732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:14.180306 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a54c3196-2f62-4855-aba7-80bf348e5533 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1510 microversion: 2.1 time: 0.155738 Sep 16 15:08:14.180890 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3917/7323] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:14 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:15.204273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:15.204911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:15.211547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:15.212052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:15.212503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:15.213210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:15.213683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:15.214125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:15.345949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:15.354922 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-93a0bddc-114a-44d9-b9d6-e01d631f3b5e tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1510 microversion: 2.1 time: 0.153982 Sep 16 15:08:15.355511 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3918/7324] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:15 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:16.141273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9c5e81dd-4fbe-40c7-8b98-090f389e7f55 req-a5e853e9-1ec4-4a13-84ca-94d5f7a76c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55dcd7-120c-441f-b647-0b6140f7759a", "name": "network-vif-deleted", "tag": "55140101-a336-4257-9321-2e7ac6fbb1a5"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:16.157616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c5e81dd-4fbe-40c7-8b98-090f389e7f55 req-a5e853e9-1ec4-4a13-84ca-94d5f7a76c38 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:16.158117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c5e81dd-4fbe-40c7-8b98-090f389e7f55 req-a5e853e9-1ec4-4a13-84ca-94d5f7a76c38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:16.158619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9c5e81dd-4fbe-40c7-8b98-090f389e7f55 req-a5e853e9-1ec4-4a13-84ca-94d5f7a76c38 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:16.173075 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-9c5e81dd-4fbe-40c7-8b98-090f389e7f55 req-a5e853e9-1ec4-4a13-84ca-94d5f7a76c38 service nova] Creating event network-vif-deleted:55140101-a336-4257-9321-2e7ac6fbb1a5 for instance 0e55dcd7-120c-441f-b647-0b6140f7759a on n-h1-858129-2 Sep 16 15:08:16.178829 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9c5e81dd-4fbe-40c7-8b98-090f389e7f55 req-a5e853e9-1ec4-4a13-84ca-94d5f7a76c38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041205 Sep 16 15:08:16.179512 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3919/7325] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:08:16.379882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:16.380879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:16.387580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:16.388080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:16.388529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:16.389239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:16.389703 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:16.390140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:16.421690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:16.422190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:16.422666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:16.423136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lazy-loading 'fault' on Instance uuid 0e55dcd7-120c-441f-b647-0b6140f7759a {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:08:16.469180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3313a9e7aa704f7cb912f061e78db114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16caca5c2a4c4fe4bfe5b91cca423c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:16.478024 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-95882eaf-a7ef-4ca2-8da4-bf774420f7b4 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 200 len: 1306 microversion: 2.1 time: 0.103195 Sep 16 15:08:16.478652 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3920/7326] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:16 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:17.501419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:17.502107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] [instance: 0e55dcd7-120c-441f-b647-0b6140f7759a] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:17.509176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:17.509672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:17.510666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:17.511373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:17.511841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:17.512275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:17.526642 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] HTTP exception thrown: Instance 0e55dcd7-120c-441f-b647-0b6140f7759a could not be found. Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Request method failure captured: Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a HTTP/1.1 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJFAWtkGgzo4r4QULhUuY_R9fWHT7wBifBmjHbf08qdhq4Ctw72flBeEfLCQnzHUCUzE2De7JTy4HlRetW8fNeGxakTplK5GmcWhw9KAU0kLP0KhPEq0hIuHqMVmAsGibKi9P3MEff_l5Q3vuO4M1VRG55Je09n7Va0sPpG0H3Tf7Ks Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16caca5c2a4c4fe4bfe5b91cca423c02", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16caca5c2a4c4fe4bfe5b91cca423c02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16caca5c2a4c4fe4bfe5b91cca423c02"}]}] Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 16caca5c2a4c4fe4bfe5b91cca423c02 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1101535438 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 3313a9e7aa704f7cb912f061e78db114 Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-ServersNegativeTestJSON-1101535438-project Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0e55dcd7-120c-441f-b647-0b6140f7759a could not be found. Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0e55dcd7-120c-441f-b647-0b6140f7759a'} Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e55dcd7-120c-441f-b647-0b6140f7759a could not be found. Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e55dcd7-120c-441f-b647-0b6140f7759a could not be found. Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:08:17.528336 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e55dcd7-120c-441f-b647-0b6140f7759a could not be found. Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] Returning 404 to user: Instance 0e55dcd7-120c-441f-b647-0b6140f7759a could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-97de800c-aa79-4b3f-bd2a-972a52ddac70 tempest-ServersNegativeTestJSON-1101535438 tempest-ServersNegativeTestJSON-1101535438-project] 10.222.0.60 "GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a" status: 404 len: 111 microversion: 2.1 time: 0.032337 Sep 16 15:08:17.533240 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3921/7327] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:17 2022] GET /compute/v2.1/servers/0e55dcd7-120c-441f-b647-0b6140f7759a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:08:48.956232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:08:48.957216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:08:49.143641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-96dcd74f-78e2-44be-9786-d52bd484bed9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: .version_select at 0x7f7247ef3e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2063546483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1jKsc+CiOFPi6JnN8Pgbdp1wbPG+Rejjags9nYJQgfd1oS745UdRUk5kdjQI/LUfyGzTL1/QdWM2f7OZKhcNbVzINlGb6+OfyKs6Po1Rv4fPlBKW0EDHj0NmOdb+RJLA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:49.160671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-96dcd74f-78e2-44be-9786-d52bd484bed9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:08:49.166310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-96dcd74f-78e2-44be-9786-d52bd484bed9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for user 72c5e700d96f43aa860b04d1cc217608 and project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:08:49.191581 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-96dcd74f-78e2-44be-9786-d52bd484bed9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.250419 Sep 16 15:08:49.192189 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3922/7328] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:08:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:08:49.244963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-881589495", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2063546483", "networks": [{"uuid": "56ffba19-f5fa-4c40-b02c-2a87a976c012"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:49.302164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] validate_networks() for [('56ffba19-f5fa-4c40-b02c-2a87a976c012', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:08:49.704533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:08:49.704839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:08:49.705340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:08:49.705773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:08:49.706203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:08:49.717108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:49.717615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:49.718071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:49.718853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:49.719327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:49.719770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:49.738872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:08:49.744265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for user 72c5e700d96f43aa860b04d1cc217608 and project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:08:49.756822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:08:49.759726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:08:49.806056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b4933ba-f16b-4c53-befd-db6a98056953 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564968 Sep 16 15:08:49.806746 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3923/7329] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 15:08:49.823410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-49be6284-9c17-49e9-9774-b8b1b8c115d9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:49.824071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-49be6284-9c17-49e9-9774-b8b1b8c115d9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:49.887764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-49be6284-9c17-49e9-9774-b8b1b8c115d9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:49.896867 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-49be6284-9c17-49e9-9774-b8b1b8c115d9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1262 microversion: 2.1 time: 0.078507 Sep 16 15:08:49.897724 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3924/7330] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:49 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:50.924388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:50.925821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:50.933696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:50.934305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:50.934995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:50.935941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:50.936604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:50.937143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:51.019220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:51.030391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4d236c41-c9b4-435b-a521-255587b73a66 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1314 microversion: 2.1 time: 0.109762 Sep 16 15:08:51.031000 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3925/7331] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:50 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1314 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:52.060833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:52.062034 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:52.078673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:52.080212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:52.081348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:52.083203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:52.084421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:52.086296 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:52.465776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:52.474534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d9dbc07c-d271-43ae-825c-48dcb35d90ee tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.422848 Sep 16 15:08:52.475625 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3926/7332] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:52 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:08:52.761594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1cc0c48c-0d93-47cf-86cc-2ca3fcac87d6 req-3b5ded2a-a02d-457c-b07c-58458c4b8163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a290b9c-058b-4015-a64d-e9446f4750bd", "tag": "90a7dd4d-10f9-4659-92a4-bd46ef67435b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:52.777681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1cc0c48c-0d93-47cf-86cc-2ca3fcac87d6 req-3b5ded2a-a02d-457c-b07c-58458c4b8163 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:52.778347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1cc0c48c-0d93-47cf-86cc-2ca3fcac87d6 req-3b5ded2a-a02d-457c-b07c-58458c4b8163 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:52.778897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1cc0c48c-0d93-47cf-86cc-2ca3fcac87d6 req-3b5ded2a-a02d-457c-b07c-58458c4b8163 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:52.792639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1cc0c48c-0d93-47cf-86cc-2ca3fcac87d6 req-3b5ded2a-a02d-457c-b07c-58458c4b8163 service nova] Creating event network-changed:90a7dd4d-10f9-4659-92a4-bd46ef67435b for instance 9a290b9c-058b-4015-a64d-e9446f4750bd on n-h1-858129-2 Sep 16 15:08:52.799015 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1cc0c48c-0d93-47cf-86cc-2ca3fcac87d6 req-3b5ded2a-a02d-457c-b07c-58458c4b8163 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041682 Sep 16 15:08:52.799881 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3927/7333] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:08:53.500517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:53.501252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:53.508030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:53.508575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:53.509002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:53.509717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:53.510188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:53.510647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:53.652696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:53.660558 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2e543728-7e7c-43bc-b975-4eff8066c281 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.165215 Sep 16 15:08:53.661169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3928/7334] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:53 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:54.683531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:54.684179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:54.691428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:54.691928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:54.692377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:54.693092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:54.693563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:54.693998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:54.833924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:54.842851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-345b0b74-1b59-4154-98c4-2f71645ebbf1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.163624 Sep 16 15:08:54.843455 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3929/7335] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:54 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:55.868088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:55.868708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:55.875749 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:55.876256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:55.876714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:55.877436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:55.877911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:55.878353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:56.011684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:56.019743 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-102aa4de-3db5-4e0d-b932-a2bed1aa2790 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.156325 Sep 16 15:08:56.020351 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3930/7336] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:55 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:57.042952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:57.043651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:57.050657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:57.051171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:57.051626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:57.052341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:57.052832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:57.053259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:57.193056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:57.201651 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e208fdd8-5904-4de7-99eb-2909d6bf6931 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.162632 Sep 16 15:08:57.202256 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3931/7337] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:57 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:58.226946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:58.227708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:58.234804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:58.235313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:58.235772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:58.236509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:58.237183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:58.237643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:58.416083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:58.425537 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9ae420c1-c2b6-4c70-b21d-b04df976a978 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.202878 Sep 16 15:08:58.428918 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3932/7338] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:58 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:08:58.435954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-57b6ad81-c63a-4825-9bf7-7addb5258e83 req-5d0647ac-aead-476c-b4b4-ff1c75e67cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a290b9c-058b-4015-a64d-e9446f4750bd", "name": "network-vif-plugged", "status": "completed", "tag": "90a7dd4d-10f9-4659-92a4-bd46ef67435b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:08:58.446778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-57b6ad81-c63a-4825-9bf7-7addb5258e83 req-5d0647ac-aead-476c-b4b4-ff1c75e67cd8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:58.447276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-57b6ad81-c63a-4825-9bf7-7addb5258e83 req-5d0647ac-aead-476c-b4b4-ff1c75e67cd8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:58.447745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-57b6ad81-c63a-4825-9bf7-7addb5258e83 req-5d0647ac-aead-476c-b4b4-ff1c75e67cd8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:58.459903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-57b6ad81-c63a-4825-9bf7-7addb5258e83 req-5d0647ac-aead-476c-b4b4-ff1c75e67cd8 service nova] Creating event network-vif-plugged:90a7dd4d-10f9-4659-92a4-bd46ef67435b for instance 9a290b9c-058b-4015-a64d-e9446f4750bd on n-h1-858129-2 Sep 16 15:08:58.466246 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-57b6ad81-c63a-4825-9bf7-7addb5258e83 req-5d0647ac-aead-476c-b4b4-ff1c75e67cd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035211 Sep 16 15:08:58.467167 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3933/7339] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:08:59.449320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:08:59.450149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:08:59.457210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:59.457728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:59.458184 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:59.458969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:08:59.459442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:08:59.459887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:08:59.599113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:08:59.607056 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76c79d30-c175-45bc-9c91-45087fe94c8c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1362 microversion: 2.1 time: 0.163071 Sep 16 15:08:59.607650 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3934/7340] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:08:59 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:09:00.631028 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:00.631832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:00.633637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:00.634489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:00.654495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:00.655363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:00.656234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:00.657569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:00.658463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:00.659283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:00.835998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:00.844525 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d6d16fea-49c6-4ce4-91ca-32790f383c70 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1555 microversion: 2.1 time: 0.217423 Sep 16 15:09:00.845139 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3935/7341] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:00 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:09:00.871481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:00.872121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:00.878304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:00.878868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:00.879320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:00.880042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:00.880516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:00.880961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:01.024334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:01.033526 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-20a8fc69-70bc-43e9-861a-a254368cae64 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1555 microversion: 2.1 time: 0.166402 Sep 16 15:09:01.034130 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3936/7342] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:00 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:09:02.708068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:02.710973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:02.718144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:02.718687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:02.719131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:02.719850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:02.720312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:02.720759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:03.033108 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f1598c2a-8e49-43e1-8d55-c48090dce4f2 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328991 Sep 16 15:09:03.034141 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3937/7343] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 15:09:02 2022] POST /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:05.589786 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:09:05.590378 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:09:14.908276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:14.908861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:14.911942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:14.912676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:14.919307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:14.919813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:14.920261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:14.921078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:14.922180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:14.922676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:15.007553 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lazy-loading 'services' on Instance uuid 9a290b9c-058b-4015-a64d-e9446f4750bd {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:09:15.079831 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-15802cc0-2d7e-4ac8-af67-647abd732c4e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments/ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5" status: 202 len: 0 microversion: 2.1 time: 0.175679 Sep 16 15:09:15.080414 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3938/7344] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:09:14 2022] DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments/ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:09:15.089477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:15.091845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:15.098320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:15.098785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:15.099234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:15.099947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:15.100414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:15.100849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:15.131952 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48014abc-da08-4a92-a806-d9173a9cff3b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Sep 16 15:09:15.132730 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3939/7345] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:15 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:16.144921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:16.147662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:16.155673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:16.156189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:16.156647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:16.157373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:16.157846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:16.158320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:16.189498 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a400ba58-447b-4c58-a713-e5b42058c288 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Sep 16 15:09:16.190077 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3940/7346] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:16 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:17.202853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:17.205275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:17.212202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:17.212707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:17.213164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:17.213919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:17.214392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:17.215242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:17.251656 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-068b1dfc-69dc-40ed-b417-903336ad905a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052884 Sep 16 15:09:17.252169 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3941/7347] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:17 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:18.265407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:18.267844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:18.275856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:18.276375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:18.276836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:18.277698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:18.278179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:18.278651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:18.312861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f910b9a-f122-47c6-8e52-a81587018f75 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051755 Sep 16 15:09:18.313465 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3942/7348] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:18 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:19.326845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:19.329045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:19.336721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:19.337230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:19.337685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:19.338451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:19.338938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:19.339374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:19.372099 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-55383432-cc47-4ab3-a351-c8b3e8b2dbdb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049296 Sep 16 15:09:19.372690 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3943/7349] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:19 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:20.386172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:20.388598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:20.396075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:20.397104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:20.397567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:20.398304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:20.398810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:20.399259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:20.433045 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6833e2ea-878a-4bd3-8fd0-788e4b5423d0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050960 Sep 16 15:09:20.433653 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3944/7350] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:20 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 15:09:20.444832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:20.445349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:20.451738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:20.452252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:20.452707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:20.453434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:20.453915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:20.454360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:20.540854 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] HTTP exception thrown: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd is not attached to volume ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Request method failure captured: Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments/ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 HTTP/1.1 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJF7bkYHEpxZT6L59Hj1JI9QXk9IOT5J4KKbjH1ru9_6dfNSxqyqqAMO5hz2Epls8HjSzkV6sxeTUZ289GW3Xjpjb54zN9r7iLbnjPBR3RNzcA7X0M-R3a4FFEe4oVf4BvBzT2LXmyoRnxmAX8HO3jmNJLN4XzR_onxK0QaUkchj7tM Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00f5ac5f515a4d6ca58fde5afcfaa424", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}] Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 72c5e700d96f43aa860b04d1cc217608 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd is not attached to volume ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '9a290b9c-058b-4015-a64d-e9446f4750bd', 'id': 'ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5'} Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5. Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd is not attached to volume ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:20.550555 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd is not attached to volume ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Returning 404 to user: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd is not attached to volume ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30be7363-11e9-428f-a363-de2e3e46703a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments/ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5" status: 404 len: 154 microversion: 2.1 time: 0.111396 Sep 16 15:09:20.558110 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3945/7351] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:09:20 2022] DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd/os-volume_attachments/ee98cd18-7f3e-4c71-9d1a-3d976ec5b4f5 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:09:23.989708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:23.990450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:23.998574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:23.999092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:23.999555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:24.000322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:24.000814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:24.001247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:24.035120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:09:24.127416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-418f0a3a-7d3f-407b-93c1-8c7eb7d448aa tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 204 len: 0 microversion: 2.1 time: 0.138153 Sep 16 15:09:24.127416 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3946/7352] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:09:23 2022] DELETE /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:09:24.134443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:24.135552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:24.142969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:24.143626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:24.144295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:24.145210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:24.145791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:24.146989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:24.166753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG neutronclient.v2_0.client [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=128643) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 16 15:09:24.167559 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.651688 Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack Traceback (most recent call last): Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-e7c25a43-fd6d-46e9-b84a-e5be5cc57ce9'] Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack Traceback (most recent call last): Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return req.get_response(self.application) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack self.force_reraise() Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack raise self.value Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return resp(environ, start_response) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return request.get_response(self.application) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 16 15:09:24.221631 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return resp(environ, start_response) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return resp(environ, start_response) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return resp(environ, start_response) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self._create_instance( Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2641, in validate_networks Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ports = neutron.list_ports(**params)['ports'] Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 815, in list_ports Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.list('ports', self.ports_path, retrieve_all, Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 16 15:09:24.226543 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] http://10.222.0.60/compute/v2.1/servers returned with HTTP 401 Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:09:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.60) Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: CRITICAL nova [None req-8ec17141-4640-4a9d-9c78-41efc6f5ccd6 tempest-TestVolumeBootPattern-1826600963 tempest-TestVolumeBootPattern-1826600963-project] Unhandled error: OSError: write error Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova OSError: write error Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova Sep 16 15:09:24.231638 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3407/7353] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 14:54:23 2022] POST /compute/v2.1/servers => generated 0 bytes in 900710 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Sep 16 15:09:24.295509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:24.303767 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cadbfa40-1efc-4920-a918-3c8b516e2810 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1561 microversion: 2.1 time: 0.173955 Sep 16 15:09:24.304349 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3947/7354] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:24 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:09:25.329308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:25.329918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:25.336202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:25.336687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:25.337121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:25.337812 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:25.338264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:25.338757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:25.467666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:25.476525 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8011ed24-2b9a-4ce9-8acf-3a26aea0ab15 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1561 microversion: 2.1 time: 0.152598 Sep 16 15:09:25.477123 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3408/7355] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:25 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:26.375986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-ecf0df0b-6f54-469d-9186-59bbf26bd7c6 req-9925c840-a638-4139-8cf6-a8af541d071f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a290b9c-058b-4015-a64d-e9446f4750bd", "name": "network-vif-deleted", "tag": "90a7dd4d-10f9-4659-92a4-bd46ef67435b"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:26.390071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ecf0df0b-6f54-469d-9186-59bbf26bd7c6 req-9925c840-a638-4139-8cf6-a8af541d071f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:26.391213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ecf0df0b-6f54-469d-9186-59bbf26bd7c6 req-9925c840-a638-4139-8cf6-a8af541d071f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:26.391672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-ecf0df0b-6f54-469d-9186-59bbf26bd7c6 req-9925c840-a638-4139-8cf6-a8af541d071f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:26.406429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-ecf0df0b-6f54-469d-9186-59bbf26bd7c6 req-9925c840-a638-4139-8cf6-a8af541d071f service nova] Creating event network-vif-deleted:90a7dd4d-10f9-4659-92a4-bd46ef67435b for instance 9a290b9c-058b-4015-a64d-e9446f4750bd on n-h1-858129-2 Sep 16 15:09:26.412352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-ecf0df0b-6f54-469d-9186-59bbf26bd7c6 req-9925c840-a638-4139-8cf6-a8af541d071f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039831 Sep 16 15:09:26.412975 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3948/7356] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:26.499356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:26.499969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:26.508300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:26.509041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:26.509480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:26.510185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:26.510674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:26.511237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:26.544364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:26.544850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:26.545286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:26.545746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lazy-loading 'fault' on Instance uuid 9a290b9c-058b-4015-a64d-e9446f4750bd {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:09:26.590184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:26.599614 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c43095d6-829c-4276-b5e1-d9649d57ec03 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 200 len: 1352 microversion: 2.1 time: 0.104034 Sep 16 15:09:26.600179 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3409/7357] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:26 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:27.623969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:27.624637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 9a290b9c-058b-4015-a64d-e9446f4750bd] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:27.631813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:27.632317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:27.632774 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:27.633487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:27.633964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:27.634428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:27.648235 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] HTTP exception thrown: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd could not be found. Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Request method failure captured: Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd HTTP/1.1 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJF7bkYHEpxZT6L59Hj1JI9QXk9IOT5J4KKbjH1ru9_6dfNSxqyqqAMO5hz2Epls8HjSzkV6sxeTUZ289GW3Xjpjb54zN9r7iLbnjPBR3RNzcA7X0M-R3a4FFEe4oVf4BvBzT2LXmyoRnxmAX8HO3jmNJLN4XzR_onxK0QaUkchj7tM Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00f5ac5f515a4d6ca58fde5afcfaa424", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}] Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 72c5e700d96f43aa860b04d1cc217608 Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd could not be found. Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '9a290b9c-058b-4015-a64d-e9446f4750bd'} Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd could not be found. Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd could not be found. Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:27.649881 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd could not be found. Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Returning 404 to user: Instance 9a290b9c-058b-4015-a64d-e9446f4750bd could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee9f4e2d-c48a-4178-8aef-e7a54e822266 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd" status: 404 len: 111 microversion: 2.1 time: 0.031784 Sep 16 15:09:27.654851 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3949/7358] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:27 2022] GET /compute/v2.1/servers/9a290b9c-058b-4015-a64d-e9446f4750bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:09:27.660300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5a199cd2-c441-4c97-b404-631b05080957 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '.version_select at 0x7f724d076040>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:27.665383 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a199cd2-c441-4c97-b404-631b05080957 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [06bb6011-c533-4d38-a08e-8776a507e591] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:09:28.674218 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a199cd2-c441-4c97-b404-631b05080957 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [06bb6011-c533-4d38-a08e-8776a507e591] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44800. Sep 16 15:09:28.700073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5a199cd2-c441-4c97-b404-631b05080957 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2063546483" status: 202 len: 0 microversion: 2.1 time: 1.043704 Sep 16 15:09:28.700658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3410/7359] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 15:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2063546483 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:09:28.718488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8905ab0b-8301-49d1-a072-b26176ddf65c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: .version_select at 0x7f724ce3a790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1731441445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzAyl4KAiH4axmO26rX1IcdYAc7NFe8xXz48D5JrPe/FJyJyjeo1aqvGtUHqmbETOD1e4GUxw0EI4uSd1diV1R27BOFbRbwJ0Fq5P5A0bRRULil3vrb2/YKeNfnpCpvbQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:28.735781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8905ab0b-8301-49d1-a072-b26176ddf65c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:09:28.742388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-8905ab0b-8301-49d1-a072-b26176ddf65c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for user 72c5e700d96f43aa860b04d1cc217608 and project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:09:28.765146 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8905ab0b-8301-49d1-a072-b26176ddf65c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050732 Sep 16 15:09:28.765751 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3950/7360] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:09:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:28.817789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2073439571", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1731441445", "networks": [{"uuid": "56ffba19-f5fa-4c40-b02c-2a87a976c012"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:28.870346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] validate_networks() for [('56ffba19-f5fa-4c40-b02c-2a87a976c012', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:09:29.308555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:09:29.309050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:09:29.309543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:09:29.309950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:09:29.310355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:09:29.320437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:29.320934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:29.321394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:29.322131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:29.322624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:29.323151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:29.340768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:09:29.346302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for user 72c5e700d96f43aa860b04d1cc217608 and project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:09:29.348798 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:09:29.349644 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:09:29.363580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:09:29.365876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:09:29.414557 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a5907294-aa27-45cc-8d5a-e1f8d2928d36 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601278 Sep 16 15:09:29.415221 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3411/7361] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:09:29.427020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d22bbcda-11b0-433b-a75a-fe5a8bf4e571 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:29.427788 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d22bbcda-11b0-433b-a75a-fe5a8bf4e571 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:29.484573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d22bbcda-11b0-433b-a75a-fe5a8bf4e571 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:29.491621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d22bbcda-11b0-433b-a75a-fe5a8bf4e571 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1263 microversion: 2.1 time: 0.068533 Sep 16 15:09:29.492098 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3951/7362] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:29 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:30.516850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:30.517401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:30.524595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:30.525095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:30.525539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:30.526338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:30.526853 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:30.527353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:30.610118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:30.618652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-891a3025-3af3-4cf9-9f41-a1fbef560e7b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1333 microversion: 2.1 time: 0.107465 Sep 16 15:09:30.619243 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3412/7363] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:30 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:31.643070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:31.643776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:31.651125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:31.651632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:31.652105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:31.652798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:31.653266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:31.653700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:31.894604 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:31.902615 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-83238445-63d9-4421-affa-7e544e951cb8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.263455 Sep 16 15:09:31.903210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3952/7364] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:31 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:32.361396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3eed4896-6b0d-414e-8573-656cc75c36d0 req-f4e5a3b0-944a-466e-95b5-f6da98d9ad78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe0aab7-203a-4577-95ca-af6d9ff7e0ee", "tag": "50d82865-6961-45d6-8de5-10797ef0dc71"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:32.372935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3eed4896-6b0d-414e-8573-656cc75c36d0 req-f4e5a3b0-944a-466e-95b5-f6da98d9ad78 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:32.373766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3eed4896-6b0d-414e-8573-656cc75c36d0 req-f4e5a3b0-944a-466e-95b5-f6da98d9ad78 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:32.374198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3eed4896-6b0d-414e-8573-656cc75c36d0 req-f4e5a3b0-944a-466e-95b5-f6da98d9ad78 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:32.388276 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3eed4896-6b0d-414e-8573-656cc75c36d0 req-f4e5a3b0-944a-466e-95b5-f6da98d9ad78 service nova] Creating event network-changed:50d82865-6961-45d6-8de5-10797ef0dc71 for instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee on n-h2-858129-2 Sep 16 15:09:32.394152 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3eed4896-6b0d-414e-8573-656cc75c36d0 req-f4e5a3b0-944a-466e-95b5-f6da98d9ad78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036697 Sep 16 15:09:32.394810 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3413/7365] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:32.925945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:32.926631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:32.933439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:32.933936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:32.934385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:32.935109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:32.935578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:32.936015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:33.066915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:33.074557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-665b7b48-466c-46bd-9d48-82bc074bb686 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.152502 Sep 16 15:09:33.075137 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3953/7366] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:32 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:34.100704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:34.101405 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:34.107580 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:34.108066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:34.108500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:34.109188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:34.109640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:34.110062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:34.241497 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:34.249561 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ab03d11a-20b9-4036-bf3e-841f45fe7866 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.154801 Sep 16 15:09:34.250155 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3414/7367] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:34 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:35.272671 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:35.273310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:35.280287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:35.280792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:35.281248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:35.281961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:35.282458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:35.282908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:35.420345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:35.428703 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-de703b81-058c-4be7-8550-ae63f5d6b92e tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.159961 Sep 16 15:09:35.429300 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3954/7368] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:35 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:09:36.451941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:36.452553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:36.460080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:36.460570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:36.461001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:36.461702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:36.462152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:36.462612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:36.591644 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:36.599635 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-05843b36-9c31-4d22-a9ac-70aa1aa35c8f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.151696 Sep 16 15:09:36.600220 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3415/7369] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:36 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:37.622464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:37.623098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:37.630101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:37.630634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:37.631087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:37.631792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:37.632262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:37.632704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:37.651468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:37.773377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:37.781217 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3ebe374c-f76f-4fa2-b74b-1f84fc48228a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.162655 Sep 16 15:09:37.781811 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3955/7370] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:37 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:38.357845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4f94ed2a-e6f2-4409-b64a-0f3688e35d19 req-e21f2c80-dd68-45bd-9249-e6d673ac5892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe0aab7-203a-4577-95ca-af6d9ff7e0ee", "name": "network-vif-plugged", "status": "completed", "tag": "50d82865-6961-45d6-8de5-10797ef0dc71"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:38.369566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4f94ed2a-e6f2-4409-b64a-0f3688e35d19 req-e21f2c80-dd68-45bd-9249-e6d673ac5892 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:38.370135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4f94ed2a-e6f2-4409-b64a-0f3688e35d19 req-e21f2c80-dd68-45bd-9249-e6d673ac5892 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:38.370792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4f94ed2a-e6f2-4409-b64a-0f3688e35d19 req-e21f2c80-dd68-45bd-9249-e6d673ac5892 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:38.383239 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4f94ed2a-e6f2-4409-b64a-0f3688e35d19 req-e21f2c80-dd68-45bd-9249-e6d673ac5892 service nova] Creating event network-vif-plugged:50d82865-6961-45d6-8de5-10797ef0dc71 for instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee on n-h2-858129-2 Sep 16 15:09:38.388500 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4f94ed2a-e6f2-4409-b64a-0f3688e35d19 req-e21f2c80-dd68-45bd-9249-e6d673ac5892 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 Sep 16 15:09:38.389107 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3416/7371] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:38.804721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:38.805272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:38.812721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:38.813222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:38.813679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:38.814389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:38.814884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:38.815326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:38.942851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:38.950818 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-818aa6b4-2aa5-4ad5-a3f5-cd0bc0863413 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1363 microversion: 2.1 time: 0.150660 Sep 16 15:09:38.951409 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3956/7372] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:38 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:39.972133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:39.973369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:39.979090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:39.980494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:39.987365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:39.987845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:39.988274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:39.988986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:39.989446 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:39.989860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:40.122943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:40.130936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-04f724fa-40e0-4b3f-bef1-849ddb988f37 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1556 microversion: 2.1 time: 0.159773 Sep 16 15:09:40.131527 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3417/7373] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:39 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:40.153081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:40.153721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:40.155672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:40.161952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:40.162522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:40.163490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:40.164213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:40.164690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:40.165133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:40.293232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:09:40.301490 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6a44185d-d57b-4f08-9e32-a5b5fa6dd7f9 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1556 microversion: 2.1 time: 0.152177 Sep 16 15:09:40.302214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3957/7374] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:09:40 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:09:41.821060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d171ed46-593e-4e94-beee-456d2762d49c"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:09:41.823413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:41.830195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:41.830713 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:41.831145 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:41.831839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:41.832287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:41.832709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:42.119691 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-27162939-65cf-4a3a-9118-403ee042edc1 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302398 Sep 16 15:09:42.120324 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3418/7375] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 15:09:41 2022] POST /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:52.868098 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:52.869022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:52.872769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:52.873590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=14 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:52.880789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:52.881376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:52.881834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:52.882597 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:52.883075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:52.883521 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:52.967308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lazy-loading 'services' on Instance uuid 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:09:53.038045 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-18811e01-44d3-4769-97bf-de7977ea9438 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments/d171ed46-593e-4e94-beee-456d2762d49c" status: 202 len: 0 microversion: 2.1 time: 0.176730 Sep 16 15:09:53.038756 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3958/7376] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:09:52 2022] DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments/d171ed46-593e-4e94-beee-456d2762d49c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:09:53.045689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:53.046611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:09:53.050991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:53.053506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:53.061725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:53.062223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:53.062664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:53.063359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:53.063806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:53.064226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:53.099652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93aec05b-c534-4adc-b79b-0a0a06438499 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055813 Sep 16 15:09:53.100149 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3419/7377] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:53 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:54.113013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:54.115495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:54.122890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:54.123397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:54.123844 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:54.124565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:54.125035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:54.125471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:54.158616 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6c7a9666-22b8-4533-a0ad-cf7789fbc1b0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049914 Sep 16 15:09:54.159210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3959/7378] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:54 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:55.174211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:55.176950 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:55.185659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:55.186153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:55.186632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:55.187356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:55.187808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:55.188236 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:55.222532 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-65ea4cc3-39f4-4592-964b-bcb2326eb8f6 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053436 Sep 16 15:09:55.223289 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3420/7379] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:55 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:56.235254 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:56.237448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:56.244939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:56.245447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:56.245902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:56.246649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:56.248239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:56.248239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:56.278687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f5277ef1-82ed-4b69-919e-33f882a5159c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047445 Sep 16 15:09:56.279266 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3960/7380] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:56 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:09:57.292135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:57.294799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:57.301611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:57.302094 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:57.302564 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:57.303265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:57.303717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:57.304143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:57.336216 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f0a6c634-2e3e-4ef4-b667-f07d8bc4d023 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048756 Sep 16 15:09:57.336800 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3421/7381] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:57 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:09:58.349746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:58.351978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:58.358741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:58.359275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:58.359731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:58.360448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:58.360919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:58.361364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:58.393411 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-51348412-d2d3-4864-8e85-f039befeb54c tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047646 Sep 16 15:09:58.394004 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3961/7382] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:09:58 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 15:09:58.404898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:09:58.405451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:09:58.412323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:58.412837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:58.413275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:58.413975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:09:58.414456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:09:58.414888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:09:58.497552 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] HTTP exception thrown: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee is not attached to volume d171ed46-593e-4e94-beee-456d2762d49c Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Request method failure captured: Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: request: DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments/d171ed46-593e-4e94-beee-456d2762d49c HTTP/1.1 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJF7bkYHEpxZT6L59Hj1JI9QXk9IOT5J4KKbjH1ru9_6dfNSxqyqqAMO5hz2Epls8HjSzkV6sxeTUZ289GW3Xjpjb54zN9r7iLbnjPBR3RNzcA7X0M-R3a4FFEe4oVf4BvBzT2LXmyoRnxmAX8HO3jmNJLN4XzR_onxK0QaUkchj7tM Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00f5ac5f515a4d6ca58fde5afcfaa424", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}] Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 72c5e700d96f43aa860b04d1cc217608 Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee is not attached to volume d171ed46-593e-4e94-beee-456d2762d49c Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'server_id': '1fe0aab7-203a-4577-95ca-af6d9ff7e0ee', 'id': 'd171ed46-593e-4e94-beee-456d2762d49c'} Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d171ed46-593e-4e94-beee-456d2762d49c. Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee is not attached to volume d171ed46-593e-4e94-beee-456d2762d49c Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:09:58.499759 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee is not attached to volume d171ed46-593e-4e94-beee-456d2762d49c Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Returning 404 to user: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee is not attached to volume d171ed46-593e-4e94-beee-456d2762d49c {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a32ff816-d8b3-4f93-9ba2-dfbf91e060d3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments/d171ed46-593e-4e94-beee-456d2762d49c" status: 404 len: 154 microversion: 2.1 time: 0.100757 Sep 16 15:09:58.506544 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3422/7383] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:09:58 2022] DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee/os-volume_attachments/d171ed46-593e-4e94-beee-456d2762d49c => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:10:01.881305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:01.881807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:01.889486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:01.889989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:01.890459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:01.891182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:01.891649 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:01.892091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:01.921894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:10:02.021331 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b87b83d8-f25f-4c20-8aca-f70943020132 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 204 len: 0 microversion: 2.1 time: 0.142813 Sep 16 15:10:02.022239 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3962/7384] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:10:01 2022] DELETE /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:10:02.031782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:02.032410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:02.040954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:02.041451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:02.041882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:02.042685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:02.043095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:02.043694 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:02.207574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:02.216581 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b49d4398-b0d0-43ec-8e79-2be59b7a992b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1562 microversion: 2.1 time: 0.188892 Sep 16 15:10:02.217283 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3423/7385] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:02 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:03.241392 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:03.242031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:03.249575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:03.250076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:03.250559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:03.251274 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:03.251751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:03.252192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:03.390903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:03.399855 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-23db4e3c-33ae-4d21-9a0b-f59d1f1ded57 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1562 microversion: 2.1 time: 0.162254 Sep 16 15:10:03.400458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3963/7386] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:03 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:04.287569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-a7c21bb5-db05-4695-9069-ece19890808e req-aebc2e66-99d0-41e3-af03-726d1ecf4740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe0aab7-203a-4577-95ca-af6d9ff7e0ee", "name": "network-vif-deleted", "tag": "50d82865-6961-45d6-8de5-10797ef0dc71"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:04.313137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a7c21bb5-db05-4695-9069-ece19890808e req-aebc2e66-99d0-41e3-af03-726d1ecf4740 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:04.313632 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a7c21bb5-db05-4695-9069-ece19890808e req-aebc2e66-99d0-41e3-af03-726d1ecf4740 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:04.314075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-a7c21bb5-db05-4695-9069-ece19890808e req-aebc2e66-99d0-41e3-af03-726d1ecf4740 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:04.328580 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-a7c21bb5-db05-4695-9069-ece19890808e req-aebc2e66-99d0-41e3-af03-726d1ecf4740 service nova] Creating event network-vif-deleted:50d82865-6961-45d6-8de5-10797ef0dc71 for instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee on n-h2-858129-2 Sep 16 15:10:04.334460 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-a7c21bb5-db05-4695-9069-ece19890808e req-aebc2e66-99d0-41e3-af03-726d1ecf4740 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053361 Sep 16 15:10:04.335098 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3424/7387] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:04.425230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:04.425849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:04.436428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:04.437180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:04.438059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:04.439095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:04.439847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:04.440441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:04.478117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:04.478672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:04.479135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:04.479603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lazy-loading 'fault' on Instance uuid 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:10:04.524912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:04.533854 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b043c354-c1b2-4391-853e-430106d630f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 200 len: 1353 microversion: 2.1 time: 0.114020 Sep 16 15:10:04.534464 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3964/7388] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:04 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 1353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:05.559611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:05.560215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:05.566739 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:05.567279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:05.567721 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:05.568445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:05.568905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:05.569327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:05.584901 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] HTTP exception thrown: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee could not be found. Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Request method failure captured: Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee HTTP/1.1 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJF7bkYHEpxZT6L59Hj1JI9QXk9IOT5J4KKbjH1ru9_6dfNSxqyqqAMO5hz2Epls8HjSzkV6sxeTUZ289GW3Xjpjb54zN9r7iLbnjPBR3RNzcA7X0M-R3a4FFEe4oVf4BvBzT2LXmyoRnxmAX8HO3jmNJLN4XzR_onxK0QaUkchj7tM Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00f5ac5f515a4d6ca58fde5afcfaa424", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}] Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 72c5e700d96f43aa860b04d1cc217608 Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee could not be found. Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1fe0aab7-203a-4577-95ca-af6d9ff7e0ee'} Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee could not be found. Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee could not be found. Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:10:05.586640 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee could not be found. Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Returning 404 to user: Instance 1fe0aab7-203a-4577-95ca-af6d9ff7e0ee could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-652367c1-1d83-4faf-b4fa-25b83f909c7a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee" status: 404 len: 111 microversion: 2.1 time: 0.034546 Sep 16 15:10:05.593441 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3425/7389] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:05 2022] GET /compute/v2.1/servers/1fe0aab7-203a-4577-95ca-af6d9ff7e0ee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:10:05.599993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-181dbc4f-4a9c-4512-b92d-9fb16fd1d1a8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '.version_select at 0x7f7247da0f70>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:05.624786 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-181dbc4f-4a9c-4512-b92d-9fb16fd1d1a8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1731441445" status: 202 len: 0 microversion: 2.1 time: 0.029320 Sep 16 15:10:05.625402 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3965/7390] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 15:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1731441445 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:10:05.645051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1fe83c0b-66f0-4b33-b865-b71fdf467168 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: .version_select at 0x7f724c34a670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1813314575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0oIDguscOBkgWrhppjNQZlHRLNdSlkMSiUEqxq2WjWSr0PHJ5dMTY0VNvSV2mA/Co3GwKbZ4AmMFUPw6+6/su1sAZ7DairS4Z2kpPRblVz7g4DsY/IFVK0o/i41hIDyw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:05.661529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-1fe83c0b-66f0-4b33-b865-b71fdf467168 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:10:05.668970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-1fe83c0b-66f0-4b33-b865-b71fdf467168 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for user 72c5e700d96f43aa860b04d1cc217608 and project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:10:05.696167 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1fe83c0b-66f0-4b33-b865-b71fdf467168 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055060 Sep 16 15:10:05.696782 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3426/7391] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:10:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:05.751163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-431896793", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1813314575", "networks": [{"uuid": "56ffba19-f5fa-4c40-b02c-2a87a976c012"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:05.814541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] validate_networks() for [('56ffba19-f5fa-4c40-b02c-2a87a976c012', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:10:06.283842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:10:06.284427 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:10:06.285104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:10:06.285697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:10:06.286259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:10:06.296881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:06.297396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:06.297860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:06.298647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:06.299124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:06.299568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:06.318603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:10:06.324935 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Getting quotas for user 72c5e700d96f43aa860b04d1cc217608 and project 00f5ac5f515a4d6ca58fde5afcfaa424. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:10:06.339103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:10:06.341488 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:10:06.392076 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f0963b27-a0a5-4d23-8b49-e43388747146 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644538 Sep 16 15:10:06.392978 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3966/7392] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:10:06.405912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43c15d3c-36f8-43b7-90a6-66c20f19a1ec tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:06.406712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43c15d3c-36f8-43b7-90a6-66c20f19a1ec tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:06.471826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43c15d3c-36f8-43b7-90a6-66c20f19a1ec tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:06.484230 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43c15d3c-36f8-43b7-90a6-66c20f19a1ec tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1262 microversion: 2.1 time: 0.082788 Sep 16 15:10:06.485537 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3427/7393] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:06 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:07.522874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:07.524389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:07.535326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:07.536058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:07.537064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:07.538021 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:07.538824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:07.540094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:07.643583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:07.655387 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1df8e639-3621-4767-a656-daea06015946 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1322 microversion: 2.1 time: 0.137311 Sep 16 15:10:07.656131 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3967/7394] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:07 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:08.681336 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:08.682060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:08.690328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:08.690969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:08.691439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:08.692181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:08.692642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:08.693125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:08.924792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:08.936521 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d611dead-6365-4a49-b188-fb8d4c7ac2f5 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.259161 Sep 16 15:10:08.937700 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3428/7395] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:08 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:09.144351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-162a27b1-4280-4d10-8eff-133bfa5cddac req-2ea8d448-3d0a-4f86-aba9-3c41370a1117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120224af-7fa4-4ce1-9f6a-a4b4c9cc1132", "tag": "23a62573-3a1c-45cb-a932-08934387556e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:09.157566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-162a27b1-4280-4d10-8eff-133bfa5cddac req-2ea8d448-3d0a-4f86-aba9-3c41370a1117 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:09.158565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-162a27b1-4280-4d10-8eff-133bfa5cddac req-2ea8d448-3d0a-4f86-aba9-3c41370a1117 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:09.159020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-162a27b1-4280-4d10-8eff-133bfa5cddac req-2ea8d448-3d0a-4f86-aba9-3c41370a1117 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:09.174589 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-162a27b1-4280-4d10-8eff-133bfa5cddac req-2ea8d448-3d0a-4f86-aba9-3c41370a1117 service nova] Creating event network-changed:23a62573-3a1c-45cb-a932-08934387556e for instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 on n-h2-858129-2 Sep 16 15:10:09.181581 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-162a27b1-4280-4d10-8eff-133bfa5cddac req-2ea8d448-3d0a-4f86-aba9-3c41370a1117 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040951 Sep 16 15:10:09.182512 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3968/7396] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:09.978419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:09.979246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:09.986874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:09.987383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:09.987837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:09.988581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:09.989044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:09.989477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:10.144944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:10.153803 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d05ff546-79d2-44ec-b6e3-91f65bfd5431 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.179941 Sep 16 15:10:10.154248 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3429/7397] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:09 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:11.179292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:11.180535 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:11.187337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:11.187848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:11.188304 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:11.189053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:11.189528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:11.189975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:11.349363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:11.358114 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7f1fb7f0-d389-472d-b0a0-3e1aba311d5a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.184373 Sep 16 15:10:11.358747 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3969/7398] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:11 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:12.382227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:12.383541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:12.390577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:12.391076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:12.391536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:12.392242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:12.392698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:12.393129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:12.539951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:12.548206 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb219824-2dc7-474c-8b85-88df9ed40f3d tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.169787 Sep 16 15:10:12.548804 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3430/7399] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:12 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:13.571852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:13.572412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:13.580446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:13.580961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:13.581421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:13.582192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:13.582704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:13.583291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:13.727720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:13.740702 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f337f603-0fd5-4982-bb35-1e64d8a78bad tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.172343 Sep 16 15:10:13.741339 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3970/7400] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:13 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:14.597089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-300ba254-4b4c-40bb-93ca-ea126e97d1f9 req-74c439e8-3c18-421a-a4c3-ce545b260f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120224af-7fa4-4ce1-9f6a-a4b4c9cc1132", "name": "network-vif-plugged", "status": "completed", "tag": "23a62573-3a1c-45cb-a932-08934387556e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:14.609323 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-300ba254-4b4c-40bb-93ca-ea126e97d1f9 req-74c439e8-3c18-421a-a4c3-ce545b260f0b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:14.609880 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-300ba254-4b4c-40bb-93ca-ea126e97d1f9 req-74c439e8-3c18-421a-a4c3-ce545b260f0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:14.610325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-300ba254-4b4c-40bb-93ca-ea126e97d1f9 req-74c439e8-3c18-421a-a4c3-ce545b260f0b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:14.623264 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-300ba254-4b4c-40bb-93ca-ea126e97d1f9 req-74c439e8-3c18-421a-a4c3-ce545b260f0b service nova] Creating event network-vif-plugged:23a62573-3a1c-45cb-a932-08934387556e for instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 on n-h2-858129-2 Sep 16 15:10:14.628549 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-300ba254-4b4c-40bb-93ca-ea126e97d1f9 req-74c439e8-3c18-421a-a4c3-ce545b260f0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037366 Sep 16 15:10:14.629181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3431/7401] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:10:14.765881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:14.767401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:14.777860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:14.778798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:14.779449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:14.780213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:14.780702 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:14.781145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:15.270588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:15.279559 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b9bf6a6-adcc-412a-b38a-22087a40612a tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.519395 Sep 16 15:10:15.280162 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3971/7402] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:14 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:16.304565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:16.305268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:16.312271 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:16.312631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:16.313063 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:16.313865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:16.314368 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:16.314882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:16.471824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:16.479123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:16.489813 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-53e4bb29-18a8-4036-8db4-742bed71d1b3 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1362 microversion: 2.1 time: 0.190199 Sep 16 15:10:16.490945 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3432/7403] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:16 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:17.524208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:17.524894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:17.527980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:17.528727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:17.535486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:17.536006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:17.536473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:17.537264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:17.537728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:17.538179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:17.687537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:17.696180 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7145f6d5-74d1-46cb-91ee-9bcfdf77c64b tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1554 microversion: 2.1 time: 0.175989 Sep 16 15:10:17.696803 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3972/7404] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:17 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:10:17.720330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:17.721267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:17.729396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:17.729892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:17.730333 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:17.731096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:17.731557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:17.731988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:17.888565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:17.899095 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d602b8a5-9e2b-4ab7-9849-235f3f0054c8 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1554 microversion: 2.1 time: 0.183150 Sep 16 15:10:17.899727 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3433/7405] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:17 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:10:19.531611 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb73a911-206d-4be1-9883-a319577440de"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:19.534080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:19.542017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:19.542483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:19.542942 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:19.543677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:19.544199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:19.544601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:19.700987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:19.837552 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a964b889-856f-455e-9a72-cf5802eb2553 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "POST /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309714 Sep 16 15:10:19.838521 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3973/7406] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 15:10:19 2022] POST /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:31.664352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:31.665395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:31.668463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:31.669158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=66 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:31.675824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:31.676321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:31.676794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:31.677512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:31.677974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:31.679095 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:31.767796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lazy-loading 'services' on Instance uuid 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:10:31.847571 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4ce6feb8-4edf-4d31-81ba-faf2465bfb7f tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments/eb73a911-206d-4be1-9883-a319577440de" status: 202 len: 0 microversion: 2.1 time: 0.188833 Sep 16 15:10:31.848210 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3434/7407] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:10:31 2022] DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments/eb73a911-206d-4be1-9883-a319577440de => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:10:31.856593 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:31.857481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:10:31.862894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:31.866832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:31.876707 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:31.877360 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:31.877895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:31.878716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:31.879185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:31.879622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:31.925948 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6b76a36e-7850-4fc2-acff-942e30dcc778 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071372 Sep 16 15:10:31.926578 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3974/7408] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:10:31 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:32.941617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:32.944637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:32.951220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:32.951715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:32.952159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:32.952882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:32.953334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:32.953762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:32.985738 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55578ec9-5abc-480b-9d3e-e320c4196a74 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049566 Sep 16 15:10:32.986328 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3435/7409] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:10:32 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:33.998252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:34.000529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:34.008007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:34.008508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:34.008962 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:34.009679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:34.010153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:34.010626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:34.328805 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c990d634-1e06-4c1b-b5ad-70822d4bcd72 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.334516 Sep 16 15:10:34.329384 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3975/7410] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:10:33 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 197 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:35.346055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:35.352106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:35.360152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:35.360549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:35.360980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:35.361681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:35.362126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:35.362576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:35.393069 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b070cbc1-df3e-479b-96cf-6f48cbb32231 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054531 Sep 16 15:10:35.393644 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3436/7411] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:10:35 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:36.405791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:36.408095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:36.416778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:36.417291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:36.417833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:36.418569 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:36.419047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:36.419498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:36.453620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a31bd75d-d65a-40a0-af68-06157bc56f26 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051864 Sep 16 15:10:36.454231 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3976/7412] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:10:36 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:10:37.466265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:37.468682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:37.475509 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:37.475986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:37.476418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:37.477106 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:37.477567 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:37.477969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:37.508073 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0792b184-1de5-4eb9-8338-7fc0973f4156 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045667 Sep 16 15:10:37.508708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3437/7413] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:10:37 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 15:10:37.520046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:37.520578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:37.527469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:37.527967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:37.528418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:37.529119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:37.529583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:37.530015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:37.604961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] HTTP exception thrown: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 is not attached to volume eb73a911-206d-4be1-9883-a319577440de Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Request method failure captured: Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments/eb73a911-206d-4be1-9883-a319577440de HTTP/1.1 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJF7bkYHEpxZT6L59Hj1JI9QXk9IOT5J4KKbjH1ru9_6dfNSxqyqqAMO5hz2Epls8HjSzkV6sxeTUZ289GW3Xjpjb54zN9r7iLbnjPBR3RNzcA7X0M-R3a4FFEe4oVf4BvBzT2LXmyoRnxmAX8HO3jmNJLN4XzR_onxK0QaUkchj7tM Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00f5ac5f515a4d6ca58fde5afcfaa424", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}] Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 72c5e700d96f43aa860b04d1cc217608 Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 is not attached to volume eb73a911-206d-4be1-9883-a319577440de Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '120224af-7fa4-4ce1-9f6a-a4b4c9cc1132', 'id': 'eb73a911-206d-4be1-9883-a319577440de'} Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eb73a911-206d-4be1-9883-a319577440de. Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 is not attached to volume eb73a911-206d-4be1-9883-a319577440de Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:10:37.606673 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 is not attached to volume eb73a911-206d-4be1-9883-a319577440de Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Returning 404 to user: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 is not attached to volume eb73a911-206d-4be1-9883-a319577440de {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91fdd430-c543-41df-bfd7-926a069f9cd0 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments/eb73a911-206d-4be1-9883-a319577440de" status: 404 len: 154 microversion: 2.1 time: 0.092113 Sep 16 15:10:37.611022 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3977/7414] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:10:37 2022] DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132/os-volume_attachments/eb73a911-206d-4be1-9883-a319577440de => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:10:40.967963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:40.968878 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:40.976083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:40.976583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:40.977032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:40.977760 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:40.978225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:40.978753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:41.007659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:10:41.095032 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9ec09853-22aa-4019-9f39-1d332a31f187 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 204 len: 0 microversion: 2.1 time: 0.130813 Sep 16 15:10:41.095990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3438/7415] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:10:40 2022] DELETE /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:10:41.104584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:41.105245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:41.112814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:41.113325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:41.113786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:41.114563 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:41.115588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:41.116036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:41.253235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:41.262094 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9758d727-fdc8-40ec-91c9-2c0b5ec44f68 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1560 microversion: 2.1 time: 0.161376 Sep 16 15:10:41.262764 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3978/7416] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:41 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:10:42.287662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:42.288432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:42.295560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:42.296045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:42.296508 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:42.297212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:42.297665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:42.298087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:42.427488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:42.435230 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8a876ab7-8f90-4d58-bc6f-6ce113e608fb tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1560 microversion: 2.1 time: 0.151957 Sep 16 15:10:42.435805 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3439/7417] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:42 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:43.458272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:43.459372 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:43.466356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:43.466888 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:43.467341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:43.468322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:43.468791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:43.469230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:43.564599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c5e700d96f43aa860b04d1cc217608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5ac5f515a4d6ca58fde5afcfaa424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:10:43.569611 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e9b3da8c-90b6-43e4-84b1-f874b69a9ea2 req-8d673889-2e1b-46ef-b63b-0b44b22317a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120224af-7fa4-4ce1-9f6a-a4b4c9cc1132", "name": "network-vif-deleted", "tag": "23a62573-3a1c-45cb-a932-08934387556e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:10:43.580457 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eebe18bd-304c-4022-85a7-392bdf81ea27 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 200 len: 1518 microversion: 2.1 time: 0.126068 Sep 16 15:10:43.581214 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3979/7418] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:43 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 1518 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:10:43.588114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e9b3da8c-90b6-43e4-84b1-f874b69a9ea2 req-8d673889-2e1b-46ef-b63b-0b44b22317a2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:43.588506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e9b3da8c-90b6-43e4-84b1-f874b69a9ea2 req-8d673889-2e1b-46ef-b63b-0b44b22317a2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:43.589006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e9b3da8c-90b6-43e4-84b1-f874b69a9ea2 req-8d673889-2e1b-46ef-b63b-0b44b22317a2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:43.607351 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e9b3da8c-90b6-43e4-84b1-f874b69a9ea2 req-8d673889-2e1b-46ef-b63b-0b44b22317a2 service nova] Creating event network-vif-deleted:23a62573-3a1c-45cb-a932-08934387556e for instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 on n-h2-858129-2 Sep 16 15:10:43.612414 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e9b3da8c-90b6-43e4-84b1-f874b69a9ea2 req-8d673889-2e1b-46ef-b63b-0b44b22317a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052192 Sep 16 15:10:43.613038 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3440/7419] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:10:44.609255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:44.609802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] [instance: 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:10:44.617474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:44.617982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:44.618461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:44.619185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:10:44.619672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:10:44.620125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:10:44.633557 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] HTTP exception thrown: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 could not be found. Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Request method failure captured: Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 HTTP/1.1 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJF7bkYHEpxZT6L59Hj1JI9QXk9IOT5J4KKbjH1ru9_6dfNSxqyqqAMO5hz2Epls8HjSzkV6sxeTUZ289GW3Xjpjb54zN9r7iLbnjPBR3RNzcA7X0M-R3a4FFEe4oVf4BvBzT2LXmyoRnxmAX8HO3jmNJLN4XzR_onxK0QaUkchj7tM Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00f5ac5f515a4d6ca58fde5afcfaa424", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00f5ac5f515a4d6ca58fde5afcfaa424"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00f5ac5f515a4d6ca58fde5afcfaa424"}]}] Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 00f5ac5f515a4d6ca58fde5afcfaa424 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1358643743 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 72c5e700d96f43aa860b04d1cc217608 Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestEncryptedCinderVolumes-1358643743-project Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 could not be found. Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '120224af-7fa4-4ce1-9f6a-a4b4c9cc1132'} Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 could not be found. Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 could not be found. Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:44.635149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 could not be found. Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Returning 404 to user: Instance 120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b89596a6-14c1-4375-80cd-1f76706d9c61 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132" status: 404 len: 111 microversion: 2.1 time: 0.031477 Sep 16 15:10:44.640277 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3980/7420] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:10:44 2022] GET /compute/v2.1/servers/120224af-7fa4-4ce1-9f6a-a4b4c9cc1132 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:10:44.646816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62830687-d693-46ce-90e3-03b77ac9f574 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] Calling method '.version_select at 0x7f724c2500d0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:10:44.666932 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62830687-d693-46ce-90e3-03b77ac9f574 tempest-TestEncryptedCinderVolumes-1358643743 tempest-TestEncryptedCinderVolumes-1358643743-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1813314575" status: 202 len: 0 microversion: 2.1 time: 0.025161 Sep 16 15:10:44.667515 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3441/7421] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 15:10:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1813314575 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:11:11.733178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aafcb394-c388-4341-9550-46391c2d4945 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'create', calling method: .version_select at 0x7f724d711790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-342465551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxhL+FHYwMuOdu4+3vwKyHNdrsXLci2e84hjWRhVnzHYH6ZtEo3v05+p34l0xKdUrk1z2ge6DL9lpPRbRlR1usbqKYe8wzP0yEQtd18f0glr+75a/iiW4oDC2ROAWwCLQ=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:11.740002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=14 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:11.740713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=38 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:11.752731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-aafcb394-c388-4341-9550-46391c2d4945 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:11:11.759313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-aafcb394-c388-4341-9550-46391c2d4945 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for user e2c5b27fda4e446dbcbe946a6302a2f1 and project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:11:11.782287 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aafcb394-c388-4341-9550-46391c2d4945 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053072 Sep 16 15:11:11.782911 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3981/7422] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:11:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:11:11.831118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:11.831898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:11.836500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1749683922", "imageRef": "f025a905-05a6-485c-bcaa-e21cc79eae90", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-342465551", "networks": [{"uuid": "26f24c85-1dd1-4af8-962a-6ccd881e35a2"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:11.891545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] validate_networks() for [('26f24c85-1dd1-4af8-962a-6ccd881e35a2', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:11:12.264122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:11:12.264543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:11:12.265022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:11:12.265464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:11:12.265883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:11:12.282072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:12.282596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:12.283037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:12.283762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:12.284215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:12.284638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:12.304456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:11:12.309626 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for user e2c5b27fda4e446dbcbe946a6302a2f1 and project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:11:12.321787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:11:12.324141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f025a905-05a6-485c-bcaa-e21cc79eae90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:11:12.370023 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a4d9f91-d3a6-48ce-a36c-80eeea1672cc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540968 Sep 16 15:11:12.370734 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3442/7423] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:11:12.381881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bc9961a2-c66b-438c-97a2-af9a986e6c59 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:12.382550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bc9961a2-c66b-438c-97a2-af9a986e6c59 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:12.437856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bc9961a2-c66b-438c-97a2-af9a986e6c59 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:12.445710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bc9961a2-c66b-438c-97a2-af9a986e6c59 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1258 microversion: 2.1 time: 0.067834 Sep 16 15:11:12.446304 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3982/7424] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:12 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:13.470857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:13.472248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:13.479704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:13.480547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:13.481203 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:13.482173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:13.482940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:13.483808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:13.573904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:13.585933 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3a0ca7c-7c6c-488a-86f2-4edd4a931e1d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1318 microversion: 2.1 time: 0.119395 Sep 16 15:11:13.587529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3443/7425] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:13 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1318 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:14.613390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:14.614029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:14.658107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:14.658689 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:14.661209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:14.662255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:14.662756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:14.663210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:14.900367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:14.907969 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94a23bcf-d029-4714-ad37-444023966a4e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.299726 Sep 16 15:11:14.909144 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3983/7426] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:14 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:15.932143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:15.932929 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:15.940730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:15.941746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:15.942198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:15.942945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:15.943407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:15.943835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:16.131710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:16.143643 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-df6236c8-e783-496c-bfce-eed4eb186839 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.215318 Sep 16 15:11:16.147107 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3444/7427] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:15 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:17.170681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:17.171986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:17.179120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:17.179630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:17.180077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:17.180952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:17.181426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:17.181868 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:17.321979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:17.330967 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b23d1c49-0c55-4ed2-9b41-e2a42fa8155a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.165272 Sep 16 15:11:17.331564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3984/7428] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:17 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:18.355870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:18.356481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:18.364039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:18.364526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:18.364963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:18.365667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:18.366116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:18.366568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:18.516363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:18.525602 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2db68853-8c89-4df7-ad7a-d3cea053da6b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.173513 Sep 16 15:11:18.538991 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3445/7429] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:18 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:19.551661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:19.552306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:19.559949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:19.560462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:19.560924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:19.561652 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:19.562167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:19.562610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:19.970139 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:19.980488 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-4f5116da-a212-4bc2-8215-485db48ab4c1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.433135 Sep 16 15:11:19.981320 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3985/7430] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:19 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:21.006358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:21.008897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:21.016693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:21.017214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:21.017649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:21.018342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:21.018860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:21.019456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:21.154344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:21.163194 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3b9d6eec-27a0-4e06-ae70-ebfbaa81f6bf tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.161442 Sep 16 15:11:21.163522 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3446/7431] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:21 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:22.186498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:22.187125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:22.194423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:22.194950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:22.195413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:22.196145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:22.196623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:22.197074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:22.329055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:22.338194 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52ea9c13-107d-451d-adb9-66a6d82c6531 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.155758 Sep 16 15:11:22.338801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3986/7432] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:22 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:23.362471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:23.363168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:23.366364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:23.367054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:23.372439 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:23.372921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:23.373355 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:23.374047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:23.374527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:23.374952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:23.505944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:23.513752 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-edeeb692-17c9-461f-a9d2-52cee50c47be tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.155202 Sep 16 15:11:23.514347 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3447/7433] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:23 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:24.536562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:24.537207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:24.539096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:24.545406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:24.545842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:24.546292 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:24.547027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:24.547501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:24.547946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:24.678458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:24.686272 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab475c9b-50ae-46bb-96b1-c99ff23e5270 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.153683 Sep 16 15:11:24.686891 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3987/7434] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:24 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:25.672833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2f07b3aa-7e43-4ab8-80a5-5aee421b7cf2 req-b5721b86-e772-4337-81e9-8421abb3c8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:25.683576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2f07b3aa-7e43-4ab8-80a5-5aee421b7cf2 req-b5721b86-e772-4337-81e9-8421abb3c8f1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:25.684072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2f07b3aa-7e43-4ab8-80a5-5aee421b7cf2 req-b5721b86-e772-4337-81e9-8421abb3c8f1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:25.684510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2f07b3aa-7e43-4ab8-80a5-5aee421b7cf2 req-b5721b86-e772-4337-81e9-8421abb3c8f1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:25.703174 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2f07b3aa-7e43-4ab8-80a5-5aee421b7cf2 req-b5721b86-e772-4337-81e9-8421abb3c8f1 service nova] Creating event network-changed:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:11:25.710191 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2f07b3aa-7e43-4ab8-80a5-5aee421b7cf2 req-b5721b86-e772-4337-81e9-8421abb3c8f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041020 Sep 16 15:11:25.710496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:25.711147 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3448/7435] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:11:25.711380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:25.719879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:25.720487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:25.721022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:25.721746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:25.722218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:25.722680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:25.863829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:25.871970 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-458bfeb1-38c6-4d35-b061-99bdce75fe10 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.166785 Sep 16 15:11:25.872576 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3988/7436] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:25 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:11:26.897792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:26.898629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:26.904940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:26.905433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:26.905873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:26.906604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:26.907068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:26.907501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:27.040364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:27.048241 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4336b366-3584-4b97-a32f-998e45b4d2ce tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.156179 Sep 16 15:11:27.048838 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3449/7437] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:26 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:28.071875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:28.072513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:28.079323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:28.079832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:28.080290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:28.081007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:28.081485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:28.081934 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:28.213754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:28.221755 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-76bdca1c-496b-4350-a9c0-453a1d8cac3e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.153868 Sep 16 15:11:28.222326 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3989/7438] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:28 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:29.244102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:29.244752 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:29.251683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:29.252167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:29.252605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:29.253303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:29.253757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:29.254186 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:29.389511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:29.398237 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d0cae70-9c28-47f2-9853-274c508452a6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.158089 Sep 16 15:11:29.398849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3450/7439] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:29 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:30.421020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:30.421651 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:30.429338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:30.429848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:30.430303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:30.431064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:30.431542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:30.431991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:30.564132 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:30.573673 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-362edad3-ae60-4277-a9f2-c8cbfe4893bd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.156530 Sep 16 15:11:30.574262 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3990/7440] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:30 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:31.597988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:31.598555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:31.605586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:31.606078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:31.606546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:31.607253 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:31.607714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:31.608148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:31.735558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:31.744843 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e3379a2-bfba-48e0-9966-9ca72abc9074 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.151128 Sep 16 15:11:31.745641 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3451/7441] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:31 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:32.768681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:32.769476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:32.783102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:32.783102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:32.783102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:32.783102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:32.783102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:32.783102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:32.907737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d62d8eaa-77af-4108-bf30-312e1702a3a5 req-0e400e63-cd95-4b0a-b37d-6bb350dd5507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "name": "network-vif-plugged", "status": "completed", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:32.919814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d62d8eaa-77af-4108-bf30-312e1702a3a5 req-0e400e63-cd95-4b0a-b37d-6bb350dd5507 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:32.921000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d62d8eaa-77af-4108-bf30-312e1702a3a5 req-0e400e63-cd95-4b0a-b37d-6bb350dd5507 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:32.921442 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d62d8eaa-77af-4108-bf30-312e1702a3a5 req-0e400e63-cd95-4b0a-b37d-6bb350dd5507 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:32.922901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:32.933629 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ff694b56-a42c-4fe7-bb38-e091d055ca79 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.168842 Sep 16 15:11:32.933954 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d62d8eaa-77af-4108-bf30-312e1702a3a5 req-0e400e63-cd95-4b0a-b37d-6bb350dd5507 service nova] Creating event network-vif-plugged:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:11:32.938494 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3991/7442] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:32 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:32.939377 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d62d8eaa-77af-4108-bf30-312e1702a3a5 req-0e400e63-cd95-4b0a-b37d-6bb350dd5507 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036470 Sep 16 15:11:32.939978 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3452/7443] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:11:33.957832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:33.958482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:33.965375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:33.965879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:33.966358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:33.967433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:33.967908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:33.968354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:34.094659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:34.102899 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ac786d9d-0ec2-42b4-bd12-35a9178ff995 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1358 microversion: 2.1 time: 0.149139 Sep 16 15:11:34.103481 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3992/7444] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:33 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:35.127462 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:35.128158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:35.136026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.136506 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.136959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.137653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.138102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.138553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.277645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:35.285891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1c2780ee-3c17-43bc-8fa8-1efdf0957016 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1548 microversion: 2.1 time: 0.162667 Sep 16 15:11:35.286494 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3453/7445] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:35 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:35.309316 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:35.310565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:35.318199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.318726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.319177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.319890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.320368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.320799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.451198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:35.459034 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf3c2b57-f92d-41b8-9e0f-2b16c87639ec tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1548 microversion: 2.1 time: 0.153772 Sep 16 15:11:35.459617 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3993/7446] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:35 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:35.481786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:35.486517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:35.487302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Searching by: {'deleted': False, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b'} {{(pid=128643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 15:11:35.493222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.493707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.494144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.494916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.495374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.495800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.519612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.multi_cell_list [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 15:11:35.551340 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed24b2a1-864b-4b2a-afcb-e6e8b772be91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072697 Sep 16 15:11:35.551961 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3454/7447] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 15:11:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:11:35.563705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:35.564330 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:35.570442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.570953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.571408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.572123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:35.572600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:35.573044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:35.707310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:35.715211 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dd88e7fa-1877-43db-b272-1d9a6d92d888 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1548 microversion: 2.1 time: 0.155426 Sep 16 15:11:35.715799 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3994/7448] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:35 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:37.270557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45814184-f838-442a-b241-a12bf917286d"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:37.272928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:37.279858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:37.280348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:37.280789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:37.281489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:37.281948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:37.282377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:37.555652 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8bbe70ca-83f8-47a0-b04d-0a22da476145 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289465 Sep 16 15:11:37.556311 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3455/7449] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 15:11:37 2022] POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:11:50.609042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:50.609676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:50.612237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:50.613470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=72 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:50.620181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:50.620688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:50.621148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:50.621876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:50.622351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:50.622826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:50.753456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:50.761683 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12fecf7e-e416-4356-b714-219c0f8448fd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1594 microversion: 2.1 time: 0.156683 Sep 16 15:11:50.762261 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3995/7450] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:50 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:11:52.746101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:52.747382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:52.748190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:11:52.829980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-28363709-cb26-4497-a993-69d4a5f3de5e req-e4378832-414f-42a2-8b06-ad58bb4547ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:52.841824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28363709-cb26-4497-a993-69d4a5f3de5e req-e4378832-414f-42a2-8b06-ad58bb4547ba service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:52.842308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28363709-cb26-4497-a993-69d4a5f3de5e req-e4378832-414f-42a2-8b06-ad58bb4547ba service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:52.842773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28363709-cb26-4497-a993-69d4a5f3de5e req-e4378832-414f-42a2-8b06-ad58bb4547ba service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:52.854354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-28363709-cb26-4497-a993-69d4a5f3de5e req-e4378832-414f-42a2-8b06-ad58bb4547ba service nova] Creating event network-changed:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:11:52.861050 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-28363709-cb26-4497-a993-69d4a5f3de5e req-e4378832-414f-42a2-8b06-ad58bb4547ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116774 Sep 16 15:11:52.862117 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3456/7451] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:11:53.813433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-864190751"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:53.813999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:53.821302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:53.821813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:53.822272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:53.823026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:53.823502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:53.823945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:53.961064 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.security_group_api [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Adding security group e0e7e1dd-278c-465a-b91c-8b8c1c6bca7e to port cdd33e2b-b8aa-4646-af2c-2f415c1761af Sep 16 15:11:54.270849 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f7011416-d44d-4d86-a8d2-52fa5effbfcd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action" status: 202 len: 0 microversion: 2.1 time: 0.461291 Sep 16 15:11:54.271615 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3996/7452] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:11:53 2022] POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:11:54.280362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e5a6ceae-cba1-457e-8bbf-af4795c1a126 req-e28ab842-2e3a-4b31-b579-65a9a4772d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:11:54.290113 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:11:54.290773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:11:54.297472 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e5a6ceae-cba1-457e-8bbf-af4795c1a126 req-e28ab842-2e3a-4b31-b579-65a9a4772d2f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:54.299102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:54.299476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:54.299709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e5a6ceae-cba1-457e-8bbf-af4795c1a126 req-e28ab842-2e3a-4b31-b579-65a9a4772d2f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:54.300009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:54.300609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e5a6ceae-cba1-457e-8bbf-af4795c1a126 req-e28ab842-2e3a-4b31-b579-65a9a4772d2f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:54.301014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:11:54.301646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:11:54.302087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:11:54.318354 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e5a6ceae-cba1-457e-8bbf-af4795c1a126 req-e28ab842-2e3a-4b31-b579-65a9a4772d2f service nova] Creating event network-changed:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:11:54.324804 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e5a6ceae-cba1-457e-8bbf-af4795c1a126 req-e28ab842-2e3a-4b31-b579-65a9a4772d2f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049318 Sep 16 15:11:54.325924 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3457/7453] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:11:54.552899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:11:54.561834 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-080cfed4-a363-44d0-8fd4-9fbd95ce1a1b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1758 microversion: 2.1 time: 0.275497 Sep 16 15:11:54.562882 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3997/7454] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:11:54 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1758 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:14:07.853880 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:14:07.854480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:14:07.855213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:14:07.856424 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:14:07.856664 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action (ip 10.222.0.60) !!! Sep 16 15:14:07.859514 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:14:07.859756 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action (ip 10.222.0.60) !!! Sep 16 15:14:07.861616 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:14:07.861865 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action (ip 10.222.0.60) !!! Sep 16 15:14:07.867605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:14:07.869890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:14:07.883293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:14:07.883843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:14:07.884285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:14:07.885001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:14:07.885459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:14:07.885885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:14:07.968682 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-552a2128-89a8-466b-9bad-2325a030f3b9 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action" status: 202 len: 0 microversion: 2.1 time: 0.116271 Sep 16 15:14:07.969347 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3458/7455] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:14:07 2022] POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:14:07.976869 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:14:07.978438 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:14:07.978992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:14:07.979828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:14:07.980992 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:14:07.981133 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 (ip 10.222.0.60) !!! Sep 16 15:14:07.982973 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:14:07.983093 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 (ip 10.222.0.60) !!! Sep 16 15:14:07.984509 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:14:07.984628 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 (ip 10.222.0.60) !!! Sep 16 15:14:07.990284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:14:07.991125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:14:08.009086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:14:08.009596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:14:08.010056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:14:08.010820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:14:08.011302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:14:08.011752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:14:08.245659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:14:08.254080 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79a07742-3b2a-4617-b4a2-4523ef6d95d4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1760 microversion: 2.1 time: 0.279889 Sep 16 15:14:08.254883 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3998/7456] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:14:07 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1760 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:14:09.280593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:14:09.281311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:14:09.288652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:14:09.289156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:14:09.289601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:14:09.291411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:14:09.292521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:14:09.293243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:14:09.313792 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45516. Sep 16 15:14:09.446640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:14:09.454991 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ec4c7b0f-43fe-4e78-9aba-8a822a946118 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1758 microversion: 2.1 time: 0.180861 Sep 16 15:14:09.455569 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3459/7457] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:14:09 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:15:53.436633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:15:53.437406 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:15:53.443018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-864190751"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:15:53.443645 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:15:53.455446 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:53.455982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:53.456473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:53.457162 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:53.457634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:53.458076 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:53.459288 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45544. Sep 16 15:15:53.462453 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45542. Sep 16 15:15:53.596752 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.security_group_api [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Removing security group e0e7e1dd-278c-465a-b91c-8b8c1c6bca7e from port cdd33e2b-b8aa-4646-af2c-2f415c1761af Sep 16 15:15:53.911621 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7456c76b-2d90-414f-9d99-2b0eeb1a5e0f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action" status: 202 len: 0 microversion: 2.1 time: 0.478087 Sep 16 15:15:53.912270 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 3999/7458] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:15:53 2022] POST /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:15:53.919363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:15:53.920130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:15:54.013006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2098b886-0b8c-47ae-9d44-e6f15fba7fb6 req-00aaed12-1e5c-4bd1-b657-94ae8db1943f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:15:54.023077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2098b886-0b8c-47ae-9d44-e6f15fba7fb6 req-00aaed12-1e5c-4bd1-b657-94ae8db1943f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:54.023728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2098b886-0b8c-47ae-9d44-e6f15fba7fb6 req-00aaed12-1e5c-4bd1-b657-94ae8db1943f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:54.024170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2098b886-0b8c-47ae-9d44-e6f15fba7fb6 req-00aaed12-1e5c-4bd1-b657-94ae8db1943f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:54.037558 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2098b886-0b8c-47ae-9d44-e6f15fba7fb6 req-00aaed12-1e5c-4bd1-b657-94ae8db1943f service nova] Creating event network-changed:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:15:54.043428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2098b886-0b8c-47ae-9d44-e6f15fba7fb6 req-00aaed12-1e5c-4bd1-b657-94ae8db1943f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127508 Sep 16 15:15:54.044551 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3460/7459] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:15:55.724848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:15:55.725439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:15:55.731993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:55.732493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:55.732950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:55.733674 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:55.734147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:55.734633 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:55.824644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lazy-loading 'services' on Instance uuid 7c302403-3752-4838-a4db-b8befbd313e7 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:15:55.903744 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28123c18-0482-4f5e-83c1-b662a4850fbd tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments/45814184-f838-442a-b241-a12bf917286d" status: 202 len: 0 microversion: 2.1 time: 0.183725 Sep 16 15:15:55.904398 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4000/7460] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:15:55 2022] DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments/45814184-f838-442a-b241-a12bf917286d => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:15:55.914482 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:15:55.916765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:15:55.925734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:55.926223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:55.926727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:55.927708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:55.928193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:55.928763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:55.964906 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-49cb58c1-62db-4864-a2cb-88f7d203adb8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055052 Sep 16 15:15:55.966692 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3461/7461] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:15:55 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:15:56.060657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-66ba9aa9-52bb-4396-843e-b5dea8ac676b req-8ef30deb-4cb4-46f8-ac96-0e58aa78c3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:15:56.071912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-66ba9aa9-52bb-4396-843e-b5dea8ac676b req-8ef30deb-4cb4-46f8-ac96-0e58aa78c3a6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:56.072413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-66ba9aa9-52bb-4396-843e-b5dea8ac676b req-8ef30deb-4cb4-46f8-ac96-0e58aa78c3a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:56.072859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-66ba9aa9-52bb-4396-843e-b5dea8ac676b req-8ef30deb-4cb4-46f8-ac96-0e58aa78c3a6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:56.084261 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-66ba9aa9-52bb-4396-843e-b5dea8ac676b req-8ef30deb-4cb4-46f8-ac96-0e58aa78c3a6 service nova] Creating event network-changed:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:15:56.089488 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-66ba9aa9-52bb-4396-843e-b5dea8ac676b req-8ef30deb-4cb4-46f8-ac96-0e58aa78c3a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033332 Sep 16 15:15:56.090128 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4001/7462] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:15:56.979138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:15:56.981738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:15:56.989736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:56.990248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:56.990707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:56.991476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:56.991926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:56.992382 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:57.021961 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dbc20d43-85b6-4468-afec-a858f9566f91 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047521 Sep 16 15:15:57.022565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3462/7463] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:15:56 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:15:58.037255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:15:58.039685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:15:58.046634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:58.047152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:58.047609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:58.048348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:58.048830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:58.049305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:58.083861 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-191dcc83-7274-4b80-9e5f-51cb740b5d28 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052652 Sep 16 15:15:58.084472 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4002/7464] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:15:58 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:15:59.096947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:15:59.099152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:15:59.106171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:59.106692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:59.107137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:59.107840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:15:59.108297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:15:59.108723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:15:59.139386 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d7bb5f9-0566-412f-aa45-8be0c2937623 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 16 15:15:59.139791 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3463/7465] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:15:59 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:00.151715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:00.153981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:00.161727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:00.162245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:00.162735 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:00.163477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:00.163959 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:00.164410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:00.195583 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9a89ede7-e34e-4368-81f5-67f0a9c99d04 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047985 Sep 16 15:16:00.196386 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4003/7466] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:16:00 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:01.208852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:01.211239 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:01.218027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:01.218546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:01.218989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:01.219689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:01.220147 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:01.220601 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:01.249589 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c355670c-1fb9-4dfa-ad32-84a9ab9bd067 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045423 Sep 16 15:16:01.250154 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3464/7467] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:16:01 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 15:16:01.260925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:01.261440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:01.268847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:01.269350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:01.269796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:01.270528 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:01.270995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:01.271437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:01.348594 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] HTTP exception thrown: Instance 7c302403-3752-4838-a4db-b8befbd313e7 is not attached to volume 45814184-f838-442a-b241-a12bf917286d Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Request method failure captured: Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments/45814184-f838-442a-b241-a12bf917286d HTTP/1.1 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJIA4FNXmRXdwgt_nrzybOHpCS2DALZh35iGF7DUhPmAry6i8lSJ3Ok32vqpABUMcrUEA0107EbMX6wlyvo0dtdGLvXPu46oY0mlNdeRWRiA43E-dUyPvayZSgsSnNY_AQAoy_43nX0cO8ElBp63IdoVUsWpY6AbYUW1VuEi-bM229A Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbbbe64dfc3f46c88191230ea1d6442b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}] Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2c5b27fda4e446dbcbe946a6302a2f1 Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7c302403-3752-4838-a4db-b8befbd313e7 is not attached to volume 45814184-f838-442a-b241-a12bf917286d Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': '7c302403-3752-4838-a4db-b8befbd313e7', 'id': '45814184-f838-442a-b241-a12bf917286d'} Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45814184-f838-442a-b241-a12bf917286d. Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c302403-3752-4838-a4db-b8befbd313e7 is not attached to volume 45814184-f838-442a-b241-a12bf917286d Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:16:01.350237 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c302403-3752-4838-a4db-b8befbd313e7 is not attached to volume 45814184-f838-442a-b241-a12bf917286d Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Returning 404 to user: Instance 7c302403-3752-4838-a4db-b8befbd313e7 is not attached to volume 45814184-f838-442a-b241-a12bf917286d {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3039feb9-f5df-4cca-a4c0-b6e637818ca5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments/45814184-f838-442a-b241-a12bf917286d" status: 404 len: 154 microversion: 2.1 time: 0.094846 Sep 16 15:16:01.355470 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4004/7468] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:16:01 2022] DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7/os-volume_attachments/45814184-f838-442a-b241-a12bf917286d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:16:04.699212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:04.699776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:04.707958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:04.708491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:04.709081 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:04.709647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:04.710123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:04.710984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:04.738686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:16:04.817649 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f66b674f-0be8-4161-b598-a6567ba4934a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 204 len: 0 microversion: 2.1 time: 0.121982 Sep 16 15:16:04.818748 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3465/7469] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:16:04 2022] DELETE /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:16:04.827690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:04.828564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:04.836191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:04.836705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:04.837135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:04.837845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:04.838312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:04.838882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:04.970936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:04.979607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-808050c0-4994-4a74-9e2b-3e550b636562 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1554 microversion: 2.1 time: 0.156205 Sep 16 15:16:04.980530 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4005/7470] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:04 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:16:06.003029 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:06.003741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:06.011407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:06.011898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:06.012342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:06.013042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:06.013503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:06.013933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:06.199558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:06.207822 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-260a44a3-a990-40a4-a083-ef80b94a1857 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1554 microversion: 2.1 time: 0.209124 Sep 16 15:16:06.208565 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3466/7471] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:05 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:07.139460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e3bbe630-a748-4601-99c0-462ebe9f888b req-399839b2-d7a1-4498-bfd2-c2f31bd2ab7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c302403-3752-4838-a4db-b8befbd313e7", "name": "network-vif-deleted", "tag": "cdd33e2b-b8aa-4646-af2c-2f415c1761af"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:07.153981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e3bbe630-a748-4601-99c0-462ebe9f888b req-399839b2-d7a1-4498-bfd2-c2f31bd2ab7c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:07.154615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e3bbe630-a748-4601-99c0-462ebe9f888b req-399839b2-d7a1-4498-bfd2-c2f31bd2ab7c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:07.155218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e3bbe630-a748-4601-99c0-462ebe9f888b req-399839b2-d7a1-4498-bfd2-c2f31bd2ab7c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:07.169183 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e3bbe630-a748-4601-99c0-462ebe9f888b req-399839b2-d7a1-4498-bfd2-c2f31bd2ab7c service nova] Creating event network-vif-deleted:cdd33e2b-b8aa-4646-af2c-2f415c1761af for instance 7c302403-3752-4838-a4db-b8befbd313e7 on n-h1-858129-2 Sep 16 15:16:07.175451 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e3bbe630-a748-4601-99c0-462ebe9f888b req-399839b2-d7a1-4498-bfd2-c2f31bd2ab7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041284 Sep 16 15:16:07.176069 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4006/7472] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:07.232783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:07.233397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:07.240381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:07.240882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:07.241300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:07.242064 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:07.242610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:07.243068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:07.276025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:07.276534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:07.276971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:07.277623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lazy-loading 'fault' on Instance uuid 7c302403-3752-4838-a4db-b8befbd313e7 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:16:07.325890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:07.334679 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-efbe5d6b-aef4-4b03-882b-67e1bdd3bd66 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 200 len: 1348 microversion: 2.1 time: 0.105695 Sep 16 15:16:07.335332 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3467/7473] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:07 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:08.360019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:08.360743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: 7c302403-3752-4838-a4db-b8befbd313e7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:08.368539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:08.369306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:08.369772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:08.370527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:08.371008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:08.371457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:08.387214 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] HTTP exception thrown: Instance 7c302403-3752-4838-a4db-b8befbd313e7 could not be found. Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Request method failure captured: Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 HTTP/1.1 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJIA4FNXmRXdwgt_nrzybOHpCS2DALZh35iGF7DUhPmAry6i8lSJ3Ok32vqpABUMcrUEA0107EbMX6wlyvo0dtdGLvXPu46oY0mlNdeRWRiA43E-dUyPvayZSgsSnNY_AQAoy_43nX0cO8ElBp63IdoVUsWpY6AbYUW1VuEi-bM229A Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbbbe64dfc3f46c88191230ea1d6442b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}] Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2c5b27fda4e446dbcbe946a6302a2f1 Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 7c302403-3752-4838-a4db-b8befbd313e7 could not be found. Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '7c302403-3752-4838-a4db-b8befbd313e7'} Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c302403-3752-4838-a4db-b8befbd313e7 could not be found. Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c302403-3752-4838-a4db-b8befbd313e7 could not be found. Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:16:08.388899 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c302403-3752-4838-a4db-b8befbd313e7 could not be found. Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Returning 404 to user: Instance 7c302403-3752-4838-a4db-b8befbd313e7 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0517e0e6-acb9-4a09-803c-cc9c4332bd9e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7" status: 404 len: 111 microversion: 2.1 time: 0.034619 Sep 16 15:16:08.394694 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4007/7474] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:08 2022] GET /compute/v2.1/servers/7c302403-3752-4838-a4db-b8befbd313e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:16:08.399942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b8304cf7-bc8e-499a-a111-4e87989c139d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '.version_select at 0x7f724c659f70>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:08.433485 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b8304cf7-bc8e-499a-a111-4e87989c139d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-342465551" status: 202 len: 0 microversion: 2.1 time: 0.037322 Sep 16 15:16:08.434169 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3468/7475] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 15:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-342465551 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:16:17.533517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dbcd4afd-3449-4e09-8436-9ce76428fc92 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'create', calling method: .version_select at 0x7f724c2d1790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-891754854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxvy41CBaSKfsottLD5pyx3245Yc1IW0ez0pOK2kBC/BRaUzy5k5oMuAUJS4j3SMEabZ7SOcCWyxylIaJ59q4pJ5ujlMO55b757rvMi6n8U9bEtHGdvr9DTIi6DXGEvNg=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:17.551744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dbcd4afd-3449-4e09-8436-9ce76428fc92 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:16:17.556983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-dbcd4afd-3449-4e09-8436-9ce76428fc92 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for user e2c5b27fda4e446dbcbe946a6302a2f1 and project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:16:17.584800 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dbcd4afd-3449-4e09-8436-9ce76428fc92 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056460 Sep 16 15:16:17.585415 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4008/7476] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:16:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:17.633852 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:16:17.637427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-827394332", "imageRef": "a6d97fe9-8ef4-4fc0-b189-134903cebb58", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-891754854", "networks": [{"uuid": "26f24c85-1dd1-4af8-962a-6ccd881e35a2"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:17.646892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:17.692698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] validate_networks() for [('26f24c85-1dd1-4af8-962a-6ccd881e35a2', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:16:18.120788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:16:18.121223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:16:18.121712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:16:18.122129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:16:18.122584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:16:18.131526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:18.132016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:18.132456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:18.133195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:18.133692 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:18.134125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:18.154740 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:16:18.160542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Getting quotas for user e2c5b27fda4e446dbcbe946a6302a2f1 and project cbbbe64dfc3f46c88191230ea1d6442b. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:16:18.173877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:16:18.176899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6d97fe9-8ef4-4fc0-b189-134903cebb58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:16:18.225065 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d1a948bf-3e76-4289-90e2-9c881632f07b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592496 Sep 16 15:16:18.225751 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3469/7477] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:16:18.237103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6f92895-d732-464d-be40-23db06cd247f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:18.237854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6f92895-d732-464d-be40-23db06cd247f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:18.296839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6f92895-d732-464d-be40-23db06cd247f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:18.304039 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6f92895-d732-464d-be40-23db06cd247f tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1257 microversion: 2.1 time: 0.070912 Sep 16 15:16:18.304629 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4009/7478] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:18 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:19.327926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:19.328543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:19.335452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:19.336211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:19.336706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:19.337413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:19.337869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:19.338296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:19.344055 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45730. Sep 16 15:16:19.404005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:19.413118 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ccc8c180-1714-4881-821f-143cf7537272 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1309 microversion: 2.1 time: 0.090536 Sep 16 15:16:19.414302 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3470/7479] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:19 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:20.437873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:20.439203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:20.451857 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:20.455665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:20.456469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:20.457321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:20.458663 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:20.459381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:20.460047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:20.695910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:20.709775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ab7d9a7-a77c-427a-a522-f493f4ab795c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.276044 Sep 16 15:16:20.729097 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4010/7480] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:20 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:21.742947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:21.743984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:21.754686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:21.755189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:21.755634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:21.756351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:21.756815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:21.757251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:21.929141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:21.943802 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a924ac88-1e3f-41c1-8628-5ca291f52807 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.208429 Sep 16 15:16:21.944909 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3471/7481] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:21 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:22.968328 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:22.969725 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:22.977290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:22.977883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:22.978481 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:22.979448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:22.979991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:22.980501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:23.123875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:23.132722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b82d3e60-101e-4ea8-ade9-e3f2e4575a8e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.168295 Sep 16 15:16:23.133597 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4011/7482] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:22 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:24.157123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:24.157753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:24.160738 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:24.166948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:24.167460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:24.167901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:24.168622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:24.169080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:24.169514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:24.321675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:24.329681 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43afea00-353e-497f-8053-cdccb5b09d0d tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.177149 Sep 16 15:16:24.347065 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3472/7483] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:24 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:25.356756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:25.357407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:25.359760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:25.366433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:25.366946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:25.367411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:25.368151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:25.368630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:25.369075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:25.516856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:25.527057 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c350f50e-29f1-4fe3-9a2b-39ec19efa7e2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.174534 Sep 16 15:16:25.528079 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4012/7484] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:25 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:26.550875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:26.551456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:26.558914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:26.559402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:26.559839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:26.560578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:26.561049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:26.561470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:26.701117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:26.710140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-20332488-85ce-490d-bdfd-337b70473631 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.163599 Sep 16 15:16:26.711038 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3473/7485] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:26 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:27.734163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:27.734824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:27.742363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:27.742892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:27.743349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:27.744052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:27.744520 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:27.744960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:27.875087 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:27.882836 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24425d09-2a2e-406a-89f4-0925fc660840 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.152592 Sep 16 15:16:27.883424 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4013/7486] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:27 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:28.905868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:28.906504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:28.909068 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:28.909904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:28.915659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:28.916140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:28.916574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:28.917268 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:28.917719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:28.918140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:29.054251 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:29.061974 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-776e47f1-0978-4aee-947e-55f1b7f38e48 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.160150 Sep 16 15:16:29.062578 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3474/7487] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:28 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:16:30.086319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:30.086960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:30.089881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:30.094990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:30.095220 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:30.095640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:30.096914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:30.097390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:30.097830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:30.099485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-66e569db-50bb-415c-8b26-dda6661c32e4 req-66d43b7c-3948-419a-9874-e9e0222e96ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:30.110879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-66e569db-50bb-415c-8b26-dda6661c32e4 req-66d43b7c-3948-419a-9874-e9e0222e96ff service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:30.111512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-66e569db-50bb-415c-8b26-dda6661c32e4 req-66d43b7c-3948-419a-9874-e9e0222e96ff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:30.112614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-66e569db-50bb-415c-8b26-dda6661c32e4 req-66d43b7c-3948-419a-9874-e9e0222e96ff service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:30.125420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-66e569db-50bb-415c-8b26-dda6661c32e4 req-66d43b7c-3948-419a-9874-e9e0222e96ff service nova] Creating event network-changed:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:16:30.130738 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-66e569db-50bb-415c-8b26-dda6661c32e4 req-66d43b7c-3948-419a-9874-e9e0222e96ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036860 Sep 16 15:16:30.131505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3475/7488] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:30.246041 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:30.254468 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12f9a203-98de-4177-804b-ceab49904960 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.173424 Sep 16 15:16:30.255090 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4014/7489] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:30 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:31.279949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:31.280657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:31.287511 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:31.287999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:31.288435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:31.289131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:31.289587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:31.290013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:31.426440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:31.434243 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3251901-0c29-46ef-897d-160610790022 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.159564 Sep 16 15:16:31.434872 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3476/7490] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:31 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:32.457314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:32.457953 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:32.465240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:32.465743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:32.466203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:32.467029 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:32.467453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:32.467898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:32.593827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:32.601725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-70377846-761f-4e5c-88f1-3d7105a8bb50 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.148388 Sep 16 15:16:32.602329 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4015/7491] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:32 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:33.625242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:33.625859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:33.633269 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:33.633759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:33.634196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:33.634922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:33.635384 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:33.635811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:33.765577 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:33.773685 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7db77e03-8ff3-4e1d-be4d-eeffb3fb46b4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.152440 Sep 16 15:16:33.774273 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3477/7492] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:33 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:34.797261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:34.797908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:34.805234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:34.805728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:34.806185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:34.806907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:34.807375 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:34.807812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:34.934426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:34.942808 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f115a64e-7fa2-4e5d-b0ad-49961b127782 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.149466 Sep 16 15:16:34.943390 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4016/7493] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:34 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:35.965527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:35.966124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:35.973090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:35.973581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:35.974018 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:35.974746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:35.975205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:35.975634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:36.102153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:36.109947 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ada9f534-a56f-4eb6-af8e-1e0d6e8ba004 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.148386 Sep 16 15:16:36.110557 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3478/7494] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:35 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:37.133312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:37.134170 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:37.141319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:37.141827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:37.142284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:37.143532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:37.144013 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:37.144460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:37.281704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:37.295005 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5b4d9ba8-fc90-4f93-805e-2a2b80e9bd00 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.163956 Sep 16 15:16:37.295753 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4017/7495] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:37 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:16:38.318801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:38.319450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:38.326332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:38.326844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:38.327281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:38.327982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:38.328433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:38.328856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:38.458614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:38.467030 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2d31ae6d-512a-40ba-81a1-add848c1215e tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.152675 Sep 16 15:16:38.467622 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3479/7496] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:38 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:38.562545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-92a8075c-e611-4bb5-a97a-a3e1e7e57ebc req-df5933fe-8a86-4638-86c0-347fb33e46f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "name": "network-vif-plugged", "status": "completed", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:38.572978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-92a8075c-e611-4bb5-a97a-a3e1e7e57ebc req-df5933fe-8a86-4638-86c0-347fb33e46f1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:38.573479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-92a8075c-e611-4bb5-a97a-a3e1e7e57ebc req-df5933fe-8a86-4638-86c0-347fb33e46f1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:38.573949 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-92a8075c-e611-4bb5-a97a-a3e1e7e57ebc req-df5933fe-8a86-4638-86c0-347fb33e46f1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:38.585097 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-92a8075c-e611-4bb5-a97a-a3e1e7e57ebc req-df5933fe-8a86-4638-86c0-347fb33e46f1 service nova] Creating event network-vif-plugged:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:16:38.591420 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-92a8075c-e611-4bb5-a97a-a3e1e7e57ebc req-df5933fe-8a86-4638-86c0-347fb33e46f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093734 Sep 16 15:16:38.592099 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4018/7497] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:16:39.491175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:39.491790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:39.499045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:39.499531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:39.499965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:39.500673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:39.501176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:39.501607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:39.629194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:39.637005 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60cc5333-1ffe-4fe6-8396-7b9e890b381c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1357 microversion: 2.1 time: 0.149831 Sep 16 15:16:39.637584 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3480/7498] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:39 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:40.662505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:40.663147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:40.672324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:40.673249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:40.674443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:40.674602 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:40.675085 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:40.675533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:40.810744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:40.818660 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c8b7850a-9eb2-4faa-8767-12511b5dfa52 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1548 microversion: 2.1 time: 0.161214 Sep 16 15:16:40.819243 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4019/7499] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:40 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:40.843041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:40.843764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:40.851151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:40.851631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:40.852060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:40.852748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:40.853196 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:40.853645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:40.980391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:40.988171 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f37272ef-ae5f-4d95-bf3f-5311ffbeb762 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1548 microversion: 2.1 time: 0.149091 Sep 16 15:16:40.988749 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3481/7500] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:40 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:41.009863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:41.014731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:41.015524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Searching by: {'deleted': False, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b'} {{(pid=128642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 15:16:41.023361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:41.023896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:41.024358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:41.025111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:41.025580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:41.026026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:41.056141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.multi_cell_list [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 15:16:41.083935 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-eab61f1a-cef1-4f12-ba60-a54e318bff88 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.077955 Sep 16 15:16:41.084540 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4020/7501] 10.222.0.60 () {58 vars in 1125 bytes} [Fri Sep 16 15:16:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:41.096393 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:41.097006 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:41.102911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:41.103397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:41.103832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:41.104525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:41.104977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:41.105409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:41.235940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:41.243639 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6e40e40-221d-4338-a214-39546db3d7da tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1548 microversion: 2.1 time: 0.151117 Sep 16 15:16:41.244221 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3482/7502] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:41 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:42.779822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c1c185e-0f91-487b-a419-daf19875e1d7"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:42.782216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:42.789580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:42.790084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:42.790596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:42.791309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:42.791785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:42.792223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:43.068118 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fc797b1f-14f1-4cf9-9b80-4a9c62891670 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292165 Sep 16 15:16:43.068788 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4021/7503] 10.222.0.60 () {60 vars in 1323 bytes} [Fri Sep 16 15:16:42 2022] POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:53.867128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:53.867734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:53.870354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=21 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:53.871222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=76 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:53.876642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:53.877124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:53.877557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:53.878299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:53.878772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:53.879191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:54.021504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:54.029867 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c0617a73-74e2-4c1f-809a-ba208b84be20 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1594 microversion: 2.1 time: 0.167410 Sep 16 15:16:54.030461 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3483/7504] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:53 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:16:55.690014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6550791b-22d1-4292-b077-9408012a9a10 req-854c1a94-c70a-44e1-9521-7cc85e5d1605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:55.697015 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:55.698130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=19 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:55.699398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:16:55.709007 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6550791b-22d1-4292-b077-9408012a9a10 req-854c1a94-c70a-44e1-9521-7cc85e5d1605 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:55.709480 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6550791b-22d1-4292-b077-9408012a9a10 req-854c1a94-c70a-44e1-9521-7cc85e5d1605 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:55.709944 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6550791b-22d1-4292-b077-9408012a9a10 req-854c1a94-c70a-44e1-9521-7cc85e5d1605 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:55.724890 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6550791b-22d1-4292-b077-9408012a9a10 req-854c1a94-c70a-44e1-9521-7cc85e5d1605 service nova] Creating event network-changed:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:16:55.730614 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6550791b-22d1-4292-b077-9408012a9a10 req-854c1a94-c70a-44e1-9521-7cc85e5d1605 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044912 Sep 16 15:16:55.731586 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4022/7505] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:16:56.942284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-111579940"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:56.942843 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:56.949642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:56.950136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:56.950624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:56.951331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:56.951790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:56.952221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:57.084584 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.network.security_group_api [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Adding security group a42a6666-8624-4edd-982a-2be800576ece to port d7fc9be2-a2af-4347-adf1-49a7ea0daf6e Sep 16 15:16:57.406223 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f05990bc-19b8-44be-a2f3-3e453d5dee37 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action" status: 202 len: 0 microversion: 2.1 time: 0.468490 Sep 16 15:16:57.406885 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3484/7506] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:16:56 2022] POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:16:57.417153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:16:57.417876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:16:57.425000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:57.425000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:57.425285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:57.425874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:57.426564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:57.427005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:57.586814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:16:57.595444 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-07f5f4d5-bfde-48d9-8b09-25c4392cd27b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1759 microversion: 2.1 time: 0.183471 Sep 16 15:16:57.596475 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4023/7507] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:16:57 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:16:57.746108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-50a49505-e1d2-462c-ab05-1b7f41139bd4 req-df676b3b-993a-4f70-bef5-75d7047065a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:16:57.756911 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-50a49505-e1d2-462c-ab05-1b7f41139bd4 req-df676b3b-993a-4f70-bef5-75d7047065a0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:16:57.757399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-50a49505-e1d2-462c-ab05-1b7f41139bd4 req-df676b3b-993a-4f70-bef5-75d7047065a0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:16:57.757831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-50a49505-e1d2-462c-ab05-1b7f41139bd4 req-df676b3b-993a-4f70-bef5-75d7047065a0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:16:57.771902 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-50a49505-e1d2-462c-ab05-1b7f41139bd4 req-df676b3b-993a-4f70-bef5-75d7047065a0 service nova] Creating event network-changed:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:16:57.778185 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-50a49505-e1d2-462c-ab05-1b7f41139bd4 req-df676b3b-993a-4f70-bef5-75d7047065a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035750 Sep 16 15:16:57.779392 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3485/7508] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:17:55.434355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:17:55.436692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:17:55.438841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:17:55.439661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:17:55.440339 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:17:55.440476 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:17:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action (ip 10.222.0.60) !!! Sep 16 15:17:55.448069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:55.448581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:55.449035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:55.449806 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:55.450230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:55.450698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:55.525580 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-07faca47-c85f-4cfa-b40c-ae285517acdc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action" status: 202 len: 0 microversion: 2.1 time: 0.095470 Sep 16 15:17:55.526236 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4024/7509] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:17:55 2022] POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:17:55.534602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:17:55.535463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:17:55.540265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:17:55.540960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:17:55.548397 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:55.548874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:55.549908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:55.550651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:55.551143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:55.551528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:55.781135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:17:55.791570 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-62a0e058-7f3b-4b0c-99de-578370ea2649 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1751 microversion: 2.1 time: 0.260337 Sep 16 15:17:55.792306 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3486/7510] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:17:55 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:17:56.817341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:17:56.818070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:17:56.824412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:56.824927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:56.825386 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:56.826105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:56.826619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:56.827067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:56.971978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:17:56.985033 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d1252e93-cbea-4714-bce2-afbaefed9d86 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.172925 Sep 16 15:17:56.985636 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4025/7511] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:17:56 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:17:58.009171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:17:58.009879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:17:58.016803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:58.017303 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:58.017745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:58.018996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:58.019457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:58.019890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:58.509343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:17:58.519045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-51220d60-8878-4ceb-83d0-3d91a33d1d46 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.513877 Sep 16 15:17:58.519635 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3487/7512] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:17:58 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:17:59.544173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:17:59.544810 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:17:59.551750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:59.552276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:59.552715 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:59.553423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:17:59.553895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:17:59.554390 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:17:59.696631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:17:59.705152 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f2fbd4d0-cc74-4467-b7b0-01c844d8905a tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.164905 Sep 16 15:17:59.706270 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4026/7513] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:17:59 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:00.730496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:00.731042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:00.738534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:00.739032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:00.739471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:00.740178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:00.740637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:00.741067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:00.891362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:00.900181 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-825c8223-b21b-46f4-bbc7-b4d46875b4c6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.173724 Sep 16 15:18:00.900758 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3488/7514] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:00 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:01.924672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:01.925310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:01.932449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:01.932991 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:01.933432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:01.934163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:01.934673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:01.935123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:02.079854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:02.088620 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-224b29e6-a014-4e87-9de4-0091d550659b tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.168454 Sep 16 15:18:02.089222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4027/7515] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:01 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:03.113148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:03.113758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:03.120688 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:03.121173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:03.121607 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:03.122307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:03.122786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:03.123212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:03.268232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:03.276795 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a72c0505-6383-4b8e-9bf8-4db77ae88bef tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.168087 Sep 16 15:18:03.277389 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3489/7516] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:03 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:04.302264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:04.302931 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:04.310323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:04.310863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:04.311335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:04.312082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:04.312565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:04.313017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:04.459846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:04.468383 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-90670bf1-a486-4eeb-ab0b-c8112edefc95 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.171024 Sep 16 15:18:04.468962 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4028/7517] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:04 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:05.495769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:05.496331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:05.503279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:05.503775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:05.504218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:05.504926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:05.505386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:05.505819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:05.653105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:05.662163 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-89f0b870-9634-49e4-8f13-08ee1b5b1abc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.170330 Sep 16 15:18:05.662794 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3490/7518] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:05 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:06.685699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:06.686251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:06.693824 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:06.694336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:06.694832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:06.695557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:06.696039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:06.696491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:06.853610 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:06.862812 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-81aadd0e-b8b4-4d38-9d78-501dfab7c344 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1756 microversion: 2.1 time: 0.181071 Sep 16 15:18:06.863398 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4029/7519] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:06 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:18:07.887111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:18:07.887706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:18:07.895172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:07.895665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:07.896103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:07.896808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:18:07.897270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:18:07.897744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:18:08.042396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:18:08.050879 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6aaf4cb1-1b17-43dd-a430-6e482413e2e0 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1759 microversion: 2.1 time: 0.167710 Sep 16 15:18:08.051517 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3491/7520] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:18:07 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:11.386607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:11.388402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:11.391744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-111579940"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:11.392315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:11.400334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:11.400849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:11.401307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:11.402043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:11.402551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:11.403009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:11.540712 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.network.security_group_api [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Removing security group a42a6666-8624-4edd-982a-2be800576ece from port d7fc9be2-a2af-4347-adf1-49a7ea0daf6e Sep 16 15:19:11.882535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-40b5bef3-1545-4631-9a8d-792788fe23dc tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action" status: 202 len: 0 microversion: 2.1 time: 0.497890 Sep 16 15:19:11.883669 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4030/7521] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:19:11 2022] POST /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:19:11.898784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:11.909277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:11.909464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=36 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:11.911743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:11.912852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:11.913736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:11.928545 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] Creating event network-changed:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:19:11.934003 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] [fce150d1-26ed-46bc-ba1d-b2a4ac025f05] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:19:12.943400 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] [fce150d1-26ed-46bc-ba1d-b2a4ac025f05] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45974. Sep 16 15:19:12.948316 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-fff4675a-3e70-4751-ad70-f235c80d8a3d req-91b782f0-e2ed-4ee2-adda-6f4dca86702f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.055370 Sep 16 15:19:12.949079 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3492/7522] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:13.246248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:13.248632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:13.266373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:13.266925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:13.267389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:13.268141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:13.268668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:13.269119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:13.382486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lazy-loading 'services' on Instance uuid f066f53c-f9f9-417a-ac1f-ca24799ce566 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:19:13.473008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e692616b-ce70-4193-bde5-8124662d0550 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments/4c1c185e-0f91-487b-a419-daf19875e1d7" status: 202 len: 0 microversion: 2.1 time: 0.237349 Sep 16 15:19:13.473818 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4031/7523] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:19:13 2022] DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments/4c1c185e-0f91-487b-a419-daf19875e1d7 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:19:13.484917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:13.487566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:13.500695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:13.501897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:13.502631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:13.504078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:13.504800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:13.505488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:13.555435 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-919045c6-a585-4255-b2c5-bf6f5fca54a8 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075579 Sep 16 15:19:13.556883 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3493/7524] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:19:13 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:14.573814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:14.576904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:14.585473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:14.585990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:14.586485 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:14.587244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:14.587726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:14.588173 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:14.626756 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30812161-888b-44cc-ad37-4249279737f6 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060930 Sep 16 15:19:14.627517 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4032/7525] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:19:14 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:19:14.964153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-27045dbf-d88f-4d32-afcd-1c88ede89ace req-722c27df-c9cc-47dd-8214-6c63fe78e20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:14.975779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-27045dbf-d88f-4d32-afcd-1c88ede89ace req-722c27df-c9cc-47dd-8214-6c63fe78e20c service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:14.976267 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-27045dbf-d88f-4d32-afcd-1c88ede89ace req-722c27df-c9cc-47dd-8214-6c63fe78e20c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:14.976711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-27045dbf-d88f-4d32-afcd-1c88ede89ace req-722c27df-c9cc-47dd-8214-6c63fe78e20c service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:14.989700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-27045dbf-d88f-4d32-afcd-1c88ede89ace req-722c27df-c9cc-47dd-8214-6c63fe78e20c service nova] Creating event network-changed:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:19:14.996094 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-27045dbf-d88f-4d32-afcd-1c88ede89ace req-722c27df-c9cc-47dd-8214-6c63fe78e20c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035882 Sep 16 15:19:14.996780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3494/7526] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:19:15.645352 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:15.647728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:15.657578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:15.658086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:15.658578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:15.659334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:15.659807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:15.660256 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:15.696757 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99093d58-e188-41a7-8e46-357f1628cc11 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058053 Sep 16 15:19:15.697371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4033/7527] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:19:15 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:16.715698 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:16.718663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:16.726088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:16.726630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:16.727076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:16.727810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:16.728272 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:16.728700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:16.769313 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-56bddda5-f307-4ae0-8187-ccfe7f285a34 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059319 Sep 16 15:19:16.770089 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3495/7528] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:19:16 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:17.784635 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:17.787065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:17.794530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:17.795053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:17.795513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:17.796253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:17.796737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:17.797191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:17.829416 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24d91c89-a1ef-4d75-b2e3-5f7bb490b3f2 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048815 Sep 16 15:19:17.829892 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4034/7529] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:19:17 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:18.843536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:18.845670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:18.853494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:18.853980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:18.854447 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:18.855154 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:18.855602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:18.856021 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:18.891878 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8eab0b07-ae2c-4a95-b8ed-1eff0183fb8c tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052511 Sep 16 15:19:18.892481 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3496/7530] 10.222.0.60 () {58 vars in 1302 bytes} [Fri Sep 16 15:19:18 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 15:19:18.904865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:18.905443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:18.913202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:18.913766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:18.914237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:18.915001 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:18.915482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:18.915930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:18.997125 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] HTTP exception thrown: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 is not attached to volume 4c1c185e-0f91-487b-a419-daf19875e1d7 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Request method failure captured: Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: request: DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments/4c1c185e-0f91-487b-a419-daf19875e1d7 HTTP/1.1 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJIA4FNXmRXdwgt_nrzybOHpCS2DALZh35iGF7DUhPmAry6i8lSJ3Ok32vqpABUMcrUEA0107EbMX6wlyvo0dtdGLvXPu46oY0mlNdeRWRiA43E-dUyPvayZSgsSnNY_AQAoy_43nX0cO8ElBp63IdoVUsWpY6AbYUW1VuEi-bM229A Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbbbe64dfc3f46c88191230ea1d6442b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}] Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2c5b27fda4e446dbcbe946a6302a2f1 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 is not attached to volume 4c1c185e-0f91-487b-a419-daf19875e1d7 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'server_id': 'f066f53c-f9f9-417a-ac1f-ca24799ce566', 'id': '4c1c185e-0f91-487b-a419-daf19875e1d7'} Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4c1c185e-0f91-487b-a419-daf19875e1d7. Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 is not attached to volume 4c1c185e-0f91-487b-a419-daf19875e1d7 Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:19:18.998914 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 is not attached to volume 4c1c185e-0f91-487b-a419-daf19875e1d7 Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Returning 404 to user: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 is not attached to volume 4c1c185e-0f91-487b-a419-daf19875e1d7 {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-8b3e8f3d-8ade-4dfd-b204-a9e758fe43db tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments/4c1c185e-0f91-487b-a419-daf19875e1d7" status: 404 len: 154 microversion: 2.1 time: 0.100461 Sep 16 15:19:19.004255 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4035/7531] 10.222.0.60 () {58 vars in 1416 bytes} [Fri Sep 16 15:19:18 2022] DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566/os-volume_attachments/4c1c185e-0f91-487b-a419-daf19875e1d7 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 15:19:22.305867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:22.306799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:22.320234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:22.321151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:22.321965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:22.323331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:22.324192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:22.325011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:22.365715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:19:22.477283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-68cca6bf-a609-4186-a904-4ba43d0887a1 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 204 len: 0 microversion: 2.1 time: 0.178689 Sep 16 15:19:22.478603 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3497/7532] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:19:22 2022] DELETE /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:19:22.487393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:22.488165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:22.497221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:22.497734 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:22.498189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:22.498980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:22.499626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:22.500077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:22.669887 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:22.685188 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cbe18369-542b-4435-b9f0-c19dae8b10df tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1554 microversion: 2.1 time: 0.201371 Sep 16 15:19:22.686303 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4036/7533] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:22 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:23.726240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:23.727093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:23.735298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:23.735800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:23.736249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:23.736994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:23.737457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:23.737890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:23.914480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:23.929545 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-420175a6-ea58-4f31-ac6a-fd42090be6c4 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1554 microversion: 2.1 time: 0.208199 Sep 16 15:19:23.930676 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3498/7534] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:23 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:24.964670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:24.965409 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:24.972205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:24.972724 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:24.973183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:24.974443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:24.974443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:24.974900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:25.192032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c5b27fda4e446dbcbe946a6302a2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbbe64dfc3f46c88191230ea1d6442b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:25.202090 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-85f62b46-1b8c-496c-82dd-f6d79aec7654 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 200 len: 1554 microversion: 2.1 time: 0.241519 Sep 16 15:19:25.202821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4037/7535] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:24 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:25.323589 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-3fd17293-c152-4a73-81cf-023e562ac880 req-55e0f91d-15ff-408a-8b98-23f61a559195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f066f53c-f9f9-417a-ac1f-ca24799ce566", "name": "network-vif-deleted", "tag": "d7fc9be2-a2af-4347-adf1-49a7ea0daf6e"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:25.334806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3fd17293-c152-4a73-81cf-023e562ac880 req-55e0f91d-15ff-408a-8b98-23f61a559195 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:25.335391 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3fd17293-c152-4a73-81cf-023e562ac880 req-55e0f91d-15ff-408a-8b98-23f61a559195 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:25.335909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-3fd17293-c152-4a73-81cf-023e562ac880 req-55e0f91d-15ff-408a-8b98-23f61a559195 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:25.348478 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-3fd17293-c152-4a73-81cf-023e562ac880 req-55e0f91d-15ff-408a-8b98-23f61a559195 service nova] Creating event network-vif-deleted:d7fc9be2-a2af-4347-adf1-49a7ea0daf6e for instance f066f53c-f9f9-417a-ac1f-ca24799ce566 on n-h2-858129-2 Sep 16 15:19:25.356021 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-3fd17293-c152-4a73-81cf-023e562ac880 req-55e0f91d-15ff-408a-8b98-23f61a559195 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Sep 16 15:19:25.357282 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3499/7536] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:26.227401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:26.228012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [instance: f066f53c-f9f9-417a-ac1f-ca24799ce566] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:26.236138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:26.236642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:26.237097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:26.237831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:26.238306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:26.238783 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:26.256310 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] HTTP exception thrown: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 could not be found. Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Request method failure captured: Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 HTTP/1.1 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJIA4FNXmRXdwgt_nrzybOHpCS2DALZh35iGF7DUhPmAry6i8lSJ3Ok32vqpABUMcrUEA0107EbMX6wlyvo0dtdGLvXPu46oY0mlNdeRWRiA43E-dUyPvayZSgsSnNY_AQAoy_43nX0cO8ElBp63IdoVUsWpY6AbYUW1VuEi-bM229A Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbbbe64dfc3f46c88191230ea1d6442b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbbbe64dfc3f46c88191230ea1d6442b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbbbe64dfc3f46c88191230ea1d6442b"}]}] Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: cbbbe64dfc3f46c88191230ea1d6442b Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962402662 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: e2c5b27fda4e446dbcbe946a6302a2f1 Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestMinimumBasicScenario-1962402662-project Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 could not be found. Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'f066f53c-f9f9-417a-ac1f-ca24799ce566'} Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 could not be found. Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 could not be found. Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:19:26.258149 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 could not be found. Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Returning 404 to user: Instance f066f53c-f9f9-417a-ac1f-ca24799ce566 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9eb5a194-d94f-4b04-aeab-b6be3c11e047 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566" status: 404 len: 111 microversion: 2.1 time: 0.036895 Sep 16 15:19:26.263504 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4038/7537] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:26 2022] GET /compute/v2.1/servers/f066f53c-f9f9-417a-ac1f-ca24799ce566 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:19:26.269641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d8b38e6e-9196-494a-9e37-c24240257cf5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] Calling method '.version_select at 0x7f724cf92160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:26.275014 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8b38e6e-9196-494a-9e37-c24240257cf5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [06bb6011-c533-4d38-a08e-8776a507e591] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:19:27.283062 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8b38e6e-9196-494a-9e37-c24240257cf5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] [06bb6011-c533-4d38-a08e-8776a507e591] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 46030. Sep 16 15:19:27.318780 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d8b38e6e-9196-494a-9e37-c24240257cf5 tempest-TestMinimumBasicScenario-1962402662 tempest-TestMinimumBasicScenario-1962402662-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-891754854" status: 202 len: 0 microversion: 2.1 time: 1.052413 Sep 16 15:19:27.319933 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3500/7538] 10.222.0.60 () {58 vars in 1269 bytes} [Fri Sep 16 15:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-891754854 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:19:36.858559 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:19:36.859310 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Sep 16 15:19:36.860772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=18 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:36.861568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:37.044188 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca1f64b4-cbe6-4974-8f7f-1129c56365ec tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: .version_select at 0x7f724c313550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-45381507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmvhGRblBE9mP3SAobA5xjvl1barK5TPO+VRo8gx7Lh2n+FJeb9WIa6TIMEawb+zLStemry31FlAvjnq/e2VGu8JxqJmmXsOYc2Reqo0hn/5jNtEYgaoBUZbgv6hN7jkw=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:37.061654 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ca1f64b4-cbe6-4974-8f7f-1129c56365ec tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:19:37.067058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-ca1f64b4-cbe6-4974-8f7f-1129c56365ec tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:19:37.098265 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca1f64b4-cbe6-4974-8f7f-1129c56365ec tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.245449 Sep 16 15:19:37.099500 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4039/7539] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:19:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:43.049189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:43.050260 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:19:43.050428 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:19:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 16 15:19:43.053228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:43.058723 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1679760419", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "97c532fd-75f1-44f1-983e-9301afa9a2f1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-45381507", "security_groups": [{"name": "tempest-secgroup-smoke-681015322"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:43.183300 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] validate_networks() for [('97c532fd-75f1-44f1-983e-9301afa9a2f1', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:19:43.648270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:19:43.648711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:19:43.649195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:19:43.649609 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:19:43.650032 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:19:43.659050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:43.659544 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:43.659984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:43.661237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:43.661695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:43.662126 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:43.680424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:19:43.685756 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:19:43.698424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:19:43.700877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:19:43.753019 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e4394113-3e6c-473a-8a96-6c74327861a5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705702 Sep 16 15:19:43.756925 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3501/7540] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:19:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:19:43.768897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e54b46ed-bbe0-4ecf-90ed-395ec88179fc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:43.770219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e54b46ed-bbe0-4ecf-90ed-395ec88179fc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:43.837507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e54b46ed-bbe0-4ecf-90ed-395ec88179fc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:43.844787 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e54b46ed-bbe0-4ecf-90ed-395ec88179fc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1265 microversion: 2.1 time: 0.080566 Sep 16 15:19:43.845757 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4040/7541] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:43 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:19:44.870345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:44.871031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:44.878328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:44.878936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:44.880105 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:44.880824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:44.881287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:44.881753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:44.981793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:44.990588 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c12817a2-8d47-4e41-9569-1002555a5312 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1317 microversion: 2.1 time: 0.125562 Sep 16 15:19:44.991226 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3502/7542] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:44 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1317 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:46.015395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:46.016038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:46.027475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:46.028207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:46.028825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:46.029728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:46.030388 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:46.030861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:46.305737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:46.314239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5dbf8155-42fd-4339-adb5-38031d2ec5d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.303204 Sep 16 15:19:46.314890 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4041/7543] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:46 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:46.818948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-596aa36d-738d-4590-b4b2-70ca7aa162f4 req-416a8a58-3ef6-4c58-b14c-ef10f0059417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc083d8c-3326-4b14-9145-fc7138622042", "tag": "b8ccea91-a548-4796-a782-5b1f2e4d771b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:46.830115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-596aa36d-738d-4590-b4b2-70ca7aa162f4 req-416a8a58-3ef6-4c58-b14c-ef10f0059417 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:46.830792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-596aa36d-738d-4590-b4b2-70ca7aa162f4 req-416a8a58-3ef6-4c58-b14c-ef10f0059417 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:46.831325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-596aa36d-738d-4590-b4b2-70ca7aa162f4 req-416a8a58-3ef6-4c58-b14c-ef10f0059417 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:46.844517 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-596aa36d-738d-4590-b4b2-70ca7aa162f4 req-416a8a58-3ef6-4c58-b14c-ef10f0059417 service nova] Creating event network-changed:b8ccea91-a548-4796-a782-5b1f2e4d771b for instance bc083d8c-3326-4b14-9145-fc7138622042 on n-h1-858129-2 Sep 16 15:19:46.851321 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-596aa36d-738d-4590-b4b2-70ca7aa162f4 req-416a8a58-3ef6-4c58-b14c-ef10f0059417 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036110 Sep 16 15:19:46.852099 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3503/7544] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:47.339407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:47.340043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:47.349460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:47.350035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:47.350524 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:47.351324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:47.352039 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:47.352483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:47.505014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:47.513122 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-79ca8420-793f-4f5d-b74a-a103386e3fb5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.177923 Sep 16 15:19:47.513718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4042/7545] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:47 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:48.538276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:48.539062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:48.545375 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:48.545799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:48.546234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:48.546955 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:48.547406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:48.547833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:48.679184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:48.687010 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-202220f3-775b-4358-a16e-08dcdb13e985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.154484 Sep 16 15:19:48.687594 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3504/7546] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:48 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:49.712004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:49.712926 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:49.719585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:49.720101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:49.720598 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:49.721494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:49.722073 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:49.722687 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:49.890975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:49.902150 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f49583cf-eac6-408e-b1c5-aee11cefa7b0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.195481 Sep 16 15:19:49.903174 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4043/7547] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:49 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:50.929017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:50.929635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:50.936309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:50.936795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:50.937231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:50.937926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:50.938381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:50.938837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:51.416431 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:51.426493 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9a57b008-8c3b-42d9-a7d8-22ae21c4fd11 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.501728 Sep 16 15:19:51.427222 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3505/7548] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:50 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:52.450017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:52.450615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:52.457518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:52.458280 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:52.458780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:52.459496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:52.459975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:52.460424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:52.591178 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:52.599534 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0d8dac42-926a-4f40-a12e-cc0214dcd515 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.153718 Sep 16 15:19:52.600114 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4044/7549] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:52 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:53.345464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4291b8b1-352d-43a8-b949-3fbe5cdb671d req-1fd67a0a-cb4c-41ab-8bc1-83666fd7ed82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc083d8c-3326-4b14-9145-fc7138622042", "name": "network-vif-plugged", "status": "completed", "tag": "b8ccea91-a548-4796-a782-5b1f2e4d771b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:53.360144 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4291b8b1-352d-43a8-b949-3fbe5cdb671d req-1fd67a0a-cb4c-41ab-8bc1-83666fd7ed82 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:53.360802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4291b8b1-352d-43a8-b949-3fbe5cdb671d req-1fd67a0a-cb4c-41ab-8bc1-83666fd7ed82 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:53.361372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4291b8b1-352d-43a8-b949-3fbe5cdb671d req-1fd67a0a-cb4c-41ab-8bc1-83666fd7ed82 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:53.373493 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4291b8b1-352d-43a8-b949-3fbe5cdb671d req-1fd67a0a-cb4c-41ab-8bc1-83666fd7ed82 service nova] Creating event network-vif-plugged:b8ccea91-a548-4796-a782-5b1f2e4d771b for instance bc083d8c-3326-4b14-9145-fc7138622042 on n-h1-858129-2 Sep 16 15:19:53.379051 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4291b8b1-352d-43a8-b949-3fbe5cdb671d req-1fd67a0a-cb4c-41ab-8bc1-83666fd7ed82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037518 Sep 16 15:19:53.379679 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3506/7550] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:53.622950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:53.623516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:53.630171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:53.630705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:53.631167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:53.631884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:53.632363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:53.632812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:53.761561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:53.769439 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-82f3cd2a-5668-45a9-98f6-75b5ec10e3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.150880 Sep 16 15:19:53.770024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4045/7551] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:53 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:54.790569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:54.792211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:54.797120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:54.797846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:54.806230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:54.806753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:54.807185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:54.807901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:54.808364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:54.808787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:54.957255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:54.965628 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f0d46bd8-2c71-4b05-bb5c-4fd5d55b9ad8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1390 microversion: 2.1 time: 0.176028 Sep 16 15:19:54.966208 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3507/7552] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:54 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:55.990243 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:55.990815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:55.992712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:19:55.998698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:55.999209 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:55.999672 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:56.000395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:56.000877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:56.001331 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:56.133716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:56.141614 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88dad5f1-eb34-4389-b25a-c3b6f604060d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1562 microversion: 2.1 time: 0.155444 Sep 16 15:19:56.142196 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4046/7553] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:55 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:56.164973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:56.165581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:56.172542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:56.173027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:56.173464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:56.174162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:56.174645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:56.175075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:56.312177 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:56.321215 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39bfe64f-ce7b-4d6c-b853-a2b4f9cf2e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1562 microversion: 2.1 time: 0.160705 Sep 16 15:19:56.321808 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3508/7554] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:56 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:19:58.305275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:19:58.305902 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:19:58.318551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:58.319728 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:58.320847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:58.322175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:58.323353 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:58.324249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:58.369898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-304591c5-59d1-4066-90be-a534ef51f406 req-e8fe8271-8c91-4e3d-9dee-2f8e3afdbfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc083d8c-3326-4b14-9145-fc7138622042", "tag": "b8ccea91-a548-4796-a782-5b1f2e4d771b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:19:58.381515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-304591c5-59d1-4066-90be-a534ef51f406 req-e8fe8271-8c91-4e3d-9dee-2f8e3afdbfa9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:19:58.381994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-304591c5-59d1-4066-90be-a534ef51f406 req-e8fe8271-8c91-4e3d-9dee-2f8e3afdbfa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:19:58.382672 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-304591c5-59d1-4066-90be-a534ef51f406 req-e8fe8271-8c91-4e3d-9dee-2f8e3afdbfa9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:19:58.396740 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-304591c5-59d1-4066-90be-a534ef51f406 req-e8fe8271-8c91-4e3d-9dee-2f8e3afdbfa9 service nova] Creating event network-changed:b8ccea91-a548-4796-a782-5b1f2e4d771b for instance bc083d8c-3326-4b14-9145-fc7138622042 on n-h1-858129-2 Sep 16 15:19:58.402423 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-304591c5-59d1-4066-90be-a534ef51f406 req-e8fe8271-8c91-4e3d-9dee-2f8e3afdbfa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097626 Sep 16 15:19:58.403231 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3509/7555] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:19:58.511327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:19:58.520169 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3c19e027-affa-482d-8060-f66bd389b3d0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1562 microversion: 2.1 time: 0.219507 Sep 16 15:19:58.520849 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4047/7556] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:19:58 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:20:31.820231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:20:31.821090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:20:31.825261 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:20:31.827560 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:20:31.835530 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:20:31.836019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:20:31.836458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:20:31.837163 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:20:31.837614 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:20:31.838041 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:20:31.906149 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-620e5d3a-9704-48ac-84c1-3286bd7011c5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action" status: 200 len: 24565 microversion: 2.1 time: 0.088693 Sep 16 15:20:31.906844 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3510/7557] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:20:31 2022] POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action => generated 24565 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:21:10.987985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:10.988938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=42 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:10.993539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:10.994094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:11.001411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:11.001912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:11.002369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:11.003112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:11.003586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:11.004032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:11.073884 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-759347ba-9808-4474-896c-d841e9578235 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action" status: 202 len: 0 microversion: 2.1 time: 0.087614 Sep 16 15:21:11.074622 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4048/7558] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:21:10 2022] POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:21:11.083949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:11.085129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:11.088277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:11.088943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:11.095357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:11.095854 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:11.096373 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:11.097092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:11.097555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:11.097984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:11.284014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:11.292876 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c88d82e1-afc1-4ea9-9b2d-d1ee93761b7e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1686 microversion: 2.1 time: 0.213725 Sep 16 15:21:11.306859 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3511/7559] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:11 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1686 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:12.319219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:12.320003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:12.326341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:12.326880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:12.327338 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:12.328057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:12.328538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:12.328987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:12.467236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:12.475234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3e24e21a-1635-4381-a6d7-262984be9e5f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1666 microversion: 2.1 time: 0.161461 Sep 16 15:21:12.475820 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4049/7560] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:12 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:13.569171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:13.572161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:13.584096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:13.584591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:13.585059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:13.585762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:13.586213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:13.586676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:13.655821 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-96273d09-e1ca-4576-946c-3e5abc6054ed tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action" status: 200 len: 32640 microversion: 2.1 time: 0.090671 Sep 16 15:21:13.663676 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3512/7561] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:21:13 2022] POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action => generated 32640 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:21:13.669581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:13.670148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:13.677295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:13.677802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:13.678260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:13.679025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:13.680133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:13.680943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:13.757574 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab5d12f1-5d36-4b5e-af66-105f7a370b9c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action" status: 202 len: 0 microversion: 2.1 time: 0.092145 Sep 16 15:21:13.758222 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4050/7562] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:21:13 2022] POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:21:13.767202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:13.768302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:13.776959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:13.777605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:13.778050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:13.778954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:13.779466 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:13.780235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:13.938069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:13.946097 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d5f8596-6ac3-4cda-b381-05e9525a0579 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1673 microversion: 2.1 time: 0.183303 Sep 16 15:21:13.946704 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3513/7563] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:13 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:14.970650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:14.971377 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:14.978341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:14.978875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:14.979335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:14.980059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:14.980539 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:14.980990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:15.117064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:15.125731 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e12ad10b-6b11-4ef5-8686-6a2d92de0d3c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1681 microversion: 2.1 time: 0.160229 Sep 16 15:21:15.126364 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4051/7564] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:14 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:15.225374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:15.228054 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:15.235790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:15.236283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:15.236728 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:15.237461 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:15.237924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:15.238357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:15.301365 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6ed60fd0-6a6c-4be0-894f-17f4e35d40c6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action" status: 200 len: 38369 microversion: 2.1 time: 0.079830 Sep 16 15:21:15.302306 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3514/7565] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:21:15 2022] POST /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042/action => generated 38369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:21:16.291482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:16.292011 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:16.299680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:16.300194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:16.300708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:16.301445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:16.302756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:16.303413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:16.333533 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:21:16.367545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-e7634604-eaaa-40af-aead-229e1b9b00e9 req-9699aa29-54fc-4066-ad26-a82d088b24f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc083d8c-3326-4b14-9145-fc7138622042", "tag": "b8ccea91-a548-4796-a782-5b1f2e4d771b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:16.379410 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e7634604-eaaa-40af-aead-229e1b9b00e9 req-9699aa29-54fc-4066-ad26-a82d088b24f3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:16.380028 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e7634604-eaaa-40af-aead-229e1b9b00e9 req-9699aa29-54fc-4066-ad26-a82d088b24f3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:16.380726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-e7634604-eaaa-40af-aead-229e1b9b00e9 req-9699aa29-54fc-4066-ad26-a82d088b24f3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:16.392126 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-e7634604-eaaa-40af-aead-229e1b9b00e9 req-9699aa29-54fc-4066-ad26-a82d088b24f3 service nova] Creating event network-changed:b8ccea91-a548-4796-a782-5b1f2e4d771b for instance bc083d8c-3326-4b14-9145-fc7138622042 on n-h1-858129-2 Sep 16 15:21:16.397488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-e7634604-eaaa-40af-aead-229e1b9b00e9 req-9699aa29-54fc-4066-ad26-a82d088b24f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107387 Sep 16 15:21:16.398926 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3515/7566] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:21:16.414330 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ee45318f-a538-450d-824b-6dfbc3fd1daf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 204 len: 0 microversion: 2.1 time: 0.126624 Sep 16 15:21:16.414655 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4052/7567] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:21:16 2022] DELETE /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:21:16.425292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:16.426085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:16.432312 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:16.432873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:16.433399 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:16.434538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:16.434697 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:16.435252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:16.603642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:16.611913 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ece3065-37e0-4e72-9918-3cc540e7f704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1687 microversion: 2.1 time: 0.190783 Sep 16 15:21:16.612599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3516/7568] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:16 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:17.637067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:17.637796 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:17.640098 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:21:17.640240 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:21:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 (ip 10.222.0.60) !!! Sep 16 15:21:17.648835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:17.649348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:17.649813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:17.650585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:17.651065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:17.651515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:17.796095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:17.804073 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-478bf29e-8893-4d76-943c-908c32d73535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1687 microversion: 2.1 time: 0.171397 Sep 16 15:21:17.804662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4053/7569] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:17 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:18.788051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-6160c524-a8a2-48be-a69a-f0b1f45c4aae req-9064b689-7e5f-4d9d-a250-71b23108b119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc083d8c-3326-4b14-9145-fc7138622042", "name": "network-vif-deleted", "tag": "b8ccea91-a548-4796-a782-5b1f2e4d771b"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:18.801345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6160c524-a8a2-48be-a69a-f0b1f45c4aae req-9064b689-7e5f-4d9d-a250-71b23108b119 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:18.801757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6160c524-a8a2-48be-a69a-f0b1f45c4aae req-9064b689-7e5f-4d9d-a250-71b23108b119 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:18.802189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-6160c524-a8a2-48be-a69a-f0b1f45c4aae req-9064b689-7e5f-4d9d-a250-71b23108b119 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:18.814712 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-6160c524-a8a2-48be-a69a-f0b1f45c4aae req-9064b689-7e5f-4d9d-a250-71b23108b119 service nova] Creating event network-vif-deleted:b8ccea91-a548-4796-a782-5b1f2e4d771b for instance bc083d8c-3326-4b14-9145-fc7138622042 on n-h1-858129-2 Sep 16 15:21:18.820536 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-6160c524-a8a2-48be-a69a-f0b1f45c4aae req-9064b689-7e5f-4d9d-a250-71b23108b119 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036390 Sep 16 15:21:18.821181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3517/7570] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:21:18.830387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:18.831083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:18.838913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:18.839416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:18.839871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:18.840592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:18.841062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:18.841500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:18.910512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:18.919248 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a3154b8b-ae61-40df-beb4-ee5c466c27ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 200 len: 1350 microversion: 2.1 time: 0.092818 Sep 16 15:21:18.919827 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4054/7571] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:18 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:19.942683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:19.943386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: bc083d8c-3326-4b14-9145-fc7138622042] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:19.951234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:19.951720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:19.952159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:19.952863 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:19.953321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:19.953753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:19.968576 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] HTTP exception thrown: Instance bc083d8c-3326-4b14-9145-fc7138622042 could not be found. Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Request method failure captured: Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 HTTP/1.1 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJQIjZXVUt8f82HTQ3jmn3ZlIpKXWPdP8OBz59wnm6BEY0XdA6MAv20NehZpSnuDzBzPfkfGl_p4wA3ZoKfQ6fumJFQLxy4fqZUV4iQqD63vKyoPlRJNZM2qUl0cWkk1fUeXSlEoUFEmYT-XybVvmlkEUY7MHiOPaze_KuEL1jzFchg Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0edf82f3d40649db816118d6443ebff4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}] Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 4499374ea3b745b2a84e7d659b9699c8 Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance bc083d8c-3326-4b14-9145-fc7138622042 could not be found. Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'bc083d8c-3326-4b14-9145-fc7138622042'} Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc083d8c-3326-4b14-9145-fc7138622042 could not be found. Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc083d8c-3326-4b14-9145-fc7138622042 could not be found. Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:21:19.970255 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc083d8c-3326-4b14-9145-fc7138622042 could not be found. Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Returning 404 to user: Instance bc083d8c-3326-4b14-9145-fc7138622042 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-efefd073-b48e-48bd-8b07-7359b55c551d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042" status: 404 len: 111 microversion: 2.1 time: 0.033387 Sep 16 15:21:19.975483 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3518/7572] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:19 2022] GET /compute/v2.1/servers/bc083d8c-3326-4b14-9145-fc7138622042 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:21:23.350434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-37a5bbfd-b442-4d34-891e-c278c78de535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '.version_select at 0x7f724c424310>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:23.374520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-37a5bbfd-b442-4d34-891e-c278c78de535 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-45381507" status: 202 len: 0 microversion: 2.1 time: 0.040474 Sep 16 15:21:23.375445 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4055/7573] 10.222.0.60 () {58 vars in 1278 bytes} [Fri Sep 16 15:21:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-45381507 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:21:23.404221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-39bf09c9-b350-4497-b1a0-c99fd3d2a3e7 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: .version_select at 0x7f724c0d0820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1751994793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVNNh3M9OJg/t/ROzN6oIl1RQF+Ucdp3uG/crHYLUcVyCn54+Lc6vaAhwRQfw7hTrvqP4coSuXY174TJHXMQFoKTC6x/vNWQx8b8Pk+7ODnTUt5dahd6t81juWpzYwMsw=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:23.422869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-39bf09c9-b350-4497-b1a0-c99fd3d2a3e7 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:21:23.428438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-39bf09c9-b350-4497-b1a0-c99fd3d2a3e7 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:21:23.455131 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-39bf09c9-b350-4497-b1a0-c99fd3d2a3e7 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054875 Sep 16 15:21:23.456065 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3519/7574] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:21:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:21:29.191193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:29.195943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1901164016", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "7825b1ea-c18d-4dbb-88aa-a23e1ad536a2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1751994793", "security_groups": [{"name": "tempest-secgroup-smoke-457753479"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:29.479365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] validate_networks() for [('7825b1ea-c18d-4dbb-88aa-a23e1ad536a2', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:21:30.025603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:21:30.025603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:21:30.025603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:21:30.025875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:21:30.026282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:21:30.039168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:30.040459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:30.041091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:30.041852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:30.042547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:30.043158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:30.064211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:21:30.070464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:21:30.088217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:21:30.090717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:21:30.150961 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a39fc679-c44b-4460-86d3-095fe2591042 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.961395 Sep 16 15:21:30.151857 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4056/7575] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:21:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:21:30.161682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=32 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:30.167388 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6e64d558-04ae-47b2-bdd7-b2772027e6aa tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:30.168455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6e64d558-04ae-47b2-bdd7-b2772027e6aa tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:30.233800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6e64d558-04ae-47b2-bdd7-b2772027e6aa tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:30.241149 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6e64d558-04ae-47b2-bdd7-b2772027e6aa tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1267 microversion: 2.1 time: 0.081692 Sep 16 15:21:30.241758 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3520/7576] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:30 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:21:31.265636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:31.266309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:31.273233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:31.274370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:31.274837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:31.275559 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:31.276036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:31.276482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:31.360069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:31.371555 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bf2d4933-1cb1-467e-b075-e00f783bd13d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1327 microversion: 2.1 time: 0.109987 Sep 16 15:21:31.372805 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4057/7577] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:31 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:32.398174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:32.400828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:32.415502 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:32.416435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:32.417042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:32.417952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:32.418631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:32.419285 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:32.581986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:32.605900 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c66a1fe9-ff3d-492c-b150-8643630f6b3d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.211940 Sep 16 15:21:32.608545 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3521/7578] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:32 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:33.095493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-446fc87e-cc01-4d8e-b4b7-faa15b22e4f8 req-913e2cb9-0ad6-4ed4-8e94-d81d2ccf579b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad31b-1798-42c7-b402-261b691a925f", "tag": "f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:33.107179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-446fc87e-cc01-4d8e-b4b7-faa15b22e4f8 req-913e2cb9-0ad6-4ed4-8e94-d81d2ccf579b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:33.107708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-446fc87e-cc01-4d8e-b4b7-faa15b22e4f8 req-913e2cb9-0ad6-4ed4-8e94-d81d2ccf579b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:33.108195 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-446fc87e-cc01-4d8e-b4b7-faa15b22e4f8 req-913e2cb9-0ad6-4ed4-8e94-d81d2ccf579b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:33.120230 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-446fc87e-cc01-4d8e-b4b7-faa15b22e4f8 req-913e2cb9-0ad6-4ed4-8e94-d81d2ccf579b service nova] Creating event network-changed:f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c for instance 1c3ad31b-1798-42c7-b402-261b691a925f on n-h1-858129-2 Sep 16 15:21:33.129008 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-446fc87e-cc01-4d8e-b4b7-faa15b22e4f8 req-913e2cb9-0ad6-4ed4-8e94-d81d2ccf579b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Sep 16 15:21:33.129933 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4058/7579] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:21:33.631860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:33.632412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:33.639437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:33.639919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:33.640358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:33.641118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:33.641566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:33.641987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:33.781892 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:33.790701 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-084aa4b9-ff34-4da7-ac19-c92cc3e5e373 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.162729 Sep 16 15:21:33.791320 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3522/7580] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:33 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:34.814914 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:34.815644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:34.823048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:34.823557 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:34.824019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:34.824756 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:34.825216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:34.825665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:34.967009 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:34.975247 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58ada6fb-d8a4-4dfe-9e26-1499f4404f71 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.164529 Sep 16 15:21:34.975758 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4059/7581] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:34 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:36.000178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:36.001885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:36.009678 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:36.010170 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:36.010888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:36.011460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:36.011917 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:36.012348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:36.155146 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:36.163539 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c9dc32ef-6e11-4c6c-8cfa-a49b422133cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.168219 Sep 16 15:21:36.164125 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3523/7582] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:35 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:21:37.187346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:37.187929 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:37.194807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:37.195309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:37.195759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:37.196466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:37.196936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:37.197380 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:37.337248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:37.345830 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ca36166-d5f0-4966-856e-879e69b8999c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.162473 Sep 16 15:21:37.346444 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4060/7583] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:37 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:21:38.369211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:38.369831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:38.376994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:38.377484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:38.377925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:38.378681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:38.379139 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:38.379558 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:38.513418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:38.521161 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fc0aa254-b626-488d-b9e1-1d77c6f1fb8f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.155908 Sep 16 15:21:38.521744 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3524/7584] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:38 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:39.544744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:39.545327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:39.552379 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:39.552884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:39.553342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:39.554058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:39.554564 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:39.555518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:39.694466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:39.705328 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b7fbe491-1875-4c8a-b1b8-50c93c1e2bb3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.164537 Sep 16 15:21:39.705959 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4061/7585] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:39 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:39.887162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-74a22211-789b-4d08-a432-1dc2ccd69048 req-c06862b3-a8e8-49a5-8646-25e99f1bbd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ad31b-1798-42c7-b402-261b691a925f", "name": "network-vif-plugged", "status": "completed", "tag": "f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:39.897437 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-74a22211-789b-4d08-a432-1dc2ccd69048 req-c06862b3-a8e8-49a5-8646-25e99f1bbd48 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:39.897928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-74a22211-789b-4d08-a432-1dc2ccd69048 req-c06862b3-a8e8-49a5-8646-25e99f1bbd48 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:39.899136 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-74a22211-789b-4d08-a432-1dc2ccd69048 req-c06862b3-a8e8-49a5-8646-25e99f1bbd48 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:39.910984 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-74a22211-789b-4d08-a432-1dc2ccd69048 req-c06862b3-a8e8-49a5-8646-25e99f1bbd48 service nova] Creating event network-vif-plugged:f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c for instance 1c3ad31b-1798-42c7-b402-261b691a925f on n-h1-858129-2 Sep 16 15:21:39.916880 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-74a22211-789b-4d08-a432-1dc2ccd69048 req-c06862b3-a8e8-49a5-8646-25e99f1bbd48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096419 Sep 16 15:21:39.917492 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3525/7586] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:21:40.729759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:40.730426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:40.732496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:40.733393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:40.740460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:40.740972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:40.741430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:40.742157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:40.742755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:40.743205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:40.885190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:40.894223 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12a0d0ec-b485-4428-80ad-05b25792c752 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1392 microversion: 2.1 time: 0.168482 Sep 16 15:21:40.894868 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4062/7587] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:40 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:21:41.916424 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:41.922089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:41.922999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:41.925542 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:41.932352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:41.932859 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:41.933304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:41.934037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:41.934536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:41.934966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:42.094784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:42.103292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-697118f5-79c5-47e5-a25c-1c19aa88f166 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1564 microversion: 2.1 time: 0.187847 Sep 16 15:21:42.103878 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3526/7588] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:41 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1564 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:42.129475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:42.130116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:42.133583 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:21:42.139312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:42.139821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:42.140276 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:42.141017 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:42.141474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:42.141918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:42.292776 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:42.300957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bdd3d1c6-7917-4763-a530-e430c4394362 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1564 microversion: 2.1 time: 0.178400 Sep 16 15:21:42.301754 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4063/7589] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:42 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:21:44.443258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:21:44.444505 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:21:44.449295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-6198489f-1c82-4598-b3dd-8820769496ef req-15f5302d-60bc-46be-ba74-60d55ecbd0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad31b-1798-42c7-b402-261b691a925f", "tag": "f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:21:44.452307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:44.452799 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:44.453229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:44.453964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:44.454647 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:44.455073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:44.462108 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6198489f-1c82-4598-b3dd-8820769496ef req-15f5302d-60bc-46be-ba74-60d55ecbd0a3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:21:44.462723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6198489f-1c82-4598-b3dd-8820769496ef req-15f5302d-60bc-46be-ba74-60d55ecbd0a3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:21:44.463398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-6198489f-1c82-4598-b3dd-8820769496ef req-15f5302d-60bc-46be-ba74-60d55ecbd0a3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:21:44.476171 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-6198489f-1c82-4598-b3dd-8820769496ef req-15f5302d-60bc-46be-ba74-60d55ecbd0a3 service nova] Creating event network-changed:f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c for instance 1c3ad31b-1798-42c7-b402-261b691a925f on n-h1-858129-2 Sep 16 15:21:44.482176 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-6198489f-1c82-4598-b3dd-8820769496ef req-15f5302d-60bc-46be-ba74-60d55ecbd0a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037838 Sep 16 15:21:44.483134 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4064/7590] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:21:44.641959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:21:44.652929 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe43d75a-b722-40b1-a7ef-82ec3fbb6f07 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1564 microversion: 2.1 time: 0.212384 Sep 16 15:21:44.653970 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3527/7591] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:21:44 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:18.016891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:22:18.017723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=42 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:22:18.022577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:22:18.024894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:18.032055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:18.032565 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:18.033026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:18.033742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:18.034221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:18.034694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:18.101549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-66dfdf74-6ff5-44c2-9187-3cc936fe6f4d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f/action" status: 200 len: 24576 microversion: 2.1 time: 0.086728 Sep 16 15:22:18.102208 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4065/7592] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:22:18 2022] POST /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f/action => generated 24576 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:22:48.534769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:22:48.535524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:22:48.540122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:22:48.542981 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:48.549828 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:48.550250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:48.550729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:48.551441 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:48.551902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:48.552332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:48.629840 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0afa6f6d-9724-4c77-a8da-6d1e8d142245 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f/action" status: 202 len: 0 microversion: 2.1 time: 0.096717 Sep 16 15:22:48.630576 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3528/7593] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:22:48 2022] POST /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:22:48.640772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:48.641511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:48.644206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:22:48.645079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:22:48.650745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:48.651247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:48.651710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:48.652467 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:48.652946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:48.653410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:48.801291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:48.809880 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13aa4780-aa8d-498f-832e-359cd3c2a8bc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1675 microversion: 2.1 time: 0.173868 Sep 16 15:22:48.810789 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4066/7594] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:48 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:22:49.837233 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:49.837945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:49.844240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:49.844725 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:49.845162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:49.845857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:49.846307 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:49.846755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:49.980078 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:49.987938 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fd7bb965-10ce-404a-a18d-92aa1c2f418b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.156415 Sep 16 15:22:49.988518 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3529/7595] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:49 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:51.012878 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:51.013513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:51.021157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:51.021653 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:51.022102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:51.022833 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:51.023303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:51.023743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:51.159662 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:51.167799 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6525b53-daa5-461a-bd2a-12926d919e37 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.159325 Sep 16 15:22:51.168398 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4067/7596] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:51 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:52.191559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:52.192195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:52.199665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:52.200157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:52.200603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:52.201296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:52.201758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:52.202185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:52.333563 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:52.342305 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6041656a-63ed-46e1-a806-628f1ff40384 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.154690 Sep 16 15:22:52.343050 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3530/7597] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:52 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:53.365260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:53.365895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:53.375259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:53.376047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:53.376510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:53.377235 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:53.377714 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:53.378157 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:53.522194 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:53.531020 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-710e55ff-5616-4746-8c58-b7a634b94810 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.169775 Sep 16 15:22:53.531604 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4068/7598] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:53 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:54.555016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:54.555571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:54.562545 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:54.563040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:54.563481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:54.564183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:54.564651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:54.565077 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:54.701552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:54.709646 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-505e4dd8-949d-40cc-b0e3-b94afd11d77c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.158625 Sep 16 15:22:54.710225 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3531/7599] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:54 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:55.733958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:55.734523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:55.741452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:55.741963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:55.742450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:55.743171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:55.744155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:55.744605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:55.890760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:55.898725 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-576bae0b-7cb3-429a-8357-f52c9d990f9a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.168841 Sep 16 15:22:55.899510 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4069/7600] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:55 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:56.924119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:56.924696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:56.932099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:56.932593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:56.933027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:56.933762 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:56.934229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:56.934679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:57.068357 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:57.077486 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-016b9a51-b698-49ae-ad0a-fc6cdc7b3a53 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.157417 Sep 16 15:22:57.078079 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3532/7601] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:56 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:58.102738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:58.103408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:58.111112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:58.111621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:58.112122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:58.112848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:58.113329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:58.113780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:58.252016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:58.260183 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-289cff27-f7b7-4168-97b6-bf9f79002856 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.161408 Sep 16 15:22:58.260778 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4070/7602] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:58 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:22:59.284556 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:22:59.285283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:22:59.292339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:59.292834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:59.293276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:59.294108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:22:59.294469 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:22:59.294901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:22:59.436211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:22:59.444043 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3574c59c-6326-4e27-8c97-aac79cb9688a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.163664 Sep 16 15:22:59.444640 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3533/7603] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:22:59 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:23:00.469020 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:23:00.469688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:23:00.476807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:00.477317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:00.477780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:00.478529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:00.479014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:00.479473 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:00.616024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:23:00.624010 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-766d294e-d069-4a67-9ccd-70d116d34c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.158969 Sep 16 15:23:00.624602 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4071/7604] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:23:00 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:23:01.647670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:23:01.648227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:23:01.655109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:01.655599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:01.656038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:01.656734 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:01.657188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:01.657617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:01.790994 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:23:01.799252 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-176ae647-f64a-4c9e-ab90-6fc268303fc9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.155557 Sep 16 15:23:01.799849 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3534/7605] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:23:01 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:23:02.824400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:23:02.825035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:23:02.832252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:02.832755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:02.833211 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:02.833932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:02.834429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:02.834871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:02.979202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:23:02.987084 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c14325fd-db71-4aab-8c21-1ea8f3f77193 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.167310 Sep 16 15:23:02.987667 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4072/7606] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:23:02 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:23:04.011546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:23:04.012199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:23:04.015575 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:23:04.015719 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:23:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f (ip 10.222.0.60) !!! Sep 16 15:23:04.021943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:04.022459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:04.022902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:04.023612 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:04.024072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:04.025141 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:04.157112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:23:04.165113 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-97d55a61-f8af-4818-9bd3-d8bd8eb942f6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1680 microversion: 2.1 time: 0.157988 Sep 16 15:23:04.165699 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3535/7607] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:23:04 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:23:05.189062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:23:05.190070 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:23:05.196686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:05.197192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:05.197657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:05.198482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:05.198984 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:05.199422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:05.341809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:23:05.349682 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd83c7aa-e7c6-478a-8d95-c9a923a2aba2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1683 microversion: 2.1 time: 0.164707 Sep 16 15:23:05.350256 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4073/7608] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:23:05 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:23:37.581366 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:23:37.583847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:23:37.585899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:23:37.586591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:23:37.592925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:37.593418 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:37.593864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:37.594618 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:23:37.595080 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:23:37.595510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:23:37.668375 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-60b454e3-1027-4d65-aea7-4898ea3b3e09 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f/action" status: 200 len: 69042 microversion: 2.1 time: 0.091368 Sep 16 15:23:37.669036 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3536/7609] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:23:37 2022] POST /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f/action => generated 69042 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:24:01.860803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:01.861516 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:01.867304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-75942dc6-3f6b-449f-b599-7e1995679b4f req-4aa9f44e-a335-4c74-ba6f-7e9bd7a1ebe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad31b-1798-42c7-b402-261b691a925f", "tag": "f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:01.873831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:01.876925 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:01.877647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=48 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:01.879806 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:01.887648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-75942dc6-3f6b-449f-b599-7e1995679b4f req-4aa9f44e-a335-4c74-ba6f-7e9bd7a1ebe0 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:01.888159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-75942dc6-3f6b-449f-b599-7e1995679b4f req-4aa9f44e-a335-4c74-ba6f-7e9bd7a1ebe0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:01.888600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-75942dc6-3f6b-449f-b599-7e1995679b4f req-4aa9f44e-a335-4c74-ba6f-7e9bd7a1ebe0 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:01.895065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:01.895580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:01.896033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:01.896800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:01.897239 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:01.897700 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:01.911634 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-75942dc6-3f6b-449f-b599-7e1995679b4f req-4aa9f44e-a335-4c74-ba6f-7e9bd7a1ebe0 service nova] Creating event network-changed:f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c for instance 1c3ad31b-1798-42c7-b402-261b691a925f on n-h1-858129-2 Sep 16 15:24:01.917269 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-75942dc6-3f6b-449f-b599-7e1995679b4f req-4aa9f44e-a335-4c74-ba6f-7e9bd7a1ebe0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053811 Sep 16 15:24:01.918251 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3537/7610] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:24:01.943432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:24:02.043944 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-77c39056-a0ef-4cba-b21e-f271b607464e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 204 len: 0 microversion: 2.1 time: 0.186142 Sep 16 15:24:02.047984 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4074/7611] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:24:01 2022] DELETE /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:24:02.054765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:02.055798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:02.067371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:02.067886 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:02.068335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:02.069059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:02.069719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:02.070328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:02.236075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:02.244722 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-265a13f0-60ab-4d27-b273-5aca70a9f326 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1689 microversion: 2.1 time: 0.195048 Sep 16 15:24:02.245435 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3538/7612] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:02 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:03.270318 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:03.271112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:03.279414 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:03.279927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:03.280391 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:03.281140 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:03.281617 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:03.282067 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:03.447149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:03.455729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-12e66677-cfcc-42af-b26d-beb32b9a6624 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1689 microversion: 2.1 time: 0.189911 Sep 16 15:24:03.456336 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4075/7613] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:03 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:04.338153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-534355c8-2e68-42d1-8422-0676d1d07177 req-e1a76f3f-aab5-4be4-97d4-7ede0262eda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ad31b-1798-42c7-b402-261b691a925f", "name": "network-vif-deleted", "tag": "f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:04.355012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-534355c8-2e68-42d1-8422-0676d1d07177 req-e1a76f3f-aab5-4be4-97d4-7ede0262eda5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:04.356183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-534355c8-2e68-42d1-8422-0676d1d07177 req-e1a76f3f-aab5-4be4-97d4-7ede0262eda5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:04.356627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-534355c8-2e68-42d1-8422-0676d1d07177 req-e1a76f3f-aab5-4be4-97d4-7ede0262eda5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:04.369603 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-534355c8-2e68-42d1-8422-0676d1d07177 req-e1a76f3f-aab5-4be4-97d4-7ede0262eda5 service nova] Creating event network-vif-deleted:f3ebaec0-8d20-4b8d-9e03-7c8d37cad84c for instance 1c3ad31b-1798-42c7-b402-261b691a925f on n-h1-858129-2 Sep 16 15:24:04.376044 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-534355c8-2e68-42d1-8422-0676d1d07177 req-e1a76f3f-aab5-4be4-97d4-7ede0262eda5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044944 Sep 16 15:24:04.377210 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3539/7614] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:24:04.481626 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:04.482463 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:04.489709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:04.490231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:04.490784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:04.491486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:04.491973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:04.492422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:04.540472 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:04.540831 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:04.540947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:04.541435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lazy-loading 'fault' on Instance uuid 1c3ad31b-1798-42c7-b402-261b691a925f {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:24:04.597618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:04.606390 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7013cc70-2218-4f05-8f94-fad7e3d70aa1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 200 len: 1357 microversion: 2.1 time: 0.129460 Sep 16 15:24:04.607135 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4076/7615] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:04 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 1357 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:24:05.630474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:05.631189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 1c3ad31b-1798-42c7-b402-261b691a925f] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:05.638867 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:05.639360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:05.639796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:05.640528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:05.640979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:05.641407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:05.656706 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] HTTP exception thrown: Instance 1c3ad31b-1798-42c7-b402-261b691a925f could not be found. Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Request method failure captured: Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f HTTP/1.1 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJQIjZXVUt8f82HTQ3jmn3ZlIpKXWPdP8OBz59wnm6BEY0XdA6MAv20NehZpSnuDzBzPfkfGl_p4wA3ZoKfQ6fumJFQLxy4fqZUV4iQqD63vKyoPlRJNZM2qUl0cWkk1fUeXSlEoUFEmYT-XybVvmlkEUY7MHiOPaze_KuEL1jzFchg Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0edf82f3d40649db816118d6443ebff4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}] Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 4499374ea3b745b2a84e7d659b9699c8 Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 1c3ad31b-1798-42c7-b402-261b691a925f could not be found. Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '1c3ad31b-1798-42c7-b402-261b691a925f'} Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3ad31b-1798-42c7-b402-261b691a925f could not be found. Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3ad31b-1798-42c7-b402-261b691a925f could not be found. Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:24:05.658287 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3ad31b-1798-42c7-b402-261b691a925f could not be found. Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Returning 404 to user: Instance 1c3ad31b-1798-42c7-b402-261b691a925f could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6494be74-9e50-4df4-9cfb-2c0217d081c1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f" status: 404 len: 111 microversion: 2.1 time: 0.033635 Sep 16 15:24:05.663500 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3540/7616] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:05 2022] GET /compute/v2.1/servers/1c3ad31b-1798-42c7-b402-261b691a925f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:24:09.047503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0dd1409a-f629-4467-918f-c184a15539d1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '.version_select at 0x7f724d197670>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:09.053612 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dd1409a-f629-4467-918f-c184a15539d1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [60e5b4d7-67ac-409f-a1ef-145ac803fecd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:24:10.060526 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dd1409a-f629-4467-918f-c184a15539d1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [60e5b4d7-67ac-409f-a1ef-145ac803fecd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 46576. Sep 16 15:24:10.081701 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0dd1409a-f629-4467-918f-c184a15539d1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1751994793" status: 202 len: 0 microversion: 2.1 time: 1.038438 Sep 16 15:24:10.082314 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4077/7617] 10.222.0.60 () {58 vars in 1284 bytes} [Fri Sep 16 15:24:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1751994793 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:24:10.113073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-eb250abf-b98a-4c47-b602-f09d6e70c86c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: .version_select at 0x7f724cf03dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-631607945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoQShe50glQfwSJv8mEnzV3Wdl4QfvDLNP+D+0mkdDT9X/oiZCZmLI1+s1swVA8y3SAyFwlZQT7P3lWRGx+J1Bc+2Vd27n6fIVuhY0y7ijxVBwr8T3Blo54Q1fzBVeXCA=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:10.130687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-eb250abf-b98a-4c47-b602-f09d6e70c86c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:24:10.137631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-eb250abf-b98a-4c47-b602-f09d6e70c86c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:24:10.153057 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eb250abf-b98a-4c47-b602-f09d6e70c86c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [06bb6011-c533-4d38-a08e-8776a507e591] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:24:11.159367 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [None req-eb250abf-b98a-4c47-b602-f09d6e70c86c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [06bb6011-c533-4d38-a08e-8776a507e591] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 46580. Sep 16 15:24:11.175178 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-eb250abf-b98a-4c47-b602-f09d6e70c86c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.065946 Sep 16 15:24:11.175860 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3541/7618] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:24:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:24:16.875474 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1594046393", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "802169d1-d0bf-4a1c-9c8a-5b267ebb9b6e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-631607945", "security_groups": [{"name": "tempest-secgroup-smoke-1816513555"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:16.885817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:16.996293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] validate_networks() for [('802169d1-d0bf-4a1c-9c8a-5b267ebb9b6e', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:24:17.457928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:24:17.458369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:24:17.459905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:24:17.462058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:24:17.462785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:24:17.474199 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:17.474737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:17.475329 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:17.476080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:17.477176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:17.477637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:17.497393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:24:17.503122 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:24:17.517168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:24:17.519798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:24:17.570774 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bb0c136f-163c-4eea-9789-226e60bcb8cb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699763 Sep 16 15:24:17.571600 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4078/7619] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:24:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:24:17.582204 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:17.586810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3898aaa2-4371-49d7-9c0a-2c93327a6577 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:17.587427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3898aaa2-4371-49d7-9c0a-2c93327a6577 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:17.654941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3898aaa2-4371-49d7-9c0a-2c93327a6577 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:17.665483 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3898aaa2-4371-49d7-9c0a-2c93327a6577 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1266 microversion: 2.1 time: 0.085371 Sep 16 15:24:17.678897 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3542/7620] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:17 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:18.691405 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:18.692054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:18.701666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:18.701666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:18.701666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:18.702393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:18.702999 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:18.703449 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:18.818071 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:18.829012 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6aa92d6b-4307-44c8-a6be-cdd3af80a93d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1326 microversion: 2.1 time: 0.143621 Sep 16 15:24:18.829933 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4079/7621] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:18 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:19.852912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:19.854152 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:19.871549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:19.873091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:19.875358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:19.877775 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:19.878481 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:19.879207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:20.160565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:20.169555 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b973e5a4-c11c-43e8-b5b6-841614f44e4a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.321233 Sep 16 15:24:20.174448 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3543/7622] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:19 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:20.597743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-274274bf-25e0-4cf0-9c77-75534a163c42 req-bc20eadc-1d78-44cc-9318-0de068a84f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:20.611272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-274274bf-25e0-4cf0-9c77-75534a163c42 req-bc20eadc-1d78-44cc-9318-0de068a84f68 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:20.611891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-274274bf-25e0-4cf0-9c77-75534a163c42 req-bc20eadc-1d78-44cc-9318-0de068a84f68 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:20.612346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-274274bf-25e0-4cf0-9c77-75534a163c42 req-bc20eadc-1d78-44cc-9318-0de068a84f68 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:20.639977 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-274274bf-25e0-4cf0-9c77-75534a163c42 req-bc20eadc-1d78-44cc-9318-0de068a84f68 service nova] Creating event network-changed:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h2-858129-2 Sep 16 15:24:20.645660 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-274274bf-25e0-4cf0-9c77-75534a163c42 req-bc20eadc-1d78-44cc-9318-0de068a84f68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054274 Sep 16 15:24:20.646778 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4080/7623] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:24:21.197292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:21.197908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:21.204540 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:21.205014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:21.205454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:21.207304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:21.207770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:21.208205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:21.410093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:21.418761 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-267c71eb-fccd-4d7f-aa97-5ef5bcaf77ba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.225242 Sep 16 15:24:21.419431 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3544/7624] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:21 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:22.442301 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:22.443059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:22.450943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:22.451441 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:22.451889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:22.452629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:22.453094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:22.453537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:22.599986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:22.608155 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fdeb8d76-e70e-42ec-a503-7ca54fd2792d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.170079 Sep 16 15:24:22.608741 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4081/7625] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:22 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:23.631301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:23.631831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:23.639496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:23.639976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:23.640404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:23.641093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:23.641539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:23.641968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:23.799211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:23.808476 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-04f872c3-f32e-4937-bbf7-eba461e94c95 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.180609 Sep 16 15:24:23.809344 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3545/7626] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:23 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:24.832720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:24.833364 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:24.839518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:24.840644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:24.841106 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:24.841843 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:24.842323 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:24.842804 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:24.982172 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:24.991429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5962544d-37f4-40e1-adc3-06b1c4e3e73d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.163064 Sep 16 15:24:24.992024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4082/7627] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:24 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:26.015874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:26.016495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:26.023438 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:26.023934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:26.024377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:26.025082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:26.025539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:26.025984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:26.160903 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:26.169420 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-306fe6f6-777e-4fc6-9951-5864b10af3ac tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.157471 Sep 16 15:24:26.170002 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3546/7628] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:26 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:26.388216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-184b0e98-0446-4b5a-8985-6c65833c460f req-450a8e13-496f-4f42-94d1-bf99cc4c97d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "name": "network-vif-plugged", "status": "completed", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:26.401088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-184b0e98-0446-4b5a-8985-6c65833c460f req-450a8e13-496f-4f42-94d1-bf99cc4c97d7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:26.401613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-184b0e98-0446-4b5a-8985-6c65833c460f req-450a8e13-496f-4f42-94d1-bf99cc4c97d7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:26.402053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-184b0e98-0446-4b5a-8985-6c65833c460f req-450a8e13-496f-4f42-94d1-bf99cc4c97d7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:26.414923 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-184b0e98-0446-4b5a-8985-6c65833c460f req-450a8e13-496f-4f42-94d1-bf99cc4c97d7 service nova] Creating event network-vif-plugged:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h2-858129-2 Sep 16 15:24:26.420391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-184b0e98-0446-4b5a-8985-6c65833c460f req-450a8e13-496f-4f42-94d1-bf99cc4c97d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037241 Sep 16 15:24:26.421024 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4083/7629] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:24:27.192623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:27.193193 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:27.200494 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:27.200984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:27.201426 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:27.202129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:27.202640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:27.203057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:27.339270 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:27.347532 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-59929d58-0600-43b5-855a-33ba71a0b8b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1392 microversion: 2.1 time: 0.159063 Sep 16 15:24:27.348115 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3547/7630] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:27 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:24:28.371630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:28.372411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:28.375267 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:28.375952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:28.382086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:28.382619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:28.383077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:28.383826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:28.384299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:28.384744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:28.517680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:28.525599 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ed2a11af-a6cd-4aeb-855d-3abbcc27d487 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1565 microversion: 2.1 time: 0.159124 Sep 16 15:24:28.526188 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4084/7631] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:28 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:28.548294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:28.548838 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:28.550822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:24:28.557219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:28.557708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:28.558148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:28.559464 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:28.559924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:28.560354 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:28.699216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:28.707352 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7f91a7e5-f76b-448c-9390-21073e7b516d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1565 microversion: 2.1 time: 0.163020 Sep 16 15:24:28.707948 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3548/7632] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:28 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:24:30.631709 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:24:30.637159 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-208e3eb4-d280-48f3-87b7-1655814b8afb req-f9e04b91-bbdb-471b-aff1-18dadbbb0f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:24:30.642721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:24:30.650363 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:30.651683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-208e3eb4-d280-48f3-87b7-1655814b8afb req-f9e04b91-bbdb-471b-aff1-18dadbbb0f89 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:30.652012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:30.652663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-208e3eb4-d280-48f3-87b7-1655814b8afb req-f9e04b91-bbdb-471b-aff1-18dadbbb0f89 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:30.653099 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-208e3eb4-d280-48f3-87b7-1655814b8afb req-f9e04b91-bbdb-471b-aff1-18dadbbb0f89 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:30.653317 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:30.654133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:24:30.654876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:24:30.655400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:24:30.664808 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-208e3eb4-d280-48f3-87b7-1655814b8afb req-f9e04b91-bbdb-471b-aff1-18dadbbb0f89 service nova] Creating event network-changed:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h2-858129-2 Sep 16 15:24:30.670672 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-208e3eb4-d280-48f3-87b7-1655814b8afb req-f9e04b91-bbdb-471b-aff1-18dadbbb0f89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037109 Sep 16 15:24:30.671293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3549/7633] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:24:30.876456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:24:30.885510 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0f873981-75ff-4848-a17c-540cef7f0d5b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1565 microversion: 2.1 time: 0.257680 Sep 16 15:24:30.886165 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4085/7634] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:24:30 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1565 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:04.182667 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:25:04.183422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:25:04.237780 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:25:04.240180 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:04.246680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:04.247200 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:04.247656 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:04.248935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:04.249392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:04.249822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:04.318226 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3e33f342-2e45-46c8-903a-18104f0c51b5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action" status: 200 len: 24568 microversion: 2.1 time: 0.137766 Sep 16 15:25:04.318914 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3550/7635] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:25:04 2022] POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action => generated 24568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:25:43.397719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:25:43.398562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=36 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:25:43.403072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:25:43.406165 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:43.414923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:43.415470 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:43.415930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:43.416656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:43.417135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:43.417579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:43.459637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:43.465900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Old instance type m1.heat2, new instance type m1.heat {{(pid=128642) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 16 15:25:43.473176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:25:43.473622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:25:43.474129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:25:43.474596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:25:43.475033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:25:43.538710 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d7e4cbe7-30d0-4803-baa4-c112389e3fba tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action" status: 202 len: 0 microversion: 2.1 time: 0.143509 Sep 16 15:25:43.539319 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4086/7636] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:25:43 2022] POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:25:43.549226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:43.549845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:43.552526 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:25:43.553162 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:25:43.559767 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:43.560337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:43.560796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:43.561578 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:43.562045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:43.562638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:43.699690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:43.708351 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d19a1139-d467-4161-a028-bae524d45a82 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1693 microversion: 2.1 time: 0.164387 Sep 16 15:25:43.708946 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3551/7637] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:43 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:44.735836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:44.736461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:44.746261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:44.746822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:44.747277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:44.747990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:44.748457 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:44.748893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:44.881348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:44.889793 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7f72f94-344b-4370-b0dc-1f87cbb6037f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1693 microversion: 2.1 time: 0.158319 Sep 16 15:25:44.890374 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4087/7638] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:44 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:45.913364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:45.913938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:45.921121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:45.921603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:45.922037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:45.922774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:45.923232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:45.923659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:46.062586 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:46.070488 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2c609e3d-8c38-4626-8400-7258dd6129eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.161203 Sep 16 15:25:46.071080 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3552/7639] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:45 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:47.095398 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:47.096031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:47.102968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:47.103479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:47.103947 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:47.104708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:47.105182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:47.105629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:47.238314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:47.246241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c03d2a0c-c753-49f1-8a62-36ba4255ce16 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.155521 Sep 16 15:25:47.246859 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4088/7640] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:47 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:48.271020 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:48.271621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:48.278555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:48.279052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:48.280109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:48.280816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:48.281277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:48.281707 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:48.418194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:48.426324 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0bd1db10-c9df-4e95-b976-9e638bbe97e8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.159619 Sep 16 15:25:48.426932 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3553/7641] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:48 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:49.449976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:49.450640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:49.457846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:49.458348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:49.458827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:49.459538 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:49.460012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:49.460456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:49.592568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:49.600400 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b1dbe774-7011-4707-bf34-1fbd3974a3e9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.154406 Sep 16 15:25:49.600982 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4089/7642] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:49 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:50.624225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:50.624861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:50.631380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:50.631868 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:50.632304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:50.633002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:50.633458 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:50.633884 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:50.764119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:50.771949 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-75db2db3-50cf-417c-8e70-836bffee295a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.151863 Sep 16 15:25:50.772525 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3554/7643] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:50 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:51.796066 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:51.796712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:51.803721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:51.804230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:51.804691 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:51.805412 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:51.805889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:51.806337 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:51.943781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:51.952374 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e9722ed6-c1cc-4896-b8e0-822e619495ca tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.160277 Sep 16 15:25:51.952966 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4090/7644] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:51 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:25:52.976210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:52.976826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:52.983664 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:52.984151 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:52.984592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:52.985289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:52.985748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:52.986172 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:53.119619 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:53.127956 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-99ca4bd8-f4b8-4b5e-9278-bd8723f371b8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.155842 Sep 16 15:25:53.128595 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3555/7645] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:52 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:54.230077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:54.230741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:54.237899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:54.238428 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:54.238883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:54.239623 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:54.240099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:54.240537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:54.379158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:54.387029 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d4191f3f-467e-41e6-a2b4-1411dc8fe4ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.161571 Sep 16 15:25:54.387610 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4091/7646] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:54 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:55.411286 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:55.411931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:55.419125 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:55.419613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:55.420681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:55.421364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:55.421951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:55.422451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:55.562228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:55.570157 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3ab20587-f485-4da6-9389-d31a81d182b6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.162778 Sep 16 15:25:55.570774 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3556/7647] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:55 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:56.593273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:56.593862 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:56.600694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:56.601193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:56.601648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:56.602349 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:56.602839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:56.603279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:56.737079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:56.744891 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-13a256fa-1444-44dc-b1e3-63c149a3837c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.155661 Sep 16 15:25:56.745466 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4092/7648] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:56 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:57.769913 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:57.770514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:57.777695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:57.778195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:57.778679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:57.779412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:57.779877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:57.780316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:57.928521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:57.936981 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c595d82-27ff-42c0-a02b-4a87a4e58213 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.171130 Sep 16 15:25:57.937562 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3557/7649] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:57 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:25:58.961297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:25:58.961922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:25:58.968964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:58.969465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:58.969916 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:58.970658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:25:58.971127 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:25:58.971567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:25:59.105159 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:25:59.113577 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2f81c1d9-2ef5-42f5-9fdb-7fb968867589 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.156210 Sep 16 15:25:59.114157 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4093/7650] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:25:58 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:00.138377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:00.139695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:00.146771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:00.147266 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:00.147709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:00.148483 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:00.148888 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:00.149314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:00.284524 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:00.294134 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c701a845-e67f-415c-947a-9e1687595e56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.159356 Sep 16 15:26:00.294333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3558/7651] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:00 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:01.318803 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:01.319434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:01.326852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:01.327361 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:01.327811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:01.328517 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:01.328993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:01.329432 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:01.463853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:01.472132 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-71d2325f-18b6-4745-9091-856839778698 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.157332 Sep 16 15:26:01.472707 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4094/7652] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:01 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:02.495996 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:02.496790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:02.504242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:02.504730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:02.505167 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:02.505873 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:02.506332 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:02.506789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:02.680499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:02.688914 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-18a94519-7aa5-404a-9904-54ab6c6dce56 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1698 microversion: 2.1 time: 0.196835 Sep 16 15:26:02.690343 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3559/7653] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:02 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1698 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:03.357665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "name": "network-vif-unplugged", "status": "completed", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:26:03.367588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:03.368314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:03.368760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:03.382135 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] Creating event network-vif-unplugged:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h1-858129-2 Sep 16 15:26:03.387969 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:26:03.400044 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-e8e14dbc-6a1c-46de-9ea7-7012a0c3d1eb req-184494b9-09ae-443a-a29c-be1446923cf3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112442 Sep 16 15:26:03.400864 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4095/7654] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:26:03.714302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:03.714925 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:03.723640 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:03.724197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:03.724772 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:03.725615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:03.725965 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:03.726413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:03.868835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:03.876924 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb9c2375-0d39-4f39-8775-4f115ccf1d1a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1697 microversion: 2.1 time: 0.167105 Sep 16 15:26:03.877658 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3560/7655] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:03 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:04.901820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:04.902576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:04.910730 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:04.911234 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:04.911695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:04.912421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:04.912893 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:04.913344 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:05.048324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:05.056185 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1fbd7eaa-ee1f-4443-a2ad-530b24ee1c3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1695 microversion: 2.1 time: 0.158841 Sep 16 15:26:05.056777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4096/7656] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:04 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:05.423588 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:26:05.434298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:05.434826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:05.435827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:05.451534 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] Creating event network-changed:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h1-858129-2 Sep 16 15:26:05.457256 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128643) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:26:05.468313 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-b18582b0-a702-48b0-b414-d688a9082ceb req-9ad9eadd-2f1d-492b-9aca-a22749f838a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048447 Sep 16 15:26:05.468937 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3561/7657] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:26:06.079847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:06.080423 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:06.087711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:06.088221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:06.088683 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:06.089402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:06.089883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:06.090333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:06.224090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:06.235558 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3544a934-7003-4fd4-b47f-daef186c07af tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1695 microversion: 2.1 time: 0.159862 Sep 16 15:26:06.236157 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4097/7658] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:06 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:07.261495 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:07.262255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:07.269745 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:07.270898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:07.271677 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:07.272771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:07.273534 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:07.274255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:07.439185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:07.447563 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8fe9ce24-54ab-4a06-941f-56e16e6e4669 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1695 microversion: 2.1 time: 0.191599 Sep 16 15:26:07.448257 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3562/7659] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:07 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:08.472585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:08.473306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:08.480300 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.480798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.481249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.482577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.483048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.483515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.614044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:08.621984 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-88828cfe-a5b3-4c2e-b70d-4443c4b2917a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1692 microversion: 2.1 time: 0.153322 Sep 16 15:26:08.622588 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4098/7660] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:08 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:08.644942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:26:08.645499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:08.652374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.652860 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.653296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.654634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.655091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.655521 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.712413 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c4e2c3e3-3643-4aee-b130-f6f3665cdfd2 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action" status: 204 len: 0 microversion: 2.1 time: 0.071280 Sep 16 15:26:08.713059 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3563/7661] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:26:08 2022] POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:26:08.722083 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:08.722742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:08.728875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.729413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.729865 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.730588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.731069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.731510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.941606 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:08.949810 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-94769bf2-c56c-4c28-a0e6-4c5c59e9f94c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1692 microversion: 2.1 time: 0.231782 Sep 16 15:26:08.951054 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4099/7662] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:08 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1692 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:08.973639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:08.974364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:08.980668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.981155 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.981597 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:08.982298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:08.982791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:08.983219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:09.214386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:09.223856 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-30e33fcf-21d9-4ce3-89b4-917f70d3ba2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1692 microversion: 2.1 time: 0.254404 Sep 16 15:26:09.224458 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3564/7663] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:08 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1692 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:09.342489 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "name": "network-vif-plugged", "status": "completed", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:26:09.355193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:09.355619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:09.356072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:09.372074 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] Creating event network-vif-plugged:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h1-858129-2 Sep 16 15:26:09.379131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858129-2', 'n-h2-858129-2'} {{(pid=128642) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 16 15:26:09.391334 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-81b891fe-7b2c-4043-b01e-58b28bc4e2b6 req-749f2263-eb41-4bc8-ad6c-6828aa8f164b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054336 Sep 16 15:26:09.392254 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4100/7664] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:26:10.247912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:10.248457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:10.255364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:10.255855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:10.256299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:10.257000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:10.257467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:10.257897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:10.392168 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:10.400124 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8325d3ff-9f2e-4e9b-b1a8-475f17108580 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1692 microversion: 2.1 time: 0.156471 Sep 16 15:26:10.401058 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3565/7665] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:10 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:11.425376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:11.426124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:11.432440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:11.432951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:11.433401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:11.434112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:11.434657 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:11.435167 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:11.572247 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:11.575879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:26:11.581312 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9e38470e-6e23-45df-b50f-9d5196d693cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1684 microversion: 2.1 time: 0.160899 Sep 16 15:26:11.581893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4101/7666] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:11 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:26:41.799292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:26:41.801515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:41.803969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=30 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:26:41.804648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:26:41.811225 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:41.811720 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:41.812171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:41.812889 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:41.813349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:41.813784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:41.888138 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7dbfe474-b0c9-4b0b-88e5-f7b22f935985 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action" status: 200 len: 24577 microversion: 2.1 time: 0.092244 Sep 16 15:26:41.888800 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3566/7667] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:26:41 2022] POST /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:26:59.113549 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:59.114147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:59.117620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=36 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:26:59.119267 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:26:59.119267 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:26:59.120989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:26:59.120989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:26:59.126072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:59.127169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:59.128762 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:59.129792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:59.130348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:59.130900 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:59.164134 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:26:59.207148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1286afd1-4288-41fd-8538-0db530be1b6d req-5f4a9551-d2f0-4037-9410-d86d66ab1438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:26:59.220757 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1286afd1-4288-41fd-8538-0db530be1b6d req-5f4a9551-d2f0-4037-9410-d86d66ab1438 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:59.221517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1286afd1-4288-41fd-8538-0db530be1b6d req-5f4a9551-d2f0-4037-9410-d86d66ab1438 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:59.222802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1286afd1-4288-41fd-8538-0db530be1b6d req-5f4a9551-d2f0-4037-9410-d86d66ab1438 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:59.235489 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1286afd1-4288-41fd-8538-0db530be1b6d req-5f4a9551-d2f0-4037-9410-d86d66ab1438 service nova] Creating event network-changed:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h1-858129-2 Sep 16 15:26:59.251041 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1286afd1-4288-41fd-8538-0db530be1b6d req-5f4a9551-d2f0-4037-9410-d86d66ab1438 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146438 Sep 16 15:26:59.252134 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-222c7599-234a-41fb-87f1-eb6a96a6821d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 204 len: 0 microversion: 2.1 time: 0.149964 Sep 16 15:26:59.252528 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3567/7668] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:26:59.253283 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4102/7669] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:26:59 2022] DELETE /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:26:59.263179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:26:59.264161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:26:59.270641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:59.271133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:59.271573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:59.272281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:26:59.272742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:26:59.273195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:26:59.485005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:26:59.493022 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3ce1d8cd-2865-4a69-9d83-845a61f75efe tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1690 microversion: 2.1 time: 0.235070 Sep 16 15:26:59.493589 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3568/7670] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:26:59 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:00.519493 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:00.520213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:00.528182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:00.528682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:00.529138 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:00.529855 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:00.530327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:00.530813 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:00.708943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:00.716894 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-806727fd-f4ab-4f79-970e-dcf2a504e76a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1690 microversion: 2.1 time: 0.201749 Sep 16 15:27:00.717482 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4103/7671] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:00 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:01.529024 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-eb6480ed-bc1f-459a-a193-db82e3f0575c req-7b2bb9eb-7caa-4e4e-8b31-d7108393e427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaaf0f59-ae67-4d24-9d20-43e12b36a732", "name": "network-vif-deleted", "tag": "113a1acc-ddde-4a1d-9e3a-08f242d2b194"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:27:01.540330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eb6480ed-bc1f-459a-a193-db82e3f0575c req-7b2bb9eb-7caa-4e4e-8b31-d7108393e427 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:01.540808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eb6480ed-bc1f-459a-a193-db82e3f0575c req-7b2bb9eb-7caa-4e4e-8b31-d7108393e427 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:01.541327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-eb6480ed-bc1f-459a-a193-db82e3f0575c req-7b2bb9eb-7caa-4e4e-8b31-d7108393e427 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:01.553389 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-eb6480ed-bc1f-459a-a193-db82e3f0575c req-7b2bb9eb-7caa-4e4e-8b31-d7108393e427 service nova] Creating event network-vif-deleted:113a1acc-ddde-4a1d-9e3a-08f242d2b194 for instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 on n-h1-858129-2 Sep 16 15:27:01.558374 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-eb6480ed-bc1f-459a-a193-db82e3f0575c req-7b2bb9eb-7caa-4e4e-8b31-d7108393e427 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Sep 16 15:27:01.559204 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3569/7672] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:27:01.741104 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:01.741834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:01.749354 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:01.749870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:01.750339 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:01.751097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:01.751579 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:01.752061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:01.784181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:01.784951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:01.785148 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:01.785616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lazy-loading 'fault' on Instance uuid aaaf0f59-ae67-4d24-9d20-43e12b36a732 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:27:01.833189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:01.836306 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c8998be2-ba9b-4e1c-9ca8-76e7654dd067 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 200 len: 1356 microversion: 2.1 time: 0.099274 Sep 16 15:27:01.837294 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4104/7673] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:01 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:02.863310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:02.864014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: aaaf0f59-ae67-4d24-9d20-43e12b36a732] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:02.870319 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:02.870840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:02.871280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:02.871983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:02.872445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:02.872876 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:02.886223 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] HTTP exception thrown: Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 could not be found. Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Request method failure captured: Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 HTTP/1.1 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJQIjZXVUt8f82HTQ3jmn3ZlIpKXWPdP8OBz59wnm6BEY0XdA6MAv20NehZpSnuDzBzPfkfGl_p4wA3ZoKfQ6fumJFQLxy4fqZUV4iQqD63vKyoPlRJNZM2qUl0cWkk1fUeXSlEoUFEmYT-XybVvmlkEUY7MHiOPaze_KuEL1jzFchg Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0edf82f3d40649db816118d6443ebff4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}] Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 4499374ea3b745b2a84e7d659b9699c8 Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 could not be found. Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'aaaf0f59-ae67-4d24-9d20-43e12b36a732'} Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 could not be found. Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 could not be found. Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:27:02.887899 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 could not be found. Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Returning 404 to user: Instance aaaf0f59-ae67-4d24-9d20-43e12b36a732 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f3825490-3680-4775-85f5-3b1e31aa3ca6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732" status: 404 len: 111 microversion: 2.1 time: 0.031231 Sep 16 15:27:02.892877 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3570/7674] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:02 2022] GET /compute/v2.1/servers/aaaf0f59-ae67-4d24-9d20-43e12b36a732 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:27:05.874343 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-539a8c0e-9d84-4315-90a0-b4b638adf41a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '.version_select at 0x7f724c2ee8b0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:05.899391 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-539a8c0e-9d84-4315-90a0-b4b638adf41a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-631607945" status: 202 len: 0 microversion: 2.1 time: 0.031209 Sep 16 15:27:05.900541 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4105/7675] 10.222.0.60 () {58 vars in 1281 bytes} [Fri Sep 16 15:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-631607945 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:27:05.936331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fa953e5a-9e98-401b-bbc8-be5971b2f78e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: .version_select at 0x7f724c45e8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-307621525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJE8H7vFjetdEcjJfhr+V4b4WmJFQeoIL9TfxT8yzwCtDjptl6rK0iJguBV8wfmPAWZzOo6YK0sQ/rENtgqM6G4JUBUjvRJugoePEYQ38eyXjfPX9sNaAkdLsA6GTjrG8Q=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:27:05.953413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fa953e5a-9e98-401b-bbc8-be5971b2f78e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:27:05.959967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-fa953e5a-9e98-401b-bbc8-be5971b2f78e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:27:05.984388 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fa953e5a-9e98-401b-bbc8-be5971b2f78e tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052078 Sep 16 15:27:05.984989 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3571/7676] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:27:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:27:11.972268 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-187302238", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "ad1597ad-24d2-4b90-811b-4a6cd432c7b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-307621525", "security_groups": [{"name": "tempest-secgroup-smoke-886972479"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:27:11.984722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:27:12.096445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] validate_networks() for [('ad1597ad-24d2-4b90-811b-4a6cd432c7b4', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:27:12.568503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:27:12.569255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:27:12.570279 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:27:12.572321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:27:12.572785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:27:12.582996 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:12.583646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:12.584314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:12.585240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:12.585943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:12.586718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:12.614356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:27:12.621452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:27:12.635319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:27:12.641705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:27:12.688991 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d89635bf-3e52-4aa9-b614-830bec4d806b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720867 Sep 16 15:27:12.689748 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4106/7677] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:27:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:27:12.702845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-24b2705e-22ad-4209-a1ff-8bd71a1ccdc8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:12.704905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-24b2705e-22ad-4209-a1ff-8bd71a1ccdc8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:12.773417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-24b2705e-22ad-4209-a1ff-8bd71a1ccdc8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:12.781939 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-24b2705e-22ad-4209-a1ff-8bd71a1ccdc8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1265 microversion: 2.1 time: 0.084192 Sep 16 15:27:12.787237 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3572/7678] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:12 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:13.806928 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:13.807570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:13.820018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:13.821248 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:13.821938 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:13.823062 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:13.824185 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:13.825004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:13.903438 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:13.912050 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-99cf9296-c27d-4057-8e33-b5e492067c20 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1269 microversion: 2.1 time: 0.110479 Sep 16 15:27:13.912814 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4107/7679] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:13 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:14.939345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:14.940412 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:14.949648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=12 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:27:14.956665 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:14.957861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:14.958774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:14.960337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:14.961156 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:14.961948 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:15.052503 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:15.061152 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-152f2b8c-134e-4814-8c3f-9d8437d0c5d4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1335 microversion: 2.1 time: 0.128319 Sep 16 15:27:15.061752 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3573/7680] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:14 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:16.085618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:16.086283 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:16.093816 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:16.094313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:16.095022 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:16.095741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:16.096202 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:16.096643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:16.241133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:16.249086 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-234fede1-9946-4744-a695-df70273ef119 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.167392 Sep 16 15:27:16.249665 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4108/7681] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:16 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:16.449103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-7b04af2a-5f89-4be3-9717-850f52f0fbeb req-0494605a-54ff-42ef-a44a-8669227c69a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5044d3c8-6af1-4d29-8c13-6ef13cdd2574", "tag": "3d0708ae-f377-4283-b0c8-4352cb358f56"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:27:16.460120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7b04af2a-5f89-4be3-9717-850f52f0fbeb req-0494605a-54ff-42ef-a44a-8669227c69a8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:16.460702 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7b04af2a-5f89-4be3-9717-850f52f0fbeb req-0494605a-54ff-42ef-a44a-8669227c69a8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:16.461230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-7b04af2a-5f89-4be3-9717-850f52f0fbeb req-0494605a-54ff-42ef-a44a-8669227c69a8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:16.473702 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-7b04af2a-5f89-4be3-9717-850f52f0fbeb req-0494605a-54ff-42ef-a44a-8669227c69a8 service nova] Creating event network-changed:3d0708ae-f377-4283-b0c8-4352cb358f56 for instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 on n-h1-858129-2 Sep 16 15:27:16.478904 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-7b04af2a-5f89-4be3-9717-850f52f0fbeb req-0494605a-54ff-42ef-a44a-8669227c69a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034109 Sep 16 15:27:16.479679 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3574/7682] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:27:17.273821 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:17.274476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:17.282060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:17.282600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:17.283064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:17.283785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:17.284260 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:17.284708 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:17.415483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:17.423354 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-314b5bc4-6b98-4854-ad2a-463181fcc9da tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.153471 Sep 16 15:27:17.423940 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4109/7683] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:17 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:18.447869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:18.449187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:18.455489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:18.456250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:18.456691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:18.457389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:18.457846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:18.458279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:18.592977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:18.601065 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2ea40e8f-01a0-48e7-91a7-625e8ce8678f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.158343 Sep 16 15:27:18.601649 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3575/7684] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:18 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:19.625859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:19.629899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:19.637143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:19.637656 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:19.638146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:19.638876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:19.639351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:19.639822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:19.773782 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:19.783983 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d83e7749-baf9-41d5-9ffb-a9269c326285 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.162055 Sep 16 15:27:19.784614 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4110/7685] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:19 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:20.808827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:20.809440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:20.816339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:20.816875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:20.817451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:20.818210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:20.818765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:20.819263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:20.955188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:20.964188 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f29a86a-e3e7-4fca-9d30-6d3532fc4c0f tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.159680 Sep 16 15:27:20.964798 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3576/7686] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:20 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:21.728224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-38d295fd-f07d-49c3-b78a-ddbfd3ef0c91 req-ecc43e83-6a4c-49f8-b6ec-f805a3b468ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5044d3c8-6af1-4d29-8c13-6ef13cdd2574", "name": "network-vif-plugged", "status": "completed", "tag": "3d0708ae-f377-4283-b0c8-4352cb358f56"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:27:21.738792 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38d295fd-f07d-49c3-b78a-ddbfd3ef0c91 req-ecc43e83-6a4c-49f8-b6ec-f805a3b468ca service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:21.739299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38d295fd-f07d-49c3-b78a-ddbfd3ef0c91 req-ecc43e83-6a4c-49f8-b6ec-f805a3b468ca service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:21.739752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-38d295fd-f07d-49c3-b78a-ddbfd3ef0c91 req-ecc43e83-6a4c-49f8-b6ec-f805a3b468ca service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:21.752041 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-38d295fd-f07d-49c3-b78a-ddbfd3ef0c91 req-ecc43e83-6a4c-49f8-b6ec-f805a3b468ca service nova] Creating event network-vif-plugged:3d0708ae-f377-4283-b0c8-4352cb358f56 for instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 on n-h1-858129-2 Sep 16 15:27:21.756989 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-38d295fd-f07d-49c3-b78a-ddbfd3ef0c91 req-ecc43e83-6a4c-49f8-b6ec-f805a3b468ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086879 Sep 16 15:27:21.757589 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4111/7687] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:27:21.988130 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:21.988769 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:21.996306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:21.996784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:21.997214 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:21.997905 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:21.998353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:21.998802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:22.131512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:22.139283 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-723a3a90-b0f4-4d6b-8cec-1be3fe6adc74 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.155023 Sep 16 15:27:22.139872 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3577/7688] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:21 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:23.160362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:27:23.161171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:27:23.166218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:23.167042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:23.175668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:23.176180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:23.176634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:23.177491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:23.177973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:23.178464 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:23.321100 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:23.329120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6ce132e4-0c82-4167-ab52-9e5a5607784c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1390 microversion: 2.1 time: 0.169727 Sep 16 15:27:23.329713 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4112/7689] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:23 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:24.355260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:24.355875 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:24.358005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:27:24.364449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:24.364941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:24.365380 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:24.366096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:24.366606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:24.366998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:24.503026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:24.511339 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f767b8fd-3155-4be8-90bf-945a18180283 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1561 microversion: 2.1 time: 0.161913 Sep 16 15:27:24.511840 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3578/7690] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:24 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:24.534750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:24.535393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:24.542168 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:24.542704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:24.543164 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:24.543889 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:24.544367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:24.544817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:24.674754 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:24.683094 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-639bd99a-0ab5-4695-869b-9283b8d6b667 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1561 microversion: 2.1 time: 0.152056 Sep 16 15:27:24.683678 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4113/7691] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:24 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:27:26.632470 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:27:26.633166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:27:26.636051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-b67fefec-d0d6-4f86-a61f-311662a77897 req-cb2c8647-75ef-438f-bdb5-680c0265cb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5044d3c8-6af1-4d29-8c13-6ef13cdd2574", "tag": "3d0708ae-f377-4283-b0c8-4352cb358f56"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:27:26.641122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:26.641710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:26.642211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:26.643084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:26.643766 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:26.644402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:26.648035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b67fefec-d0d6-4f86-a61f-311662a77897 req-cb2c8647-75ef-438f-bdb5-680c0265cb50 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:27:26.648545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b67fefec-d0d6-4f86-a61f-311662a77897 req-cb2c8647-75ef-438f-bdb5-680c0265cb50 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:27:26.648998 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-b67fefec-d0d6-4f86-a61f-311662a77897 req-cb2c8647-75ef-438f-bdb5-680c0265cb50 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:27:26.665518 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-b67fefec-d0d6-4f86-a61f-311662a77897 req-cb2c8647-75ef-438f-bdb5-680c0265cb50 service nova] Creating event network-changed:3d0708ae-f377-4283-b0c8-4352cb358f56 for instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 on n-h1-858129-2 Sep 16 15:27:26.671011 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-b67fefec-d0d6-4f86-a61f-311662a77897 req-cb2c8647-75ef-438f-bdb5-680c0265cb50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040183 Sep 16 15:27:26.671998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4114/7692] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:27:26.797671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:27:26.808983 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e1f6b93f-c6e1-4036-9fcb-a979af19d588 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1561 microversion: 2.1 time: 0.180709 Sep 16 15:27:26.809589 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3579/7693] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:27:26 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:00.102439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:28:00.103242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=42 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:28:00.107853 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:28:00.110289 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:00.118110 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:00.118737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:00.119212 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:00.119917 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:00.120400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:00.120846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:00.190540 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-03cd0ff4-a393-43f7-9b34-e2d37c780b24 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action" status: 200 len: 24569 microversion: 2.1 time: 0.089913 Sep 16 15:28:00.191204 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4115/7694] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:28:00 2022] POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action => generated 24569 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:28:30.664279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:28:30.664954 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:28:30.669710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-98defa76-199e-41b2-8ed0-479410d200e1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:28:30.677060 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98defa76-199e-41b2-8ed0-479410d200e1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:30.677557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98defa76-199e-41b2-8ed0-479410d200e1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:30.678000 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-98defa76-199e-41b2-8ed0-479410d200e1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:30.700882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-98defa76-199e-41b2-8ed0-479410d200e1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Going to try to stop instance {{(pid=128643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 15:28:30.742961 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-98defa76-199e-41b2-8ed0-479410d200e1 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action" status: 202 len: 0 microversion: 2.1 time: 0.080319 Sep 16 15:28:30.747212 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3580/7695] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:28:30 2022] POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:28:30.753396 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:30.754120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:30.756793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:28:30.757507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:28:30.763510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:30.764014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:30.764468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:30.765189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:30.765661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:30.766103 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:30.905401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:30.913357 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9bdaf804-2981-4e42-acec-f41156984ed8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.164695 Sep 16 15:28:30.913937 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4116/7696] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:30 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:28:31.940381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:31.941118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:31.947989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:31.948489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:31.948919 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:31.949615 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:31.950075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:31.950535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:32.088310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:32.096202 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80878ff1-e036-4af4-924d-fb1c8a4f79ab tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.161176 Sep 16 15:28:32.096783 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3581/7697] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:31 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:33.119859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:33.120430 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:33.127402 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:33.127905 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:33.128362 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:33.129074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:33.129547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:33.129994 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:33.262180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:33.270116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91602f36-e591-4fcc-ba8c-698b5d8a2f06 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.154358 Sep 16 15:28:33.270718 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4117/7698] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:33 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:34.295137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:34.295763 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:34.302977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:34.303474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:34.303916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:34.304624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:34.305085 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:34.305519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:34.436857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:34.444622 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c36c04f5-9381-4330-91cf-37659823591c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.154391 Sep 16 15:28:34.445229 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3582/7699] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:34 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:35.468912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:35.469575 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:35.476572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:35.477081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:35.477531 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:35.478781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:35.479255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:35.479697 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:35.618080 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:35.625963 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7f7b9c5-85be-451c-a76f-87751ceff43d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.161063 Sep 16 15:28:35.626566 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4118/7700] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:35 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:36.649422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:36.650089 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:36.656898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:36.657385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:36.657825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:36.658565 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:36.659023 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:36.659460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:36.794245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:36.802075 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5d86b49c-baac-4dee-8e70-74ce7b1061cf tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.156774 Sep 16 15:28:36.802689 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3583/7701] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:36 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:37.826160 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:37.826812 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:37.834137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:37.834673 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:37.835128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:37.835837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:37.836308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:37.836751 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:37.971720 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:37.980101 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b12cecc4-fc60-4c39-b82d-7b38e1d76a03 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.157916 Sep 16 15:28:37.980680 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4119/7702] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:37 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:39.003669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:39.004211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:39.011012 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:39.011499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:39.011937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:39.012633 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:39.013091 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:39.013512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:39.143222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:39.151140 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1038abd1-3c5b-40b2-bcfd-6f5ce6947d23 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.151468 Sep 16 15:28:39.151731 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3584/7703] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:38 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:40.176074 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:40.176995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:40.184943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:40.185450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:40.185906 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:40.186677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:40.187161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:40.187600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:40.322546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:40.330549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c75640e-19a4-4635-a6bd-7b4e30397fb6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1689 microversion: 2.1 time: 0.158489 Sep 16 15:28:40.331393 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4120/7704] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:40 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:41.354568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:41.355176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:41.361751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:41.362237 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:41.362696 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:41.363392 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:41.363841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:41.364263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:41.505207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:41.513603 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4a41bfdf-aa38-4a58-913b-722e8f8c5407 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1666 microversion: 2.1 time: 0.163166 Sep 16 15:28:41.514186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3585/7705] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:41 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:42.606647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:28:42.608869 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:42.615820 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:42.616321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:42.616772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:42.617484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:42.617955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:42.618927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:42.685047 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5e0fdc43-6104-4dbd-817d-0c8c2c193165 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action" status: 200 len: 37530 microversion: 2.1 time: 0.082196 Sep 16 15:28:42.685737 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4121/7706] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:28:42 2022] POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action => generated 37530 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:28:42.697918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b4e9891d-de39-4196-8204-4dfed87ababb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:28:42.704926 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4e9891d-de39-4196-8204-4dfed87ababb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:42.705420 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4e9891d-de39-4196-8204-4dfed87ababb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:42.706135 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b4e9891d-de39-4196-8204-4dfed87ababb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:42.728684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b4e9891d-de39-4196-8204-4dfed87ababb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Going to try to start instance {{(pid=128643) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 15:28:42.770739 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b4e9891d-de39-4196-8204-4dfed87ababb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action" status: 202 len: 0 microversion: 2.1 time: 0.076607 Sep 16 15:28:42.771412 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3586/7707] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:28:42 2022] POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:28:42.780420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:42.781147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:42.788454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:42.788973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:42.789450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:42.790210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:42.790731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:42.791181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:42.935200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:42.943316 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ffe5eedd-b806-444f-a27d-878ee378992a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1675 microversion: 2.1 time: 0.167020 Sep 16 15:28:42.943910 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4122/7708] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:42 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:43.968992 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:43.969599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:43.975791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:43.976273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:43.976711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:43.977401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:43.977857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:43.978281 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:44.113175 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:44.121070 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b71f88ae-0fb3-49d2-8cf8-dc7b07348418 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1675 microversion: 2.1 time: 0.157817 Sep 16 15:28:44.121653 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3587/7709] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:43 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:28:45.145347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:28:45.146223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:28:45.153177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:45.153677 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:45.154126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:45.154870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:28:45.155341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:28:45.155785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:28:45.299483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:28:45.307722 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4640015-7c34-41c1-b8c4-053cfe82b7dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1679 microversion: 2.1 time: 0.166410 Sep 16 15:28:45.308358 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4123/7710] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:28:45 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:17.538072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:29:17.540967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:17.543314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:17.543980 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:17.549921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:17.550432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:17.550900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:17.551602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:17.552053 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:17.552476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:17.623240 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8795cdd2-2660-4a37-8067-588ef546af86 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action" status: 200 len: 62088 microversion: 2.1 time: 0.089155 Sep 16 15:29:17.623899 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3588/7711] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:29:17 2022] POST /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574/action => generated 62088 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:29:41.217605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:41.218152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:41.220636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:41.220782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-45086bee-9992-4454-b75a-b614a88d7066 req-815e6ff1-6b93-4cfe-a9dd-3ad550d14e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5044d3c8-6af1-4d29-8c13-6ef13cdd2574", "tag": "3d0708ae-f377-4283-b0c8-4352cb358f56"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:29:41.221561 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=46 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:41.222701 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:29:41.222961 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 (ip 10.222.0.60) !!! Sep 16 15:29:41.224141 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:29:41.224560 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 (ip 10.222.0.60) !!! Sep 16 15:29:41.228076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:41.228983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:41.235455 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:41.236232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:41.236921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:41.237262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45086bee-9992-4454-b75a-b614a88d7066 req-815e6ff1-6b93-4cfe-a9dd-3ad550d14e8f service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:41.237755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45086bee-9992-4454-b75a-b614a88d7066 req-815e6ff1-6b93-4cfe-a9dd-3ad550d14e8f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:41.237882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:41.238197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-45086bee-9992-4454-b75a-b614a88d7066 req-815e6ff1-6b93-4cfe-a9dd-3ad550d14e8f service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:41.238310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:41.238882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:41.252929 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-45086bee-9992-4454-b75a-b614a88d7066 req-815e6ff1-6b93-4cfe-a9dd-3ad550d14e8f service nova] Creating event network-changed:3d0708ae-f377-4283-b0c8-4352cb358f56 for instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 on n-h1-858129-2 Sep 16 15:29:41.261131 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-45086bee-9992-4454-b75a-b614a88d7066 req-815e6ff1-6b93-4cfe-a9dd-3ad550d14e8f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044583 Sep 16 15:29:41.261740 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3589/7712] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:29:41.270507 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:29:41.361520 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-20de4f1c-4098-4c42-a588-a60ab2f514f5 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 204 len: 0 microversion: 2.1 time: 0.148389 Sep 16 15:29:41.362224 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4124/7713] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:29:41 2022] DELETE /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:29:41.372051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:41.372764 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:41.380133 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:41.380795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:41.381252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:41.381970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:41.382646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:41.383278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:41.532551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:41.540943 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-fe3cdd27-9db5-4092-b9cb-d9944527ecb0 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1685 microversion: 2.1 time: 0.173870 Sep 16 15:29:41.541609 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3590/7714] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:41 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:42.568286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:42.569018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:42.576670 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:42.577166 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:42.577624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:42.578347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:42.578850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:42.579294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:42.711490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:42.719770 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-639c279d-f717-490a-9022-36ded32f08cc tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1685 microversion: 2.1 time: 0.155732 Sep 16 15:29:42.720370 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4125/7715] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:42 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:43.743478 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:43.744117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:43.751402 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:43.751893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:43.752330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:43.753033 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:43.753924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:43.753924 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:43.949330 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:43.957520 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-52404b8a-ddf0-414a-913e-92e8a81c3223 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 200 len: 1567 microversion: 2.1 time: 0.217961 Sep 16 15:29:43.958191 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3591/7716] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:43 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:44.033951 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-62c1981b-a795-4047-ac75-f3dfea7c40d1 req-d1ff7e87-cf19-40dc-b945-c5fd472efb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5044d3c8-6af1-4d29-8c13-6ef13cdd2574", "name": "network-vif-deleted", "tag": "3d0708ae-f377-4283-b0c8-4352cb358f56"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:29:44.044794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-62c1981b-a795-4047-ac75-f3dfea7c40d1 req-d1ff7e87-cf19-40dc-b945-c5fd472efb23 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:44.045302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-62c1981b-a795-4047-ac75-f3dfea7c40d1 req-d1ff7e87-cf19-40dc-b945-c5fd472efb23 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:44.045757 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-62c1981b-a795-4047-ac75-f3dfea7c40d1 req-d1ff7e87-cf19-40dc-b945-c5fd472efb23 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:44.058117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-62c1981b-a795-4047-ac75-f3dfea7c40d1 req-d1ff7e87-cf19-40dc-b945-c5fd472efb23 service nova] Creating event network-vif-deleted:3d0708ae-f377-4283-b0c8-4352cb358f56 for instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 on n-h1-858129-2 Sep 16 15:29:44.063589 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-62c1981b-a795-4047-ac75-f3dfea7c40d1 req-d1ff7e87-cf19-40dc-b945-c5fd472efb23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033476 Sep 16 15:29:44.064158 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4126/7717] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:29:44.981335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:44.981976 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: 5044d3c8-6af1-4d29-8c13-6ef13cdd2574] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:44.988751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:44.989228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:44.989659 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:44.990350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:44.990827 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:44.991250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:45.004524 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] HTTP exception thrown: Instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 could not be found. Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Request method failure captured: Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 HTTP/1.1 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJQIjZXVUt8f82HTQ3jmn3ZlIpKXWPdP8OBz59wnm6BEY0XdA6MAv20NehZpSnuDzBzPfkfGl_p4wA3ZoKfQ6fumJFQLxy4fqZUV4iQqD63vKyoPlRJNZM2qUl0cWkk1fUeXSlEoUFEmYT-XybVvmlkEUY7MHiOPaze_KuEL1jzFchg Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0edf82f3d40649db816118d6443ebff4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}] Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 4499374ea3b745b2a84e7d659b9699c8 Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 could not be found. Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '5044d3c8-6af1-4d29-8c13-6ef13cdd2574'} Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 could not be found. Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 could not be found. Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:29:45.006174 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 could not be found. Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Returning 404 to user: Instance 5044d3c8-6af1-4d29-8c13-6ef13cdd2574 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-702ad5ec-5f27-416c-97fe-3542e77d53b4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574" status: 404 len: 111 microversion: 2.1 time: 0.030175 Sep 16 15:29:45.012280 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3592/7718] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:44 2022] GET /compute/v2.1/servers/5044d3c8-6af1-4d29-8c13-6ef13cdd2574 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:29:48.390866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ef703e5-2c14-46a6-b0ad-c88e68196963 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '.version_select at 0x7f724d1bfd30>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:48.416645 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ef703e5-2c14-46a6-b0ad-c88e68196963 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-307621525" status: 202 len: 0 microversion: 2.1 time: 0.032187 Sep 16 15:29:48.417262 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4127/7719] 10.222.0.60 () {58 vars in 1281 bytes} [Fri Sep 16 15:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-307621525 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 15:29:48.450093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e38462f-cab7-4b41-a3d7-a1598916182c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: .version_select at 0x7f724c1fad30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1595124985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0ICEdcM+d5cBK7iJYGP161ghG9KqftOHHFp7nJLgz2DJ3iD6BsFWmAFeiJHBArLAsCJaOecWT4oMGOz4iEKLSX8bwfkH4jf69tLRzouKUF4UAgoKfUtc5rpWYIR4kp6g=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:29:48.467759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0e38462f-cab7-4b41-a3d7-a1598916182c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:29:48.474045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0e38462f-cab7-4b41-a3d7-a1598916182c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:29:48.488963 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e38462f-cab7-4b41-a3d7-a1598916182c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [06bb6011-c533-4d38-a08e-8776a507e591] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:29:49.496834 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e38462f-cab7-4b41-a3d7-a1598916182c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [06bb6011-c533-4d38-a08e-8776a507e591] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47088. Sep 16 15:29:49.512923 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e38462f-cab7-4b41-a3d7-a1598916182c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.066643 Sep 16 15:29:49.513529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3593/7720] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:29:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:29:55.212980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-616544312", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "networks": [{"uuid": "29c11ea0-9d75-46ee-b847-59fa19ee2cbc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1595124985", "security_groups": [{"name": "tempest-secgroup-smoke-56612587"}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:29:55.235156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:55.335586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] validate_networks() for [('29c11ea0-9d75-46ee-b847-59fa19ee2cbc', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:29:55.730918 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:29:55.731968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:29:55.732496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:29:55.732924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:29:55.733356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:29:55.743479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:55.743982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:55.744431 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:55.745175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:55.745646 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:55.746097 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:55.769324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:29:55.775932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Getting quotas for user 4499374ea3b745b2a84e7d659b9699c8 and project 0edf82f3d40649db816118d6443ebff4. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:29:55.790389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:29:55.793171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:29:55.850332 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e66bd894-1236-4d17-8ae3-065cd3300a27 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.641769 Sep 16 15:29:55.860021 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4128/7721] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:29:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:29:55.863646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=16 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:29:55.867850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-840b2a7e-c2bb-4c1a-9a1f-df80c89b10eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:55.868454 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-840b2a7e-c2bb-4c1a-9a1f-df80c89b10eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:55.934331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-840b2a7e-c2bb-4c1a-9a1f-df80c89b10eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:55.942183 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-840b2a7e-c2bb-4c1a-9a1f-df80c89b10eb tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1266 microversion: 2.1 time: 0.080503 Sep 16 15:29:55.943283 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3594/7722] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:55 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:56.969075 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:56.970587 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:56.977210 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:56.977836 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:56.978479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:56.979462 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:56.980008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:56.980632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:57.082023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:57.095798 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-48bf5da5-9237-4b5e-8842-0c2dde7e48e4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1326 microversion: 2.1 time: 0.131470 Sep 16 15:29:57.112102 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4129/7723] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:56 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:58.128223 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:58.131046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:58.145608 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:58.147957 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:58.149634 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:58.151093 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:58.152259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:58.153325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:58.409916 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:58.418491 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-736aab7f-c9d3-4120-819b-a01aded9fd87 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.298949 Sep 16 15:29:58.419085 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3595/7724] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:58 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:29:58.965532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-c2510518-da2b-4674-a46d-f9221f8ffb32 req-74f0103f-2f0a-485a-81d4-06881e01eeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d23b75-01aa-41b4-aa32-bd8309d93605", "tag": "10c3f942-a293-4b8b-bf51-3cc90a313991"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:29:58.979849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c2510518-da2b-4674-a46d-f9221f8ffb32 req-74f0103f-2f0a-485a-81d4-06881e01eeb8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:58.980262 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c2510518-da2b-4674-a46d-f9221f8ffb32 req-74f0103f-2f0a-485a-81d4-06881e01eeb8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:58.980907 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-c2510518-da2b-4674-a46d-f9221f8ffb32 req-74f0103f-2f0a-485a-81d4-06881e01eeb8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:58.993097 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-c2510518-da2b-4674-a46d-f9221f8ffb32 req-74f0103f-2f0a-485a-81d4-06881e01eeb8 service nova] Creating event network-changed:10c3f942-a293-4b8b-bf51-3cc90a313991 for instance a7d23b75-01aa-41b4-aa32-bd8309d93605 on n-h2-858129-2 Sep 16 15:29:58.999264 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-c2510518-da2b-4674-a46d-f9221f8ffb32 req-74f0103f-2f0a-485a-81d4-06881e01eeb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039514 Sep 16 15:29:59.000044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4130/7725] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:29:59.443593 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:29:59.444210 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:29:59.452058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:59.452538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:59.452971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:59.453733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:29:59.454124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:29:59.454576 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:29:59.591900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:29:59.600059 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-085375cf-affa-42c2-ac38-4d7e02cb98f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.161241 Sep 16 15:29:59.600629 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3596/7726] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:29:59 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:00.623513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:00.624229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:00.631701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:00.632198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:00.633161 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:00.633879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:00.634346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:00.634814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:00.775272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:00.783493 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6206c9d-c3c2-4050-bd2f-847bad6565f8 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.164258 Sep 16 15:30:00.784089 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4131/7727] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:00 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:01.807148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:01.807758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:01.814722 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:01.815211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:01.815638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:01.816460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:01.816920 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:01.817343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:02.028329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:02.036257 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3d90f9b3-3e2e-44f5-994b-96f5046dd025 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.233681 Sep 16 15:30:02.036840 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3597/7728] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:01 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:03.189373 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:03.189883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:03.196378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:03.196856 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:03.197312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:03.198027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:03.198527 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:03.198976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:03.330119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:03.338565 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0b1f50ed-b084-4e72-8566-14b0d21448a6 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.282751 Sep 16 15:30:03.339167 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4132/7729] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:03 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:04.361238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:04.361912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:04.369372 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:04.369865 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:04.370308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:04.371055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:04.371516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:04.371945 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:04.506034 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:04.514169 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8d36610d-57ba-4db9-99a7-c0bb1d406071 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.156847 Sep 16 15:30:04.514806 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3598/7730] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:04 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:05.537244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:05.537880 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:05.544903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:05.545410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:05.545866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:05.546676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:05.547158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:05.547608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:05.683537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:05.691367 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-bd4d85d0-45a0-46ae-ada5-bcac83138a70 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.158054 Sep 16 15:30:05.691955 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4133/7731] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:05 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:06.048350 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-4c86e9a1-4320-4b23-8806-3f1839bf1240 req-8088b8a5-8cf2-4b63-8faa-c3c954285676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d23b75-01aa-41b4-aa32-bd8309d93605", "name": "network-vif-plugged", "status": "completed", "tag": "10c3f942-a293-4b8b-bf51-3cc90a313991"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:30:06.055143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:30:06.062395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4c86e9a1-4320-4b23-8806-3f1839bf1240 req-8088b8a5-8cf2-4b63-8faa-c3c954285676 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:06.062984 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4c86e9a1-4320-4b23-8806-3f1839bf1240 req-8088b8a5-8cf2-4b63-8faa-c3c954285676 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:06.063421 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-4c86e9a1-4320-4b23-8806-3f1839bf1240 req-8088b8a5-8cf2-4b63-8faa-c3c954285676 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:06.075362 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-4c86e9a1-4320-4b23-8806-3f1839bf1240 req-8088b8a5-8cf2-4b63-8faa-c3c954285676 service nova] Creating event network-vif-plugged:10c3f942-a293-4b8b-bf51-3cc90a313991 for instance a7d23b75-01aa-41b4-aa32-bd8309d93605 on n-h2-858129-2 Sep 16 15:30:06.081131 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-4c86e9a1-4320-4b23-8806-3f1839bf1240 req-8088b8a5-8cf2-4b63-8faa-c3c954285676 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036151 Sep 16 15:30:06.081759 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3599/7732] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:30:06.716124 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:06.716761 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:06.718752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:30:06.719448 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:30:06.726638 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:06.727149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:06.727605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:06.728320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:06.728795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:06.729242 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:06.866581 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:06.874352 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cd19a8dc-b59e-4588-b7ea-13f7d96f1a35 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1390 microversion: 2.1 time: 0.162177 Sep 16 15:30:06.874959 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4134/7733] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:06 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:07.898814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:07.899436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:07.906617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:07.907109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:07.907551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:07.908252 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:07.908714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:07.909138 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:08.042985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:08.050786 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-94448d30-66dd-4b00-a1ea-1155f888da42 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1562 microversion: 2.1 time: 0.156878 Sep 16 15:30:08.051379 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3600/7734] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:07 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:08.073241 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:08.073867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:08.081081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:08.081578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:08.082033 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:08.082759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:08.083232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:08.083669 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:08.216948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:08.224775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-34d0a532-a829-4fd4-8764-8a465b0bc8cd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1562 microversion: 2.1 time: 0.155477 Sep 16 15:30:08.225371 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4135/7735] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:08 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:10.131737 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:30:10.137264 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-17f6f853-14a0-43c9-968b-dc5498402279 req-5bf3ff73-79d9-4426-ac53-c9a2145a0750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d23b75-01aa-41b4-aa32-bd8309d93605", "tag": "10c3f942-a293-4b8b-bf51-3cc90a313991"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:30:10.144230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:10.151768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:10.155819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17f6f853-14a0-43c9-968b-dc5498402279 req-5bf3ff73-79d9-4426-ac53-c9a2145a0750 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:10.156368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17f6f853-14a0-43c9-968b-dc5498402279 req-5bf3ff73-79d9-4426-ac53-c9a2145a0750 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:10.156828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-17f6f853-14a0-43c9-968b-dc5498402279 req-5bf3ff73-79d9-4426-ac53-c9a2145a0750 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:10.161220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:10.161998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:10.162759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:10.163234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:10.164277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:10.170927 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-17f6f853-14a0-43c9-968b-dc5498402279 req-5bf3ff73-79d9-4426-ac53-c9a2145a0750 service nova] Creating event network-changed:10c3f942-a293-4b8b-bf51-3cc90a313991 for instance a7d23b75-01aa-41b4-aa32-bd8309d93605 on n-h2-858129-2 Sep 16 15:30:10.176891 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-17f6f853-14a0-43c9-968b-dc5498402279 req-5bf3ff73-79d9-4426-ac53-c9a2145a0750 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043066 Sep 16 15:30:10.177671 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4136/7736] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:30:10.398116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:30:10.407647 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-07f716d5-0756-497d-a3b1-c8ca888b0be4 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1562 microversion: 2.1 time: 0.279907 Sep 16 15:30:10.408975 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3601/7737] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:30:10 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1562 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:30:43.745335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:30:43.747775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:30:43.750145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:30:43.750854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=42 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:30:43.757621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:43.758129 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:43.758630 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:43.759355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:30:43.759839 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:30:43.760286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:30:43.834761 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7f0987f6-7143-44d0-8e4b-7f52f63e2f2c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action" status: 200 len: 24561 microversion: 2.1 time: 0.093675 Sep 16 15:30:43.835431 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4137/7738] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:30:43 2022] POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action => generated 24561 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:31:14.256914 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:31:14.256914 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action (ip 10.222.0.60) !!! Sep 16 15:31:14.257773 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:14.258592 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:14.263035 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:14.263569 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:14.272798 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:14.273308 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:14.273718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:14.274443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:14.274922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:14.275320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:14.300436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lazy-loading 'flavor' on Instance uuid a7d23b75-01aa-41b4-aa32-bd8309d93605 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:31:14.366163 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1432f614-9832-4767-88bb-90cdc7a086c3 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action" status: 202 len: 0 microversion: 2.1 time: 0.112367 Sep 16 15:31:14.367016 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3602/7739] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:31:14 2022] POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:31:14.375981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:14.376717 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:14.379965 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:14.381453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:14.388374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:14.388883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:14.389334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:14.390079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:14.390568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:14.391302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:14.535698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:14.543827 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf7d98d1-8468-4550-bc5d-68aae5b2e760 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1689 microversion: 2.1 time: 0.172470 Sep 16 15:31:14.544423 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4138/7740] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:14 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:15.572161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:15.572890 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:15.579161 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:15.579646 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:15.580082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:15.581043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:15.581498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:15.581921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:15.717717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:15.727097 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4d980018-ba26-4f14-a76f-d62b95ad714c tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1689 microversion: 2.1 time: 0.161425 Sep 16 15:31:15.727679 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3603/7741] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:15 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:16.751384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:16.751970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:16.759518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:16.760031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:16.760490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:16.761207 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:16.761686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:16.762136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:16.894494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:16.902535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d0187131-5224-440c-98e7-0ee1db2bc006 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1672 microversion: 2.1 time: 0.155074 Sep 16 15:31:16.903131 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4139/7742] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:16 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:31:18.002686 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:18.004982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:18.012423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:18.012909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:18.013351 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:18.014052 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:18.014548 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:18.014983 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:18.081704 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-67d44f32-8f2d-4ad4-98e3-13ed70922a0a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action" status: 200 len: 35285 microversion: 2.1 time: 0.083034 Sep 16 15:31:18.082640 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3604/7743] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:31:17 2022] POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action => generated 35285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:31:18.094747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:18.095303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:18.102143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:18.102680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:18.103137 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:18.103847 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:18.104322 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:18.104769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:18.171539 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a20c67d5-a56f-4855-bf34-f13640c0199b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action" status: 202 len: 0 microversion: 2.1 time: 0.080320 Sep 16 15:31:18.175471 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4140/7744] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:31:18 2022] POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:31:18.181194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:18.181906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:18.189568 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:18.190114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:18.190648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:18.191432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:18.191914 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:18.192344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:18.417181 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:18.425429 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1ba34a66-6c1d-4903-987d-3a013b040317 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1678 microversion: 2.1 time: 0.248492 Sep 16 15:31:18.426161 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3605/7745] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:18 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:19.451223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:19.451932 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:19.459204 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:19.459696 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:19.460142 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:19.460841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:19.461307 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:19.461746 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:19.592197 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:19.600556 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-961f6640-a3c1-4338-ba42-2c38f98dfe3a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1678 microversion: 2.1 time: 0.154440 Sep 16 15:31:19.601140 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4141/7746] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:19 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:20.624639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:20.625230 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:20.632695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:20.633176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:20.633620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:20.634294 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:20.634771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:20.635197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:20.770819 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:20.778655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ebe29ce8-583e-4b9b-8a19-74334a27401d tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1681 microversion: 2.1 time: 0.158003 Sep 16 15:31:20.779239 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3606/7747] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:20 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:21.223596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:21.226374 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:21.233445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:21.233952 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:21.234433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:21.235155 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:21.235632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:21.236081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:21.304116 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-328a7dc8-8b43-4bd2-914b-1f18dce01704 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action" status: 200 len: 35285 microversion: 2.1 time: 0.084265 Sep 16 15:31:21.304801 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4142/7748] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:31:21 2022] POST /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605/action => generated 35285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 15:31:22.382306 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:22.383475 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:22.392248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:22.392872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:22.393417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:22.394396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:22.395195 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:22.396259 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:22.423814 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:31:22.449077 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-79043882-cc33-48d9-b8ef-0ab2aafc9c33 req-bd9344fb-484c-4886-a173-40f077a556aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d23b75-01aa-41b4-aa32-bd8309d93605", "tag": "10c3f942-a293-4b8b-bf51-3cc90a313991"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:22.460858 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-79043882-cc33-48d9-b8ef-0ab2aafc9c33 req-bd9344fb-484c-4886-a173-40f077a556aa service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:22.461460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-79043882-cc33-48d9-b8ef-0ab2aafc9c33 req-bd9344fb-484c-4886-a173-40f077a556aa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:22.462163 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-79043882-cc33-48d9-b8ef-0ab2aafc9c33 req-bd9344fb-484c-4886-a173-40f077a556aa service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:22.474729 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-79043882-cc33-48d9-b8ef-0ab2aafc9c33 req-bd9344fb-484c-4886-a173-40f077a556aa service nova] Creating event network-changed:10c3f942-a293-4b8b-bf51-3cc90a313991 for instance a7d23b75-01aa-41b4-aa32-bd8309d93605 on n-h2-858129-2 Sep 16 15:31:22.480239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-79043882-cc33-48d9-b8ef-0ab2aafc9c33 req-bd9344fb-484c-4886-a173-40f077a556aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100343 Sep 16 15:31:22.480897 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4143/7749] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:31:22.506217 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-06f7ee73-d16b-42f4-8fcb-168c7766784a tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 204 len: 0 microversion: 2.1 time: 0.128584 Sep 16 15:31:22.506955 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3607/7750] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:31:22 2022] DELETE /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:31:22.516003 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:22.516722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:22.525864 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:22.526371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:22.526863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:22.531143 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:22.532222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:22.533049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:22.681590 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:22.689485 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-df078773-c43b-4454-9903-74e888f7f8dd tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1687 microversion: 2.1 time: 0.177723 Sep 16 15:31:22.690074 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4144/7751] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:22 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:23.715301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:23.716004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:23.722861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:23.723344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:23.723808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:23.724499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:23.724967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:23.725370 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:23.859795 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:23.868391 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e6f74a27-7dbf-4b0f-af2f-e4a5ec231954 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1687 microversion: 2.1 time: 0.157197 Sep 16 15:31:23.868906 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3608/7752] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:23 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:24.870877 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-659e364f-0ee7-49b8-9641-73d8e9dc3685 req-70296893-0af4-4102-b793-0eccdcf7f484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d23b75-01aa-41b4-aa32-bd8309d93605", "name": "network-vif-deleted", "tag": "10c3f942-a293-4b8b-bf51-3cc90a313991"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:24.881273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-659e364f-0ee7-49b8-9641-73d8e9dc3685 req-70296893-0af4-4102-b793-0eccdcf7f484 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:24.881817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-659e364f-0ee7-49b8-9641-73d8e9dc3685 req-70296893-0af4-4102-b793-0eccdcf7f484 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:24.882224 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-659e364f-0ee7-49b8-9641-73d8e9dc3685 req-70296893-0af4-4102-b793-0eccdcf7f484 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:24.892934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:24.894297 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:24.894678 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-659e364f-0ee7-49b8-9641-73d8e9dc3685 req-70296893-0af4-4102-b793-0eccdcf7f484 service nova] Creating event network-vif-deleted:10c3f942-a293-4b8b-bf51-3cc90a313991 for instance a7d23b75-01aa-41b4-aa32-bd8309d93605 on n-h2-858129-2 Sep 16 15:31:24.900151 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-659e364f-0ee7-49b8-9641-73d8e9dc3685 req-70296893-0af4-4102-b793-0eccdcf7f484 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032910 Sep 16 15:31:24.900819 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4145/7753] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:31:24.904304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:24.904810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:24.905241 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:24.905944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:24.906396 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:24.906837 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:24.977839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4499374ea3b745b2a84e7d659b9699c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edf82f3d40649db816118d6443ebff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:24.986335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5b74f1cd-27f2-448c-bcb6-dec25f0f8488 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 200 len: 1351 microversion: 2.1 time: 0.097288 Sep 16 15:31:24.986960 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3609/7754] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:24 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:31:26.019052 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:26.019794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] [instance: a7d23b75-01aa-41b4-aa32-bd8309d93605] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:26.026487 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:26.026985 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:26.027436 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:26.028130 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:26.028596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:26.029035 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:26.042852 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] HTTP exception thrown: Instance a7d23b75-01aa-41b4-aa32-bd8309d93605 could not be found. Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Request method failure captured: Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 HTTP/1.1 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJQIjZXVUt8f82HTQ3jmn3ZlIpKXWPdP8OBz59wnm6BEY0XdA6MAv20NehZpSnuDzBzPfkfGl_p4wA3ZoKfQ6fumJFQLxy4fqZUV4iQqD63vKyoPlRJNZM2qUl0cWkk1fUeXSlEoUFEmYT-XybVvmlkEUY7MHiOPaze_KuEL1jzFchg Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0edf82f3d40649db816118d6443ebff4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0edf82f3d40649db816118d6443ebff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0edf82f3d40649db816118d6443ebff4"}]}] Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 0edf82f3d40649db816118d6443ebff4 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-61049881 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 4499374ea3b745b2a84e7d659b9699c8 Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestNetworkAdvancedServerOps-61049881-project Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance a7d23b75-01aa-41b4-aa32-bd8309d93605 could not be found. Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'a7d23b75-01aa-41b4-aa32-bd8309d93605'} Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d23b75-01aa-41b4-aa32-bd8309d93605 could not be found. Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d23b75-01aa-41b4-aa32-bd8309d93605 could not be found. Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:31:26.044482 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d23b75-01aa-41b4-aa32-bd8309d93605 could not be found. Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Returning 404 to user: Instance a7d23b75-01aa-41b4-aa32-bd8309d93605 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-59142126-a0df-4c82-b33c-2ee0107f299b tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605" status: 404 len: 111 microversion: 2.1 time: 0.032030 Sep 16 15:31:26.050327 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4146/7755] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:26 2022] GET /compute/v2.1/servers/a7d23b75-01aa-41b4-aa32-bd8309d93605 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:31:29.352719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0bb0172f-83ea-458b-a38b-5dca3d0a17b9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] Calling method '.version_select at 0x7f724c2a4160>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:29.377891 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0bb0172f-83ea-458b-a38b-5dca3d0a17b9 tempest-TestNetworkAdvancedServerOps-61049881 tempest-TestNetworkAdvancedServerOps-61049881-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1595124985" status: 202 len: 0 microversion: 2.1 time: 0.034166 Sep 16 15:31:29.379184 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3610/7756] 10.222.0.60 () {58 vars in 1284 bytes} [Fri Sep 16 15:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1595124985 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:31:40.521744 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=18 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:40.522591 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:40.701773 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9871e916-43ef-47ad-b372-4d2e7bba7cb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'create', calling method: .version_select at 0x7f724d81e310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1500856732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZis9IarlnEHK3TL1Vy8d+5woRuLz7QlAv6/cc9KNuQQJFjmcKK4pJ0oaMV2ltkrd2+VkF9ObG3g3xWEEPoqybJDpkzM9X0orQMsQKGs6XndOvFlSgxafasyFZlBw5amA=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:40.720065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9871e916-43ef-47ad-b372-4d2e7bba7cb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:31:40.727828 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-9871e916-43ef-47ad-b372-4d2e7bba7cb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for user 4f981c151fd6428a9326238c0bcc2083 and project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:31:40.757137 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9871e916-43ef-47ad-b372-4d2e7bba7cb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.241515 Sep 16 15:31:40.758012 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4147/7757] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:31:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:31:41.883496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1450162210", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1500856732", "security_groups": [{"name": "tempest-secgroup-smoke-579381147"}], "networks": [{"uuid": "bf6e0067-9e31-4968-9767-09cf81ad8df3"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:41.898997 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:41.899663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:42.032345 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] validate_networks() for [('bf6e0067-9e31-4968-9767-09cf81ad8df3', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:31:42.539988 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:31:42.540527 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:31:42.541114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:31:42.541639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:31:42.542182 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:31:42.553299 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:42.553956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:42.554528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:42.555496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:42.556115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:42.556587 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:42.583501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:31:42.588938 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for user 4f981c151fd6428a9326238c0bcc2083 and project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:31:42.602349 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:31:42.604793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:31:42.654640 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ea3568dc-cbde-41df-8be5-8a937cb4de65 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.775471 Sep 16 15:31:42.655387 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3611/7758] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:31:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:31:42.667513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-6f5e86e4-271b-4582-9e28-e68dd762621e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:42.668171 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-6f5e86e4-271b-4582-9e28-e68dd762621e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:42.724772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-6f5e86e4-271b-4582-9e28-e68dd762621e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:42.732120 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-6f5e86e4-271b-4582-9e28-e68dd762621e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1247 microversion: 2.1 time: 0.068807 Sep 16 15:31:42.732714 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4148/7759] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:42 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:43.759574 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-31bf2ab6-f9da-4dbb-87c0-52363566bd1a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:43.760361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-31bf2ab6-f9da-4dbb-87c0-52363566bd1a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:43.844585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-31bf2ab6-f9da-4dbb-87c0-52363566bd1a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:43.852335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-31bf2ab6-f9da-4dbb-87c0-52363566bd1a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1247 microversion: 2.1 time: 0.099728 Sep 16 15:31:43.852936 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3612/7760] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:43 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:44.878650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aab9c94a-b07e-4cc8-8131-c4fb744717ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:44.879336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aab9c94a-b07e-4cc8-8131-c4fb744717ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:44.945369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aab9c94a-b07e-4cc8-8131-c4fb744717ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:44.959670 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aab9c94a-b07e-4cc8-8131-c4fb744717ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1247 microversion: 2.1 time: 0.085315 Sep 16 15:31:44.960972 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4149/7761] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:44 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:45.984417 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8743d813-1c26-4905-83fa-70238d963667 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:45.985031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8743d813-1c26-4905-83fa-70238d963667 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:46.040986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8743d813-1c26-4905-83fa-70238d963667 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:46.048585 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8743d813-1c26-4905-83fa-70238d963667 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1247 microversion: 2.1 time: 0.067974 Sep 16 15:31:46.049180 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3613/7762] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:45 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:47.072072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:47.072768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:47.079680 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:47.080213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:47.080930 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:47.081643 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:47.082126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:47.083637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:47.146321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:47.154125 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4510ecd-5e7d-48ab-9594-266ca6b246a5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1251 microversion: 2.1 time: 0.085968 Sep 16 15:31:47.154738 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4150/7763] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:47 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1251 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:48.177742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:48.178346 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:48.185610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:48.186109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:48.186572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:48.187282 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:48.187765 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:48.188188 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:48.261643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:48.269441 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-101b4001-5ea8-4f51-b490-f3e98e6397e2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1305 microversion: 2.1 time: 0.095640 Sep 16 15:31:48.270710 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3614/7764] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:48 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:49.293837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:49.294408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:49.301885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:49.302397 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:49.302873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:49.303599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:49.304069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:49.304509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:49.429229 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d50f8f59-29d6-46d3-b351-fa7418aeea42 req-d6f13d5d-3a4c-4e09-802d-288b4f6cccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:49.440831 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d50f8f59-29d6-46d3-b351-fa7418aeea42 req-d6f13d5d-3a4c-4e09-802d-288b4f6cccc4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:49.441390 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d50f8f59-29d6-46d3-b351-fa7418aeea42 req-d6f13d5d-3a4c-4e09-802d-288b4f6cccc4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:49.442504 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d50f8f59-29d6-46d3-b351-fa7418aeea42 req-d6f13d5d-3a4c-4e09-802d-288b4f6cccc4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:49.454308 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d50f8f59-29d6-46d3-b351-fa7418aeea42 req-d6f13d5d-3a4c-4e09-802d-288b4f6cccc4 service nova] Creating event network-changed:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h1-858129-2 Sep 16 15:31:49.460686 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d50f8f59-29d6-46d3-b351-fa7418aeea42 req-d6f13d5d-3a4c-4e09-802d-288b4f6cccc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035193 Sep 16 15:31:49.461312 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3615/7765] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:31:49.542614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:49.550796 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c3b97224-6366-40a0-bc9e-ca4dc1264857 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.260836 Sep 16 15:31:49.551777 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4151/7766] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:49 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:50.576864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:50.577489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:50.584002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:50.584487 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:50.584934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:50.585624 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:50.586082 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:50.586536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:50.719134 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:50.727053 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-190a2eea-b6f2-42ba-8099-fc627b7b5aa7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.155466 Sep 16 15:31:50.727640 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3616/7767] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:50 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:51.751306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:51.751845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:51.759554 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:51.760050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:51.760504 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:51.761206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:51.761676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:51.762147 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:51.901592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:51.909601 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cb6a96ac-a61e-4b1c-a91c-adc0d44372dc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.162599 Sep 16 15:31:51.910178 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4152/7768] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:51 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:52.932378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:52.932993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:52.935857 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:52.941727 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:52.942243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:52.943076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:52.943861 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:52.944327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:52.944759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:53.102779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:53.110655 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a22799c4-5658-47bc-a5eb-20566c9e489d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.182172 Sep 16 15:31:53.111240 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3617/7769] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:52 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:54.134023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:54.134679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:54.140995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:54.141503 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:54.141961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:54.142716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:54.143193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:54.143639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:54.274639 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:54.282429 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28534304-8b84-4aa1-9d99-f906d58af977 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.152649 Sep 16 15:31:54.283096 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4153/7770] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:54 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:55.307912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:55.309209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:55.317856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:55.318559 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:55.319011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:55.319741 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:55.320207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:55.320637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:55.464591 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:55.474045 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-40b99dfb-6c4d-4603-b605-a85809888551 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.170303 Sep 16 15:31:55.474672 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3618/7771] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:55 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:31:56.501144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:56.501745 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:56.503763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=8 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:56.511982 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:56.512509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:56.512971 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:56.513713 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:56.514193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:56.514676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:56.656305 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:56.664239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4cb79b7-ee11-4ae6-8bcb-1b71c8ef1f26 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.167267 Sep 16 15:31:56.664812 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4154/7772] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:56 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:57.011197 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-1ff304c4-0f83-48a6-87fc-ef16d63350a6 req-a36a2d6f-42f8-403f-892b-fac0195b9fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "name": "network-vif-plugged", "status": "completed", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:31:57.016787 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:31:57.024295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1ff304c4-0f83-48a6-87fc-ef16d63350a6 req-a36a2d6f-42f8-403f-892b-fac0195b9fac service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:57.024758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1ff304c4-0f83-48a6-87fc-ef16d63350a6 req-a36a2d6f-42f8-403f-892b-fac0195b9fac service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:57.025176 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-1ff304c4-0f83-48a6-87fc-ef16d63350a6 req-a36a2d6f-42f8-403f-892b-fac0195b9fac service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:57.037376 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-1ff304c4-0f83-48a6-87fc-ef16d63350a6 req-a36a2d6f-42f8-403f-892b-fac0195b9fac service nova] Creating event network-vif-plugged:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h1-858129-2 Sep 16 15:31:57.042603 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-1ff304c4-0f83-48a6-87fc-ef16d63350a6 req-a36a2d6f-42f8-403f-892b-fac0195b9fac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035158 Sep 16 15:31:57.043237 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3619/7773] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:31:57.689123 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:57.689789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:57.696960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:57.696960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:57.696960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:57.698545 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:57.699031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:57.699475 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:58.172574 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:58.180954 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c4a3092e-a724-4517-a3d4-8667ec36695f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1372 microversion: 2.1 time: 0.495769 Sep 16 15:31:58.181542 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4155/7774] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:57 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1372 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:31:59.206501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:59.207809 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:59.214153 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:59.214675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:59.215117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:59.215816 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:59.216276 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:59.216700 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:59.403639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:59.411678 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9f6c2724-d818-4e27-9375-8592173da7d1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1557 microversion: 2.1 time: 0.210612 Sep 16 15:31:59.412271 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3620/7775] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:59 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1557 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:31:59.433968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:31:59.434681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:31:59.442341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:59.442894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:59.443385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:59.444105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:31:59.444585 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:31:59.445032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:31:59.576237 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:31:59.584346 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2ec4bcdb-50a5-44b2-a768-b95a0f53373e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1557 microversion: 2.1 time: 0.154277 Sep 16 15:31:59.584920 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4156/7776] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:31:59 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:32:01.240641 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-0ec8d57d-9ddd-47fe-af36-1ec8ffa46cf6 req-963119ae-991a-42b3-b0ae-96b0c28e9208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:32:01.251226 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0ec8d57d-9ddd-47fe-af36-1ec8ffa46cf6 req-963119ae-991a-42b3-b0ae-96b0c28e9208 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:32:01.252058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0ec8d57d-9ddd-47fe-af36-1ec8ffa46cf6 req-963119ae-991a-42b3-b0ae-96b0c28e9208 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:32:01.252496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-0ec8d57d-9ddd-47fe-af36-1ec8ffa46cf6 req-963119ae-991a-42b3-b0ae-96b0c28e9208 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:32:01.264605 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-0ec8d57d-9ddd-47fe-af36-1ec8ffa46cf6 req-963119ae-991a-42b3-b0ae-96b0c28e9208 service nova] Creating event network-changed:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h1-858129-2 Sep 16 15:32:01.271219 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-0ec8d57d-9ddd-47fe-af36-1ec8ffa46cf6 req-963119ae-991a-42b3-b0ae-96b0c28e9208 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034376 Sep 16 15:32:01.272257 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3621/7777] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:34:37.530668 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:34:37.531901 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:34:37.532466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:34:37.533232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=42 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:34:37.534659 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:34:37.534828 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action (ip 10.222.0.60) !!! Sep 16 15:34:37.536966 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:34:37.537114 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action (ip 10.222.0.60) !!! Sep 16 15:34:37.538761 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:34:37.538887 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action (ip 10.222.0.60) !!! Sep 16 15:34:37.550084 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:34:37.550629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:37.564303 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:37.564895 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:37.565356 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:37.566086 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:37.566605 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:37.567055 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:37.591644 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lazy-loading 'flavor' on Instance uuid 69beb4f1-b019-4ff1-9377-28c21b4536d7 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:34:37.919259 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-89a8c94d-37d5-4fe5-ae40-d795e168f6e3 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action" status: 202 len: 0 microversion: 2.1 time: 0.390183 Sep 16 15:34:37.919892 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4157/7778] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:34:37 2022] POST /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:34:37.926678 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:34:37.927570 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:34:37.928234 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:34:37.929314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:34:37.930395 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:34:37.930639 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 (ip 10.222.0.60) !!! Sep 16 15:34:37.932351 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:34:37.932702 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 (ip 10.222.0.60) !!! Sep 16 15:34:37.935162 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:34:37.935593 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 (ip 10.222.0.60) !!! Sep 16 15:34:37.947488 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:37.948250 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:37.968537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:37.969031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:37.969480 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:37.971067 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:37.971525 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:37.971951 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:38.111109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:38.118954 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-362ed786-b627-403e-b4f4-b866d6688cee tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.194246 Sep 16 15:34:38.119540 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3622/7779] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:37 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:34:39.146775 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:39.147506 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:39.161068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:39.161586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:39.162053 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:39.162876 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:39.163384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:39.163845 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:39.170031 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47518. Sep 16 15:34:39.170791 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47516. Sep 16 15:34:39.300440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:39.308472 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7f138900-5bec-47d0-adfe-223855e8ee42 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.169088 Sep 16 15:34:39.309054 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4158/7780] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:39 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:40.333005 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:40.333616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:40.342215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:40.342730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:40.343157 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:40.343961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:40.344411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:40.344824 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:40.362303 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47524. Sep 16 15:34:40.363028 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47522. Sep 16 15:34:40.510719 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:40.519472 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d5d4f09a-d6a8-4364-b12a-ad7e35441b52 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.190175 Sep 16 15:34:40.520119 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3623/7781] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:40 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:41.543491 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:41.544177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:41.551151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:41.551659 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:41.552121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:41.552834 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:41.553315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:41.553787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:41.693269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:41.701719 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-11668f87-162c-4d1f-9e33-8ec71759299e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.162187 Sep 16 15:34:41.702306 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4159/7782] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:41 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:42.725709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:42.726264 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:42.733356 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:42.733844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:42.734279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:42.735002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:42.735459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:42.735885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:42.866110 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:42.874592 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-66f8c3be-7c47-43f6-b8b6-f2909b2c52bf tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.152884 Sep 16 15:34:42.875172 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3624/7783] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:42 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:43.899131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:43.899815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:43.907410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:43.907919 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:43.908378 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:43.909096 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:43.909577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:43.910030 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:44.045577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:44.053519 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3473a951-2955-4535-b5fc-df3c0f7d8671 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.158311 Sep 16 15:34:44.054103 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4160/7784] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:43 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:45.077050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:45.077669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:45.086381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:45.086887 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:45.087321 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:45.088535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:45.089070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:45.090298 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:45.247098 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:45.255289 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5e882344-a9eb-40ba-9659-d8f7c2898adb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.182169 Sep 16 15:34:45.255921 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3625/7785] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:45 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:46.279433 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:46.280065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:46.287040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:46.287541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:46.287989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:46.288726 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:46.289189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:46.289628 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:46.425851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:46.434372 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-28463750-adb9-48f6-aeff-5fd49d54b681 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.158903 Sep 16 15:34:46.434997 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4161/7786] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:46 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:47.457510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:47.458119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:47.465016 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:47.465496 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:47.465923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:47.466639 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:47.467090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:47.467512 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:47.598900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:47.607082 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d17ae54e-2ac9-42e4-b49b-c3adfe4989f9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.153733 Sep 16 15:34:47.607664 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3626/7787] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:47 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:48.631546 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:48.632078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:48.639620 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:48.640111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:48.640571 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:48.641282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:48.641760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:48.642208 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:48.769560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:48.777344 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c0629c48-768d-4451-a3a6-ddbea0f8f992 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.149845 Sep 16 15:34:48.777927 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4162/7788] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:48 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:49.800631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:49.801248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:49.808320 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:49.808808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:49.809246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:49.809935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:49.810394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:49.810842 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:49.944217 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:49.952446 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93eff0a0-4519-470d-a0ef-2633ff94e0d4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1702 microversion: 2.1 time: 0.155694 Sep 16 15:34:49.953013 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3627/7789] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:49 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:50.976892 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:50.977514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:50.984369 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:50.984866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:50.985320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:50.986016 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:50.986511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:50.986954 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:51.119265 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:51.127712 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7b0975f9-79b1-4c96-a300-4ff3a965d7bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1702 microversion: 2.1 time: 0.154761 Sep 16 15:34:51.128309 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4163/7790] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:50 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:52.151342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:52.151964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:52.161140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:52.161622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:52.162051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:52.162779 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:52.163235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:52.163660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:52.303547 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:52.312009 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-420c5fa8-a70e-4459-8148-3a186b1d663c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1702 microversion: 2.1 time: 0.164733 Sep 16 15:34:52.312583 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3628/7791] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:52 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1702 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:53.335601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:53.336240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:53.343149 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:53.343660 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:53.344120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:53.344830 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:53.345320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:53.345752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:53.473818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:53.482045 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-57433bd9-b8a9-4ee7-8898-14cbeb998beb tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1702 microversion: 2.1 time: 0.150467 Sep 16 15:34:53.482664 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4164/7792] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:53 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1702 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:53.841254 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-bb149a42-b285-4dab-a50d-a415dc9211b0 req-3e9189b5-4aca-4cd4-aad1-4f03bd19422e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "name": "network-vif-plugged", "status": "completed", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:34:53.850952 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bb149a42-b285-4dab-a50d-a415dc9211b0 req-3e9189b5-4aca-4cd4-aad1-4f03bd19422e service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:53.851436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bb149a42-b285-4dab-a50d-a415dc9211b0 req-3e9189b5-4aca-4cd4-aad1-4f03bd19422e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:53.851864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-bb149a42-b285-4dab-a50d-a415dc9211b0 req-3e9189b5-4aca-4cd4-aad1-4f03bd19422e service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:53.863616 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-bb149a42-b285-4dab-a50d-a415dc9211b0 req-3e9189b5-4aca-4cd4-aad1-4f03bd19422e service nova] Creating event network-vif-plugged:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h1-858129-2 Sep 16 15:34:53.869871 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-bb149a42-b285-4dab-a50d-a415dc9211b0 req-3e9189b5-4aca-4cd4-aad1-4f03bd19422e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093297 Sep 16 15:34:53.870501 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3629/7793] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:34:54.505341 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:54.505976 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:54.513568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:54.514090 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:54.514576 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:54.515321 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:54.515799 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:54.516236 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:54.649370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:54.658146 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7664a6ec-d683-424c-b44d-59317a2b843c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.156668 Sep 16 15:34:54.658770 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4165/7794] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:54 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:55.682305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:55.682961 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:55.692518 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:55.693036 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:55.693679 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:55.694675 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:55.695383 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:55.696043 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:55.870084 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:55.878259 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-80ed2413-3fd8-452c-b835-691e24f1d1a2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.200730 Sep 16 15:34:55.878874 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3630/7795] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:55 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:56.901955 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:56.902786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:56.910710 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:56.911601 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:56.912342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:56.913460 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:56.914240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:56.914968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:57.079911 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:57.089145 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ab007e94-7a59-4340-925d-5a6640e52599 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.191224 Sep 16 15:34:57.089735 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4166/7796] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:56 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:58.114833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:58.115610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:58.123498 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:58.123989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:58.124423 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:58.125123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:58.125575 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:58.125999 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:58.276864 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:58.284648 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-11de3af7-d0f6-4854-a785-08065b95560a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.173640 Sep 16 15:34:58.285437 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3631/7797] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:58 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:34:59.308381 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:34:59.309529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:34:59.321945 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:59.322910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:59.323313 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:59.324044 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:34:59.325936 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:34:59.326078 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:34:59.501219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:34:59.510385 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a94e8e57-44b7-4a47-b7af-959129ce5c7d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.206211 Sep 16 15:34:59.523288 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4167/7798] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:34:59 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:00.537242 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:00.538662 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:00.551937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:00.552791 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:00.553302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:00.554216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:00.554704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:00.555966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:00.715922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:00.724176 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e16e60f3-0c8d-483b-b024-0f94aa83d439 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.193185 Sep 16 15:35:00.724764 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3632/7799] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:00 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:01.747784 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:01.748492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:01.757451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:01.758057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:01.758552 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:01.759287 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:01.759766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:01.760218 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:01.901190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:01.910460 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ca1a2500-55e0-475b-88de-de814d22e027 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.166689 Sep 16 15:35:01.911059 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4168/7800] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:01 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:35:02.933331 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:02.934661 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:02.942073 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:02.942605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:02.943059 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:02.943776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:02.944238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:02.944666 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:03.086776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:03.095732 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-064cba66-9abe-49c7-b3cf-88605b585262 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.166303 Sep 16 15:35:03.096358 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3633/7801] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:02 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:04.119943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:04.120580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:04.128230 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:04.128732 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:04.129187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:04.129897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:04.130376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:04.130850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:04.266038 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:04.273962 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cebbcedb-b2f1-4808-affa-ffca0cfcf02f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1697 microversion: 2.1 time: 0.157917 Sep 16 15:35:04.274589 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4169/7802] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:04 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:05.298535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:05.299158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:05.305705 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:05.306189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:05.306648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:05.307353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:05.307813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:05.308404 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:05.512537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:05.521504 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-54f2ec7e-ee2d-4ff7-bf35-ce5eb1ae6a14 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1679 microversion: 2.1 time: 0.226834 Sep 16 15:35:05.522120 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3634/7803] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:05 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:06.545849 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:06.546439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:06.553255 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:06.553759 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:06.554222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:06.554963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:06.555439 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:06.555884 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:06.688780 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:06.696512 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-fd70c424-b5d5-4f2a-ae13-94fec94efe01 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1679 microversion: 2.1 time: 0.155225 Sep 16 15:35:06.697095 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4170/7804] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:06 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:07.721262 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:07.721944 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:07.728856 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:07.729348 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:07.729821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:07.731219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:07.731680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:07.732111 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:07.863359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:07.871591 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-768bf2c3-37d2-4a2e-ae52-6af318f294aa tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1622 microversion: 2.1 time: 0.154224 Sep 16 15:35:07.872199 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3635/7805] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:07 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1622 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:07.897058 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:35:07.897690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:07.900429 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=29 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:35:07.909024 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:07.909685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:07.910193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:07.910961 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:07.911512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:07.911966 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:07.917121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:35:08.010325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128642) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 15:35:08.080600 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b8627662-fdf1-42b1-b141-9b670c795bc1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action" status: 202 len: 0 microversion: 2.1 time: 0.187497 Sep 16 15:35:08.081481 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4171/7806] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:35:07 2022] POST /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:35:08.090452 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:08.091065 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:08.093014 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=29 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:35:08.097710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:08.098191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:08.098649 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:08.099342 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:08.099789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:08.100206 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:08.103416 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=81 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:35:08.246551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:08.255302 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-91d31c7e-bfa5-48ba-852d-6c5112948bb1 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1630 microversion: 2.1 time: 0.169119 Sep 16 15:35:08.256093 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3636/7807] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:08 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1630 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:09.281752 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:09.282385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:09.288542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:09.289049 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:09.289508 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:09.290228 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:09.290741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:09.291190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:09.427903 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:09.437720 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1841bfc1-c6e2-40b6-a092-8e39446103ec tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1630 microversion: 2.1 time: 0.161305 Sep 16 15:35:09.438313 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4172/7808] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:09 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1630 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:09.799858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-31f1381a-ca46-4433-ab14-ed5538e034b8 req-bebe0672-2a69-4764-83ac-e6fbe163b452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "name": "network-vif-unplugged", "status": "completed", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:35:09.812010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31f1381a-ca46-4433-ab14-ed5538e034b8 req-bebe0672-2a69-4764-83ac-e6fbe163b452 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:09.812500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31f1381a-ca46-4433-ab14-ed5538e034b8 req-bebe0672-2a69-4764-83ac-e6fbe163b452 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:09.812933 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-31f1381a-ca46-4433-ab14-ed5538e034b8 req-bebe0672-2a69-4764-83ac-e6fbe163b452 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:09.825467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.compute.server_external_events [req-31f1381a-ca46-4433-ab14-ed5538e034b8 req-bebe0672-2a69-4764-83ac-e6fbe163b452 service nova] Unable to find a host for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7. Dropping event network-vif-unplugged {{(pid=128643) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 15:35:09.825806 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-31f1381a-ca46-4433-ab14-ed5538e034b8 req-bebe0672-2a69-4764-83ac-e6fbe163b452 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029890 Sep 16 15:35:09.826440 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3637/7809] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 15:35:10.461711 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:10.462355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:10.469787 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:10.470297 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:10.470789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:10.471509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:10.471993 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:10.472442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:10.603250 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:10.612698 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-04b78254-664a-4027-8b1d-9b412eef5b96 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1630 microversion: 2.1 time: 0.154922 Sep 16 15:35:10.613415 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4173/7810] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:10 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:11.637249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:11.637792 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:11.644500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:11.644975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:11.645407 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:11.646092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:11.646572 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:11.647004 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:11.776836 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:11.785242 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f532a2b2-f4c8-442d-873f-2a90cc8597bc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1630 microversion: 2.1 time: 0.152555 Sep 16 15:35:11.785812 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3638/7811] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:11 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1630 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:12.808915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:12.809551 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:12.816547 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:12.817057 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:12.817518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:12.818233 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:12.818743 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:12.819192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:12.955501 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:12.963971 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-af553ca4-a92d-42d8-90bb-2d2393636ea5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1630 microversion: 2.1 time: 0.159570 Sep 16 15:35:12.964574 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4174/7812] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:12 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:13.988131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:13.988682 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:13.996142 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:13.996643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:13.997087 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:13.998097 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:13.998613 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:13.999045 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:14.149277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:14.158036 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f6aa1899-8fd6-4f79-a98c-67e08fdf5bed tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.174309 Sep 16 15:35:14.158861 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3639/7813] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:13 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:14.684319 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-24cc384d-d44a-4886-a99e-8f3892785a93 req-f21949f5-9517-4e15-ad01-c1bcaee746e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:35:14.694850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24cc384d-d44a-4886-a99e-8f3892785a93 req-f21949f5-9517-4e15-ad01-c1bcaee746e2 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:14.695348 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24cc384d-d44a-4886-a99e-8f3892785a93 req-f21949f5-9517-4e15-ad01-c1bcaee746e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:14.695798 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-24cc384d-d44a-4886-a99e-8f3892785a93 req-f21949f5-9517-4e15-ad01-c1bcaee746e2 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:14.711295 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-24cc384d-d44a-4886-a99e-8f3892785a93 req-f21949f5-9517-4e15-ad01-c1bcaee746e2 service nova] Creating event network-changed:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h2-858129-2 Sep 16 15:35:14.716762 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-24cc384d-d44a-4886-a99e-8f3892785a93 req-f21949f5-9517-4e15-ad01-c1bcaee746e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036951 Sep 16 15:35:14.717401 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4175/7814] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:35:15.181198 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:15.181802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:15.188689 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:15.189178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:15.189617 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:15.190314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:15.190802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:15.191227 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:15.340690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:15.348751 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46b336a4-7c52-4dcc-a4f6-e3ed361bab85 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.171438 Sep 16 15:35:15.349333 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3640/7815] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:15 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:16.375175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:16.375896 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:16.382540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:16.383061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:16.383522 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:16.384252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:16.384739 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:16.385417 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:16.542183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:16.551460 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0caeb8fb-405b-412c-9d9c-eb89e0703a99 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.182057 Sep 16 15:35:16.552059 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4176/7816] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:16 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:17.577109 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:17.577701 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:17.585411 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:17.586315 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:17.587050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:17.588076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:17.588800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:17.589477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:17.731629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:17.739508 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-af6d99b8-4883-4b88-a595-cf9aaedd8386 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.166908 Sep 16 15:35:17.740505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3641/7817] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:17 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:18.765232 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:18.765807 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:18.772912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:18.773419 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:18.773882 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:18.774632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:18.775109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:18.775562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:18.942115 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:18.950529 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-61479707-fdc6-4bdb-918a-b7a85997aa58 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.189908 Sep 16 15:35:18.951119 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4177/7818] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:18 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:19.973456 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:19.974075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:19.982797 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:19.983289 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:19.983729 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:19.984422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:19.984882 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:19.985311 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:20.135683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:20.144187 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-43180596-f5c1-4a33-923e-aaa34bb2c9a0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.174726 Sep 16 15:35:20.144769 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3642/7819] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:19 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:21.168768 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:21.169518 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:21.176750 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:21.177259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:21.177721 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:21.178452 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:21.178943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:21.179498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:21.328244 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:21.336984 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b916b452-3994-404c-b22d-a31c05ea5478 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.172862 Sep 16 15:35:21.337564 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4178/7820] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:21 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:22.361585 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:22.362477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:22.369771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:22.370265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:22.371363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:22.372076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:22.372687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:22.373119 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:22.527813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:22.536686 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-065d8400-3ac5-48d7-8b7e-08a4ee769cc0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.178980 Sep 16 15:35:22.546564 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3643/7821] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:22 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:23.564632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:23.565688 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:23.576026 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:23.576963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:23.577543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:23.578450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:23.579006 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:23.579465 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:23.727684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:23.736227 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c5050d41-6cd7-43f6-a0bf-ce5afd33c8b4 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.178796 Sep 16 15:35:23.736823 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4179/7822] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:23 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:24.759902 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:24.760490 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:24.767881 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:24.768362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:24.768790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:24.769474 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:24.769922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:24.770338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:24.901192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:24.908939 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0c3dbf66-0955-4dd6-99eb-fce485d6e61a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.153058 Sep 16 15:35:24.909529 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3644/7823] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:24 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:25.932742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:25.933309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:25.940290 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:25.940797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:25.941259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:25.941970 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:25.942477 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:25.942927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:26.081068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:26.088889 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-450850fd-c4ec-4baa-b504-32641633f843 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.160139 Sep 16 15:35:26.090126 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4180/7824] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:25 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:27.112683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:27.113243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:27.120015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:27.120546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:27.120978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:27.121663 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:27.122115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:27.122570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:27.252691 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:27.260394 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9c6c651-4ad1-4e5d-8c35-dfb80945fb6d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.151676 Sep 16 15:35:27.260990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3645/7825] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:27 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:28.285107 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:28.286275 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:28.294181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:28.294846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:28.295169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:28.295904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:28.296383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:28.296835 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:28.446217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:28.454446 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-ef81ba4f-3e28-47ea-91fa-2b15db2f1111 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.174671 Sep 16 15:35:28.455069 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4181/7826] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:28 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:29.478973 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:29.479606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:29.486338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:29.486847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:29.487280 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:29.487964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:29.488409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:29.488829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:29.618042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:29.626590 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-e3a27c9f-14c8-41f6-8a18-f01273a27dde tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.151540 Sep 16 15:35:29.627186 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3646/7827] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:29 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:30.649785 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:30.650367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:30.657285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:30.657795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:30.658251 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:30.658990 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:30.659468 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:30.659915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:30.794568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:30.802299 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a4c2a150-49bb-4c8f-9046-4a53f3208236 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.156532 Sep 16 15:35:30.802914 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4182/7828] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:30 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:31.826183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:31.826794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:31.833931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:31.834429 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:31.834858 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:31.835552 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:31.836008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:31.836436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:31.968604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:31.976320 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2f01002f-5180-4a1e-aeba-9694570952f2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.154670 Sep 16 15:35:31.976898 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3647/7829] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:31 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:32.999484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:33.000109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:33.007141 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:33.007642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:33.008102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:33.008805 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:33.009282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:33.009722 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:33.136346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:33.144139 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1820f478-0959-4f5b-9bdd-9d077e15aca8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.148638 Sep 16 15:35:33.144717 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4183/7830] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:32 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:33.598476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-35bd3941-94b3-4ac1-ab73-875c011f6a79 req-84bf6357-4584-4e83-a66c-6a7d0ef6a77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "name": "network-vif-plugged", "status": "completed", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:35:33.609826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-35bd3941-94b3-4ac1-ab73-875c011f6a79 req-84bf6357-4584-4e83-a66c-6a7d0ef6a77d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:33.610314 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-35bd3941-94b3-4ac1-ab73-875c011f6a79 req-84bf6357-4584-4e83-a66c-6a7d0ef6a77d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:33.610815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-35bd3941-94b3-4ac1-ab73-875c011f6a79 req-84bf6357-4584-4e83-a66c-6a7d0ef6a77d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:33.622292 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-35bd3941-94b3-4ac1-ab73-875c011f6a79 req-84bf6357-4584-4e83-a66c-6a7d0ef6a77d service nova] Creating event network-vif-plugged:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h2-858129-2 Sep 16 15:35:33.627577 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-35bd3941-94b3-4ac1-ab73-875c011f6a79 req-84bf6357-4584-4e83-a66c-6a7d0ef6a77d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032835 Sep 16 15:35:33.628521 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3648/7831] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:35:34.168502 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:34.169065 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:34.175986 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:34.176494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:34.176950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:34.177665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:34.178146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:34.178631 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:34.317861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:34.325627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-30348cf2-fb86-4ff3-b3a7-c89923b96ac2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.161667 Sep 16 15:35:34.326210 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4184/7832] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:34 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:35:35.350844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:35.351555 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:35.358184 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:35.358704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:35.359143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:35.359852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:35.360309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:35.360743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:35.495839 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:35.507299 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46193017-076c-4b8a-bb10-1f626aa01a97 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1688 microversion: 2.1 time: 0.161427 Sep 16 15:35:35.507973 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3649/7833] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:35 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:35:36.532272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:35:36.532940 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:35:36.539852 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:36.540393 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:36.540850 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:36.541562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:35:36.542105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:35:36.542794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:35:36.674851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:35:36.683053 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-aeb58eb1-472b-4d85-a5b1-7013ff13c1f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1675 microversion: 2.1 time: 0.154272 Sep 16 15:35:36.683618 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4185/7834] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:35:36 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:22.564310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=27 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:22.565352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=75 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:22.570279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:22.570897 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:22.571960 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:22.573252 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:22.579718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:22.580449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:22.581378 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:22.583273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:22.583273 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:22.583596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:22.613055 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:37:22.664772 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4ed364de-34f8-4391-bce9-f6a9fe003a45 req-1e49c7f4-b357-4e87-bc4d-097a50525a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:37:22.676032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4ed364de-34f8-4391-bce9-f6a9fe003a45 req-1e49c7f4-b357-4e87-bc4d-097a50525a80 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:22.676890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4ed364de-34f8-4391-bce9-f6a9fe003a45 req-1e49c7f4-b357-4e87-bc4d-097a50525a80 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:22.677458 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4ed364de-34f8-4391-bce9-f6a9fe003a45 req-1e49c7f4-b357-4e87-bc4d-097a50525a80 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:22.697560 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4ed364de-34f8-4391-bce9-f6a9fe003a45 req-1e49c7f4-b357-4e87-bc4d-097a50525a80 service nova] Creating event network-changed:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h2-858129-2 Sep 16 15:37:22.699244 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f5a964e3-988f-4f58-881d-dc90c4680e25 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "DELETE /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 204 len: 0 microversion: 2.1 time: 0.136628 Sep 16 15:37:22.700828 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3650/7835] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:37:22 2022] DELETE /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:37:22.706311 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4ed364de-34f8-4391-bce9-f6a9fe003a45 req-1e49c7f4-b357-4e87-bc4d-097a50525a80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141438 Sep 16 15:37:22.707409 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4186/7836] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:37:22.711124 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:22.711841 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:22.717808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:22.718291 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:22.718761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:22.719457 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:22.719941 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:22.720362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:22.944943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:22.952889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-9d4a6cb8-b346-429a-9cd3-d97077a39fe7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.247186 Sep 16 15:37:22.953477 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3651/7837] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:22 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:23.979133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:23.979978 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:23.987530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:23.988042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:23.988500 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:23.989217 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:23.989694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:23.990169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:24.125206 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:24.133221 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f4797754-ae26-4068-9d76-1d74e00e2ba5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1681 microversion: 2.1 time: 0.158465 Sep 16 15:37:24.133805 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4187/7838] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:23 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:24.914803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-28ed8f19-e936-44e0-bd1b-da519030120a req-214404f3-aeb0-41e6-8a2d-6b47cb736af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69beb4f1-b019-4ff1-9377-28c21b4536d7", "name": "network-vif-deleted", "tag": "cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:37:24.925486 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28ed8f19-e936-44e0-bd1b-da519030120a req-214404f3-aeb0-41e6-8a2d-6b47cb736af5 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:24.925956 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28ed8f19-e936-44e0-bd1b-da519030120a req-214404f3-aeb0-41e6-8a2d-6b47cb736af5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:24.926385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-28ed8f19-e936-44e0-bd1b-da519030120a req-214404f3-aeb0-41e6-8a2d-6b47cb736af5 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:24.940142 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-28ed8f19-e936-44e0-bd1b-da519030120a req-214404f3-aeb0-41e6-8a2d-6b47cb736af5 service nova] Creating event network-vif-deleted:cfa21e32-c8c6-4dc4-8ead-e7f285d72f4f for instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 on n-h2-858129-2 Sep 16 15:37:24.944856 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-28ed8f19-e936-44e0-bd1b-da519030120a req-214404f3-aeb0-41e6-8a2d-6b47cb736af5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091667 Sep 16 15:37:24.945453 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3652/7839] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:37:25.158494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:25.160179 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:25.170365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:25.170910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:25.171699 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:25.173513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:25.174082 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:25.174568 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:25.216399 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:25.216913 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:25.217367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:25.217838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.objects.instance [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lazy-loading 'fault' on Instance uuid 69beb4f1-b019-4ff1-9377-28c21b4536d7 {{(pid=128642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:37:25.259335 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:25.269274 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-53c39725-d7df-4a68-8d26-18924f7ae867 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 200 len: 1337 microversion: 2.1 time: 0.114876 Sep 16 15:37:25.270156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4188/7840] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:25 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 1337 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:26.295187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:26.295921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: 69beb4f1-b019-4ff1-9377-28c21b4536d7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:26.302143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:26.302658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:26.303092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:26.303784 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:26.304238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:26.304660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:26.318463 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] HTTP exception thrown: Instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 could not be found. Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Request method failure captured: Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 HTTP/1.1 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJbXc8Op3-FBm4ka7AvLEbisU6qkyrMu-4maJsYKa-RibfiSfJyuwNxgkW08Gceon013SWs8xZZVvsUWOmAWKSCCpLF3oTR50N-vufKSZHe9v06QX4nklIggJgmznn6FeX61-RFWOSj90v8-fTWa45LH1H_an-73PiZcsEgyLggdWW0 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: 6bd438fc2a1043b28331b46361dbfdf0 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestShelveInstance-1363328790 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bd438fc2a1043b28331b46361dbfdf0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bd438fc2a1043b28331b46361dbfdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bd438fc2a1043b28331b46361dbfdf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bd438fc2a1043b28331b46361dbfdf0"}]}] Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestShelveInstance-1363328790 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: 6bd438fc2a1043b28331b46361dbfdf0 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestShelveInstance-1363328790 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestShelveInstance-1363328790-project Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: 4f981c151fd6428a9326238c0bcc2083 Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestShelveInstance-1363328790-project Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 could not be found. Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': '69beb4f1-b019-4ff1-9377-28c21b4536d7'} Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 could not be found. Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 could not be found. Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:37:26.320112 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 could not be found. Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Returning 404 to user: Instance 69beb4f1-b019-4ff1-9377-28c21b4536d7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-355c6372-b2a0-4da6-acb1-dcd9f8b385cd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7" status: 404 len: 111 microversion: 2.1 time: 0.031465 Sep 16 15:37:26.325989 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3653/7841] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:26 2022] GET /compute/v2.1/servers/69beb4f1-b019-4ff1-9377-28c21b4536d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:37:26.484403 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-338cadbd-461c-4bbf-9280-51b68a73c45d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '.version_select at 0x7f724d2d0160>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:26.510775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-338cadbd-461c-4bbf-9280-51b68a73c45d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1500856732" status: 202 len: 0 microversion: 2.1 time: 0.030413 Sep 16 15:37:26.511560 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4189/7842] 10.222.0.60 () {58 vars in 1254 bytes} [Fri Sep 16 15:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1500856732 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:37:26.531123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6dfe0f4-a552-4ff0-be19-ce99cc1a1b9d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'create', calling method: .version_select at 0x7f72517dc940>, body: {"keypair": {"name": "tempest-TestShelveInstance-3590745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADkdvpdBpA2CShIC6N15BKm39UR6nhfHCnbdO4cZzreyaOM08SE4VHSYIWa6I+HGlLptbIXfKttPN9yn8SDuqjwRU4Br8to1d/tmTZ22A6K6+psPm+YhnlgVH/LlYsmwg=="}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:37:26.547492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b6dfe0f4-a552-4ff0-be19-ce99cc1a1b9d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:37:26.552621 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-b6dfe0f4-a552-4ff0-be19-ce99cc1a1b9d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for user 4f981c151fd6428a9326238c0bcc2083 and project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'key_pairs'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:37:26.584124 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6dfe0f4-a552-4ff0-be19-ce99cc1a1b9d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.056868 Sep 16 15:37:26.584717 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3654/7843] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:37:26 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:37:42.864128 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=16 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:42.864967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:42.869056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-448551974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-3590745", "security_groups": [{"name": "tempest-secgroup-smoke-523534509"}], "networks": [{"uuid": "bf6e0067-9e31-4968-9767-09cf81ad8df3"}], "block_device_mapping_v2": [{"uuid": "4ca9d1c2-5146-4185-bf9c-183e6fdcfd88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:37:42.984183 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.network.neutron [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] validate_networks() for [('bf6e0067-9e31-4968-9767-09cf81ad8df3', None, None, None, None, None)] {{(pid=128642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:37:43.354829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Flavor limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:37:43.355278 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Image limits 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:37:43.355827 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Flavor pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:37:43.356257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Image pref 0:0:0 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:37:43.356692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.virt.hardware [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:37:43.365514 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:43.366005 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:43.366484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:43.367231 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:43.367698 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:43.368144 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:43.386540 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:37:43.392400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Getting quotas for user 4f981c151fd6428a9326238c0bcc2083 and project 6bd438fc2a1043b28331b46361dbfdf0. Resources: {'instances', 'ram', 'cores'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:37:43.449063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Going to run 1 instances... {{(pid=128642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:37:43.451872 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ca9d1c2-5146-4185-bf9c-183e6fdcfd88',volume_size=None,volume_type=None)] {{(pid=128642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:37:43.578428 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [f72a35bf-7819-446a-8f38-347e0b130acd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:37:44.586362 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [f72a35bf-7819-446a-8f38-347e0b130acd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48006. Sep 16 15:37:44.590231 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d403da9d-61eb-4cdc-be49-1f1d6ad7ba54 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.728048 Sep 16 15:37:44.590930 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4190/7844] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:37:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:37:44.600022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:44.600776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=4 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:44.601733 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:44.605985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-44565cf3-b44b-42ce-99e4-e2e22f69eee5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:44.606622 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-44565cf3-b44b-42ce-99e4-e2e22f69eee5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:44.672166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-44565cf3-b44b-42ce-99e4-e2e22f69eee5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:44.679037 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-44565cf3-b44b-42ce-99e4-e2e22f69eee5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1085 microversion: 2.1 time: 0.080913 Sep 16 15:37:44.679599 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3655/7845] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:44 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1085 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:45.704221 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:45.704778 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:45.711510 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:45.712040 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:45.712476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:45.713216 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:45.713692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:45.714135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:45.777632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:45.785410 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-c9f40c4f-ca18-4167-ae34-4526ea38b6fd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1183 microversion: 2.1 time: 0.086600 Sep 16 15:37:45.785998 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4191/7846] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:45 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:46.808277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:46.808940 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:46.815645 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:46.816374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:46.816978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:46.817676 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:46.818309 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:46.818761 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:47.046658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:47.063936 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d975df10-08b6-4ac5-907c-5bb11cd53fb0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1268 microversion: 2.1 time: 0.259370 Sep 16 15:37:47.065293 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3656/7847] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:46 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:47.756809 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-5cd00706-6363-4a99-bd75-9af5698dfea0 req-0533c45e-d678-4029-9cb6-a060546abf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:37:47.774742 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5cd00706-6363-4a99-bd75-9af5698dfea0 req-0533c45e-d678-4029-9cb6-a060546abf2d service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:47.775426 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5cd00706-6363-4a99-bd75-9af5698dfea0 req-0533c45e-d678-4029-9cb6-a060546abf2d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:47.775946 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-5cd00706-6363-4a99-bd75-9af5698dfea0 req-0533c45e-d678-4029-9cb6-a060546abf2d service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:47.788093 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-5cd00706-6363-4a99-bd75-9af5698dfea0 req-0533c45e-d678-4029-9cb6-a060546abf2d service nova] Creating event network-changed:f31cb8c0-24bc-4366-819d-79fcbb7e2ddd for instance b5dddea5-ec11-49fc-afdf-404c580a85b1 on n-h1-858129-2 Sep 16 15:37:47.793239 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-5cd00706-6363-4a99-bd75-9af5698dfea0 req-0533c45e-d678-4029-9cb6-a060546abf2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040160 Sep 16 15:37:47.793969 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4192/7848] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:37:48.090748 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:48.091344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:48.098427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:48.098912 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:48.099343 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:48.100046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:48.100500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:48.100923 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:48.292070 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:48.302707 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d67a5f72-eaa0-4345-9111-2d90fe626a16 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1268 microversion: 2.1 time: 0.215656 Sep 16 15:37:48.304053 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3657/7849] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:48 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:49.328854 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:49.329582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:49.336240 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:49.336747 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:49.337203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:49.337927 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:49.338420 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:49.338881 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:49.484010 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:49.491821 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16b3411e-1d46-4b02-8c2a-9203e9d23074 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1268 microversion: 2.1 time: 0.168195 Sep 16 15:37:49.492409 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4193/7850] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:49 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:50.515432 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:50.516074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:50.523044 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:50.523531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:50.523964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:50.524660 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:50.525113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:50.525539 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:50.665693 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:50.673922 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-10e8b11c-6b1b-434f-af95-3c9f516ca0ae tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1268 microversion: 2.1 time: 0.162833 Sep 16 15:37:50.674540 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3658/7851] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:50 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:51.696765 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:51.697408 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:51.705111 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:51.705621 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:51.706346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:51.707117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:51.707595 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:51.708042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:51.840494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:51.848871 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-45a062f7-81bd-498e-a877-620b946b5d3d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.156060 Sep 16 15:37:51.849458 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4194/7852] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:51 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:52.872845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:52.874046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:52.881046 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:52.881535 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:52.881974 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:52.882717 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:52.883174 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:52.883599 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:53.012947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:53.020843 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3625deb7-e49b-4fc7-9309-ea3712d81ef2 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.151914 Sep 16 15:37:53.021424 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3659/7853] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:52 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:54.043648 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:54.044272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:54.047189 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:54.047873 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:54.053874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:54.054370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:54.054841 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:54.055541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:54.056008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:54.056453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:54.192200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:54.199937 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-3a8fef98-733c-490b-bcc9-571e8d9fba39 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.160213 Sep 16 15:37:54.200553 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4195/7854] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:54 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:55.223680 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:55.224295 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:55.227074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:37:55.233179 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:55.233704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:55.234143 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:55.234870 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:55.235329 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:55.235786 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:55.368562 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:55.376392 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5402dcec-e6a8-475f-b039-7f5b1082abc7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.156700 Sep 16 15:37:55.376990 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3660/7855] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:55 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:56.398498 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:56.399182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:56.406555 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:56.407056 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:56.407509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:56.408222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:56.408694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:56.409136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:56.546825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:56.554668 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2d79f51b-cfdd-4533-b61c-be0d66f7e72c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.160083 Sep 16 15:37:56.555248 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4196/7856] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:56 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:57.577192 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:57.577747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:57.584998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:57.585477 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:57.585906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:57.586648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:57.587100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:57.587522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:57.716995 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:57.725199 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-490e0d80-d2a9-45da-aa3d-678195b9888e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.152015 Sep 16 15:37:57.725774 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3661/7857] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:57 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:58.748712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:58.749286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:58.756860 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:58.757366 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:58.757822 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:58.758578 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:58.759051 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:58.759494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:58.888883 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:37:58.897241 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-164ab983-700a-414b-a41e-e38c10342f66 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.152594 Sep 16 15:37:58.897821 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4197/7858] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:58 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:37:59.920993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:37:59.921603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:37:59.928455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:59.928937 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:59.929371 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:37:59.930057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:37:59.930537 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:37:59.930967 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:00.064730 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:38:00.072479 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8842f5fc-a8b7-478d-bf29-73d6ca7b86ce tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.155832 Sep 16 15:38:00.072992 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3662/7859] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:37:59 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:38:01.096434 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:38:01.097025 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:38:01.104261 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:01.104767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:01.105253 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:01.105941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:01.106440 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:01.106891 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:01.237367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:38:01.245047 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cdfb4c0b-e8eb-43a4-b225-c085655e5ad8 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.153581 Sep 16 15:38:01.245618 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4198/7860] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:38:01 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:38:02.268335 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:38:02.268896 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:38:02.276428 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:02.276909 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:02.277338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:02.278026 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:02.278499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:02.278921 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:02.414674 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:38:02.422460 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2aeb9aab-db19-4a9c-9637-2266da0d095b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.158119 Sep 16 15:38:02.423039 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3663/7861] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:38:02 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:38:02.725767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-18499c9f-0a75-4b14-9a50-487a2df6d589 req-d4acac0b-5728-49a0-8055-c4c32a4e8add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "name": "network-vif-plugged", "status": "completed", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:38:02.736795 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18499c9f-0a75-4b14-9a50-487a2df6d589 req-d4acac0b-5728-49a0-8055-c4c32a4e8add service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:02.737312 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18499c9f-0a75-4b14-9a50-487a2df6d589 req-d4acac0b-5728-49a0-8055-c4c32a4e8add service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:02.737781 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-18499c9f-0a75-4b14-9a50-487a2df6d589 req-d4acac0b-5728-49a0-8055-c4c32a4e8add service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:02.749635 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-18499c9f-0a75-4b14-9a50-487a2df6d589 req-d4acac0b-5728-49a0-8055-c4c32a4e8add service nova] Creating event network-vif-plugged:f31cb8c0-24bc-4366-819d-79fcbb7e2ddd for instance b5dddea5-ec11-49fc-afdf-404c580a85b1 on n-h1-858129-2 Sep 16 15:38:02.754687 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-18499c9f-0a75-4b14-9a50-487a2df6d589 req-d4acac0b-5728-49a0-8055-c4c32a4e8add service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Sep 16 15:38:02.755295 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4199/7862] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:38:03.444500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:38:03.445101 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:38:03.451962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:03.452440 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:03.452866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:03.453546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:03.453993 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:03.454425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:03.584451 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:38:03.592127 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-71fa8264-ed42-45e2-808d-0259398acdb9 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1256 microversion: 2.1 time: 0.151582 Sep 16 15:38:03.592733 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3664/7863] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:38:03 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1256 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:38:04.616634 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:38:04.617266 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:38:04.623619 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:04.624125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:04.624582 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:04.625284 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:04.625760 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:04.626203 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:04.765222 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:38:04.774004 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-dc088014-2ea5-43f9-b040-a6b7d6b8677a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1440 microversion: 2.1 time: 0.162721 Sep 16 15:38:04.774631 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4200/7864] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:38:04 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:38:04.795970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:38:04.796603 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:38:04.803684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:04.804171 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:04.804606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:04.805338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:04.805790 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:04.806213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:04.933998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:38:04.942367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cd0808d4-6a67-449e-be7c-9011ac10168e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1440 microversion: 2.1 time: 0.150292 Sep 16 15:38:04.942964 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3665/7865] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:38:04 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1440 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:38:06.545529 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-aa5e0549-252b-41de-a196-51b56ac24555 req-f11b1b6a-d624-41d5-9389-f31839aa8645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:38:06.555832 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-aa5e0549-252b-41de-a196-51b56ac24555 req-f11b1b6a-d624-41d5-9389-f31839aa8645 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:38:06.556340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-aa5e0549-252b-41de-a196-51b56ac24555 req-f11b1b6a-d624-41d5-9389-f31839aa8645 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:38:06.556790 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-aa5e0549-252b-41de-a196-51b56ac24555 req-f11b1b6a-d624-41d5-9389-f31839aa8645 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:38:06.568462 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-aa5e0549-252b-41de-a196-51b56ac24555 req-f11b1b6a-d624-41d5-9389-f31839aa8645 service nova] Creating event network-changed:f31cb8c0-24bc-4366-819d-79fcbb7e2ddd for instance b5dddea5-ec11-49fc-afdf-404c580a85b1 on n-h1-858129-2 Sep 16 15:38:06.573688 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-aa5e0549-252b-41de-a196-51b56ac24555 req-f11b1b6a-d624-41d5-9389-f31839aa8645 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031879 Sep 16 15:38:06.574362 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4201/7866] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:40:02.867876 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:40:02.868793 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:40:02.869361 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=24 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:02.870114 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=60 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:02.871250 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:40:02.871406 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action (ip 10.222.0.60) !!! Sep 16 15:40:02.873581 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:40:02.873708 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action (ip 10.222.0.60) !!! Sep 16 15:40:02.875431 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:40:02.875573 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action (ip 10.222.0.60) !!! Sep 16 15:40:02.884260 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:40:02.884801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:02.897249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:02.897744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:02.898183 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:02.898922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:02.899381 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:02.899813 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:02.930922 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lazy-loading 'flavor' on Instance uuid b5dddea5-ec11-49fc-afdf-404c580a85b1 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:40:03.008486 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-de47d398-2377-4845-bda5-6e75d27dc00d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action" status: 202 len: 0 microversion: 2.1 time: 0.142432 Sep 16 15:40:03.009114 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3666/7867] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:40:02 2022] POST /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:40:03.015672 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:40:03.016504 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:40:03.017114 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:03.018043 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=56 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:03.018856 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:40:03.018991 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 (ip 10.222.0.60) !!! Sep 16 15:40:03.026061 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:03.026814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:03.041668 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:03.042176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:03.042658 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:03.043615 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:03.044094 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:03.044537 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:03.255627 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:03.263456 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-50ee21f2-7443-4a2d-b299-3159b2e2a044 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.249738 Sep 16 15:40:03.264044 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4202/7868] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:03 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:04.288600 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:04.289450 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:04.302443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:04.303164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:04.303604 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:04.304325 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:04.305010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:04.305485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:04.313661 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48112. Sep 16 15:40:04.324623 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48110. Sep 16 15:40:04.449711 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:04.458475 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8ab96e80-57b5-4339-9044-d8f379f917ab tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.175462 Sep 16 15:40:04.459058 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3667/7869] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:04 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:05.482655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:05.483229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:05.493410 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:05.493908 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:05.494357 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:05.495089 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:05.495558 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:05.496004 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:05.500627 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48118. Sep 16 15:40:05.503679 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48116. Sep 16 15:40:05.630326 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:05.638190 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-b4a1b577-e2ce-4229-9477-54e04a75a1d6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.159597 Sep 16 15:40:05.638807 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4203/7870] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:05 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:06.661781 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:06.662326 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:06.669327 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:06.669810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:06.670244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:06.670968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:06.671425 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:06.671852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:06.800191 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:06.807977 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0757c628-864a-4383-a93c-929036b5a2c7 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.150773 Sep 16 15:40:06.808637 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3668/7871] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:06 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:07.831333 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:07.831987 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:07.838890 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:07.839395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:07.839848 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:07.840556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:07.841032 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:07.841476 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:07.975894 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:07.983914 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-16ba02ce-9f2a-417a-86fe-26afcea4c433 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.156796 Sep 16 15:40:07.984504 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4204/7872] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:07 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:09.010596 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:09.011213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:09.018037 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:09.018549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:09.018985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:09.019673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:09.020128 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:09.020550 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:09.150968 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:09.159377 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-f9773c06-0212-4eaa-9c16-cc2f07ba0640 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.152716 Sep 16 15:40:09.159958 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3669/7873] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:09 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:10.183340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:10.183915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:10.191486 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:10.192054 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:10.192511 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:10.193225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:10.193705 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:10.194153 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:10.329641 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:10.337874 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7d1f9b61-4f84-444f-bbc2-aa389d9e7e2c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.158612 Sep 16 15:40:10.338486 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4205/7874] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:10 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:11.361017 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:11.361630 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:11.368546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:11.369058 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:11.369491 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:11.370178 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:11.370657 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:11.371079 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:11.499553 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:11.507908 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6f6b93ab-83d4-464d-af5d-ac4b440cd447 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.150882 Sep 16 15:40:11.508485 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3670/7875] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:11 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:12.532443 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:12.533088 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:12.540131 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:12.540640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:12.541099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:12.541815 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:12.542294 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:12.542769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:12.673667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:12.682069 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7ff59ba9-0a0a-40c3-9a10-035202106dcd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.153610 Sep 16 15:40:12.682706 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4206/7876] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:12 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:13.705047 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:13.705653 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:13.713463 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:13.713946 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:13.714374 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:13.715090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:13.715538 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:13.715959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:13.864359 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:13.872120 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0e9c5ad7-82db-4448-8bf8-99ba1b4c0704 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.170923 Sep 16 15:40:13.872709 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3671/7877] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:13 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:14.895269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:14.895910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:14.902859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:14.903351 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:14.903797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:14.904492 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:14.904964 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:14.905401 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:15.034152 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:15.042812 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-26fcf26c-486f-40dc-8789-5adce29284dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.151372 Sep 16 15:40:15.043406 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4207/7878] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:14 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:16.069726 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:16.070338 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:16.077288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:16.077774 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:16.078211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:16.078942 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:16.079398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:16.079823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:16.221002 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:16.229502 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cfba76b0-2e6c-48b8-ba8c-75e3446d053f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.164157 Sep 16 15:40:16.230110 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3672/7879] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:16 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:17.253310 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:17.253943 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:17.261302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:17.261642 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:17.262099 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:17.263014 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:17.263359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:17.263867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:17.398445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:17.406273 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-903a5204-9da7-40c5-87a2-04c52ba8fe29 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1566 microversion: 2.1 time: 0.156951 Sep 16 15:40:17.406893 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4208/7880] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:17 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:17.429471 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:40:17.430069 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:17.436808 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:17.437288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:17.437718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:17.438422 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:17.438866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:17.439284 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:17.528076 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 15:40:17.597793 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c77ee99a-f99b-4c06-967c-02425bdf8983 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "POST /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action" status: 202 len: 0 microversion: 2.1 time: 0.172709 Sep 16 15:40:17.598331 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3673/7881] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:40:17 2022] POST /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:40:17.607400 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:17.608036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:17.622530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:17.623105 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:17.623624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:17.624424 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:17.624968 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:17.625478 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:17.773685 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:17.781579 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58b9fb1a-7928-4cd7-8cd6-b991f6d56806 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1514 microversion: 2.1 time: 0.178186 Sep 16 15:40:17.782168 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4209/7882] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:17 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:18.806710 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:18.807365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:18.813500 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:18.813998 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:18.814436 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:18.815185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:18.815584 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:18.816009 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:18.948712 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:18.957391 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-8fba75e6-af90-44e5-aa90-a4ae800a9774 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1514 microversion: 2.1 time: 0.155957 Sep 16 15:40:18.958224 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3674/7883] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:18 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:19.323181 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-9dd781d0-8fa8-4299-841a-29e490811186 req-08f77b0a-f8e5-4e1e-aa18-595cc5eeba10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "name": "network-vif-unplugged", "status": "completed", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:40:19.333740 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9dd781d0-8fa8-4299-841a-29e490811186 req-08f77b0a-f8e5-4e1e-aa18-595cc5eeba10 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:19.334340 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9dd781d0-8fa8-4299-841a-29e490811186 req-08f77b0a-f8e5-4e1e-aa18-595cc5eeba10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:19.334901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-9dd781d0-8fa8-4299-841a-29e490811186 req-08f77b0a-f8e5-4e1e-aa18-595cc5eeba10 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:19.347570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.compute.server_external_events [req-9dd781d0-8fa8-4299-841a-29e490811186 req-08f77b0a-f8e5-4e1e-aa18-595cc5eeba10 service nova] Unable to find a host for instance b5dddea5-ec11-49fc-afdf-404c580a85b1. Dropping event network-vif-unplugged {{(pid=128642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 15:40:19.349255 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-9dd781d0-8fa8-4299-841a-29e490811186 req-08f77b0a-f8e5-4e1e-aa18-595cc5eeba10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080353 Sep 16 15:40:19.349949 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4210/7884] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 15:40:19.981631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:19.982258 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:19.989169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:19.989658 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:19.990096 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:19.990815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:19.991279 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:19.991706 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:20.133683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:20.141545 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ed168ba9-9678-485c-b3a6-86fcbb06ad5b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1514 microversion: 2.1 time: 0.163903 Sep 16 15:40:20.142119 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3675/7885] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:19 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:21.165133 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:21.165763 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:21.172767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:21.173273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:21.173727 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:21.174461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:21.174941 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:21.175387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:21.314542 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:21.322535 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-975719d1-4848-4843-a860-83c3113255c5 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1514 microversion: 2.1 time: 0.161228 Sep 16 15:40:21.323116 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4211/7886] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:21 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:22.346594 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:22.347248 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:22.353782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:22.354277 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:22.354768 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:22.355476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:22.355936 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:22.356364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:22.499039 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:22.506967 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-004057a4-47d1-466b-a2ad-cc15f534f55b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1514 microversion: 2.1 time: 0.164371 Sep 16 15:40:22.507736 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3676/7887] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:22 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:40:23.530870 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:23.531494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:23.538983 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:23.539515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:23.539972 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:23.540679 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:23.541150 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:23.541589 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:23.675586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:23.683554 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-27512ecd-2e19-41b1-90fe-338501111b08 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1516 microversion: 2.1 time: 0.156747 Sep 16 15:40:23.684146 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4212/7888] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:23 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:24.707056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:24.707715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:24.714872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:24.715364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:24.715805 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:24.716517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:24.716977 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:24.717406 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:24.848287 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:24.856130 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c717f871-b76c-48ac-a594-e41d9c0a134a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1516 microversion: 2.1 time: 0.153355 Sep 16 15:40:24.856708 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3677/7889] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:24 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:25.878650 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:25.879291 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:25.886661 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:25.887176 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:25.887636 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:25.888359 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:25.888838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:25.889293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:26.027704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:26.035759 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e4790420-8ba7-429e-b780-e1474ecaaf7a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1516 microversion: 2.1 time: 0.161129 Sep 16 15:40:26.036351 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4213/7890] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:25 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:27.058292 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:27.058986 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:27.066040 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:27.066571 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:27.067011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:27.068205 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:27.069304 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:27.069743 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:27.215735 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:27.224744 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b09a108d-38e7-4003-ba44-778bf8f3de4f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1516 microversion: 2.1 time: 0.170333 Sep 16 15:40:27.225327 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3678/7891] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:27 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:28.248647 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:28.249187 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:28.256175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:28.256676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:28.257135 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:28.257846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:28.258324 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:28.258797 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:28.396450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:28.404361 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d01c3e30-e26d-472c-8087-2f899cac59c0 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.159818 Sep 16 15:40:28.404979 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4214/7892] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:28 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:29.429519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:29.430245 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:29.437086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:29.437579 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:29.438015 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:29.438751 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:29.439209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:29.439669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:29.459117 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:29.571687 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:29.579367 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-93e45933-b45f-4ab0-a116-1f1e0e099771 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.154095 Sep 16 15:40:29.579943 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3679/7893] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:29 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:30.603764 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:30.604345 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:30.611469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:30.611997 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:30.612445 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:30.613146 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:30.613616 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:30.614059 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:30.749259 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:30.757707 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5bfd1379-65b3-4f9a-a357-c54b8fcbf95b tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.158563 Sep 16 15:40:30.758299 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4215/7894] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:30 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:31.781108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:31.781731 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:31.789316 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:31.789800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:31.790235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:31.790960 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:31.791419 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:31.791846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:31.919770 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:31.927711 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-64890c65-6878-48d5-9894-4653d71a8fea tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.150538 Sep 16 15:40:31.928312 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3680/7895] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:31 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:32.951154 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:32.951817 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:32.959019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:32.959523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:32.959979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:32.960686 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:32.961156 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:32.961600 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:33.095045 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:33.097411 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=85 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:33.104989 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-be302595-375d-4184-b21b-1635a77a3208 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.157816 Sep 16 15:40:33.105594 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4216/7896] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:32 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:34.132427 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:34.133042 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:34.135782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:34.141056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:34.141543 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:34.141979 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:34.142703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:34.143164 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:34.143590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:34.280975 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:34.288929 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-ecb4084a-b84b-4d1f-a7dc-804e66d4de1d tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.161009 Sep 16 15:40:34.289516 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3681/7897] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:34 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:40:35.312192 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:35.312819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:35.315530 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=31 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:40:35.321566 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:35.322072 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:35.322556 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:35.323273 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:35.323755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:35.324205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:35.452000 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:35.460840 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-24f8fda9-9eec-4d9f-81d3-de332102b9f6 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.152660 Sep 16 15:40:35.461428 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4217/7898] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:35 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:36.484301 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:36.484840 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:36.491296 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:36.492782 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:36.493222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:36.493931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:36.494369 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:36.494826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:36.625991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:36.634422 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-4caa33ea-32ac-4820-b0b2-4c1a49febe68 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.154116 Sep 16 15:40:36.635012 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3682/7899] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:36 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:37.658494 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:37.659048 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:37.665741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:37.666245 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:37.666741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:37.667451 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:37.667924 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:37.668376 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:37.802789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:37.810817 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-91619b5b-64d4-445b-9b49-449d4f4cc51c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.156589 Sep 16 15:40:37.811490 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4218/7900] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:37 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:38.834874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:38.835453 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:38.842209 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:38.842714 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:38.843137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:38.843815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:38.844288 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:38.844704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:38.975232 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:38.982928 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-a427979f-c230-4137-9e35-d952f7f1bf5c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.152986 Sep 16 15:40:38.983501 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3683/7901] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:38 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:39.400948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "name": "network-vif-plugged", "status": "completed", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:40:39.412874 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:39.413550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:39.414068 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:39.426549 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] Creating event network-vif-plugged:f31cb8c0-24bc-4366-819d-79fcbb7e2ddd for instance b5dddea5-ec11-49fc-afdf-404c580a85b1 on n-h1-858129-2 Sep 16 15:40:39.435804 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] [cc536db1-c083-4e4a-9a7e-20d00bb45fa5] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:40:40.006573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:40.007216 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:40.014115 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:40.014635 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:40.015074 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:40.015759 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:40.016211 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:40.016631 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:40.148173 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:40.155935 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-874f8ddf-a5b7-495f-97ca-8a4b27d37a9e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.153368 Sep 16 15:40:40.156515 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3684/7902] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:40 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:40:40.444114 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] [cc536db1-c083-4e4a-9a7e-20d00bb45fa5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48228. Sep 16 15:40:40.448018 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d834fb38-a58f-49d3-a892-5d7936be4fd8 req-d1cfd53d-ea2b-4a17-9435-7e798e64eb50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.050974 Sep 16 15:40:40.448675 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4219/7903] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:40:41.179802 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:41.180347 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:41.187199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:41.187685 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:41.188122 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:41.188815 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:41.189275 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:41.189704 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:41.324817 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:41.332853 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-748c00e9-fabe-457a-b782-4a385289f52c tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1572 microversion: 2.1 time: 0.157031 Sep 16 15:40:41.334131 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3685/7904] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:41 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:40:42.357973 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:40:42.358731 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:40:42.364992 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:42.365496 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:42.365950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:42.366684 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:40:42.367158 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:40:42.367599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:40:42.497444 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:40:42.505243 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-52d34420-ede5-4978-8264-4cdabbdfb5dd tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1559 microversion: 2.1 time: 0.152385 Sep 16 15:40:42.505827 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4220/7905] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:40:42 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:41:58.859453 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=7 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:41:58.860100 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:41:58.860566 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:41:58.860716 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=21 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:41:58.861731 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 15:41:58.861874 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:41:58.867592 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-80a4865b-af72-4249-b4d9-16519384d416 req-5de31869-8c7a-4be0-9fd8-86ef55bb0489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:41:58.867807 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=9 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:41:58.869019 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=38 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:41:58.872683 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:41:58.873246 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:41:58.873901 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:41:58.875213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:41:58.875213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:41:58.875533 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:41:58.879682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-80a4865b-af72-4249-b4d9-16519384d416 req-5de31869-8c7a-4be0-9fd8-86ef55bb0489 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:41:58.880450 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-80a4865b-af72-4249-b4d9-16519384d416 req-5de31869-8c7a-4be0-9fd8-86ef55bb0489 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:41:58.880910 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-80a4865b-af72-4249-b4d9-16519384d416 req-5de31869-8c7a-4be0-9fd8-86ef55bb0489 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:41:58.895904 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-80a4865b-af72-4249-b4d9-16519384d416 req-5de31869-8c7a-4be0-9fd8-86ef55bb0489 service nova] Creating event network-changed:f31cb8c0-24bc-4366-819d-79fcbb7e2ddd for instance b5dddea5-ec11-49fc-afdf-404c580a85b1 on n-h1-858129-2 Sep 16 15:41:58.901234 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-80a4865b-af72-4249-b4d9-16519384d416 req-5de31869-8c7a-4be0-9fd8-86ef55bb0489 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044254 Sep 16 15:41:58.901951 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4221/7906] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:41:58.909908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:41:59.001397 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2bf12924-6c9a-418f-bf41-cb8c373d5b75 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 204 len: 0 microversion: 2.1 time: 0.145593 Sep 16 15:41:59.005188 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3686/7907] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:41:58 2022] DELETE /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:41:59.011818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:41:59.012541 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:41:59.019019 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:41:59.019526 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:41:59.019980 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:41:59.020825 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:41:59.021306 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:41:59.021753 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:41:59.157694 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:41:59.165775 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31dde64d-51f2-4510-8759-c8608f58877e tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.158947 Sep 16 15:41:59.166368 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4222/7908] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:41:59 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:00.192215 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:00.192904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:00.200546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:00.201103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:00.201573 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:00.202305 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:00.202825 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:00.203274 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:00.336949 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:00.346057 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-58aaf4f5-2cdc-47ca-889e-e0afa1e74360 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1565 microversion: 2.1 time: 0.158240 Sep 16 15:42:00.346673 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3687/7909] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:00 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:01.325120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-8589b91a-2c7d-497e-bc06-0f1664e8c1cb req-7b0912ae-984a-4bb2-af74-ab5218a92c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dddea5-ec11-49fc-afdf-404c580a85b1", "name": "network-vif-deleted", "tag": "f31cb8c0-24bc-4366-819d-79fcbb7e2ddd"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:42:01.337655 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8589b91a-2c7d-497e-bc06-0f1664e8c1cb req-7b0912ae-984a-4bb2-af74-ab5218a92c56 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:01.338151 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8589b91a-2c7d-497e-bc06-0f1664e8c1cb req-7b0912ae-984a-4bb2-af74-ab5218a92c56 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:01.338629 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-8589b91a-2c7d-497e-bc06-0f1664e8c1cb req-7b0912ae-984a-4bb2-af74-ab5218a92c56 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:01.351413 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-8589b91a-2c7d-497e-bc06-0f1664e8c1cb req-7b0912ae-984a-4bb2-af74-ab5218a92c56 service nova] Creating event network-vif-deleted:f31cb8c0-24bc-4366-819d-79fcbb7e2ddd for instance b5dddea5-ec11-49fc-afdf-404c580a85b1 on n-h1-858129-2 Sep 16 15:42:01.358165 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-8589b91a-2c7d-497e-bc06-0f1664e8c1cb req-7b0912ae-984a-4bb2-af74-ab5218a92c56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036603 Sep 16 15:42:01.358815 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4223/7910] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:42:01.369150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:01.369758 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:01.377166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:01.377643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:01.378072 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:01.378783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:01.379235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:01.379654 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:01.443322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:01.451692 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d393091e-5a78-4eb4-9568-0bc54429b9fc tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1216 microversion: 2.1 time: 0.086366 Sep 16 15:42:01.452289 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3688/7911] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:01 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:02.476190 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:02.476901 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:02.484693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:02.485385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:02.485939 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:02.486789 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:02.487270 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:02.487723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:02.550384 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:02.558415 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cdff68df-d2c0-4a1a-85ae-1f42ee0da421 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1216 microversion: 2.1 time: 0.086647 Sep 16 15:42:02.559026 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4224/7912] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:02 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:03.581519 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:03.582083 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:03.589185 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:03.589670 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:03.590102 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:03.590826 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:03.591278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:03.591715 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:03.655582 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:03.663417 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-5c4b4f17-e621-4c09-8521-6a6b0568111f tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1216 microversion: 2.1 time: 0.086101 Sep 16 15:42:03.663991 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3689/7913] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:03 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:04.687198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:04.688060 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:04.695031 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:04.695543 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:04.696002 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:04.696718 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:04.697198 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:04.697682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:04.759695 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:04.767842 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-31dbc446-fc0d-47a5-96b8-d88e1a56805a tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1216 microversion: 2.1 time: 0.084573 Sep 16 15:42:04.768452 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4225/7914] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:04 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:05.791771 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:05.792394 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:05.799056 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:05.799671 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:05.800108 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:05.800801 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:05.801249 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:05.801668 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:05.837709 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:05.838189 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:05.838643 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:05.839090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lazy-loading 'fault' on Instance uuid b5dddea5-ec11-49fc-afdf-404c580a85b1 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:42:05.885062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f981c151fd6428a9326238c0bcc2083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd438fc2a1043b28331b46361dbfdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:05.893820 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dd5736be-31f5-4169-b2de-90956579ac35 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 200 len: 1221 microversion: 2.1 time: 0.107100 Sep 16 15:42:05.894435 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3690/7915] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:05 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:06.917309 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:06.918064 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] [instance: b5dddea5-ec11-49fc-afdf-404c580a85b1] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:06.924842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:06.925466 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:06.925995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:06.926819 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:06.927367 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:06.927826 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:06.942191 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] HTTP exception thrown: Instance b5dddea5-ec11-49fc-afdf-404c580a85b1 could not be found. Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Request method failure captured: Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 HTTP/1.1 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJbXc8Op3-FBm4ka7AvLEbisU6qkyrMu-4maJsYKa-RibfiSfJyuwNxgkW08Gceon013SWs8xZZVvsUWOmAWKSCCpLF3oTR50N-vufKSZHe9v06QX4nklIggJgmznn6FeX61-RFWOSj90v8-fTWa45LH1H_an-73PiZcsEgyLggdWW0 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: 6bd438fc2a1043b28331b46361dbfdf0 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestShelveInstance-1363328790 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6bd438fc2a1043b28331b46361dbfdf0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bd438fc2a1043b28331b46361dbfdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6bd438fc2a1043b28331b46361dbfdf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6bd438fc2a1043b28331b46361dbfdf0"}]}] Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestShelveInstance-1363328790 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: 6bd438fc2a1043b28331b46361dbfdf0 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestShelveInstance-1363328790 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestShelveInstance-1363328790-project Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: 4f981c151fd6428a9326238c0bcc2083 Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestShelveInstance-1363328790-project Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance b5dddea5-ec11-49fc-afdf-404c580a85b1 could not be found. Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': 'b5dddea5-ec11-49fc-afdf-404c580a85b1'} Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5dddea5-ec11-49fc-afdf-404c580a85b1 could not be found. Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5dddea5-ec11-49fc-afdf-404c580a85b1 could not be found. Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:42:06.944037 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5dddea5-ec11-49fc-afdf-404c580a85b1 could not be found. Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Returning 404 to user: Instance b5dddea5-ec11-49fc-afdf-404c580a85b1 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:42:06.949957 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-cf69cc73-0756-4b11-9611-1b584bc90dfe tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1" status: 404 len: 111 microversion: 2.1 time: 0.032236 Sep 16 15:42:06.958671 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4226/7916] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:06 2022] GET /compute/v2.1/servers/b5dddea5-ec11-49fc-afdf-404c580a85b1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:42:07.119401 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-cb0ffa08-589e-4062-a5b1-a619f2cfe037 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] Calling method '.version_select at 0x7f724c2c0dc0>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:07.145312 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-cb0ffa08-589e-4062-a5b1-a619f2cfe037 tempest-TestShelveInstance-1363328790 tempest-TestShelveInstance-1363328790-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-3590745" status: 202 len: 0 microversion: 2.1 time: 0.029524 Sep 16 15:42:07.149326 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3691/7917] 10.222.0.60 () {58 vars in 1245 bytes} [Fri Sep 16 15:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-3590745 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 15:42:24.782758 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=12 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:24.783512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=24 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:24.971092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e97ed12e-b879-4e43-ad9e-d5dd2621fa6e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Action: 'create', calling method: .version_select at 0x7f724c4c68b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2003487928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTO2D7PX6TlFgsVSwjGtkHK+n95nPlFNWyguhbzSHQDlLp3/wRJgA6/SECuXCTWjyv7M4fnUg4x2t0qnyOeBk0i6YFBgrw4CNK/sW1axVnGI2u4FayTLzLy6UAbojSa/A=="}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:42:24.988226 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e97ed12e-b879-4e43-ad9e-d5dd2621fa6e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Getting quotas for project eaea10483f81431086baebffde31bfe2. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:42:24.994614 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.quota [None req-e97ed12e-b879-4e43-ad9e-d5dd2621fa6e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Getting quotas for user c6bf6b4f5aa84935885944219aa4a914 and project eaea10483f81431086baebffde31bfe2. Resources: {'key_pairs'} {{(pid=128642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:42:25.025551 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e97ed12e-b879-4e43-ad9e-d5dd2621fa6e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.248811 Sep 16 15:42:25.026337 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4227/7918] 10.222.0.60 () {60 vars in 1159 bytes} [Fri Sep 16 15:42:24 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:42:26.038008 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:26.038869 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:26.043013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-780605206", "imageRef": "b0b65f17-d770-469f-9ae4-7c7011730f1b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2003487928", "security_groups": [{"name": "tempest-secgroup-smoke-1248469790"}], "networks": [{"uuid": "cb32386d-f71a-412f-8364-461d107bb2a9"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:42:26.308551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] validate_networks() for [('cb32386d-f71a-412f-8364-461d107bb2a9', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:42:26.710900 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:42:26.711328 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:42:26.711803 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:42:26.712212 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:42:26.712623 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:42:26.722013 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:26.722629 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:26.723150 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:26.723962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:26.724489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:26.724982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:26.744744 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Getting quotas for project eaea10483f81431086baebffde31bfe2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:42:26.750883 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Getting quotas for user c6bf6b4f5aa84935885944219aa4a914 and project eaea10483f81431086baebffde31bfe2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:42:26.764433 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:42:26.766821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0b65f17-d770-469f-9ae4-7c7011730f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:42:26.816517 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-0201594a-0e6d-426b-9160-2a6a5a064602 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780237 Sep 16 15:42:26.817173 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3692/7919] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:42:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:42:26.829334 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2743e5d0-c6b9-4918-b372-64aa3593d606 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:26.830229 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2743e5d0-c6b9-4918-b372-64aa3593d606 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:26.888693 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2743e5d0-c6b9-4918-b372-64aa3593d606 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:26.897384 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2743e5d0-c6b9-4918-b372-64aa3593d606 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1248 microversion: 2.1 time: 0.072080 Sep 16 15:42:26.912965 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4228/7920] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:26 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:27.923627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:27.924364 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:27.930777 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:27.931263 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:27.931699 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:27.932395 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:27.932846 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:27.933476 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:28.010220 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:28.019217 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-949e28a1-ccb3-4102-b81c-1dc701a478b7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1300 microversion: 2.1 time: 0.101768 Sep 16 15:42:28.020052 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3693/7921] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:27 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:29.048738 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:29.049766 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:29.066182 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:29.067119 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:29.067667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:29.068509 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:29.069092 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:29.069608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:29.359957 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:29.368109 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-65f89dc2-663f-4b76-b277-29c84178c5a7 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.324787 Sep 16 15:42:29.369925 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4229/7922] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:29 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:29.823590 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-61d45cce-36da-452a-bd52-2b9a560749ae req-3a9f42bb-c6b8-4594-ad7c-28873d1ed9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:42:29.834353 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-61d45cce-36da-452a-bd52-2b9a560749ae req-3a9f42bb-c6b8-4594-ad7c-28873d1ed9bb service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:29.834978 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-61d45cce-36da-452a-bd52-2b9a560749ae req-3a9f42bb-c6b8-4594-ad7c-28873d1ed9bb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:29.835499 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-61d45cce-36da-452a-bd52-2b9a560749ae req-3a9f42bb-c6b8-4594-ad7c-28873d1ed9bb service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:29.847331 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-61d45cce-36da-452a-bd52-2b9a560749ae req-3a9f42bb-c6b8-4594-ad7c-28873d1ed9bb service nova] Creating event network-changed:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:42:29.852728 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-61d45cce-36da-452a-bd52-2b9a560749ae req-3a9f42bb-c6b8-4594-ad7c-28873d1ed9bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109694 Sep 16 15:42:29.853377 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3694/7923] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:42:30.392286 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:30.392923 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:30.399912 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:30.400415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:30.400867 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:30.401572 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:30.402046 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:30.402513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:30.538471 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:30.547213 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-9785cb54-6525-49ad-a0ec-bcdb26971251 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.158802 Sep 16 15:42:30.547805 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4230/7924] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:30 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:31.572219 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:31.572947 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:31.580789 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:31.581310 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:31.581736 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:31.582510 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:31.582963 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:31.583415 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:31.713165 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:31.720800 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-162d28bb-7b28-450e-af50-b5b6c5291730 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.153631 Sep 16 15:42:31.721380 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3695/7925] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:31 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:32.743308 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:32.743948 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:32.750879 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:32.751383 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:32.751837 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:32.752544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:32.753018 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:32.753461 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:32.898042 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:32.906450 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0075934a-f976-47c1-862d-93b489a5555d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.167072 Sep 16 15:42:32.907017 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4231/7926] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:32 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:33.929244 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:33.929874 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:33.936850 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:33.937337 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:33.937776 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:33.938501 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:33.938962 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:33.939386 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:34.073823 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:34.082152 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b6321d40-37df-46a6-9948-2d9a8148a428 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.156843 Sep 16 15:42:34.082780 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3696/7927] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:33 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:35.106495 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:35.107125 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:35.114793 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:35.115302 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:35.115755 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:35.116479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:35.116958 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:35.117404 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:35.252047 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:35.259903 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-d82c2fe0-005c-4e34-9964-22200e653b06 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.158052 Sep 16 15:42:35.260495 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4232/7928] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:35 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:36.140389 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d61196fa-cc00-46c3-b040-920e1242b0db req-c4b49bb3-0913-44b1-b373-0c01a7936d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "name": "network-vif-plugged", "status": "completed", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:42:36.150283 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d61196fa-cc00-46c3-b040-920e1242b0db req-c4b49bb3-0913-44b1-b373-0c01a7936d20 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:36.150794 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d61196fa-cc00-46c3-b040-920e1242b0db req-c4b49bb3-0913-44b1-b373-0c01a7936d20 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:36.151221 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d61196fa-cc00-46c3-b040-920e1242b0db req-c4b49bb3-0913-44b1-b373-0c01a7936d20 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:36.162792 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d61196fa-cc00-46c3-b040-920e1242b0db req-c4b49bb3-0913-44b1-b373-0c01a7936d20 service nova] Creating event network-vif-plugged:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:42:36.167785 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d61196fa-cc00-46c3-b040-920e1242b0db req-c4b49bb3-0913-44b1-b373-0c01a7936d20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Sep 16 15:42:36.169057 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3697/7929] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:42:36.283666 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:36.284336 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:36.291295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:36.291897 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:36.292532 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:36.293898 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:36.295389 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:36.295800 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:36.440840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:36.448610 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e86d8ad8-c531-41b3-aaca-b3d0a0e8ed86 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.168903 Sep 16 15:42:36.449700 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4233/7930] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:36 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:42:37.469833 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:37.470669 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=6 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:37.476489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:37.477213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:37.485129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:37.485616 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:37.486050 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:37.486783 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:37.487240 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:37.487906 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:37.630549 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:37.638669 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-d67f3db3-af20-4753-af7c-8894515dc823 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1374 microversion: 2.1 time: 0.169804 Sep 16 15:42:37.639256 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3698/7931] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:37 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:38.661456 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:38.661988 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:38.663937 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=6 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:42:38.670560 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:38.671063 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:38.671519 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:38.672225 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:38.672701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:38.673145 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:38.805719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:38.814307 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-58e807ce-a91b-4cc2-b062-3a8327275430 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1559 microversion: 2.1 time: 0.156889 Sep 16 15:42:38.814924 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4234/7932] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:38 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:38.836638 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:42:38.837228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:42:38.844038 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:38.844515 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:38.844943 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:38.845627 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:38.846075 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:38.846513 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:38.976218 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:42:38.984600 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-55b53acb-4c03-41a1-b6da-edfb20e9877a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1559 microversion: 2.1 time: 0.151884 Sep 16 15:42:38.985181 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3699/7933] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:42:38 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:42:40.967370 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-1e527d23-4412-44f4-b7d7-9eab856924a3 req-b27d6de6-ad22-49a3-b622-6ef81e21adae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:42:40.978435 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1e527d23-4412-44f4-b7d7-9eab856924a3 req-b27d6de6-ad22-49a3-b622-6ef81e21adae service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:42:40.978963 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1e527d23-4412-44f4-b7d7-9eab856924a3 req-b27d6de6-ad22-49a3-b622-6ef81e21adae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:42:40.979416 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-1e527d23-4412-44f4-b7d7-9eab856924a3 req-b27d6de6-ad22-49a3-b622-6ef81e21adae service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:42:40.991314 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-1e527d23-4412-44f4-b7d7-9eab856924a3 req-b27d6de6-ad22-49a3-b622-6ef81e21adae service nova] Creating event network-changed:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:42:40.996441 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-1e527d23-4412-44f4-b7d7-9eab856924a3 req-b27d6de6-ad22-49a3-b622-6ef81e21adae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032877 Sep 16 15:42:40.997616 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4235/7934] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:45:07.437638 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:45:07.438710 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 15:45:07.439247 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:07.440025 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=36 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:07.440996 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:45:07.441143 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:45:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7/action (ip 10.222.0.60) !!! Sep 16 15:45:07.442197 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:45:07.442342 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:45:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7/action (ip 10.222.0.60) !!! Sep 16 15:45:07.443337 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:45:07.443468 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:45:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7/action (ip 10.222.0.60) !!! Sep 16 15:45:07.449788 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-790545066"}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:07.452360 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:07.463610 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:07.464088 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:07.464517 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:07.465207 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:07.465651 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:07.466071 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:07.664837 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-77d2295b-5f08-4e50-9149-e23516dc2cd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "POST /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7/action" status: 202 len: 0 microversion: 2.1 time: 0.228805 Sep 16 15:45:07.665485 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3700/7935] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:45:07 2022] POST /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 15:45:14.950568 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:45:14.951750 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:45:14.952479 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:14.953413 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=38 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:14.954827 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:45:14.954827 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:45:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:45:14.956044 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:45:14.956177 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:45:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:45:14.962823 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-74e80d61-e786-443a-ab95-eb5e8d297197 req-d769da86-e827-427b-92c2-c19f3226cf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "name": "network-vif-plugged", "status": "completed", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:14.976612 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-74e80d61-e786-443a-ab95-eb5e8d297197 req-d769da86-e827-427b-92c2-c19f3226cf74 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:14.977117 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-74e80d61-e786-443a-ab95-eb5e8d297197 req-d769da86-e827-427b-92c2-c19f3226cf74 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:14.977567 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-74e80d61-e786-443a-ab95-eb5e8d297197 req-d769da86-e827-427b-92c2-c19f3226cf74 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:14.989088 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-74e80d61-e786-443a-ab95-eb5e8d297197 req-d769da86-e827-427b-92c2-c19f3226cf74 service nova] Creating event network-vif-plugged:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:45:14.994117 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-74e80d61-e786-443a-ab95-eb5e8d297197 req-d769da86-e827-427b-92c2-c19f3226cf74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045337 Sep 16 15:45:14.994787 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4236/7936] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:45:26.351222 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:26.352001 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:26.357855 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1519811069", "imageRef": "41ada6e4-c933-4a32-abc5-3be3a6272cc6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2003487928", "security_groups": [{"name": "tempest-secgroup-smoke-1248469790"}], "networks": [{"uuid": "cb32386d-f71a-412f-8364-461d107bb2a9"}]}} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:26.385438 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48722. Sep 16 15:45:26.387197 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48724. Sep 16 15:45:26.473845 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.network.neutron [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] validate_networks() for [('cb32386d-f71a-412f-8364-461d107bb2a9', None, None, None, None, None)] {{(pid=128643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 15:45:26.892800 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Flavor limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 15:45:26.893231 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Image limits 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 15:45:26.893708 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Flavor pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 15:45:26.894120 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Image pref 0:0:0 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 15:45:26.894602 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.virt.hardware [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 15:45:26.903445 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:26.903928 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:26.904362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:26.905086 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:26.905536 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:26.905985 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:26.923408 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Getting quotas for project eaea10483f81431086baebffde31bfe2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 15:45:26.928652 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.quota [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Getting quotas for user c6bf6b4f5aa84935885944219aa4a914 and project eaea10483f81431086baebffde31bfe2. Resources: {'instances', 'ram', 'cores'} {{(pid=128643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 15:45:26.941449 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Going to run 1 instances... {{(pid=128643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 15:45:26.943953 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='41ada6e4-c933-4a32-abc5-3be3a6272cc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 15:45:26.990833 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-3313c3fc-31f4-42f9-9eb0-0e87fb6b2c92 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.643303 Sep 16 15:45:26.991494 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3701/7937] 10.222.0.60 () {60 vars in 1147 bytes} [Fri Sep 16 15:45:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 15:45:27.003786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:27.004690 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:27.010771 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f3c980b2-87f2-43d3-8d4f-5e11ea63a05d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:27.011358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-f3c980b2-87f2-43d3-8d4f-5e11ea63a05d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:27.022744 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [c609f8f9-a1af-4b9e-9a9e-0d48209d19b7] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48740. Sep 16 15:45:27.026345 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ece5215-0049-4922-b2f1-56e49b036a30] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48738. Sep 16 15:45:27.122811 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-f3c980b2-87f2-43d3-8d4f-5e11ea63a05d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:27.130464 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f3c980b2-87f2-43d3-8d4f-5e11ea63a05d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1249 microversion: 2.1 time: 0.129961 Sep 16 15:45:27.131030 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4237/7938] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:26 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1249 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:28.154238 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-833f42c2-3233-482d-933a-60c33f426c4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:28.154885 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-833f42c2-3233-482d-933a-60c33f426c4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:28.207027 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-833f42c2-3233-482d-933a-60c33f426c4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:28.214335 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-833f42c2-3233-482d-933a-60c33f426c4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1249 microversion: 2.1 time: 0.065142 Sep 16 15:45:28.214938 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3702/7939] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:28 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1249 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:29.236915 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-7384c21e-e856-421f-ad00-2fe8e656ef85 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:29.237544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-7384c21e-e856-421f-ad00-2fe8e656ef85 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:29.293295 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-7384c21e-e856-421f-ad00-2fe8e656ef85 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:29.298750 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-7384c21e-e856-421f-ad00-2fe8e656ef85 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1249 microversion: 2.1 time: 0.065548 Sep 16 15:45:29.299662 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4238/7940] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:29 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:30.325365 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-1d15c2bd-c1b2-49f3-a31a-3aa02e59ac78 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:30.326235 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-1d15c2bd-c1b2-49f3-a31a-3aa02e59ac78 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:30.396467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-1d15c2bd-c1b2-49f3-a31a-3aa02e59ac78 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:30.404108 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-1d15c2bd-c1b2-49f3-a31a-3aa02e59ac78 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1249 microversion: 2.1 time: 0.083244 Sep 16 15:45:30.418556 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3703/7941] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:30 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:30.989325 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4e555fc2-8f19-4f22-b523-099bdf635c11 req-9964f1d1-5d2b-46db-bd9a-e3682d937ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "name": "network-vif-unplugged", "status": "completed", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:31.000469 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4e555fc2-8f19-4f22-b523-099bdf635c11 req-9964f1d1-5d2b-46db-bd9a-e3682d937ab8 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:31.000967 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4e555fc2-8f19-4f22-b523-099bdf635c11 req-9964f1d1-5d2b-46db-bd9a-e3682d937ab8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:31.001415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4e555fc2-8f19-4f22-b523-099bdf635c11 req-9964f1d1-5d2b-46db-bd9a-e3682d937ab8 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:31.011627 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4e555fc2-8f19-4f22-b523-099bdf635c11 req-9964f1d1-5d2b-46db-bd9a-e3682d937ab8 service nova] Creating event network-vif-unplugged:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:45:31.016608 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4e555fc2-8f19-4f22-b523-099bdf635c11 req-9964f1d1-5d2b-46db-bd9a-e3682d937ab8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092062 Sep 16 15:45:31.017205 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4239/7942] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:45:31.427894 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:31.428492 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:31.435718 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:31.436194 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:31.436620 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:31.437302 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:31.437753 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:31.438166 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:31.499898 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:31.508805 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-46094df4-2f2c-46af-868b-39f81098292c tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1253 microversion: 2.1 time: 0.084848 Sep 16 15:45:31.518505 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3704/7943] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:31 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:32.534588 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:32.535358 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:32.544293 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:32.544818 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:32.545282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:32.546027 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:32.546562 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:32.546989 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:32.637594 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:32.646640 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-1d2879b9-f490-4cd2-8317-f773a3917b27 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1307 microversion: 2.1 time: 0.118071 Sep 16 15:45:32.663521 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4240/7944] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:32 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:33.671529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:33.672121 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:33.678931 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:33.679413 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:33.679847 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:33.680531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:33.681485 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:33.681908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:33.829529 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:33.837700 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-376ce42d-52ee-496a-9598-8995b9e7be02 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.170044 Sep 16 15:45:33.838542 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3705/7945] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:33 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:34.861136 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:34.861767 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:34.868851 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:34.869355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:34.869802 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:34.870550 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:34.871219 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:34.871838 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:35.017863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:35.026898 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5ef7d752-e129-421b-894a-6d2e74a3343e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.169689 Sep 16 15:45:35.027508 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4241/7946] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:34 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:36.049112 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:36.049747 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:36.057322 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:36.057690 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:36.058334 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:36.059255 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:36.059893 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:36.060581 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:36.223531 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:36.232428 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-853b2a52-d12a-465b-b788-d79814a02ec2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.187142 Sep 16 15:45:36.233231 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3706/7947] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:36 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:37.257346 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:37.258282 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:37.266272 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:37.267269 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:37.267770 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:37.268741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:37.269315 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:37.269995 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:37.419101 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:37.431524 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-5c221982-4dca-4105-8766-6768e2d3d28d tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.179154 Sep 16 15:45:37.432123 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4242/7948] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:37 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:38.457202 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:38.457844 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:38.459851 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:38.467031 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:38.467570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:38.468341 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:38.469057 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:38.469849 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:38.470541 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:38.628228 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:38.636996 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2b192dfe-de95-4a24-9700-e7ee55636cba tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.184468 Sep 16 15:45:38.637733 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3707/7949] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:38 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:39.660584 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:39.661515 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:39.664459 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell0:SELECT=4 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:39.669861 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:39.670387 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:39.670875 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:39.671613 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:39.672095 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:39.672544 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:39.813193 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:39.821785 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-25818db9-a8c6-4f12-94ab-78e15f059746 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.164641 Sep 16 15:45:39.822357 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4243/7950] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:39 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:40.846137 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:40.846796 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:40.849443 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell0:SELECT=10 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:45:40.854755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:40.855243 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:40.855681 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:40.856377 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:40.856832 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:40.857257 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:40.987213 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:40.994987 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-2945295c-d71f-4c3e-a446-033b31f0b9c6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.152739 Sep 16 15:45:40.995576 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3708/7951] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:40 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:42.018454 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:42.019079 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:42.026701 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:42.027227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:42.027682 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:42.028421 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:42.028899 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:42.029347 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:42.414191 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:42.422591 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-a209783c-978e-4445-9805-c3fed2a7174a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.408077 Sep 16 15:45:42.423184 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4244/7952] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:42 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:42.945489 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-35ecf3ee-dbca-4530-bfa1-be0f9a981fc6 req-73f75b20-d960-4438-9722-5738aadb39b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5125d8-6764-4052-a636-16e215cf0db7", "tag": "2015c69b-fcde-42c8-b0d6-da21478097f0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:42.956358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-35ecf3ee-dbca-4530-bfa1-be0f9a981fc6 req-73f75b20-d960-4438-9722-5738aadb39b7 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:42.956852 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-35ecf3ee-dbca-4530-bfa1-be0f9a981fc6 req-73f75b20-d960-4438-9722-5738aadb39b7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:42.957557 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-35ecf3ee-dbca-4530-bfa1-be0f9a981fc6 req-73f75b20-d960-4438-9722-5738aadb39b7 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:42.969357 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-35ecf3ee-dbca-4530-bfa1-be0f9a981fc6 req-73f75b20-d960-4438-9722-5738aadb39b7 service nova] Creating event network-changed:2015c69b-fcde-42c8-b0d6-da21478097f0 for instance 0a5125d8-6764-4052-a636-16e215cf0db7 on n-h2-858129-2 Sep 16 15:45:42.974889 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-35ecf3ee-dbca-4530-bfa1-be0f9a981fc6 req-73f75b20-d960-4438-9722-5738aadb39b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033072 Sep 16 15:45:42.975511 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3709/7953] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:45:43.446842 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:43.447385 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:43.454712 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:43.455223 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:43.455681 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:43.456395 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:43.456871 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:43.457320 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:43.586447 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:43.594228 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e6f44002-25f8-43df-87e6-e6243f4ef699 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.152149 Sep 16 15:45:43.594848 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4245/7954] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:43 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:44.618990 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:44.619695 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:44.625872 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:44.626358 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:44.626821 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:44.627514 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:44.627970 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:44.628398 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:44.765131 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:44.772802 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b9257247-1ff3-4092-977d-6eaf9a8c971e tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.159628 Sep 16 15:45:44.773384 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3710/7955] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:44 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:45.795846 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:45.796483 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:45.803665 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:45.804175 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:45.804632 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:45.805885 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:45.806365 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:45.806840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:45.941422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:45.949789 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-298464c7-12e3-4323-a06a-8959bb10c6fc tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.157934 Sep 16 15:45:45.950392 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4246/7956] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:45 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:46.972866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:46.973516 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:46.980363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:46.980848 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:46.981278 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:46.981971 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:46.982606 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:46.983158 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:47.118265 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:47.125863 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-7032bdb7-3247-4004-bb30-a4a3793ceba9 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.156924 Sep 16 15:45:47.126451 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3711/7957] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:46 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:48.149863 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:48.150580 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:48.157513 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:48.158012 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:48.158490 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:48.159205 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:48.159676 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:48.160121 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:48.294840 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:48.302955 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-0140e52a-4a32-4a53-b191-cd4d786d0911 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.157506 Sep 16 15:45:48.303562 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4247/7958] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:48 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:48.729066 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-2dcd46a5-7203-4640-b9c6-895a1d99e6fd req-e5663a9d-e43a-41bd-86fa-86a1b6316935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5125d8-6764-4052-a636-16e215cf0db7", "name": "network-vif-plugged", "status": "completed", "tag": "2015c69b-fcde-42c8-b0d6-da21478097f0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:48.739528 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2dcd46a5-7203-4640-b9c6-895a1d99e6fd req-e5663a9d-e43a-41bd-86fa-86a1b6316935 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:48.740011 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2dcd46a5-7203-4640-b9c6-895a1d99e6fd req-e5663a9d-e43a-41bd-86fa-86a1b6316935 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:48.740435 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-2dcd46a5-7203-4640-b9c6-895a1d99e6fd req-e5663a9d-e43a-41bd-86fa-86a1b6316935 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:48.754790 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-2dcd46a5-7203-4640-b9c6-895a1d99e6fd req-e5663a9d-e43a-41bd-86fa-86a1b6316935 service nova] Creating event network-vif-plugged:2015c69b-fcde-42c8-b0d6-da21478097f0 for instance 0a5125d8-6764-4052-a636-16e215cf0db7 on n-h2-858129-2 Sep 16 15:45:48.760440 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-2dcd46a5-7203-4640-b9c6-895a1d99e6fd req-e5663a9d-e43a-41bd-86fa-86a1b6316935 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 Sep 16 15:45:48.761145 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3712/7959] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 15:45:49.325667 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:49.326577 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:49.333407 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:49.333904 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:49.334350 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:49.335081 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:49.335573 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:49.336116 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:49.495102 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:49.503022 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01b37a27-88d5-4fc8-a497-8ccb591943d6 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1375 microversion: 2.1 time: 0.181227 Sep 16 15:45:49.503623 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4248/7960] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:49 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:50.526987 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:50.527684 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:50.534049 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:50.534595 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:50.535116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:50.535835 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:50.536293 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:50.536724 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:50.673959 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:50.682510 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-811b10f8-e49f-49c2-815b-d89de353da4a tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1561 microversion: 2.1 time: 0.160990 Sep 16 15:45:50.683103 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3713/7961] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:50 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:50.704866 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:45:50.705505 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:45:50.712512 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:50.713023 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:50.713484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:50.714200 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:50.714723 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:50.715169 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:50.844415 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:45:50.852780 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-999fd4db-f2b2-40cc-8dc3-04005bd27dc1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1561 microversion: 2.1 time: 0.151427 Sep 16 15:45:50.853352 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4249/7962] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:45:50 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:45:52.420118 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-9a16b14f-cccf-4214-a387-272197806ee1 req-c32e0a2a-f6c5-4dfa-9bdc-9fa4f4005c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5125d8-6764-4052-a636-16e215cf0db7", "tag": "2015c69b-fcde-42c8-b0d6-da21478097f0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:45:52.432385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9a16b14f-cccf-4214-a387-272197806ee1 req-c32e0a2a-f6c5-4dfa-9bdc-9fa4f4005c5a service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:45:52.432904 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9a16b14f-cccf-4214-a387-272197806ee1 req-c32e0a2a-f6c5-4dfa-9bdc-9fa4f4005c5a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:45:52.433352 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-9a16b14f-cccf-4214-a387-272197806ee1 req-c32e0a2a-f6c5-4dfa-9bdc-9fa4f4005c5a service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:45:52.445985 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-9a16b14f-cccf-4214-a387-272197806ee1 req-c32e0a2a-f6c5-4dfa-9bdc-9fa4f4005c5a service nova] Creating event network-changed:2015c69b-fcde-42c8-b0d6-da21478097f0 for instance 0a5125d8-6764-4052-a636-16e215cf0db7 on n-h2-858129-2 Sep 16 15:45:52.451990 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-9a16b14f-cccf-4214-a387-272197806ee1 req-c32e0a2a-f6c5-4dfa-9bdc-9fa4f4005c5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037681 Sep 16 15:45:52.452593 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3714/7963] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:48:05.734586 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=30 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:05.735371 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=62 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:05.736336 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:48:05.736580 n-d-858129-2 devstack@n-api.service[128642]: Fri Sep 16 15:48:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7/action (ip 10.222.0.60) !!! Sep 16 15:48:05.802692 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-239223266"}} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:48:05.805608 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:05.811737 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:05.812180 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:05.812637 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:05.813342 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:05.813814 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:05.814257 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:06.019544 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-63f14063-8f19-4233-9b7f-99739e0e5512 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "POST /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7/action" status: 202 len: 0 microversion: 2.1 time: 0.286824 Sep 16 15:48:06.020156 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4250/7964] 10.222.0.60 () {60 vars in 1278 bytes} [Fri Sep 16 15:48:05 2022] POST /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 16 15:48:11.483295 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 16 15:48:11.484362 n-d-858129-2 devstack@n-api.service[128643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 16 15:48:11.484964 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:11.485746 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=56 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:11.486934 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:48:11.487119 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:48:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:48:11.488529 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:48:11.488681 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:48:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:48:11.489744 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 15:48:11.489887 n-d-858129-2 devstack@n-api.service[128643]: Fri Sep 16 15:48:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Sep 16 15:48:11.497966 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-fba418c2-e49e-4c97-8c7b-3c3ba8f8b9cd req-dc1f8bc2-73f5-476f-a377-5a62af5936d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5125d8-6764-4052-a636-16e215cf0db7", "name": "network-vif-plugged", "status": "completed", "tag": "2015c69b-fcde-42c8-b0d6-da21478097f0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:48:11.513090 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fba418c2-e49e-4c97-8c7b-3c3ba8f8b9cd req-dc1f8bc2-73f5-476f-a377-5a62af5936d6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:11.514129 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fba418c2-e49e-4c97-8c7b-3c3ba8f8b9cd req-dc1f8bc2-73f5-476f-a377-5a62af5936d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:11.514605 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-fba418c2-e49e-4c97-8c7b-3c3ba8f8b9cd req-dc1f8bc2-73f5-476f-a377-5a62af5936d6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:11.527896 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-fba418c2-e49e-4c97-8c7b-3c3ba8f8b9cd req-dc1f8bc2-73f5-476f-a377-5a62af5936d6 service nova] Creating event network-vif-plugged:2015c69b-fcde-42c8-b0d6-da21478097f0 for instance 0a5125d8-6764-4052-a636-16e215cf0db7 on n-h2-858129-2 Sep 16 15:48:11.533719 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-fba418c2-e49e-4c97-8c7b-3c3ba8f8b9cd req-dc1f8bc2-73f5-476f-a377-5a62af5936d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052590 Sep 16 15:48:11.534336 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3715/7965] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:48:23.690437 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_api:SELECT=2 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:23.691769 n-d-858129-2 devstack@n-api.service[128642]: DEBUG dbcounter [-] [128642] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:23.696022 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_cell1:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:23.697596 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:23.697755 n-d-858129-2 devstack@n-api.service[128643]: DEBUG dbcounter [-] [128643] Writing DB stats nova_api:SELECT=2 {{(pid=128643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 15:48:23.698277 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:23.706241 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [923a779e-a0e5-4485-8458-d3b961fa6172] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 49092. Sep 16 15:48:23.708986 n-d-858129-2 devstack@n-api.service[128643]: INFO oslo.messaging._drivers.impl_rabbit [-] [76765499-734a-4c10-945d-c2aad5e0652f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 49094. Sep 16 15:48:23.718741 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:23.719525 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:23.719981 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:23.720704 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:23.721177 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:23.721624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:23.750829 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Going to try to terminate instance {{(pid=128642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:48:23.819822 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [req-d9833afd-b665-4ffb-9721-4c52f4565515 req-f0c7f24b-857c-4a40-8d50-8b6858cfbcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5125d8-6764-4052-a636-16e215cf0db7", "tag": "2015c69b-fcde-42c8-b0d6-da21478097f0"}]} {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:48:23.831103 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d9833afd-b665-4ffb-9721-4c52f4565515 req-f0c7f24b-857c-4a40-8d50-8b6858cfbcf4 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:23.831583 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d9833afd-b665-4ffb-9721-4c52f4565515 req-f0c7f24b-857c-4a40-8d50-8b6858cfbcf4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:23.832010 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [req-d9833afd-b665-4ffb-9721-4c52f4565515 req-f0c7f24b-857c-4a40-8d50-8b6858cfbcf4 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:23.842938 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-440d17c9-99ea-4ae1-a007-1683a3ecdf18 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 204 len: 0 microversion: 2.1 time: 0.154579 Sep 16 15:48:23.843890 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.compute.server_external_events [req-d9833afd-b665-4ffb-9721-4c52f4565515 req-f0c7f24b-857c-4a40-8d50-8b6858cfbcf4 service nova] Creating event network-changed:2015c69b-fcde-42c8-b0d6-da21478097f0 for instance 0a5125d8-6764-4052-a636-16e215cf0db7 on n-h2-858129-2 Sep 16 15:48:23.844130 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4251/7966] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:48:23 2022] DELETE /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 15:48:23.849084 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [req-d9833afd-b665-4ffb-9721-4c52f4565515 req-f0c7f24b-857c-4a40-8d50-8b6858cfbcf4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158368 Sep 16 15:48:23.850560 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3716/7967] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:48:23.854975 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:23.855794 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:23.862091 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:23.862719 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:23.863249 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:23.864036 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:23.864599 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:23.865112 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:24.130120 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:48:24.138819 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-01297e09-583f-4a06-a106-831721f52356 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1686 microversion: 2.1 time: 0.290075 Sep 16 15:48:24.139498 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4252/7968] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:23 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1686 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 15:48:25.164958 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:25.165703 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:25.171969 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:25.172460 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:25.172934 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:25.173648 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:25.174113 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:25.174551 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:25.389190 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:48:25.398913 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-dc110384-7a0a-4d02-87fd-fd22fba851f0 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1686 microversion: 2.1 time: 0.239654 Sep 16 15:48:25.399502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3717/7969] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:25 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1686 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:48:26.179950 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-bfc42230-c04e-49f3-a702-5455e2d16662 req-bbffaea7-69e1-425f-a1d9-0791f59515c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5125d8-6764-4052-a636-16e215cf0db7", "name": "network-vif-deleted", "tag": "2015c69b-fcde-42c8-b0d6-da21478097f0"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:48:26.189622 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bfc42230-c04e-49f3-a702-5455e2d16662 req-bbffaea7-69e1-425f-a1d9-0791f59515c6 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:26.190126 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bfc42230-c04e-49f3-a702-5455e2d16662 req-bbffaea7-69e1-425f-a1d9-0791f59515c6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:26.190624 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-bfc42230-c04e-49f3-a702-5455e2d16662 req-bbffaea7-69e1-425f-a1d9-0791f59515c6 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:26.202639 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-bfc42230-c04e-49f3-a702-5455e2d16662 req-bbffaea7-69e1-425f-a1d9-0791f59515c6 service nova] Creating event network-vif-deleted:2015c69b-fcde-42c8-b0d6-da21478097f0 for instance 0a5125d8-6764-4052-a636-16e215cf0db7 on n-h2-858129-2 Sep 16 15:48:26.207887 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-bfc42230-c04e-49f3-a702-5455e2d16662 req-bbffaea7-69e1-425f-a1d9-0791f59515c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086627 Sep 16 15:48:26.208528 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4253/7970] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:48:26.422829 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:26.424123 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:26.432062 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:26.432546 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:26.433148 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:26.433866 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:26.434363 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:26.434810 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:26.468187 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:26.468673 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:26.469116 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:26.469570 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.objects.instance [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lazy-loading 'fault' on Instance uuid 0a5125d8-6764-4052-a636-16e215cf0db7 {{(pid=128643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 15:48:26.512199 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:48:26.520209 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-c754176c-2cea-44ff-802f-9059ab008e87 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 200 len: 1339 microversion: 2.1 time: 0.101295 Sep 16 15:48:26.520805 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3718/7971] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:26 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:48:27.545603 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:27.546355 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: 0a5125d8-6764-4052-a636-16e215cf0db7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:27.552570 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:27.553069 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:27.553523 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:27.554442 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:27.554922 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:27.555368 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:27.568665 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.wsgi [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] HTTP exception thrown: Instance 0a5125d8-6764-4052-a636-16e215cf0db7 could not be found. Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Request method failure captured: Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: request: GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 HTTP/1.1 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Accept: application/json Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Accept-Encoding: identity Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Connection: close Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Content-Length: 0 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Content-Type: application/json Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Host: 10.222.0.60 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: Openstack-System-Scope: None Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: User-Agent: python-urllib3/1.26.12 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Auth-Token: gAAAAABjJJlb5j8flqupZdXa0PxY2lYQLx6p9PIRc2ejDmlbttIgX8bnjn5OhD9PdzrlQ-aXIOuJKxR_TmfTMweE2MLOx0ca-Byw4O8WYGP8CiZSKyIRu_fWUUktOHubo9bMlJwsC5rxijPpNL75fAStaxNAYAWi69QbpqIsmuYmUqFFhJNsbCs Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Id: None Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Domain-Name: None Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Identity-Status: Confirmed Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Is-Admin-Project: True Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Id: default Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Domain-Name: Default Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Id: eaea10483f81431086baebffde31bfe2 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Project-Name: tempest-TestSnapshotPattern-734244281 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Role: reader,member Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Roles: reader,member Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eaea10483f81431086baebffde31bfe2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaea10483f81431086baebffde31bfe2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eaea10483f81431086baebffde31bfe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaea10483f81431086baebffde31bfe2"}]}] Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant: tempest-TestSnapshotPattern-734244281 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Id: eaea10483f81431086baebffde31bfe2 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-Tenant-Name: tempest-TestSnapshotPattern-734244281 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-User: tempest-TestSnapshotPattern-734244281-project Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Id: default Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-User-Domain-Name: Default Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-User-Id: c6bf6b4f5aa84935885944219aa4a914 Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: X-User-Name: tempest-TestSnapshotPattern-734244281-project Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: method: > Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: exception: Instance 0a5125d8-6764-4052-a636-16e215cf0db7 could not be found. Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: action_args: {'id': '0a5125d8-6764-4052-a636-16e215cf0db7'} Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5125d8-6764-4052-a636-16e215cf0db7 could not be found. Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5125d8-6764-4052-a636-16e215cf0db7 could not be found. Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:48:27.570299 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5125d8-6764-4052-a636-16e215cf0db7 could not be found. Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: ERROR nova.api.openstack.wsgi Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Returning 404 to user: Instance 0a5125d8-6764-4052-a636-16e215cf0db7 could not be found. {{(pid=128642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-e7c61e93-bad5-4f3a-a1c0-e080f74f4a99 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7" status: 404 len: 111 microversion: 2.1 time: 0.031408 Sep 16 15:48:27.576607 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4254/7972] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:27 2022] GET /compute/v2.1/servers/0a5125d8-6764-4052-a636-16e215cf0db7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:48:28.917908 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:28.918455 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:28.927050 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-d466b6af-0de6-4674-9f6a-0cb02712f7db req-3beda5b9-6a7a-402f-983b-0733eecd8714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:48:28.937554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:28.938051 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:28.938742 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:28.939459 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:28.939918 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:28.940344 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:28.940921 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d466b6af-0de6-4674-9f6a-0cb02712f7db req-3beda5b9-6a7a-402f-983b-0733eecd8714 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:28.941418 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d466b6af-0de6-4674-9f6a-0cb02712f7db req-3beda5b9-6a7a-402f-983b-0733eecd8714 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:28.941859 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-d466b6af-0de6-4674-9f6a-0cb02712f7db req-3beda5b9-6a7a-402f-983b-0733eecd8714 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:28.953694 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-d466b6af-0de6-4674-9f6a-0cb02712f7db req-3beda5b9-6a7a-402f-983b-0733eecd8714 service nova] Creating event network-changed:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:48:28.959422 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-d466b6af-0de6-4674-9f6a-0cb02712f7db req-3beda5b9-6a7a-402f-983b-0733eecd8714 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036012 Sep 16 15:48:28.960549 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4255/7973] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:48:28.971834 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Going to try to terminate instance {{(pid=128643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 15:48:29.058866 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-475cfbf0-7909-463c-ad07-2de43857574f tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 204 len: 0 microversion: 2.1 time: 0.144252 Sep 16 15:48:29.059502 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3719/7974] 10.222.0.60 () {58 vars in 1239 bytes} [Fri Sep 16 15:48:28 2022] DELETE /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 15:48:29.069791 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:29.070640 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.compute.api [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:29.077609 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:29.078109 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:29.078618 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:29.079314 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:29.079786 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:29.080227 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:29.216285 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.policy [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:48:29.225061 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-2a15fde0-848a-4d56-a09d-4466a184edd2 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1684 microversion: 2.1 time: 0.160721 Sep 16 15:48:29.226263 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4256/7975] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:29 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:48:30.250140 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:30.251169 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:30.258637 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:30.259339 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:30.259554 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:30.260522 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:30.260982 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:30.261409 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:30.395092 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.policy [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bf6b4f5aa84935885944219aa4a914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaea10483f81431086baebffde31bfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 15:48:30.402788 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-b927805b-3166-48ce-8534-a8104f461526 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 200 len: 1684 microversion: 2.1 time: 0.157108 Sep 16 15:48:30.403369 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3720/7976] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:30 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 15:48:30.976213 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [req-4a274c14-cbc0-4eae-b5c0-5f4b6de0139b req-ba805c4f-f046-4ab8-9193-6d56b9d7ffe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f287bf7c-a460-4089-8e6b-1224ea341bc7", "name": "network-vif-deleted", "tag": "bc96e6ee-64d2-446c-a4b7-a29fd73400f8"}]} {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 15:48:30.987484 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4a274c14-cbc0-4eae-b5c0-5f4b6de0139b req-ba805c4f-f046-4ab8-9193-6d56b9d7ffe9 service nova] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:30.987979 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4a274c14-cbc0-4eae-b5c0-5f4b6de0139b req-ba805c4f-f046-4ab8-9193-6d56b9d7ffe9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:30.988422 n-d-858129-2 devstack@n-api.service[128642]: DEBUG oslo_concurrency.lockutils [req-4a274c14-cbc0-4eae-b5c0-5f4b6de0139b req-ba805c4f-f046-4ab8-9193-6d56b9d7ffe9 service nova] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:31.000500 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.compute.server_external_events [req-4a274c14-cbc0-4eae-b5c0-5f4b6de0139b req-ba805c4f-f046-4ab8-9193-6d56b9d7ffe9 service nova] Creating event network-vif-deleted:bc96e6ee-64d2-446c-a4b7-a29fd73400f8 for instance f287bf7c-a460-4089-8e6b-1224ea341bc7 on n-h1-858129-2 Sep 16 15:48:31.014343 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [req-4a274c14-cbc0-4eae-b5c0-5f4b6de0139b req-ba805c4f-f046-4ab8-9193-6d56b9d7ffe9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039370 Sep 16 15:48:31.015002 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4257/7977] 10.222.0.60 () {64 vars in 1317 bytes} [Fri Sep 16 15:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 15:48:31.426811 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '>' {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:31.427467 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.compute.api [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [instance: f287bf7c-a460-4089-8e6b-1224ea341bc7] Fetching instance by UUID {{(pid=128643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 15:48:31.434879 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:31.435362 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:31.435793 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:31.436484 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Acquiring lock "08ea4950-b373-4785-aced-301964963f98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 15:48:31.436935 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 15:48:31.437385 n-d-858129-2 devstack@n-api.service[128643]: DEBUG oslo_concurrency.lockutils [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Lock "08ea4950-b373-4785-aced-301964963f98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 15:48:31.451368 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.wsgi [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] HTTP exception thrown: Instance f287bf7c-a460-4089-8e6b-1224ea341bc7 could not be found. Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Request method failure captured: Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: request: GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 HTTP/1.1 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Accept: application/json Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Accept-Encoding: identity Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Connection: close Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Content-Length: 0 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Content-Type: application/json Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Host: 10.222.0.60 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: Openstack-System-Scope: None Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: User-Agent: python-urllib3/1.26.12 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Auth-Token: gAAAAABjJJlb5j8flqupZdXa0PxY2lYQLx6p9PIRc2ejDmlbttIgX8bnjn5OhD9PdzrlQ-aXIOuJKxR_TmfTMweE2MLOx0ca-Byw4O8WYGP8CiZSKyIRu_fWUUktOHubo9bMlJwsC5rxijPpNL75fAStaxNAYAWi69QbpqIsmuYmUqFFhJNsbCs Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Id: None Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Domain-Name: None Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Identity-Status: Confirmed Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Is-Admin-Project: True Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Id: default Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Domain-Name: Default Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Id: eaea10483f81431086baebffde31bfe2 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Project-Name: tempest-TestSnapshotPattern-734244281 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Role: reader,member Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Roles: reader,member Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eaea10483f81431086baebffde31bfe2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaea10483f81431086baebffde31bfe2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eaea10483f81431086baebffde31bfe2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eaea10483f81431086baebffde31bfe2"}]}] Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant: tempest-TestSnapshotPattern-734244281 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Id: eaea10483f81431086baebffde31bfe2 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-Tenant-Name: tempest-TestSnapshotPattern-734244281 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-User: tempest-TestSnapshotPattern-734244281-project Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Id: default Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Domain-Name: Default Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Id: c6bf6b4f5aa84935885944219aa4a914 Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: X-User-Name: tempest-TestSnapshotPattern-734244281-project Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: method: > Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: exception: Instance f287bf7c-a460-4089-8e6b-1224ea341bc7 could not be found. Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: action_args: {'id': 'f287bf7c-a460-4089-8e6b-1224ea341bc7'} Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: {{(pid=128643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f287bf7c-a460-4089-8e6b-1224ea341bc7 could not be found. Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f287bf7c-a460-4089-8e6b-1224ea341bc7 could not be found. Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 15:48:31.452991 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f287bf7c-a460-4089-8e6b-1224ea341bc7 could not be found. Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: ERROR nova.api.openstack.wsgi Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: DEBUG nova.api.openstack.wsgi [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Returning 404 to user: Instance f287bf7c-a460-4089-8e6b-1224ea341bc7 could not be found. {{(pid=128643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: INFO nova.api.openstack.requestlog [None req-6afb6d3d-bc4b-4d7a-a941-7a47ffbab8b1 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7" status: 404 len: 111 microversion: 2.1 time: 0.031594 Sep 16 15:48:31.458642 n-d-858129-2 devstack@n-api.service[128643]: [pid: 128643|app: 0|req: 3721/7978] 10.222.0.60 () {58 vars in 1236 bytes} [Fri Sep 16 15:48:31 2022] GET /compute/v2.1/servers/f287bf7c-a460-4089-8e6b-1224ea341bc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 15:48:31.617008 n-d-858129-2 devstack@n-api.service[128642]: DEBUG nova.api.openstack.wsgi [None req-f607d3d2-6815-4dfd-8604-55a03b426f73 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] Calling method '.version_select at 0x7f7251817ee0>' {{(pid=128642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 15:48:31.621464 n-d-858129-2 devstack@n-api.service[128642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f607d3d2-6815-4dfd-8604-55a03b426f73 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [60e5b4d7-67ac-409f-a1ef-145ac803fecd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 15:48:32.629479 n-d-858129-2 devstack@n-api.service[128642]: INFO oslo.messaging._drivers.impl_rabbit [None req-f607d3d2-6815-4dfd-8604-55a03b426f73 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] [60e5b4d7-67ac-409f-a1ef-145ac803fecd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 49180. Sep 16 15:48:32.647968 n-d-858129-2 devstack@n-api.service[128642]: INFO nova.api.openstack.requestlog [None req-f607d3d2-6815-4dfd-8604-55a03b426f73 tempest-TestSnapshotPattern-734244281 tempest-TestSnapshotPattern-734244281-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2003487928" status: 202 len: 0 microversion: 2.1 time: 1.035914 Sep 16 15:48:32.648563 n-d-858129-2 devstack@n-api.service[128642]: [pid: 128642|app: 0|req: 4258/7979] 10.222.0.60 () {58 vars in 1257 bytes} [Fri Sep 16 15:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2003487928 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)